The Standard for Quality in Research Technology

How can we ensure that you’re getting high quality survey responses? The Lucid Quality Program provides a unique solution for evaluating supply partners and respondents. Using independent, third-party data specialists we measure our supply partners on the three most important aspects of survey sample: response quality, accepted completes, and consistency.

This exclusive offering allows Lucid customers to run projects with confidence, knowing they’re getting high-quality survey responses. In the spirit of transparency, we publish results each quarter – and current scores can be viewed anytime.

The Science Behind Quality Scoring

We conduct a rigorous assessment of our supply partners that is designed to provide customers (sample buyers) with insight into their sample quality. All eligible supply partners are required to participate in the program. 

After being evaluated, supply partners are issued a QScore, Acceptance Score, and Consistency Score.

QScore

Even when demographics are matched precisely, latent or unseen characteristics can influence data outcomes – and the degree of influence is driven by the subject matter of the survey. Our program monitors respondent values and behaviors, with regard to specific subject matter, so it can be managed by sample buyers

Acceptance

Acceptance Score measures the acceptance rate of survey completes for individual supply partners. “Acceptance” refers to completes that meet buyers’ quality standards and, as a result, are accepted by those buyers. To define a benchmark for acceptance, a weighted average of all accepted completes in the Lucid Marketplace is measured. Then, to calculate Acceptance Score, individual supply partners’ completes are measured against each other, at the project level, to determine how close they are to that benchmark.

Consistency

Consistency Score measures a supply partner’s composition from quarter to quarter. “Composition” is the balance of respondent preferences and opinions within a given panel. These attitudinal responses are determined by respondents’ brand affinity, value-seeking behavior, technology adoption, movie and music usage, and gaming activities. Measuring composition can help researchers with tracking research.

Minimizing Sample Bias

To get accurate data, researchers must take great care to apply quotas – helping to prevent bias from over/under representation of certain groups. Similar care should be taken to manage latent sample characteristics, which are inherent in sample sources (due to differences in respondent recruitment strategies).

Even when demographics are matched precisely, latent or unseen characteristics can influence data outcomes – and the degree of influence is driven by the subject matter of the survey. Our program monitors respondent values and behaviors, with regard to specific subject matter, so it can be managed by sample buyers.

A common objective of survey research is to measure the performance and impact of brands. By selecting sample sources that do not skew too brand-favorable or averse, clients can get the best reads on their brands. Lucid regularly creates sample blends that can mitigate this potential source of bias.

Similar to brand preference and usage, some sources may skew heavier or lighter in terms of consumers that use coupons, shop sales, or exhibit extreme bargain hunting. Selecting sample sources that lean too far in either direction can provide biased insight not reflective of the population as a whole. This otherwise latent characteristic is quantified by our Quality Program.

People who are avid, early adopters of technology tend to have different attitudes around innovation and change than the general population. Using a sample source that skews too tech savvy or laggard can bias research outcomes – especially if the study is related to technology. Scoring sample sources on tech usage helps inform buyers so pitfalls can be avoided.

For entertainment research in particular, obtaining sample that skews too heavy or light in terms of media consumption can bias results. This dimension varies greatly among those who otherwise appear similar demographically – some people simply don’t listen to music or watch many movies. Understanding the tendencies of certain sample sources helps prevent research missteps.

Since some sample sources incentivize respondents in currencies used for playing games, a quick check of game-playing proclivity can reveal if a source looks mainstream or more skewed. This is particularly compelling for research in the video game category, but sample sources where larger numbers of people spend significant time gaming could signal other biasing characteristics.

Fully Transparent Supplier Scores

Supplier Scores: United States
March 14, 2021 - July 3, 2022

QScore

Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).

Acceptance

Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.

Consistency

Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research

SupplierQScoreAcceptanceConsistency
AdGate Media92.82-0.883548792894.25
Attapoll~~**91.820.171332478494.67
Besitos Corporation~*92.830.142079745394.50
Bitburst~*91.71-0.284665997397.55
BizRate88.520.2567471254
Bovitz~**94.070.0209895696
Branded Research~*94.760.376384584994.28
Centiment~~**96.760.390454814574.21
Consultancy Services LLC~~**92.590.434972107286.86
CrowdNautics, Inc.~~88.47
Dalia Research*89.05-1.009902596095.92
Decision Analyst**92.240.526549437181.77
DISQO~*95.050.104054038895.73
Embee Mobile~*86.250.133675138093.86
Gamekit~*92.3095.12
General Research Lab~**91.83-0.344795392594.77
iAngelic Research~*90.790.1149293874
InboxDollars~~**94.07-0.010489903793.69
inBrain.ai~~**89.31-0.255668497997.45
inMarket~~80.33-0.0881441066
ISA (MySoapBox)~~**90.200.340730981389.63
ITC*90.650.186553483692.17
Make Opinion GmbH~*93.520.098248980092.44
MarketCube~~*89.4992.56
MARU Group (SA)**93.020.2301475449
MindField Research~~**90.6975.22
MyPoints~~94.230.291896609928.87
On Device Research~**93.490.082175374795.48
Opinion Capital~~91.63-0.9614264753
Point Club~93.73-3.021512568491.76
Prodege~~*93.480.291896609993.97
Publishers Clearing House~~**86.470.295831025489.44
PureSpectrum~91.95
Qmee~*91.870.207714752994.08
Research for Good (SS)92.640.5227576835
Revenue Universe*90.650.238886691887.95
Screen Engine/ASI~~**94.530.068043908096.28
SocialLoop~~**89.31-0.251490988393.31
Tap Research~**87.12-0.013198096493.88
TapJoy~**88.170.274801678196.14
Tellwut~~**92.200.322963648872.32
TheoremReach*91.67-0.113776768896.07
URWelcome Technologies~*92.240.332079276296.32
Vetri Foundation~*92.48-0.092715398797.14
On the Score sheets for each country, the following applies:
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target

Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight

Supplier Scores: Australia
14 March 2022 – 3 July 2022 

QScore

Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).

Acceptance

Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.

Consistency

Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research

SupplierQScoreAcceptanceConsistency
AdGate Media~~87.480.292723830291.97
Attapoll~~*96.180.236292664791.30
Bitburst~*92.330.031147418997.16
ClixSense~~**90.05-0.133264892790.41
Competition Panel~~*91.270.198143330893.42
Dale Network~~*85.25-0.114525280890.25
Dalia Research~90.59-0.223988672488.41
DISQO92.400.214170853193.05
GMO Research~~*92.570.191271699891.82
GrowthOps~~89.8587.99
iAngelic Research91.49-0.0914839220
inBrain.ai~*92.38-0.250202923996.85
Make Opinion GmbH~*93.990.163069410996.80
MarketCube~*91.2197.27
On Device Research~*93.280.130808731193.65
Persona.ly92.290.251972391293.46
Point Club91.3992.36
Prodege*94.760.215654643693.63
Qmee~*93.900.122985773596.60
Research for Good (SS)90.270.0134156864
Researchify Pty Ltd~~90.171.208076196780.47
Revenue Universe~~*88.01-0.035946775881.34
Rewardia~*93.160.216899229594.60
Tap Research~88.35-0.152368615494.98
TapJoy~~*91.130.098491919892.23
TheoremReach~~*92.860.011510389386.00
Titan~~84.08
On the Score sheets for each country, the following applies:
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target

Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight

Supplier Scores: Brazil
14 March 2022 – 3 July 2022

QScore

Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).

Acceptance

Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.

Consistency

Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research

SupplierQScoreAcceptanceConsistency
A-K International~**92.350.028421291595.91
AdGate Media~~**91.67-1.387589770895.22
Attapoll92.210.018472168389.96
Bitburst92.320.082216694298.69
ClixSense~~*93.210.203465464996.77
Dale Network~*91.200.040011617395.98
Dalia Research~~*93.19-0.105417826896.11
Dayos~~91.310.201381659997.87
inBrain.ai92.570.166293948096.90
Make Opinion GmbH92.990.126045019798.44
Market Agent~*93.79-0.003974953593.26
MarketCube92.7493.48
Mo Web~~**93.370.238565582292.98
Neobux~92.560.544930000395.77
On Device Research~*93.790.060499007896.25
Opinaia Panel~*92.410.017237491095.50
Persona.ly~*93.330.307280385497.62
Point Club~94.3396.38
Prodege~~*92.270.184866332798.23
Research for Good (SS)91.25
Research on Mobile~~**89.930.035424968593.50
Revenue Universe~~**92.030.146417507694.82
Tap Research~**90.51-0.069993283388.32
TapJoy~~91.750.008128684387.62
TheoremReach91.520.057140294991.44
On the Score sheets for each country, the following applies:
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target

Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight

Supplier Scores: Canada
2022 March 14 – 2022 July 3

QScore

Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).

Acceptance

Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.

Consistency

Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research

SupplierQScoreAcceptanceConsistency
A-K International~~**92.010.0114169852
AdGate Media~**88.00-0.323814618995.50
Attapoll~~**89.32-0.009700702389.82
Bitburst~*91.49-0.084081209190.79
Branded Research95.000.249123695897.57
ClixSense90.960.062358912193.30
Dale Network~*85.560.000288207494.68
Dalia Research*89.28-0.832953054796.53
Decision Analyst~~92.860.147725577891.95
DISQO93.340.191248966695.56
FeedSurvey~~86.54
General Research Lab~~88.8989.60
iAngelic Research91.21-0.156193638594.81
InboxDollars (DR)92.14-0.172235778190.49
inBrain.ai91.69-0.190607130393.43
ITC93.20-0.193355922592.14
Juyanba~~81.09-0.330216593692.23
Make Opinion GmbH91.95-0.015315009496.93
MarketCube89.4197.47
MARU Group~~**92.600.230542247193.57
MyPoints~~92.070.1443471381
On Device Research90.530.5501657507
Point Club91.9192.43
Prodege94.220.144347138192.53
Qmee93.920.063051057595.00
Research for Good (SS)~*92.420.399519658991.09
Research on Mobile~~83.99-0.354776364783.34
Revenue Universe88.940.060166014996.27
Splendid Research91.050.151282767192.26
Survey Everyone88.94-0.0636416125
Tap Research88.94-0.335453117892.31
TapJoy91.46-0.009465804490.77
Tellwut~**92.250.178778533693.72
TheoremReach91.03-0.017705454296.72
On the Score sheets for each country, the following applies:
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target

Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight

Supplier Scores: China
2022 March 14 – 2022 July 3

QScore

Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).

Acceptance

Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.

Consistency

Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research

SupplierQScoreAcceptanceConsistency
Beijing Youli Technology Co., Ltd.~~*84.66-1.736939736989.95
ClixSense~~**88.26-1.318042636487.45
Dalia Research~~**88.83-2.448753800485.37
Data100~*90.920.486993770194.60
DataSpring~*91.391.141412288890.83
GMO Research91.251.147393238791.27
Ignite Vision~~**89.62-0.283287104284.29
Insight Works~*88.46-0.384908805695.63
Interface Asia~~87.8286.60
Juyanba~84.770.721625241098.34
KuRunData~**90.281.334506497994.76
Maiwen China~89.52-0.092343762196.08
Make Opinion GmbH~~**86.15-0.425395987689.94
MarketCube~~**86.8883.49
MDQ~~**89.61-0.258448940687.41
Prodege~~**89.880.351752089192.41
Research for Good (SS)91.1292.52
Revenue Universe~~**82.231.922550947878.54
SampleBus Market Research Service Ltd*82.10-0.743798654792.25
Tap Research~~**87.27-0.654834230676.66
TapJoy~~**84.52-0.262952579686.83
TheoremReach~~**83.850.084947422390.09
On the Score sheets for each country, the following applies:
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target

Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight

Supplier Scores: France
14 March 2022 – 03 July 2022

QScore

Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).

Acceptance

Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.

Consistency

Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research

SupplierQScoreAcceptanceConsistency
A-K International~~*88.220.024286322481.70
AdGate Media~**86.020.409517518396.49
Attapoll88.490.157724745192.28
Bitburst90.05-0.067386041495.46
ClixSense~90.330.571208590592.20
CreOnline~**89.86-0.493361247994.54
Dalia Research*88.86-0.249769766495.34
Decision Analyst~~**90.38-0.854981014079.21
Devola88.4393.99
Gaddin.com90.780.142343143596.83
Gamekit84.512.152411236692.31
Hiving~~**87.980.098644170475.38
inBrain.ai90.650.107322675195.94
JS Media / Moolineo~*90.230.017193054596.79
Make Opinion GmbH88.770.024443832592.14
Market Cube89.6188.86
Mo Web~~**90.490.202053217795.10
Neobux~~88.05-2.322578502297.93
On Device Research~*88.78-0.037621982695.10
Persona.ly~~**87.16-0.799126023196.78
Point Club~~87.6091.98
Prodege90.630.144036938495.61
Research on Mobile~~**85.1492.05
Revenue Universe~*86.88-0.130700707793.01
Surveoo90.940.008433127892.25
Tap Research89.91-0.055512746688.33
TapJoy~~**85.00-0.561890165891.25
TheoremReach91.77-0.020610994889.64
Trial Panel~~**89.220.5316410806
On the Score sheets for each country, the following applies:
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target

Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight

Supplier Scores: Germany
14 March 2022 – 3 July 2022

QScore

Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).

Acceptance

Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.

Consistency

Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research

SupplierQScoreAcceptanceConsistency
A-K International~~**87.720.304676574985.42
AdGate Media~89.59-1.642377699291.95
Almedia AG~~87.99
Appinio~*90.230.533642032892.85
Attapoll93.260.485475740896.04
Bitburst93.350.176785050293.15
ClixSense~91.770.580502780692.64
Dale Network~**86.140.337191519086.32
Dalia Research~*91.30-1.971888172291.53
Decision Analyst~~87.360.685511259079.49
General Research Lab~~89.07
Hiving~~**89.170.233024501982.21
inBrain.ai~**89.83-0.398134939893.55
Liidimedia oy*91.760.589494824490.25
Make Opinion GmbH93.340.477929944894.09
Market Agent ~**91.590.506203370394.88
MarketCube~**90.7795.92
Mo Web~~**92.110.483111498094.51
On Device Research~*91.260.398033990892.36
Opinion Capital~~89.73-1.141714882884.42
Panel Inzicht~~87.800.313472567973.05
Persona.ly~*90.380.466723967395.59
Point Club~~91.5092.85
Prodege93.900.580432382990.95
Promio~~**87.600.413465099079.16
Research for Good (SS)~90.940.533330370788.78
Research on Mobile~~**91.24-1.153000978084.58
Revenue Universe~**86.84-0.975411437488.93
Splendid Research~**92.650.6900428172
Tap Research90.59-0.130319280591.25
TapJoy~~**88.480.650878952392.36
TheoremReach~~*90.71-2.230139858795.03
Untiedt~~**88.080.444832915776.62
On the Score sheets for each country, the following applies:
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target

Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight

Supplier Scores: India
2022 March 14 – 2022 July 3

QScore

Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).

Acceptance

Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.

Consistency

Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research

SupplierQScoreAcceptanceConsistency
A-K International89.49-0.2337538009
AdGate Media~~**85.93-0.345816994491.66
Attapoll89.310.379684062295.96
Australian Clearing Pty Ltd~~**89.1897.60
Bitburst87.070.172647046198.05
ClixSense~~**89.140.136216621494.01
Crownit-Link86.67
Dalia Research~~**85.630.157560422094.19
Expresso82.570.8868055311
General Research Lab~~**85.66-0.2440843660
GMO Research~~**89.630.543781822591.77
inBrain.ai88.610.069186073292.63
Innovative Hall87.5191.48
Make Opinion GmbH87.41-0.013903020595.88
MarketCube87.8496.45
MarketXcel~~**90.340.397504276988.02
Neobux~~**90.060.500766309686.98
Opinion Capital~~**86.150.326646640595.60
Persona.ly~~**90.710.512910255490.33
Point Club81.66-0.332776009897.47
Poll Pronto~~90.4590.02
Prodege~~**90.430.485398866689.48
Research on Mobile~*82.55-0.154479912893.47
Revenue Universe~~**87.52-0.299240625192.51
Tap Research88.690.194825267392.49
TheoremReach88.610.348621122193.72
On the Score sheets for each country, the following applies:
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target

Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight

Supplier Scores: Italy
14 March 2022 – 3 July 2022

QScore

Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).

Acceptance

Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.

Consistency

Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research

SupplierQScoreAcceptanceConsistency
A-K International~~**88.350.125135427989.48
AdGate Media~~86.35-2.408853965479.50
Attapoll92.710.050032503795.50
Bitburst92.38-0.166630303294.47
ClixSense92.94-0.097876936091.71
CreOnline~*92.76-0.212438485993.66
Dale Network~87.420.463332887191.65
Dalia Research91.09-0.704912754095.79
Decision Analyst92.05-0.229267205992.79
Hiving~~**89.721.303497268597.21
Make Opinion GmbH91.21-0.042068943196.88
Market Agent~89.670.1586490135
MarketCube~*91.4093.43
Mo Web~*91.270.487335130296.40
Neobux~91.350.878759781594.20
On Device Research~*89.76-0.079406832791.90
Persona.ly90.92-0.422270770597.88
Point Club91.0396.38
Poll Pronto~91.47
Prodege~~**90.820.263796462093.06
Research on Mobile~~87.190.449406983894.77
Revenue Universe~~**86.53-1.466236252093.45
Splendid Research~*92.174.117076665794.66
Surveyeah~93.270.030642792087.24
Tap Research92.66-0.210489504892.66
TapJoy~*87.91-0.217573593394.25
TheoremReach92.59-0.119490225093.59
Untiedt~~**88.380.0875220537
On the Score sheets for each country, the following applies:
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target

Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight

Supplier Scores: Japan
2022 March 14 – 2022 July 03

QScore

Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).

Acceptance

Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.

Consistency

Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research

SupplierQScoreAcceptanceConsistency
Cross Marketing Account~**89.120.2634383278
Dalia Research~**89.630.044740957584.90
GMO Research~**90.150.272504043287.51
Make Opinion GmbH~~**92.460.004505557489.50
MarketCube~90.6393.36
Monitas (Gain, Inc.)~~**93.420.264483233892.14
Research for Good92.8586.07
Research on Mobile~~89.39-3.179631291096.27
Revenue Universe~87.300.334834003493.82
Tap Research~~**93.230.244503068692.22
TapJoy~~**90.600.222096645996.20
TheoremReach~~**90.550.350464438789.69
On the Score sheets for each country, the following applies:
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target

Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight

Supplier Scores: Mexico
14 March 2022 – 3 July 2022

QScore

Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).

Acceptance

Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.

Consistency

Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research

SupplierQScoreAcceptanceConsistency
A-K International~*92.69-0.145571423994.73
Attapoll~~**91.90-0.126534842089.57
Bitburst~~**91.72-0.162268325384.65
ClixSense~**93.93-0.023989677095.14
Dale Network~*90.65-0.125254433195.92
Dalia Research~~**92.24-0.850624810193.33
inBrain.ai~~**92.56-0.084062830693.91
Innovative Hall~~92.65-0.754666098094.41
Make Opinion GmbH~~**92.22-0.174625575790.80
MarketCube~*91.6095.86
Mo Web*91.88-0.179473850491.41
Neobux~~**92.81-1.495430566294.98
Opinaia Panel~*92.56-0.177356683596.35
Persona.ly~**93.11-0.256610153297.72
Point Club~~92.670.775473888994.18
Prodege~~**91.70-0.140794691293.40
Research for Good (SS)~92.3194.98
Research on Mobile~~89.12-0.035142333092.17
Revenue Universe~~**88.92-0.014242060789.81
Splendid Research92.51-0.467435387396.31
Tap Research~**90.87-0.237408476595.83
TapJoy~~**88.25-0.084354401694.23
TheoremReach~~**91.14-0.148736275697.06
On the Score sheets for each country, the following applies:
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target

Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight

Supplier Scores: Netherlands
14 March 2022 – 3 July 2022

QScore

Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).

Acceptance

Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.

Consistency

Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research

SupplierQScoreAcceptanceConsistency
AdGate Media~~81.33-0.354560538181.24
Attapoll~**91.190.173094296289.83
Bitburst~~**90.23-0.241514493892.46
ClixSense~~**92.11-2.186291999692.87
Dale Network~~85.19-0.619173646791.99
Dalia Research~~**88.64-0.753600697495.13
Make Opinion GmbH~~*90.18-0.006954567594.25
MarketCube89.4089.58
Pabble B.V.90.3495.33
Panel Inzicht~~90.98-0.336786692179.26
Persona.ly~~**90.31-0.411631919991.00
Point Club87.9791.38
Prodege~~**89.18-0.054702075491.60
Research on Mobile~~81.99-1.244802134294.11
Revenue Universe~~**81.26-0.157244579291.37
Tap Research87.8497.20
TapJoy~**89.01-0.438567469796.83
TheoremReach~~**88.740.102509863594.59
On the Score sheets for each country, the following applies:
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target

Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight

Supplier Scores: Russia
14 March 2022 – 3 July 2022

QScore

Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).

Acceptance

Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.

Consistency

Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research

SupplierQScoreAcceptanceConsistency
A-K International~~**90.53-0.295619105093.75
AdGate Media~~**89.311.141009635085.07
Amry Research~*92.001.291887873794.15
Attapoll~~90.9493.86
Bitburst~*89.87-0.639887565291.53
ClixSense~~**91.830.595587646095.79
Dalia Research~*90.090.035378157291.27
Make Opinion GmbH91.72-1.292550088395.44
Marketagent93.242.512538543997.60
MarketCube~*90.9695.38
Mo Web~~*91.03-1.360050024096.71
Neobux~~**93.150.027859842091.49
Persona.ly~~**90.56-0.465276764489.24
Point Club~92.3593.93
Prodege~*91.021.117594994393.78
Research on Mobile~*89.07-2.131926622290.91
Survey Everyone~~**91.36-0.308544102793.20
TheoremReach~~**90.32-0.151166992096.15
Tiburon Research91.61
YouThink.io~92.450.403667061388.62
On the Score sheets for each country, the following applies:
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target

Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight

Supplier Scores: Spain
14 March 2022 – 3 July 2022

QScore

Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).

Acceptance

Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.

Consistency

Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research

SupplierQScoreAcceptanceConsistency
A-K International~91.460.144176018696.92
AdGate Media~~90.03-0.436985383792.08
Attapoll94.010.168277047493.65
Bitburst93.360.137288017696.25
ClixSense~*94.090.225955026797.87
CreOnline~~**92.930.215764677291.57
Dale Network93.30-1.576262618989.01
Dalia Research~*91.60-0.663716128797.58
Decision Analyst~~93.190.353107552195.05
Gaddin.com93.91-0.061946516395.52
Hiving~~**93.340.143451336484.54
inBrain.ai*92.650.070405327497.50
Innovative Hall~**93.26-1.154596412591.54
Make Opinion GmbH93.610.337160721295.36
Market Agent*93.29-0.620864686696.90
MarketCube~~**94.1392.04
Mo Web~*92.450.324013341593.36
Neobux~*94.29-2.065714116695.76
On Device Research~*92.70-0.005346012296.73
Persona.ly~*93.890.272564920197.41
Point Club~94.80-0.356216462392.54
Prodege*93.170.151620804994.24
Research on Mobile~~90.78-2.184189898192.96
Revenue Universe~~**87.620.029177472794.92
Splendid Research~93.910.281385873092.52
Surveoo~*93.270.319736226596.20
Surveyeah~95.250.1008308598
Tap Research*90.30-0.030904491696.10
TapJoy~~*93.090.180441960993.82
TheoremReach92.500.082257123991.05
On the Score sheets for each country, the following applies:
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target

Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight

Supplier Scores: United Kingdom
14 March 2022 – 03 July 2022

QScore

Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).

Acceptance

Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.

Consistency

Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research

SupplierQScoreAcceptanceConsistency
A-K International89.080.295029056494.52
AdGate Media~*91.89-1.409988371195.47
Attapoll~~*93.130.213383653492.89
Bitburst~~*92.26-0.699921151894.73
Branded Research~*94.550.429256243496.23
ClixSense90.400.090833187396.01
Dalia Research~*90.45-1.719285410895.89
Dayos93.48-1.0796620902
Decision Analyst~~**91.280.116419445090.50
Expresso88.88
General Research Lab~~90.0993.29
Hiving~~**87.710.181942858581.63
iAngelic Research~*91.980.099515914790.63
Inbox Dollars (UK)~~**92.150.241672914095.45
inBrain.ai~~*92.78-0.148968833295.25
Innovative Hall89.20
Liidimedia oy~~**91.45-0.0638308399
Lux Surveys~~**92.5290.78
Make Opinion GmbH~*92.37-0.460307532794.42
MarketCube~*90.4992.74
MindMover~~**89.730.303670793281.69
Mirats Insights~65.88
Mo Web~~**90.100.358582872691.04
MVUK - Kato~~**89.7893.64
On Device Research*93.220.232074647895.82
Persona.ly~*91.300.435047954092.02
Pick Media Ltd~~**93.070.377645298886.70
Point Club~89.9694.35
Prodege*93.970.307479667296.66
Qmee91.35-0.045648936994.70
Research for Good (SS)~**91.640.460213193294.22
Revenue Universe91.000.282710985190.47
Splendid Research89.520.389281243287.01
Survey Everyone89.450.2930402044
Tap Research88.79-0.274899131794.84
TapJoy~*90.500.081479866794.17
TheoremReach92.08-0.722539012194.29
On the Score sheets for each country, the following applies:
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target

Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight

Supplier Scores: South Korea
14 March 2022 – 3 July 2022

QScore

Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).

Acceptance

Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.

Consistency

Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research

SupplierQScoreAcceptanceConsistency
Bitburst~~**85.76-0.3478944711
ClixSense~~94.630.5700472926
Dalia Research~~**88.32-0.268234500472.16
DataSpring~~91.080.535319181590.31
GMO Research~*91.210.125047825192.46
Make Opinion GmbH~*89.99-0.497071200696.15
MarketCube~~88.28
MarketLink~*89.090.294222330396.47
Neobux~~**94.820.721647092194.73
Panel Marketing Interactive89.41
Persona.ly~**92.340.470244102193.80
Prodege~~**92.090.555531383995.37
Research on Mobile~~83.610.080637816091.12
Revenue Universe~~81.71-0.577790225888.17
Tap Research~~87.53-0.645839614188.81
TapJoy~~**87.66-0.861916482992.98
TheoremReach~~**83.61-2.785083099785.72
On the Score sheets for each country, the following applies:
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target

Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight