The Standard for Quality in Research Technology

How can we ensure that you’re getting high quality survey responses? The Lucid Quality Program provides a unique solution for evaluating supply partners and respondents. Using independent, third-party data specialists we measure our supply partners on the three most important aspects of survey sample: response quality, accepted completes, and consistency.

This exclusive offering allows Lucid customers to run projects with confidence, knowing they’re getting high-quality survey responses. In the spirit of transparency, we publish results each quarter – and current scores can be viewed anytime.

The Science Behind Quality Scoring

We conduct a rigorous assessment of our supply partners that is designed to provide customers (sample buyers) with insight into their sample quality. All eligible supply partners are required to participate in the program. 

After being evaluated, supply partners are issued a QScore, Acceptance Score, and Consistency Score.

QScore

Even when demographics are matched precisely, latent or unseen characteristics can influence data outcomes – and the degree of influence is driven by the subject matter of the survey. Our program monitors respondent values and behaviors, with regard to specific subject matter, so it can be managed by sample buyers

Acceptance

Acceptance Score measures the acceptance rate of survey completes for individual supply partners. “Acceptance” refers to completes that meet buyers’ quality standards and, as a result, are accepted by those buyers. To define a benchmark for acceptance, a weighted average of all accepted completes in the Lucid Marketplace is measured. Then, to calculate Acceptance Score, individual supply partners’ completes are measured against each other, at the project level, to determine how close they are to that benchmark.

Consistency

Consistency Score measures a supply partner’s composition from quarter to quarter. “Composition” is the balance of respondent preferences and opinions within a given panel. These attitudinal responses are determined by respondents’ brand affinity, value-seeking behavior, technology adoption, movie and music usage, and gaming activities. Measuring composition can help researchers with tracking research.

Minimizing Sample Bias

To get accurate data, researchers must take great care to apply quotas – helping to prevent bias from over/under representation of certain groups. Similar care should be taken to manage latent sample characteristics, which are inherent in sample sources (due to differences in respondent recruitment strategies).

Even when demographics are matched precisely, latent or unseen characteristics can influence data outcomes – and the degree of influence is driven by the subject matter of the survey. Our program monitors respondent values and behaviors, with regard to specific subject matter, so it can be managed by sample buyers.

A common objective of survey research is to measure the performance and impact of brands. By selecting sample sources that do not skew too brand-favorable or averse, clients can get the best reads on their brands. Lucid regularly creates sample blends that can mitigate this potential source of bias.

Similar to brand preference and usage, some sources may skew heavier or lighter in terms of consumers that use coupons, shop sales, or exhibit extreme bargain hunting. Selecting sample sources that lean too far in either direction can provide biased insight not reflective of the population as a whole. This otherwise latent characteristic is quantified by our Quality Program.

People who are avid, early adopters of technology tend to have different attitudes around innovation and change than the general population. Using a sample source that skews too tech savvy or laggard can bias research outcomes – especially if the study is related to technology. Scoring sample sources on tech usage helps inform buyers so pitfalls can be avoided.

For entertainment research in particular, obtaining sample that skews too heavy or light in terms of media consumption can bias results. This dimension varies greatly among those who otherwise appear similar demographically – some people simply don’t listen to music or watch many movies. Understanding the tendencies of certain sample sources helps prevent research missteps.

Since some sample sources incentivize respondents in currencies used for playing games, a quick check of game-playing proclivity can reveal if a source looks mainstream or more skewed. This is particularly compelling for research in the video game category, but sample sources where larger numbers of people spend significant time gaming could signal other biasing characteristics.

Fully Transparent Supplier Scores

Supplier Scores: United States
September 13, 2021 - January 2, 2022

QScore

Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).

Acceptance

Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.

Consistency

Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research

SupplierQScoreAcceptanceConsistency
AdGate Media92.39-0.114928797792.42
Attapoll~**93.03-0.044841143196.27
Besitos Corporation91.95-0.0629876020
Bitburst~~**93.66-0.373311913693.93
BizRate88.52-0.0086580702
Bovitz~**93.150.1964963426
Branded Research~**94.370.267018734897.40
Centiment~~**94.960.2011032188
Consultancy Services LLC~~**94.080.384322129187.56
CrowdNautics, Inc.~~88.47-0.6610779025
Dalia Research89.05-0.467376324495.92
Decision Analyst92.240.486633482181.77
DISQO92.370.147072990793.44
Embee Mobile*88.07-0.146338714881.84
Gamekit~*92.560.116057411594.81
General Research Lab~~**88.64-0.677241449889.40
iAngelic Research~91.17-0.1589590786
InboxDollars~*94.240.087217408595.25
inBrain.ai~~**91.71-0.512786640198.91
inMarket~~80.33-0.1936049406
ISA (MySoapBox)~~**90.31-0.179014450791.22
ITC~*90.040.2378493545
Make Opinion GmbH~*93.98-0.157963325691.65
MarketCube85.4193.25
MARU Group (SA)93.020.0949814936
MyPoints~~94.230.168634263928.87
On Device Research*92.47-0.032431323496.54
Opinion Capital~~91.63-0.6009117336
Point Club~93.73-0.090613726291.76
Prodege~~**93.480.168634263990.39
Publishers Clearing House~~**87.730.232314616686.44
PureSpectrum~91.95
Qmee~**93.60-0.004337273196.93
Research for Good (SS)92.640.2374031061
Revenue Universe*91.53-0.119554448597.61
Screen Engine/ASI~~**93.57-1.140631505596.28
SocialLoop~~**92.79-0.242750392194.20
Tap Research88.62-0.380490465995.39
TapJoy~~**88.880.025928928294.10
Tellwut~~**87.420.1438665788
TheoremReach~*91.53-0.249511688994.94
Vetri Foundation~~93.21-1.1507447768
On the Score sheets for each country, the following applies:
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target

Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight

Supplier Scores: Australia
13 September 2021 - 02 January 2022

QScore

Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).

Acceptance

Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.

Consistency

Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research

SupplierQScoreAcceptanceConsistency
AdGate Media~~**87.48-1.144523774587.70
Attapoll~~**93.450.310335142891.85
Bitburst~~**92.33-0.609731774294.94
Competition Panel*92.160.309339307993.42
Dale Network~*88.000.126438531791.73
Dalia Research~~**90.03-0.072795503594.26
DISQO92.310.3456059218
GMO Research~~**90.040.300743330489.69
GrowthOps~~**88.9290.88
iAngelic Research91.490.2996125103
inBrain.ai~*93.520.173639314996.85
Make Opinion GmbH~*92.78-0.070696387994.80
MarketCube~*88.4095.24
On Device Research~~**92.780.257508588193.47
Persona.ly92.290.597501065493.46
Point Club91.390.629618896392.36
Prodege~*93.460.338532693392.61
Qmee~~*94.260.123881554996.60
Research for Good (SS)90.270.0226092335
Researchify Pty Ltd~~**88.871.682758309973.20
Revenue Universe~**87.71-0.999342871594.64
Rewardia~**91.740.273113166194.60
Tap Research~*88.83-0.184287783393.75
TapJoy~*90.870.139649513192.85
TheoremReach~~**92.78-0.219468570896.33
Titan~~84.08
On the Score sheets for each country, the following applies:
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target

Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight

Supplier Scores: Brazil
13 September 2021 - 02 January 2022

QScore

Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).

Acceptance

Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.

Consistency

Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research

SupplierQScoreAcceptanceConsistency
A-K International~92.47-0.104332681997.27
AdGate Media~~**92.68-0.217759352093.73
Attapoll~*93.12-0.190811728292.32
Bitburst~~*91.56-0.203813896989.21
ClixSense~~**94.70-0.123849389894.64
Dale Network~*92.01-0.124352647197.50
Dalia Research~*91.62-0.207709499195.79
Dayos~~**91.31-0.186027082997.87
inBrain.ai~~**91.24-0.151431125996.82
Make Opinion GmbH~~**93.10-0.135413042188.64
Market Agent~*93.46-0.121464291696.27
MarketCube91.9595.78
Mo Web~~**93.07-0.040383490492.25
Neobux~*92.56-0.153784573295.77
On Device Research~~**92.43-0.184639987595.71
Opinaia Panel91.06-0.288945028292.13
Persona.ly~~**92.89-0.121815076596.41
Point Club~~*92.84-0.410492070893.46
Prodege~~**93.79-0.158419216196.93
Research for Good (SS)91.25
Research on Mobile~~**92.38-0.348673013992.90
Revenue Universe~~**92.54-0.154038236887.37
Tap Research~**89.93-0.244728297588.94
TapJoy~~**91.46-0.183402420493.84
TheoremReach~~**91.91-0.224162397292.73
On the Score sheets for each country, the following applies:
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target

Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight

Supplier Scores: Canada
2021 September 13 - 2022 January 2

QScore

Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).

Acceptance

Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.

Consistency

Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research

SupplierQScoreAcceptanceConsistency
A-K International91.410.3401435713
AdGate Media*88.28-0.448888758791.34
Attapoll~**89.510.342869079591.87
Bitburst~*89.970.182337837894.26
Branded Research93.850.457752010195.08
ClixSense90.96-1.656446323393.30
Dale Network86.680.441080188795.26
Dalia Research~*89.390.351512331289.94
Decision Analyst~~92.860.455523499791.95
DISQO92.990.460187602695.34
FeedSurvey~~**86.540.1678101223
General Research Lab~~*92.140.221243597089.60
iAngelic Research91.210.360306727594.81
InboxDollars (DR)91.880.375354815594.99
inBrain.ai*93.750.418854110597.87
Juyanba~~**81.090.0718847362
Make Opinion GmbH91.810.179399818296.24
MarketCube90.4690.21
MARU Group~~**93.800.489665802089.47
On Device Research90.53-0.0384701335
Point Club91.91-1.651611093092.43
Prodege94.090.383722196495.05
Qmee~*93.780.346485237896.15
Research for Good (SS)90.310.307410283594.58
Research on Mobile~~**83.99-2.224929251083.34
Revenue Universe*87.02-0.515265397585.95
Splendid Research91.050.446167335392.26
Survey Everyone88.940.3704587179
Tap Research90.120.295350729396.44
TapJoy*91.220.455082944593.26
Tellwut~92.630.464458621892.98
TheoremReach91.440.270348904294.29
On the Score sheets for each country, the following applies:
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target

Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight

Supplier Scores: China
2021 September 13 - 2022 January 2

QScore

Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).

Acceptance

Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.

Consistency

Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research

SupplierQScoreAcceptanceConsistency
Beijing Youli Technology Co., Ltd.~~**89.33-0.077921910380.98
ClixSense**88.340.189507383489.72
Dalia Research~~89.570.215556236583.81
Data100~~**90.420.244370994797.13
DataSpring~~**90.600.272405850690.70
GMO Research~~**91.090.321014853193.80
Ignite Vision**89.920.235680521892.32
Insight Works~*88.550.248895700493.06
Interface Asia~~**87.820.092573954086.60
Juyanba~**84.770.095891497098.34
KuRunData~~**90.520.312743360795.83
Maiwen China~~**90.330.216366469292.12
Make Opinion GmbH~~**87.790.153041414188.72
MarketCube~~**91.5789.75
MDQ~~**89.830.557886852685.53
Prodege~~**89.260.0743472436
Research for Good (SS)91.120.189591284192.52
Revenue Universe~~**79.710.156238849985.37
SampleBus Market Research Service Ltd*78.750.291335868193.88
Tap Research~~**89.950.107757988289.08
TapJoy~~**83.930.035716518591.21
TheoremReach~~**85.790.057963132690.45
On the Score sheets for each country, the following applies:
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target

Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight

Supplier Scores: France
13 September 2021 - 02 January 2022

QScore

Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).

Acceptance

Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.

Consistency

Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research

SupplierQScoreAcceptanceConsistency
A-K International~~**89.200.355766900286.75
AdGate Media~**86.290.289759830991.60
Attapoll~**87.200.358592971992.41
Bitburst~~**90.160.348946128295.16
ClixSense~90.33-0.111798589592.20
CreOnline~~*89.240.330213116893.04
Dalia Research~**86.710.178946589297.37
Decision Analyst~~**90.970.402211568787.34
Devola*88.430.351627844293.99
Gaddin.com**91.030.444206607095.16
Gamekit84.510.357033603892.31
Hiving~~**88.430.362733407690.48
inBrain.ai*90.350.361696315491.06
JS Media / Moolineo90.040.353867163298.07
Make Opinion GmbH87.290.309628973687.72
Market Cube89.0292.05
Mo Web~~*89.410.403727560690.15
Neobux~~**88.05-3.606022143397.93
On Device Research~~**90.530.247077774894.15
Persona.ly~~*88.140.203393169196.68
Point Club~**88.720.185329886596.37
Prodege*91.360.367161153195.32
Research on Mobile~**87.45-4.428632933792.05
Revenue Universe~~**86.640.048746061093.73
Surveoo~*92.010.4312349520
Tap Research87.720.263222047288.59
TapJoy~~**85.480.291248364292.54
TheoremReach88.220.334147572095.26
On the Score sheets for each country, the following applies:
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target

Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight

Supplier Scores: Germany
13 September 2021 - 02 January 2022

QScore

Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).

Acceptance

Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.

Consistency

Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research

SupplierQScoreAcceptanceConsistency
A-K International~89.46-0.032569093885.42
AdGate Media~~**89.21-0.339938570490.13
Almedia AG~~**87.99-2.1540822961
Appinio~*93.460.3780564652
Attapoll*91.610.411637733094.36
Bitburst~*93.930.361466718495.22
ClixSense~91.77-0.267636291492.64
Dale Network90.660.3413260007
Dalia Research~*92.040.361103779091.37
Decision Analyst~~87.360.447637198979.49
General Research Lab~~**89.07-1.1197177683
Hiving~~**89.980.326215829390.86
inBrain.ai~~**91.820.592771856488.75
Liidimedia oy91.670.3979229045
Make Opinion GmbH*93.620.360567761694.62
Market Agent ~**93.590.516453251390.16
MarketCube88.2495.28
Mo Web~**92.430.471266435396.78
On Device Research~*93.850.513612180094.11
Opinion Capital~~**89.730.228408622484.42
Panel Inzicht~~87.800.229294831773.05
Persona.ly~*89.47-0.080410127296.63
Point Club~~*91.780.702786205787.68
Prodege94.380.502456730495.72
Promio~~**89.060.406783144885.97
Research for Good (SS)90.490.265754853993.90
Research on Mobile~~**91.24-1.300787186084.58
Revenue Universe~**88.35-0.585198964188.35
Tap Research~*88.65-0.026765486094.86
TapJoy~~**89.210.548541823494.18
TheoremReach~*90.05-0.065234017290.28
On the Score sheets for each country, the following applies:
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target

Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight

Supplier Scores: India
2021 September 13 - 2022 January 2

QScore

Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).

Acceptance

Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.

Consistency

Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research

SupplierQScoreAcceptanceConsistency
A-K International**89.490.5827947345
AdGate Media~**85.59-2.576550908495.21
Attapoll~~**88.040.210371166694.53
Australian Clearing Pty Ltd~~**89.450.5016056987
Bitburst~~**85.43-0.166016583596.48
ClixSense~~**86.23-0.325730438197.10
Crownit-Link86.670.9679604712
Dalia Research~~**86.640.052888209493.64
Expresso82.570.2265226354
GMO Research89.071.226495575394.25
inBrain.ai~~**87.690.002161996295.63
Innovative Hall87.51-0.012146554191.48
Make Opinion GmbH~~**85.490.050779854496.72
MarketCube87.8496.45
MarketXcel~~**88.750.071142237791.84
Neobux~~**89.24-0.706988696394.27
Opinion Capital~~**88.720.350504346995.66
Persona.ly~~**89.810.751927254495.16
Point Club81.66-0.936677865397.47
Poll Pronto~~**90.4590.02
Prodege~~**90.470.350781836489.97
Research on Mobile~~**80.83-1.752711756694.79
Revenue Universe~~**84.16-0.832422561091.98
Tap Research~~**87.57-0.249440133994.35
TheoremReach~~**88.870.013698616195.91
On the Score sheets for each country, the following applies:
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target

Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight

Supplier Scores: Italy
13 September 2021 - 02 January 2022

QScore

Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).

Acceptance

Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.

Consistency

Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research

SupplierQScoreAcceptanceConsistency
A-K International~~**91.350.042325991595.91
AdGate Media~**87.91-0.160441623194.17
Attapoll~**90.96-0.055678957796.59
Bitburst~**92.18-0.069782210997.55
ClixSense92.590.112554818094.61
CreOnline~**91.480.305717870896.94
Dale Network~90.90-0.053118206894.04
Dalia Research89.95-0.288600767794.87
Decision Analyst~~**91.720.632518112490.29
Hiving~~**89.64-0.093338619494.83
Make Opinion GmbH~*91.18-0.107945769693.67
Market Agent~*89.67-0.0677491321
MarketCube~~**90.7692.56
Mo Web~*91.93-0.166469952696.25
Neobux~*91.350.671676846294.20
On Device Research*91.21-0.475376715396.31
Persona.ly91.54-1.867349859596.08
Point Club91.1093.86
Prodege~*92.40-0.015814372190.11
Research on Mobile~~**84.95-2.839164055190.96
Revenue Universe~**88.81-0.636356827493.73
Splendid Research~*91.370.913452307389.92
Surveyeah92.93-0.329455342596.16
Tap Research89.10-0.497683119295.31
TapJoy~~**88.55-0.011641622095.92
TheoremReach~*90.23-0.114736637592.29
On the Score sheets for each country, the following applies:
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target

Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight

Supplier Scores: Japan
2021 September 13 - 2022 January 2

QScore

Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).

Acceptance

Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.

Consistency

Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research

SupplierQScoreAcceptanceConsistency
Dalia Research~~*89.42-0.023386283182.01
GMO Research~~**89.09-0.232024542383.65
Make Opinion GmbH~~**92.25-0.270714869590.55
MarketCube~90.6393.36
Monitas (Gain, Inc.)*92.69-0.129085199187.94
Research for Good92.853.475194686986.07
Research on Mobile~~**91.53-0.965506644896.27
Revenue Universe~~**89.10-0.870808353287.34
Tap Research~*91.39-0.262976133389.62
TapJoy~~**87.03-1.541317284777.63
TheoremReach~~**91.09-0.072803237491.59
On the Score sheets for each country, the following applies:
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target

Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight

Supplier Scores: Mexico
13 September 2021 - 02 January 2022

QScore

Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).

Acceptance

Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.

Consistency

Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research

SupplierQScoreAcceptanceConsistency
A-K International*92.700.318006443994.32
Attapoll~~**92.240.001996980690.58
Bitburst~~**91.44-0.018984233494.55
ClixSense~~**92.830.016692381194.26
Dale Network~*91.140.162733505994.93
Dalia Research~~**89.70-0.197096087594.22
inBrain.ai~~**91.410.093820829593.08
Innovative Hall~~**93.41-0.827215913594.93
Make Opinion GmbH~~**92.840.028669450495.18
MarketCube~*91.8297.51
Mo Web~*92.560.260194096395.22
Neobux~~**94.13-2.590376890292.19
Opinaia Panel~*91.140.191551203492.33
Persona.ly~~**92.87-0.875068546096.02
Point Club~~**92.06-2.611191197997.37
Prodege~~**92.240.107286985993.63
Research for Good (SS)~92.3194.98
Research on Mobile~~**92.68-1.286403100694.09
Revenue Universe~~**90.90-0.225008393284.68
Splendid Research92.51-0.092646757896.31
Tap Research~~**91.86-0.218170004492.00
TapJoy~~**89.63-0.319841618688.84
TheoremReach~~**91.96-0.187916577294.88
On the Score sheets for each country, the following applies:
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target

Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight

Supplier Scores: Netherlands
13 September 2021 - 02 January 2022

QScore

Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).

Acceptance

Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.

Consistency

Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research

SupplierQScoreAcceptanceConsistency
AdGate Media~~**85.63-0.594624845486.26
Attapoll~~**89.730.064955510393.89
Bitburst~~**88.91-0.261527084295.99
ClixSense~~**86.98-1.677933791792.87
Dale Network~*87.040.065178435587.52
Dalia Research~*90.79-0.022425980395.76
Make Opinion GmbH~*91.160.046306577391.92
MarketCube*90.2793.03
Pabble B.V.90.3495.33
Panel Inzicht~~90.980.872212737079.26
Persona.ly~~**90.25-1.031097789491.00
Point Club87.9791.38
Prodege~~**91.660.137266777295.65
Research on Mobile~**88.15-0.322519928886.60
Revenue Universe~**84.34-0.654425343191.87
Tap Research87.8497.20
TapJoy~~**90.010.135394869092.64
TheoremReach~~**89.61-0.048508120390.07
On the Score sheets for each country, the following applies:
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target

Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight

Supplier Scores: Russia
13 September 2021 - 02 January 2022

QScore

Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).

Acceptance

Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.

Consistency

Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research

SupplierQScoreAcceptanceConsistency
A-K International~~**90.290.652037778792.20
AdGate Media~~**88.43-0.209060666588.82
Amry Research~*91.030.041540220194.26
Attapoll~~**89.420.084428351691.74
Bitburst~~**89.85-0.124929605893.04
ClixSense~**91.760.438877035895.79
Dalia Research~*90.150.176599259085.63
Make Opinion GmbH**90.75-0.201508001493.68
Marketagent93.242.362628744497.60
MarketCube90.8494.08
Mo Web91.830.799733796794.58
Neobux~**92.061.300331471795.33
Persona.ly~*91.57-0.146387343495.02
Point Club~*92.350.081474229593.93
Prodege~~**91.79-0.085008506293.04
Research on Mobile~~**90.69-1.758528370694.35
Survey Everyone~~*91.140.343635899994.85
TheoremReach~~**88.65-0.011021939792.20
Tiburon Research91.61
YouThink.io~~**92.130.019635400288.44
On the Score sheets for each country, the following applies:
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target

Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight

Supplier Scores: Spain
13 September 2021 - 02 January 2022

QScore

Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).

Acceptance

Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.

Consistency

Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research

SupplierQScoreAcceptanceConsistency
A-K International92.310.151473047895.23
AdGate Media~~**89.51-0.056469824292.14
Attapoll~*92.66-0.090850693296.70
Bitburst~**94.100.095414418694.84
ClixSense~*94.920.081909977194.22
CreOnline~~**92.970.462290905893.61
Dale Network93.550.825645426694.36
Dalia Research~*91.43-0.315915084497.29
Decision Analyst~~**90.690.892812850095.05
Hiving~~**93.000.078496641692.94
inBrain.ai~~**92.00-0.013609474691.49
Innovative Hall~~**94.12-0.185025236488.75
Make Opinion GmbH~*93.650.151781131396.01
Market Agent93.610.8347699372
MarketCube*92.4391.15
Mo Web~93.640.370093785391.26
Neobux~*92.65-0.073127251994.91
On Device Research~**93.15-0.221387961595.56
Persona.ly~*93.23-0.814731726995.40
Point Club*93.620.136796710196.80
Prodege~*94.060.162884873598.51
Research on Mobile~~**92.69-0.360532959595.47
Revenue Universe~~**87.11-1.138893969295.33
Splendid Research*93.240.621535964096.25
Surveyeah~*95.250.9080246924
Tap Research~*90.87-0.623232116197.38
TapJoy~~**90.74-0.159158967594.75
TheoremReach*91.94-0.205372824796.24
On the Score sheets for each country, the following applies:
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target

Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight

Supplier Scores: United Kingdom
13 September 2021 - 02 January 2022

QScore

Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).

Acceptance

Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.

Consistency

Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research

SupplierQScoreAcceptanceConsistency
A-K International89.080.595229809694.52
AdGate Media*90.65-1.131012463186.68
Attapoll~~**92.370.421291287695.64
Bitburst~*89.81-0.050970353091.73
Branded Research~**93.940.616571863393.43
ClixSense90.4096.01
Dalia Research~*89.40-0.836274657093.97
Dayos93.48-3.4100000080
Decision Analyst~~**87.680.073550030990.50
Expresso88.88
General Research Lab~**89.66-0.219865503193.29
Hiving~*89.550.419410042592.80
iAngelic Research*90.640.384872930993.94
Inbox Dollars (UK)91.240.670493747489.79
inBrain.ai~~**91.97-0.454532448293.34
Innovative Hall89.20
Lux Surveys~**90.4986.97
Make Opinion GmbH*90.610.032607169094.53
MarketCube~*87.9394.05
MindMover~~**90.630.438486352287.62
Mirats Insights~65.88
Mo Web~~**91.610.662455101994.65
MVUK - Kato~~**91.9892.44
On Device Research~*92.030.575490135392.73
Persona.ly~**90.900.204028277690.59
Pick Media Ltd~*93.370.621523873795.44
Point Club90.97-2.313419869496.53
Prodege93.360.634342301391.13
Qmee92.040.182632979991.38
Research for Good (SS)~*88.700.362487949392.84
Revenue Universe~**85.81-0.605808128193.43
Splendid Research89.520.225505638287.01
Survey Everyone89.450.6948326484
Tap Research*87.69-0.159340963092.41
TapJoy~*90.290.316993323087.03
TheoremReach89.610.101016724295.79
On the Score sheets for each country, the following applies:
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target

Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight

Supplier Scores: South Korea
13 September 2021 - 02 January 2022

QScore

Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).

Acceptance

Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.

Consistency

Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research

SupplierQScoreAcceptanceConsistency
Dalia Research~~**83.710.101464437987.44
DataSpring91.740.1728414691
GMO Research*91.810.201906007594.15
Make Opinion GmbH~~**85.740.110054877687.56
MarketCube~~**88.28
MarketLink~~**90.960.1483999071
Panel Marketing Interactive89.41
Persona.ly~~**94.010.158720489792.73
Research on Mobile~~**85.840.074158313979.01
Revenue Universe~~*84.86-0.097047934193.17
Tap Research~~**89.62-0.180654625989.28
TapJoy~~**84.41-0.116440765395.61
TheoremReach~~**86.80-0.022573694489.62
On the Score sheets for each country, the following applies:
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target

Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight

Stay in the know with LUCID. Subscribe to our newsletter.