The Standard for Quality in Research Technology

How can we ensure that you’re getting high quality survey responses? The Lucid Quality Program provides a unique solution for evaluating supply partners and respondents. Using independent, third-party data specialists we measure our supply partners on the three most important aspects of survey sample: response quality, accepted completes, and consistency.

This exclusive offering allows Lucid customers to run projects with confidence, knowing they’re getting high-quality survey responses. In the spirit of transparency, we publish results each quarter – and current scores can be viewed anytime.

The Science Behind Quality Scoring

We conduct a rigorous assessment of our supply partners that is designed to provide customers (sample buyers) with insight into their sample quality. All eligible supply partners are required to participate in the program. 

After being evaluated, supply partners are issued a QScore, Acceptance Score, and Consistency Score.

QScore

Even when demographics are matched precisely, latent or unseen characteristics can influence data outcomes – and the degree of influence is driven by the subject matter of the survey. Our program monitors respondent values and behaviors, with regard to specific subject matter, so it can be managed by sample buyers

Acceptance

Acceptance Score measures the acceptance rate of survey completes for individual supply partners. “Acceptance” refers to completes that meet buyers’ quality standards and, as a result, are accepted by those buyers. To define a benchmark for acceptance, a weighted average of all accepted completes in the Lucid Marketplace is measured. Then, to calculate Acceptance Score, individual supply partners’ completes are measured against each other, at the project level, to determine how close they are to that benchmark.

Consistency

Consistency Score measures a supply partner’s composition from quarter to quarter. “Composition” is the balance of respondent preferences and opinions within a given panel. These attitudinal responses are determined by respondents’ brand affinity, value-seeking behavior, technology adoption, movie and music usage, and gaming activities. Measuring composition can help researchers with tracking research.

Minimizing Sample Bias

To get accurate data, researchers must take great care to apply quotas – helping to prevent bias from over/under representation of certain groups. Similar care should be taken to manage latent sample characteristics, which are inherent in sample sources (due to differences in respondent recruitment strategies).

Even when demographics are matched precisely, latent or unseen characteristics can influence data outcomes – and the degree of influence is driven by the subject matter of the survey. Our program monitors respondent values and behaviors, with regard to specific subject matter, so it can be managed by sample buyers.

A common objective of survey research is to measure the performance and impact of brands. By selecting sample sources that do not skew too brand-favorable or averse, clients can get the best reads on their brands. Lucid regularly creates sample blends that can mitigate this potential source of bias.

Similar to brand preference and usage, some sources may skew heavier or lighter in terms of consumers that use coupons, shop sales, or exhibit extreme bargain hunting. Selecting sample sources that lean too far in either direction can provide biased insight not reflective of the population as a whole. This otherwise latent characteristic is quantified by our Quality Program.

People who are avid, early adopters of technology tend to have different attitudes around innovation and change than the general population. Using a sample source that skews too tech savvy or laggard can bias research outcomes – especially if the study is related to technology. Scoring sample sources on tech usage helps inform buyers so pitfalls can be avoided.

For entertainment research in particular, obtaining sample that skews too heavy or light in terms of media consumption can bias results. This dimension varies greatly among those who otherwise appear similar demographically – some people simply don’t listen to music or watch many movies. Understanding the tendencies of certain sample sources helps prevent research missteps.

Since some sample sources incentivize respondents in currencies used for playing games, a quick check of game-playing proclivity can reveal if a source looks mainstream or more skewed. This is particularly compelling for research in the video game category, but sample sources where larger numbers of people spend significant time gaming could signal other biasing characteristics.

Fully Transparent Supplier Scores

Supplier Scores: United States
December 13, 2021 - April 03, 2022

QScore

Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).

Acceptance

Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.

Consistency

Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research

SupplierQScoreAcceptanceConsistency
AdGate Media*92.39-0.336375218892.42
Attapoll~*91.990.023156592093.94
Besitos Corporation~*91.36-0.3501729188
Bitburst~*92.77-0.544560968394.61
BizRate88.520.1253977241
Bovitz~93.15-0.7826534900
Branded Research~~**95.050.383531643392.80
Centiment~~**95.790.3099572077
Consultancy Services LLC~~**92.590.409921581886.86
CrowdNautics, Inc.~~88.47
Dalia Research**89.05-0.256550371295.92
Decision Analyst92.240.527318825181.77
DISQO*91.590.051698984093.49
Embee Mobile~**82.540.060704194792.19
Gamekit~*91.010.229147921297.60
General Research Lab~*89.69-0.753241426092.43
iAngelic Research~*91.460.1101491218
InboxDollars~~**94.07-0.055424485194.23
inBrain.ai~~**88.96-0.401702478894.71
inMarket~~80.33-0.1657532907
ISA (MySoapBox)~~**88.580.170810738489.86
ITC~*90.970.095604149993.92
Make Opinion GmbH~*93.40-0.133851056192.35
MarketCube~*89.0993.25
MARU Group (SA)93.020.1938522310
MyPoints~~94.230.204959586728.87
On Device Research~*92.310.045369281995.41
Opinion Capital~~91.63-1.2419891289
Point Club~93.730.148245514591.76
Prodege~~93.480.204959586792.66
Publishers Clearing House~~**88.800.269420465781.16
PureSpectrum~91.95
Qmee~*91.370.106173291692.07
Research for Good (SS)92.641.2142903232
Revenue Universe~~*91.930.180122998691.42
Screen Engine/ASI~~94.54-0.463859662096.28
SocialLoop~~**90.62-0.468375036694.62
Tap Research~84.80-0.179828656492.60
TapJoy~*88.170.366376135895.05
Tellwut~~**87.420.242086835487.86
TheoremReach91.67-0.129166445796.07
URWelcome Technologies~**93.710.3183968570
Vetri Foundation~~**91.58-0.3382194303
On the Score sheets for each country, the following applies:
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target

Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight

Supplier Scores: Australia
13 December 2021 – 03 April 2022 

QScore

Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).

Acceptance

Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.

Consistency

Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research

SupplierQScoreAcceptanceConsistency
AdGate Media~~**87.48-1.196180587691.97
Attapoll~**93.690.327806847394.43
Bitburst~*93.76-0.316168899894.08
ClixSense~~**92.180.111360031093.69
Competition Panel**92.160.347348918793.42
Dale Network~*89.640.259539856595.42
Dalia Research~~**90.570.070124175992.10
DISQO94.010.351779424393.93
GMO Research~~**87.490.310645521193.27
GrowthOps~~**87.6190.45
iAngelic Research91.490.1880058641
inBrain.ai~**93.610.060021666196.85
Make Opinion GmbH~*93.34-0.179207472294.94
MarketCube~*91.1494.56
On Device Research~~**93.850.263375001393.15
Persona.ly92.290.628575952493.46
Point Club91.3992.36
Prodege94.510.382557469194.22
Qmee~**94.630.240930811296.60
Research for Good (SS)90.270.3306884975
Researchify Pty Ltd~~**88.330.836812636981.14
Revenue Universe~**84.85-0.157966630690.18
Rewardia~**94.510.287053594794.60
Tap Research~*90.270.058749276691.26
TapJoy*93.510.264790042393.06
TheoremReach~*90.89-0.291687801196.04
Titan~~84.08
On the Score sheets for each country, the following applies:
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target

Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight

Supplier Scores: Brazil
13 December 2021 – 03 April 2022

QScore

Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).

Acceptance

Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.

Consistency

Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research

SupplierQScoreAcceptanceConsistency
A-K International~*92.620.189680340195.13
AdGate Media~~**91.35-2.521149727293.15
Attapoll~*93.00-0.442564952796.01
Bitburst~~**92.46-0.421769484496.35
ClixSense~~*92.500.173124661298.57
Dale Network*91.000.069960755495.89
Dalia Research~**92.130.085327104696.36
Dayos~~91.31-0.661084038397.87
inBrain.ai~*92.47-0.098448573397.43
Make Opinion GmbH~~**92.26-0.108748584793.28
Market Agent~*93.781.135151203793.84
MarketCube*91.4997.01
Mo Web~~**93.321.075411813490.28
Neobux~92.561.163494451295.77
On Device Research~*92.57-0.149594477296.46
Opinaia Panel~*90.650.095659593597.00
Persona.ly~*93.760.783267246495.42
Point Club~*94.33-0.701259797996.38
Prodege~~**90.81-0.022453156997.14
Research for Good (SS)91.25
Research on Mobile~~**92.31-1.781308041294.73
Revenue Universe~~**91.870.202867291282.84
Tap Research~*90.02-0.371876636091.07
TapJoy~~**91.75-0.963969944687.62
TheoremReach~*91.09-0.508081298289.33
On the Score sheets for each country, the following applies:
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target

Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight

Supplier Scores: Canada
2021 December 13 – 2022 April 03

QScore

Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).

Acceptance

Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.

Consistency

Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research

SupplierQScoreAcceptanceConsistency
A-K International**91.410.2599863421
AdGate Media~~*89.22-2.089038031692.41
Attapoll~~**90.750.243095969394.03
Bitburst~~*90.44-0.513891564294.90
Branded Research94.710.446869442893.88
ClixSense90.960.262019174193.30
Dale Network~*86.090.464741339496.05
Dalia Research~~*89.63-0.433090110792.26
Decision Analyst~~92.860.529330960291.95
DISQO92.840.405773750294.75
FeedSurvey~~86.54
General Research Lab~~88.89-0.568638847589.60
iAngelic Research91.210.401295230994.81
InboxDollars (DR)92.530.434876641293.65
inBrain.ai~*92.110.265185855297.53
ITC89.960.2388424322
Juyanba~~81.09-0.067684460692.23
Make Opinion GmbH~**91.08-0.112331785193.64
MarketCube93.2694.39
MARU Group~~**92.190.368598343995.42
MyPoints~~**92.070.3661580118
On Device Research90.530.5113620988
Point Club*91.910.433327644592.43
Prodege*93.130.366158011894.34
Qmee~*94.750.228971095694.71
Research for Good (SS)~*92.190.635079711791.09
Research on Mobile~~83.99-4.203541052783.34
Revenue Universe89.25-0.403082606186.54
Splendid Research91.050.385120055092.26
Survey Everyone88.940.3982038042
Tap Research~*89.500.064015469193.09
TapJoy~*90.630.353714410793.64
Tellwut~**92.080.317741087191.46
TheoremReach~*90.630.098851738097.00
On the Score sheets for each country, the following applies:
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target

Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight

Supplier Scores: China
2021 December 13 – 2022 April 03

QScore

Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).

Acceptance

Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.

Consistency

Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research

SupplierQScoreAcceptanceConsistency
Beijing Youli Technology Co., Ltd.~~**84.66-0.155733703188.91
ClixSense~~**88.34-0.052260612992.04
Dalia Research~~**89.700.145669886383.81
Data100~**91.300.127956511493.19
DataSpring~**90.260.135154191892.54
GMO Research~**90.730.169147637984.77
Ignite Vision~~**84.02-0.015611162084.29
Insight Works~*89.050.094073393394.39
Interface Asia~~87.820.051420398286.60
Juyanba~84.77-0.075345746098.34
KuRunData~~**88.010.213104221593.61
Maiwen China~~**88.09-0.058722722095.64
Make Opinion GmbH~~**87.790.020153249392.51
MarketCube~~**91.4591.13
MDQ~~**87.30-0.004718210283.21
Prodege~~**90.59-0.055856856195.86
Research for Good (SS)91.1292.52
Revenue Universe~~**82.470.069984239574.47
SampleBus Market Research Service Ltd82.10-0.019440759481.84
Tap Research~~**88.450.024093820193.20
TapJoy~~**84.23-0.002064791686.29
TheoremReach~~**84.270.060879188994.17
On the Score sheets for each country, the following applies:
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target

Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight

Supplier Scores: France
13 December 2021 – 03 April 2022

QScore

Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).

Acceptance

Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.

Consistency

Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research

SupplierQScoreAcceptanceConsistency
A-K International~~**88.220.610338695381.70
AdGate Media~**86.52-0.041656277594.74
Attapoll88.740.407887145894.80
Bitburst~*88.100.310485015895.74
ClixSense~90.330.313962193992.20
CreOnline~~**89.150.402462421694.68
Dalia Research~*86.86-0.312626787096.20
Decision Analyst~~**89.720.308182914889.16
Devola88.4393.99
Gaddin.com91.430.486429296463.90
Gamekit84.51-1.330521014892.31
Hiving~~**89.520.263389010789.45
inBrain.ai90.570.390759599095.06
JS Media / Moolineo*89.910.381144420597.25
Make Opinion GmbH88.840.304138779594.54
Market Cube~90.9789.26
Mo Web~~**91.010.517444739992.51
Neobux~~88.05-0.281814157997.93
On Device Research~*88.64-0.000514554792.90
Persona.ly~**88.52-0.459724441792.67
Point Club~~**87.60-1.584744384291.98
Prodege~*90.360.489428714797.56
Research on Mobile~87.450.277099248192.05
Revenue Universe~**85.69-0.011317422395.81
Surveoo~~**90.210.701426878296.22
Tap Research88.290.095543315386.83
TapJoy~**89.400.236782075891.36
TheoremReach89.630.315697847492.15
On the Score sheets for each country, the following applies:
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target

Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight

Supplier Scores: Germany
13 December 2021 – 03 April 2022

QScore

Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).

Acceptance

Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.

Consistency

Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research

SupplierQScoreAcceptanceConsistency
A-K International~**89.460.160415434485.42
AdGate Media~**89.59-0.923620400991.95
Almedia AG~~87.99
Appinio~**91.470.382997021089.51
Attapoll~*93.110.347788280789.77
Bitburst~*91.360.232009106393.46
ClixSense~91.770.735106071792.64
Dale Network~**87.220.490300668386.32
Dalia Research~*91.13-0.493790176092.09
Decision Analyst~~87.360.339403031679.49
General Research Lab~~89.07
Hiving~~**86.770.289983663688.94
inBrain.ai~**91.12-0.139344838892.64
Liidimedia oy~*91.050.419601605697.07
Make Opinion GmbH~~92.360.140566408286.53
Market Agent ~**92.370.524649570089.13
MarketCube~~**88.6585.16
Mo Web*91.270.324679042595.80
On Device Research~*93.190.445402469693.77
Opinion Capital~~89.73-0.761755084984.42
Panel Inzicht~~87.800.384689012473.05
Persona.ly~~**88.660.218582806692.83
Point Club~~**91.501.314916693292.85
Prodege94.050.394897690092.08
Promio~~**90.520.363953830078.36
Research for Good (SS)~*90.940.131725684788.78
Research on Mobile~~91.24-0.665866235184.58
Revenue Universe~~**88.06-0.270341597588.93
Tap Research*88.690.010873971683.86
TapJoy~~**91.580.522001896995.51
TheoremReach~**90.58-0.153296149295.67
Untiedt~~**91.260.4379920759
On the Score sheets for each country, the following applies:
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target

Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight

Supplier Scores: India
2021 December 13 – 2022 April 03

QScore

Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).

Acceptance

Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.

Consistency

Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research

SupplierQScoreAcceptanceConsistency
A-K International89.490.5496806667
AdGate Media~~**82.32-1.160785145892.76
Attapoll~~**90.340.300149948893.44
Australian Clearing Pty Ltd~*88.0295.26
Bitburst~~**86.250.159509942795.67
ClixSense~~**87.92-0.010935353794.32
Crownit-Link86.67
Dalia Research~*82.150.265611317296.59
Expresso82.57-0.1212037560
GMO Research~~**90.110.805674755194.25
inBrain.ai~~**87.910.177200143897.18
Innovative Hall87.510.709302937291.48
Make Opinion GmbH~~**87.240.149034312694.32
MarketCube87.8496.45
MarketXcel~~**89.930.308809739791.84
Neobux~~**88.790.217551980791.57
Opinion Capital~~**90.590.407403684693.89
Persona.ly~~**90.630.558734446292.06
Point Club81.660.106799428797.47
Poll Pronto~~90.4590.02
Prodege~~**91.760.609780216090.08
Research on Mobile~~**83.24-0.429180980193.67
Revenue Universe~~**81.99-0.413682476288.12
Tap Research~~**88.550.225168907791.70
TheoremReach~~**88.720.356034986890.51
On the Score sheets for each country, the following applies:
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target

Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight

Supplier Scores: Italy
13 December 2021 – 03 April 2022

QScore

Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).

Acceptance

Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.

Consistency

Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research

SupplierQScoreAcceptanceConsistency
A-K International~~**90.350.210807252587.27
AdGate Media~~**86.35-1.032804803279.50
Attapoll~*92.610.100283948493.84
Bitburst*91.710.077482673494.85
ClixSense*92.900.353351669194.77
CreOnline~*91.990.258767174894.53
Dale Network~*87.420.357870266691.65
Dalia Research~91.000.079351599095.30
Decision Analyst92.050.309613444992.79
Hiving~~**85.880.196031633390.47
Make Opinion GmbH~91.800.147526010289.93
Market Agent~89.670.5721941027
MarketCube~*90.6896.80
Mo Web~~**90.91-0.039961072092.27
Neobux~91.350.105986245694.20
On Device Research*91.21-0.097491490691.90
Persona.ly91.46-2.176189133596.95
Point Club*91.0396.38
Poll Pronto~*91.47
Prodege~**92.250.277210903593.99
Research on Mobile~~*87.190.986793569594.77
Revenue Universe~**87.25-0.833830005091.72
Splendid Research~~**92.480.110945266589.92
Surveyeah~*92.97-0.221791482495.71
Tap Research89.64-0.036936862894.04
TapJoy~~**89.460.068134355091.53
TheoremReach*90.120.146988820395.64
On the Score sheets for each country, the following applies:
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target

Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight

Supplier Scores: Japan
2021 December 13 – 2022 April 03

QScore

Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).

Acceptance

Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.

Consistency

Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research

SupplierQScoreAcceptanceConsistency
Dalia Research~*89.660.476703439185.58
GMO Research*90.27-0.179759341080.66
Make Opinion GmbH~~**91.89-0.015989197994.03
MarketCube~90.6393.36
Monitas (Gain, Inc.)~~*91.380.138781618686.71
Research for Good92.8586.07
Research on Mobile~~89.39-0.668449966496.27
Revenue Universe~*87.30-0.200358755293.82
Tap Research~~*91.190.026844306992.77
TapJoy~**92.21-0.466799528871.79
TheoremReach~~*92.050.204938476587.00
On the Score sheets for each country, the following applies:
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target

Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight

Supplier Scores: Mexico
13 December 2021 – 03 April 2022

QScore

Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).

Acceptance

Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.

Consistency

Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research

SupplierQScoreAcceptanceConsistency
A-K International*92.42-0.210994352497.33
Attapoll~~**92.27-0.237605280995.64
Bitburst~~**92.92-0.266170432389.92
ClixSense~~**94.01-0.129661168292.15
Dale Network~*92.32-0.221183559690.77
Dalia Research~~**92.29-0.172558626994.42
inBrain.ai~~**92.24-0.083530741391.51
Innovative Hall~~**92.65-1.234966295394.41
Make Opinion GmbH~~**93.76-0.262216749794.82
MarketCube~*90.6992.45
Mo Web~*93.180.019051471494.34
Neobux~~**92.73-1.812117507793.59
Opinaia Panel~**91.85-0.570742141593.54
Persona.ly~~**92.34-1.580741724195.20
Point Club~~**92.67-1.857868202994.18
Prodege~~**92.13-0.235728963293.95
Research for Good (SS)~92.3194.98
Research on Mobile~~**89.120.095115447592.17
Revenue Universe~~**92.78-0.323421382475.27
Splendid Research92.51-0.340585635596.31
Tap Research~**90.33-0.836193879895.84
TapJoy~~**91.01-0.342841095481.31
TheoremReach~~**90.52-0.171271819093.08
On the Score sheets for each country, the following applies:
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target

Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight

Supplier Scores: Netherlands
13 December 2021 – 03 April 2022

QScore

Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).

Acceptance

Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.

Consistency

Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research

SupplierQScoreAcceptanceConsistency
AdGate Media~~**81.330.083469275981.24
Attapoll~**90.300.117168101194.55
Bitburst~**88.28-0.190438458192.46
ClixSense~~86.980.036391043292.87
Dale Network~~**85.190.069161958491.99
Dalia Research~~*87.60-0.430028396697.12
Make Opinion GmbH~*88.62-0.001237971192.46
MarketCube~*90.0391.97
Pabble B.V.90.3495.33
Panel Inzicht~~90.980.166868403879.26
Persona.ly~~90.25-0.694774564591.00
Point Club87.9791.38
Prodege~~**90.420.166511697690.21
Research on Mobile~~**81.99-1.264309522294.11
Revenue Universe~~*81.26-0.643078423991.02
Tap Research87.8497.20
TapJoy~~**84.22-0.238805303691.31
TheoremReach~~**89.040.007076223193.26
On the Score sheets for each country, the following applies:
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target

Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight

Supplier Scores: Russia
13 December 2021 – 03 April 2022

QScore

Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).

Acceptance

Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.

Consistency

Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research

SupplierQScoreAcceptanceConsistency
A-K International~~**91.43-0.153098239994.62
AdGate Media~~**89.39-0.716820719486.23
Amry Research~*91.71-0.736353238692.41
Attapoll~~**90.94-0.345851124893.86
Bitburst~~*90.61-0.543626354794.63
ClixSense~~*93.390.079936906495.79
Dalia Research~~*90.06-0.268267917595.14
Make Opinion GmbH~~*91.97-0.570073977794.61
Marketagent93.244.334269001697.60
MarketCube90.8592.57
Mo Web~*91.950.095505056690.85
Neobux~**92.670.270710890691.49
Persona.ly~*92.080.143736041895.36
Point Club~92.3593.93
Prodege~~**92.10-0.180650230596.41
Research on Mobile~~**91.14-0.307854197693.89
Survey Everyone~~**91.77-0.119067209591.07
TheoremReach~~**90.79-0.485925762493.30
Tiburon Research91.61
YouThink.io~*92.45-0.026930442288.62
On the Score sheets for each country, the following applies:
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target

Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight

Supplier Scores: Spain
13 December 2021 – 03 April 2022

QScore

Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).

Acceptance

Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.

Consistency

Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research

SupplierQScoreAcceptanceConsistency
A-K International~~**92.240.294059647995.46
AdGate Media~~**90.030.002402995092.08
Attapoll~*91.940.214837881491.54
Bitburst~*92.860.206648114195.73
ClixSense~*95.280.383105988094.42
CreOnline~~**93.190.263479716496.42
Dale Network~*92.910.360181154195.48
Dalia Research~*92.12-0.207063701096.67
Decision Analyst~~**93.190.362982160395.05
Gaddin.com92.960.3430154688
Hiving~~**91.590.113691739692.40
inBrain.ai~~**91.630.266479386291.82
Innovative Hall~~**94.570.829267566894.53
Make Opinion GmbH*93.160.258850244692.93
Market Agent~*93.250.627899623895.00
MarketCube~*91.3795.99
Mo Web~*93.370.320976320195.94
Neobux~**94.29-3.839281893395.76
On Device Research**93.650.157532339194.72
Persona.ly~**94.250.476818601296.33
Point Club~*94.80-0.211598272492.54
Prodege*93.630.365935884696.88
Research on Mobile~~**90.78-0.344182929192.96
Revenue Universe~~**91.060.323886367094.92
Splendid Research~*93.910.279489669192.52
Surveoo~*94.510.3287736909
Surveyeah~95.250.2631159322
Tap Research*89.63-0.021780084892.33
TapJoy~~**91.910.247500724785.11
TheoremReach92.580.168466419392.61
On the Score sheets for each country, the following applies:
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target

Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight

Supplier Scores: United Kingdom
13 December 2021 – 03 April 2022

QScore

Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).

Acceptance

Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.

Consistency

Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research

SupplierQScoreAcceptanceConsistency
A-K International89.080.407116519294.52
AdGate Media~~**88.91-1.305016757793.04
Attapoll~*92.180.359865285894.30
Bitburst~~*91.29-0.286442066195.92
Branded Research*94.270.468824045090.81
ClixSense90.400.374194844696.01
Dalia Research~~*89.48-0.455853381591.26
Dayos93.48-0.3324408497
Decision Analyst~~87.680.219630269990.50
Expresso88.88
General Research Lab~~90.09-2.112391846593.29
Hiving~~**88.480.280849722385.95
iAngelic Research**90.640.383664592690.63
Inbox Dollars (UK)~~*92.150.493793326796.14
inBrain.ai~**90.95-0.875044641296.36
Innovative Hall89.20-4.6324363078
Lux Surveys~**91.2492.19
Make Opinion GmbH93.010.103368634395.57
MarketCube~~**91.2393.27
MindMover~~**91.690.371804803182.93
Mirats Insights~65.88
Mo Web~~**91.110.509854682989.13
MVUK - Kato~~**87.7989.06
On Device Research~*94.030.403409911288.35
Persona.ly~~**91.64-0.807950105393.90
Pick Media Ltd~~**92.760.413635585192.91
Point Club~**89.960.890946603194.35
Prodege~*93.560.450210946295.03
Qmee~*92.100.085156347595.11
Research for Good (SS)*89.780.464340080093.77
Revenue Universe~**85.310.280236190990.83
Splendid Research89.520.505509667087.01
Survey Everyone89.450.5262642324
Tap Research~*89.93-0.092445881097.16
TapJoy~*90.770.304825772793.18
TheoremReach~*91.410.175847448695.33
On the Score sheets for each country, the following applies:
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target

Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight

Supplier Scores: South Korea
13 December 2021 – 03 April 2022

QScore

Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).

Acceptance

Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.

Consistency

Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research

SupplierQScoreAcceptanceConsistency
ClixSense~~**94.630.2505763142
Dalia Research~~**85.430.103319700581.02
DataSpring~~**90.370.2030835017
GMO Research89.910.238599133693.18
Make Opinion GmbH~~**91.470.230671036486.03
MarketCube~~88.28
MarketLink~~**91.310.208402765296.89
Neobux~~**94.010.2523051798
Panel Marketing Interactive89.41
Persona.ly~**93.840.266907487592.38
Prodege~~**92.400.2257226609
Research on Mobile~~**83.610.101045850191.12
Revenue Universe~~**83.130.077530315788.17
Tap Research~~**87.530.173285700988.81
TapJoy~**85.620.044550114795.40
TheoremReach~~**83.550.075132829386.48
On the Score sheets for each country, the following applies:
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target

Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight

Stay in the know with LUCID. Subscribe to our newsletter.