The Standard for Quality in Research Technology

How can we ensure that you’re getting high quality survey responses? The Lucid Quality Program provides a unique solution for evaluating supply partners and respondents. Using independent, third-party data specialists we measure our supply partners on the three most important aspects of survey sample: response quality, accepted completes, and consistency.

This exclusive offering allows Lucid customers to run projects with confidence, knowing they’re getting high-quality survey responses. In the spirit of transparency, we publish results each quarter – and current scores can be viewed anytime.

The Science Behind Quality Scoring

We conduct a rigorous assessment of our supply partners that is designed to provide customers (sample buyers) with insight into their sample quality. All eligible supply partners are required to participate in the program. 

After being evaluated, supply partners are issued a QScore, Acceptance Score, and Consistency Score.

QScore

Even when demographics are matched precisely, latent or unseen characteristics can influence data outcomes – and the degree of influence is driven by the subject matter of the survey. Our program monitors respondent values and behaviors, with regard to specific subject matter, so it can be managed by sample buyers

Acceptance

Acceptance Score measures the acceptance rate of survey completes for individual supply partners. “Acceptance” refers to completes that meet buyers’ quality standards and, as a result, are accepted by those buyers. To define a benchmark for acceptance, a weighted average of all accepted completes in the Lucid Marketplace is measured. Then, to calculate Acceptance Score, individual supply partners’ completes are measured against each other, at the project level, to determine how close they are to that benchmark.

Consistency

Consistency Score measures a supply partner’s composition from quarter to quarter. “Composition” is the balance of respondent preferences and opinions within a given panel. These attitudinal responses are determined by respondents’ brand affinity, value-seeking behavior, technology adoption, movie and music usage, and gaming activities. Measuring composition can help researchers with tracking research.

Minimizing Sample Bias

To get accurate data, researchers must take great care to apply quotas – helping to prevent bias from over/under representation of certain groups. Similar care should be taken to manage latent sample characteristics, which are inherent in sample sources (due to differences in respondent recruitment strategies).

Even when demographics are matched precisely, latent or unseen characteristics can influence data outcomes – and the degree of influence is driven by the subject matter of the survey. Our program monitors respondent values and behaviors, with regard to specific subject matter, so it can be managed by sample buyers.

A common objective of survey research is to measure the performance and impact of brands. By selecting sample sources that do not skew too brand-favorable or averse, clients can get the best reads on their brands. Lucid regularly creates sample blends that can mitigate this potential source of bias.

Similar to brand preference and usage, some sources may skew heavier or lighter in terms of consumers that use coupons, shop sales, or exhibit extreme bargain hunting. Selecting sample sources that lean too far in either direction can provide biased insight not reflective of the population as a whole. This otherwise latent characteristic is quantified by our Quality Program.

People who are avid, early adopters of technology tend to have different attitudes around innovation and change than the general population. Using a sample source that skews too tech savvy or laggard can bias research outcomes – especially if the study is related to technology. Scoring sample sources on tech usage helps inform buyers so pitfalls can be avoided.

For entertainment research in particular, obtaining sample that skews too heavy or light in terms of media consumption can bias results. This dimension varies greatly among those who otherwise appear similar demographically – some people simply don’t listen to music or watch many movies. Understanding the tendencies of certain sample sources helps prevent research missteps.

Since some sample sources incentivize respondents in currencies used for playing games, a quick check of game-playing proclivity can reveal if a source looks mainstream or more skewed. This is particularly compelling for research in the video game category, but sample sources where larger numbers of people spend significant time gaming could signal other biasing characteristics.

Fully Transparent Supplier Scores

Supplier Scores: United States
December 12, 2022 – April 2, 2023

QScore

Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).

Acceptance

Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.

Consistency

Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research

SupplierQScoreAcceptanceConsistency
AdGate Media**92.82-1.465586446394.25
Attapoll~~**91.060.487660155694.61
Besitos Corporation92.16-0.095724202595.59
Bitburst~*91.60-1.697803644595.79
BizRate88.520.4864866846
Bovitz~*93.87-0.2633403766
Branded Research~*95.740.384681920987.35
Centiment~~**94.110.442886542174.21
Consultancy Services LLC~~**92.960.701268639387.42
CrowdNautics, Inc.~~88.470.1328220070
Dalia Research~**90.38-2.109588699495.92
Decision Analyst**92.240.651898909981.77
DISQO~*93.690.199685407791.03
Embee Mobile~82.2190.29
Gamekit92.640.159257286495.56
General Research Lab~~**89.580.197090441796.98
iAngelic Research~*91.950.286302282295.54
InboxDollars~**94.05-0.264157679286.26
inBrain.ai~**88.60-0.321393315290.23
inMarket~~80.330.3841862133
ISA (MySoapBox)~~**90.750.711543364482.55
ITC94.440.503092244492.17
Logit*88.170.499545880391.30
Make Opinion GmbH~*93.83-0.182457845497.19
MarketCube84.8183.74
MARU Group (SA)~~**92.34-0.1457122132
MindField Research~~**93.2175.22
My Cashew~~**87.640.169982314889.59
MyPoints~~94.230.125853907928.87
On Device Research92.590.490112172693.55
Opinion Capital~~91.63
Point Club92.20-1.413036459091.76
Prodege~**94.260.125853907975.47
Publishers Clearing House~~**90.450.472311632093.13
PureSpectrum~91.95
Qmee~90.990.679103402195.34
Rakuten Insight~~**92.720.6755237590
Research for Good (SS)92.640.1407861317
Revenue Universe91.44-0.118060654187.95
Rewardia~~**94.000.3342969870
Screen Engine/ASI~~**95.190.553673664096.28
SocialLoop*90.860.238281403195.23
Survey Everyone~~**90.980.3891163282
Tap Research*89.140.118752877493.90
TapJoy~90.390.652870977590.62
Tellwut~~**92.120.427329358492.06
TheoremReach89.60-0.731471178396.07
Three Hyphens93.650.741952217595.96
URWelcome Technologies*92.990.689642636994.80
Vetri Foundation91.960.449955988597.14
On the Score sheets for each country, the following applies:
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target

Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight

Supplier Scores: Australia
12 December 2022 – 02 April 2023 

QScore

Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).

Acceptance

Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.

Consistency

Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research

SupplierQScoreAcceptanceConsistency
AdGate Media~~87.48-0.127941883291.97
Attapoll~~**95.390.460287956292.87
Bitburst~*93.48-0.079431390488.93
ClixSense~~90.050.078420337190.41
Competition Panel~93.010.489736820593.42
Dale Network~88.400.418536195191.32
Dalia Research~~*90.44-0.293774701387.75
DISQO~91.92-0.702816670392.98
GMO Research~**93.090.481556527290.27
GrowthOps~~**90.5690.27
iAngelic Research91.490.3402788296
inBrain.ai~*91.43-0.175116916594.95
Make Opinion GmbH~93.720.342589658695.23
MarketCube90.7090.13
On Device Research93.300.404066175797.20
Persona.ly92.290.686670966793.46
Point Club91.39-2.019118193392.36
Prodege95.010.521880056485.11
Qmee93.680.394987824595.40
Research for Good (SS)90.27-0.3612604539
Research on Mobile~~**89.28-1.5287583511
Researchify Pty Ltd~~90.170.471051931180.47
Revenue Universe~~**88.080.089504824992.73
Rewardia~~**93.200.454972243990.65
Tap Research~*88.410.226201791889.11
TapJoy~89.45-2.017339417492.00
TheoremReach~89.65-1.627045447493.60
Titan~~84.08
On the Score sheets for each country, the following applies:
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target

Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight

Supplier Scores: Brazil
12 December 2022 – 02 April 2023 

QScore

Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).

Acceptance

Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.

Consistency

Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research

SupplierQScoreAcceptanceConsistency
A-K International~*92.640.315604268296.61
AdGate Media~**91.920.741422192096.76
Attapoll~*93.010.179138476494.27
Bitburst~*93.590.231493583293.41
ClixSense~**93.640.308376995793.38
Dale Network~*91.01-0.157730806994.48
Dalia Research~*91.92-0.152472979497.56
Dayos~~91.31-0.006409712197.87
General Research Lab~~*92.95-0.3658371572
inBrain.ai~*92.200.242560658095.40
Innovative Hall~92.950.0518837703
Make Opinion GmbH~~*93.740.295607643797.57
Market Agent~*93.700.746793276295.91
MarketCube*92.3295.25
Mo Web92.660.317070340592.28
Neobux~92.56-0.797863279995.77
On Device Research93.330.266131770593.15
Opinaia Panel**91.200.083578244590.26
Persona.ly*93.510.370630191196.92
Point Club~94.3396.38
Prodege**93.550.341813015491.76
Research for Good (SS)91.25
Research on Mobile~~**89.93-1.386161032093.50
Revenue Universe~91.150.018552432990.12
Tap Research**89.82-0.331327656994.63
TapJoy~~91.750.913703445587.62
TheoremReach91.660.170535826394.60
On the Score sheets for each country, the following applies:
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target

Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight

Supplier Scores: Canada
2022 December 12 – 2023 April 02

QScore

Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).

Acceptance

Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.

Consistency

Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research

SupplierQScoreAcceptanceConsistency
A-K International~~92.200.186473774392.80
AdGate Media~89.99-1.569816896195.19
Attapoll~**92.540.304511246295.58
Bitburst89.860.041516642497.55
Branded Research95.750.333530251895.96
ClixSense~~*92.560.320595255693.86
Dale Network86.01-0.015790765192.38
Dalia Research87.09-2.552724017985.47
Decision Analyst~~92.860.537165523891.95
DISQO91.870.337662378396.35
FeedSurvey~~86.54
General Research Lab~~88.8989.60
iAngelic Research91.21-0.572915166094.81
InboxDollars (DR)92.870.406788148892.03
inBrain.ai~*92.060.309168637193.73
ITC94.181.034448159296.31
Juyanba~~81.0992.23
Logit92.490.400208519093.69
Make Opinion GmbH93.370.271913855094.90
MarketCube88.3689.87
MARU Group~**92.750.331780207992.87
MyPoints~~92.070.3021568935
On Device Research90.53
Persona.ly~*92.790.491717545193.88
Point Club91.91-3.156122312292.43
Prodege~94.240.302156893595.31
Qmee93.930.317740737195.84
Research for Good (SS)~92.420.660647866391.09
Research on Mobile~~83.99-2.248835201583.34
Revenue Universe90.190.244908155096.52
Splendid Research~~**91.790.360640000192.26
Survey Everyone88.940.7468233979
Tap Research88.160.120420723194.96
TapJoy90.33-0.124035896595.60
Tellwut~*91.930.354253880595.87
TheoremReach~**91.11-0.735534134394.53
On the Score sheets for each country, the following applies:
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target

Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight

Supplier Scores: China
12 December 2022 – 02 April 2023 

QScore

Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).

Acceptance

Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.

Consistency

Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research

SupplierQScoreAcceptanceConsistency
Beijing Youli Technology Co., Ltd.84.00-0.369247235097.09
ClixSense~~**88.65-1.215663597894.52
Dalia Research~~*88.500.405305416890.65
Data100*90.620.410631129195.83
DataSpring*91.481.119925235493.92
GMO Research90.871.124157421295.17
Ignite Vision~~**92.181.092316898984.29
Insight Works89.620.470484175292.14
Interface Asia~~87.8286.60
Juyanba~84.770.971853325898.34
KuRunData~*90.211.055177101196.38
Maiwen China*89.070.515507086493.57
Make Opinion GmbH~~**89.28-1.905208043277.63
MarketCube~**88.9183.39
MDQ~~**89.370.241719155988.42
Prodege~~**90.96-1.877461566696.44
Research for Good (SS)91.1292.52
Revenue Universe~~82.23-0.951542253378.54
SampleBus Market Research Service Ltd87.32-0.504250685892.25
Tap Research~~**84.96-0.302344627883.73
TapJoy~~**84.31-0.767191460791.36
TheoremReach~~**86.88-0.159815377289.94
On the Score sheets for each country, the following applies:
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target

Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight

Supplier Scores: France
12 December 2022 – 02 April 2023 

QScore

Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).

Acceptance

Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.

Consistency

Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research

SupplierQScoreAcceptanceConsistency
A-K International~~**89.480.245176993896.78
AdGate Media~87.040.139667718895.59
Attapoll~~**88.640.334527378295.24
Bitburst87.440.232451938095.45
ClixSense~~*90.800.391354287596.67
CreOnline~*89.140.274891885388.73
Dalia Research87.540.197196057590.83
Decision Analyst~~**89.700.100977143179.21
Devola88.4393.99
Gaddin.com91.250.262095972393.74
Gamekit84.510.436974173592.31
General Research Lab88.07-2.039510818095.73
Hiving~~**92.030.293059268972.08
inBrain.ai89.330.301647472794.77
JS Media / Moolineo89.720.293960261495.74
Make Opinion GmbH90.130.241944007195.94
Market Cube~*86.6785.05
Mo Web*88.860.220151029491.38
Neobux~~88.050.486727027397.93
On Device Research~*88.180.191951041895.95
Persona.ly~*88.810.256326673195.06
Point Club~~87.600.191405308491.98
Prodege~*90.600.298787739294.20
Qmee87.280.2260221800
Research on Mobile~~85.48-1.901140534092.05
Revenue Universe~~**87.640.225093831094.03
Surveoo~**90.020.331577883597.39
Tap Research87.820.194386208189.28
TapJoy~~86.760.070920086391.09
TheoremReach~89.950.278197138794.28
Trial Panel~~**88.050.271602302691.88
On the Score sheets for each country, the following applies:
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target

Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight

Supplier Scores: Germany
12 December 2022 – 02 April 2023 

QScore

Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).

Acceptance

Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.

Consistency

Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research

SupplierQScoreAcceptanceConsistency
A-K International~~90.04-0.229503176285.42
AdGate Media~89.59-1.192255376591.95
Almedia AG~~87.99
Appinio~90.2392.85
Attapoll~~**93.400.566910921295.95
Bitburst~*91.51-0.038474171393.60
ClixSense~~**91.890.737443890391.18
Dale Network~**86.73-0.350802129589.35
Dalia Research89.47-1.145769756390.59
Decision Analyst~~87.360.745397549379.49
General Research Lab~~89.07
Hiving~~89.170.580425921682.21
inBrain.ai~**91.73-0.079775931694.34
Liidimedia oy*92.460.436578435095.21
Logit~*89.300.6822049930
Make Opinion GmbH~*94.230.279437794794.21
Market Agent ~*92.530.481847154391.87
MarketCube86.1478.42
Mo Web~*91.100.434986003191.82
On Device Research~~*92.200.369382649796.64
Opinion Capital~~89.7384.42
Panel Inzicht~~87.8073.05
Persona.ly~*90.440.736790927093.49
Point Club~~91.500.490012163392.85
Prodege94.610.539415405396.77
Promio~~**92.400.538458159780.72
Research for Good (SS)~90.940.310168289988.78
Research on Mobile~89.53-1.626124875395.08
Revenue Universe~86.8488.93
Splendid Research~92.970.050846231496.03
Tap Research~**88.67-0.579106819694.64
TapJoy~~87.02-0.925445034091.35
TheoremReach90.59-0.589758208391.75
Untiedt~~**88.500.418985222591.82
Vetri Foundation~*91.330.6075737930
On the Score sheets for each country, the following applies:
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target

Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight

Supplier Scores: India
2022 December 12 – 2023 April 02

QScore

Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).

Acceptance

Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.

Consistency

Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research

SupplierQScoreAcceptanceConsistency
A-K International89.490.8770937773
AdGate Media~~84.62-1.693045211296.85
Attapoll~~**89.130.412157849495.47
Australian Clearing Pty Ltd~~**89.5897.68
Bitburst~~**89.970.167000546294.01
ClixSense~~**90.880.192640477591.83
Crownit-Link86.67
Dalia Research~81.06-1.053236771494.32
Expresso82.57-1.2490294399
General Research Lab~~86.18-1.079397834990.20
GMO Research~~**89.421.116445214289.80
inBrain.ai~~**89.600.199694452094.54
Innovative Hall87.5191.48
IPRoyal~~**88.550.4717812786
Make Opinion GmbH~*89.030.259219351396.76
MarketCube87.8496.45
MarketXcel~~87.131.798963395790.98
Neobux~**90.45-0.230765316792.57
Opinion Capital~~86.1595.60
Persona.ly~~**92.190.937568692797.20
Point Club81.66-2.222935501297.47
Poll Pronto~~90.4590.02
Pollfish~~**88.340.5067402246
Prodege~~**91.090.464210577492.44
Purely Research~~**89.490.5856658202
Research on Mobile~~**89.93-3.484146128393.47
Revenue Universe~~**90.73-0.783812229396.35
Tap Research~~**88.840.270044483690.76
TheoremReach~87.920.289578892494.18
On the Score sheets for each country, the following applies:
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target

Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight

Supplier Scores: Italy
12 December 2022 – 02 April 2023

QScore

Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).

Acceptance

Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.

Consistency

Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research

SupplierQScoreAcceptanceConsistency
A-K International~~**90.160.234507576986.16
AdGate Media~~86.35-0.429169962379.50
Attapoll92.840.353771778096.01
Bitburst92.300.176467392697.51
ClixSense~**93.270.326369559095.16
CreOnline~~**93.190.247268621789.08
Dale Network~87.420.861756798591.65
Dalia Research~91.740.217328830495.85
Decision Analyst92.050.184123051192.79
Hiving~~91.300.310933626095.32
Make Opinion GmbH93.130.398144203293.69
Market Agent~89.670.7754267466
MarketCube92.1395.08
Mo Web~~**91.500.231049444692.21
Neobux~91.350.184123051194.20
On Device Research~89.760.230779065491.90
Persona.ly~*92.500.304927646396.46
Point Club91.030.184123051196.38
Poll Pronto~91.47
Prodege~*91.540.255728926692.63
Research on Mobile~~87.19-2.649177426094.77
Revenue Universe89.84-2.522441644592.62
Splendid Research~92.440.257384905794.66
Surveoo~*92.030.3325894939
Surveyeah92.120.264177363094.76
Tap Research90.210.127390118396.65
TapJoy~91.07-0.131608944494.25
TheoremReach91.580.299731296192.75
Untiedt~~89.66-0.170136358584.83
On the Score sheets for each country, the following applies:
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target

Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight

Supplier Scores: Japan
2022 December 12 – 2023 April 02

QScore

Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).

Acceptance

Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.

Consistency

Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research

SupplierQScoreAcceptanceConsistency
Bitburst~**90.12-0.322066488196.78
Cross Marketing Account~~**87.890.049231229880.21
Dalia Research91.700.173743151894.67
GMO Research~**89.50-0.021216421196.12
Make Opinion GmbH~~91.0194.73
MarketCube90.4392.05
Monitas (Gain, Inc.)~~**90.050.029374627488.96
Research for Good92.8586.07
Research on Mobile~~89.39-2.505999760296.27
Revenue Universe~~**88.19-0.129828129693.44
Tap Research~~**89.42-0.406042555094.28
TapJoy90.91-0.308477127196.18
TheoremReach~~**91.51-1.801099688586.09
On the Score sheets for each country, the following applies:
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target

Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight

Supplier Scores: Mexico
12 December 2022 – 02 April 2023 

QScore

Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).

Acceptance

Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.

Consistency

Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research

SupplierQScoreAcceptanceConsistency
A-K International*93.340.347964350796.29
Attapoll~**92.580.378471113997.47
Bitburst~~*91.600.203595103294.73
ClixSense~*94.760.197603072698.04
Dale Network~~**92.300.335576364092.62
Dalia Research~~**92.150.084837288890.78
inBrain.ai~~**91.960.442861552694.59
Innovative Hall~~92.650.570021242494.41
Make Opinion GmbH~*92.970.001748029394.70
MarketCube~~*91.9094.89
Mo Web93.080.190572716093.52
Neobux~~94.250.640541377992.77
Opinaia Panel91.90-1.192356908094.16
Persona.ly~*93.480.303886038495.43
Point Club~~92.6794.18
Prodege~~**92.760.303695176993.61
Research for Good (SS)~92.3194.98
Research on Mobile~~89.12-1.035061508492.17
Revenue Universe~~**86.82-0.329726884783.72
Splendid Research92.510.676928898896.31
Tap Research~~**89.000.199160280497.30
TapJoy~89.760.265318710190.70
TheoremReach~91.880.535394080296.25
On the Score sheets for each country, the following applies:
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target

Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight

Supplier Scores: Netherlands
12 December 2022 – 02 April 2023 

QScore

Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).

Acceptance

Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.

Consistency

Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research

SupplierQScoreAcceptanceConsistency
AdGate Media~~81.3381.24
Attapoll88.900.099151488195.94
Bitburst~*90.120.180077318491.24
ClixSense~~92.1192.87
Dale Network~~85.19-0.016945217191.99
Dalia Research86.650.146939030094.08
Make Opinion GmbH90.300.035661397691.65
MarketCube89.8193.64
Pabble B.V.90.3495.33
Panel Inzicht~~90.9879.26
Persona.ly~~**90.170.218082995189.77
Point Club87.970.009908987491.38
Prodege~~**91.350.255089222291.93
Research on Mobile~~81.99-2.012936118994.11
Revenue Universe~~**85.720.077456363995.00
Tap Research87.8497.20
TapJoy*85.42-3.675640056090.97
TheoremReach~~**88.37-1.818680755493.83
On the Score sheets for each country, the following applies:
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target

Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight

Supplier Scores: Russia
12 December 2022 – 02 April 2023

QScore

Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).

Acceptance

Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.

Consistency

Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research

SupplierQScoreAcceptanceConsistency
A-K International~~**92.180.095988716494.36
AdGate Media~**87.13-0.392298990290.99
Amry Research~92.0094.15
Attapoll~~90.9493.86
Bitburst~**89.380.049287420590.93
ClixSense~~91.830.112438490095.79
Dalia Research~*89.310.631419491591.42
Make Opinion GmbH~91.780.353883910297.01
Marketagent93.24-0.462497571397.60
MarketCube~90.9695.38
Mo Web~*91.060.237478291295.03
Neobux~~93.150.095199582291.49
Persona.ly~~*91.070.475538803396.82
Point Club~92.3593.93
Prodege~91.020.898208673593.78
Research on Mobile~~**88.350.612850618090.08
Survey Everyone~~91.3693.20
TheoremReach~*90.69-0.380795852993.70
Tiburon Research91.61
YouThink.io~92.45-0.109868603288.62
On the Score sheets for each country, the following applies:
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target

Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight

Supplier Scores: Spain
12 December 2022 – 02 April 2023

QScore

Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).

Acceptance

Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.

Consistency

Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research

SupplierQScoreAcceptanceConsistency
A-K International~93.110.133907740388.33
AdGate Media~~90.03-0.688225830592.08
Attapoll~*93.400.267831885096.30
Bitburst~*92.880.143341046396.47
ClixSense~93.920.149217882593.91
CreOnline~~93.120.230676272487.02
Dale Network92.540.443718550288.83
Dalia Research~*90.230.095139151990.10
Decision Analyst~~93.19-0.231783565895.05
Gaddin.com93.91-0.083320595795.52
General Research Lab*93.14-3.213221938792.79
Hiving92.550.000201752696.35
inBrain.ai92.930.266728909295.57
Innovative Hall~93.260.121317458291.54
Make Opinion GmbH94.470.318781114994.01
Market Agent94.322.563645881492.40
MarketCube~94.2793.72
Mo Web~92.45-0.103949793493.13
Neobux~93.77-0.278253485495.76
On Device Research~94.320.097202190994.73
Persona.ly~93.300.447618729996.07
Point Club~94.8092.54
Prodege~*94.010.067211258094.63
Research on Mobile~~90.78-4.036514085492.96
Revenue Universe~~**91.24-0.649781382294.92
Splendid Research~93.910.342663153992.52
Surveoo93.840.359194705994.36
Surveyeah~95.250.4440211645
Tap Research~~90.920.055414329586.18
TapJoy~~90.21-0.621135351189.41
TheoremReach91.870.300665125493.75
On the Score sheets for each country, the following applies:
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target

Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight

Supplier Scores: United Kingdom
12 December 2022 – 02 April 2023 

QScore

Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).

Acceptance

Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.

Consistency

Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research

SupplierQScoreAcceptanceConsistency
A-K International89.080.455907956894.52
AdGate Media88.82-3.112787002395.24
Attapoll~*92.630.502931570594.58
Bitburst~*90.190.041804354994.91
Branded Research~*94.880.517922789796.76
ClixSense90.40-0.597351165096.01
Dalia Research~~87.5895.24
Dayos93.480.7770127338
Decision Analyst~~91.280.564135024290.50
DISQO~*90.28-3.0060942324
Expresso88.88
General Research Lab~~90.0993.29
Hiving~~87.710.792487906481.63
iAngelic Research~~90.570.269220094490.63
Inbox Dollars (UK)~91.240.745714895591.87
inBrain.ai~*88.780.313220197395.26
Innovative Hall89.20
Liidimedia oy~*92.420.394843216289.63
Logit91.721.267518371492.37
Lux Surveys~~92.3186.85
Make Opinion GmbH*90.400.124836747497.95
MarketCube~91.5696.27
MindMover~~**91.141.155896829282.30
Mirats Insights~65.880.2777391534
Mo Web~~**89.510.561281042195.40
MVUK - Kato~~91.4787.87
On Device Research~*90.840.458296516194.07
Persona.ly~~*92.07-0.469143389295.05
Pick Media Ltd~~**93.420.531892813991.73
Point Club~89.96-1.784378157194.35
Prodege~~*94.470.617795266594.35
Qmee90.910.440016040692.20
Research for Good (SS)~90.170.099708667397.08
Revenue Universe*88.550.020104251388.95
SocialLoop~**88.220.2175171781
Splendid Research~*90.960.582347571094.10
Survey Everyone89.45
Tap Research~*87.27-0.322050421596.81
TapJoy~89.00-0.355620530994.75
TheoremReach90.43-1.393662044493.21
Vetri Foundation~~**91.660.589774396292.59
On the Score sheets for each country, the following applies:
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target

Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight

Supplier Scores: South Korea
12 December 2022 – 02 April 2023

QScore

Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).

Acceptance

Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.

Consistency

Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research

SupplierQScoreAcceptanceConsistency
Bitburst~~**88.560.353311370191.66
ClixSense~~94.630.0775177173
Dalia Research~86.23-0.833863423190.20
DataSpring89.490.707134330697.52
GMO Research89.920.670600669394.94
Make Opinion GmbH89.520.683361121895.76
MarketCube~~88.28
MarketLink90.150.262628785796.79
Neobux~~**91.930.052406486095.49
Panel Marketing Interactive89.41
Persona.ly~~**92.560.718825912195.02
Prodege~~92.090.281856215795.37
Research on Mobile~~83.61-1.701254337391.12
Revenue Universe~~**81.76-0.455655949992.17
Tap Research~~87.53-0.946758268088.81
TapJoy~**86.23-0.165855354194.35
TheoremReach~~**85.49-0.190206556695.99
On the Score sheets for each country, the following applies:
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target

Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight