The Science Behind Quality Scoring
We conduct a rigorous assessment of our supply partners that is designed to provide customers (sample buyers) with insight into their sample quality. All eligible supply partners are required to participate in the program.
After being evaluated, supply partners are issued a QScore, Acceptance Score, and Consistency Score.
QScore
Even when demographics are matched precisely, latent or unseen characteristics can influence data outcomes – and the degree of influence is driven by the subject matter of the survey. Our program monitors respondent values and behaviors, with regard to specific subject matter, so it can be managed by sample buyers
Acceptance
Acceptance Score measures the acceptance rate of survey completes for individual supply partners. “Acceptance” refers to completes that meet buyers’ quality standards and, as a result, are accepted by those buyers. To define a benchmark for acceptance, a weighted average of all accepted completes in the Lucid Marketplace is measured. Then, to calculate Acceptance Score, individual supply partners’ completes are measured against each other, at the project level, to determine how close they are to that benchmark.
Consistency
Consistency Score measures a supply partner’s composition from quarter to quarter. “Composition” is the balance of respondent preferences and opinions within a given panel. These attitudinal responses are determined by respondents’ brand affinity, value-seeking behavior, technology adoption, movie and music usage, and gaming activities. Measuring composition can help researchers with tracking research.
Minimizing Sample Bias
To get accurate data, researchers must take great care to apply quotas – helping to prevent bias from over/under representation of certain groups. Similar care should be taken to manage latent sample characteristics, which are inherent in sample sources (due to differences in respondent recruitment strategies).
Even when demographics are matched precisely, latent or unseen characteristics can influence data outcomes – and the degree of influence is driven by the subject matter of the survey. Our program monitors respondent values and behaviors, with regard to specific subject matter, so it can be managed by sample buyers.
A common objective of survey research is to measure the performance and impact of brands. By selecting sample sources that do not skew too brand-favorable or averse, clients can get the best reads on their brands. Lucid regularly creates sample blends that can mitigate this potential source of bias.
People who are avid, early adopters of technology tend to have different attitudes around innovation and change than the general population. Using a sample source that skews too tech savvy or laggard can bias research outcomes – especially if the study is related to technology. Scoring sample sources on tech usage helps inform buyers so pitfalls can be avoided.
For entertainment research in particular, obtaining sample that skews too heavy or light in terms of media consumption can bias results. This dimension varies greatly among those who otherwise appear similar demographically – some people simply don’t listen to music or watch many movies. Understanding the tendencies of certain sample sources helps prevent research missteps.
Since some sample sources incentivize respondents in currencies used for playing games, a quick check of game-playing proclivity can reveal if a source looks mainstream or more skewed. This is particularly compelling for research in the video game category, but sample sources where larger numbers of people spend significant time gaming could signal other biasing characteristics.
Fully Transparent Supplier Scores
Supplier Scores: United States
September 12, 2022 – January 1, 2023
QScore
Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).
Acceptance
Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.
Consistency
Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research
| Supplier | QScore | Acceptance | Consistency |
|---|---|---|---|
| AdGate Media | 92.82 | -1.8648732149 | 94.25 |
| Attapoll~~** | 92.68 | 0.4129989100 | 95.95 |
| Besitos Corporation~* | 92.25 | -0.0129840583 | 94.50 |
| Bitburst~* | 91.09 | -0.4391616639 | 97.26 |
| BizRate | 88.52 | 0.5250044780 | |
| Bovitz~~** | 93.89 | -0.5279299785 | |
| Branded Research~~** | 92.33 | 0.3870719295 | 95.74 |
| Centiment~~** | 96.76 | 0.5009209662 | 74.21 |
| Consultancy Services LLC~~** | 92.81 | 0.6405162850 | 86.86 |
| CrowdNautics, Inc.~~ | 88.47 | -0.1047429953 | |
| Dalia Research | 89.05 | -3.2051544000 | 95.92 |
| Decision Analyst | 92.24 | 0.5859194321 | 81.77 |
| DISQO~* | 91.23 | -0.5938799603 | 94.71 |
| Embee Mobile~** | 82.21 | 0.4874454345 | 90.29 |
| Gamekit | 92.25 | 0.2511999014 | 95.12 |
| General Research Lab~* | 90.63 | 0.2727970426 | 92.47 |
| iAngelic Research~** | 92.42 | 0.0849146063 | |
| InboxDollars~** | 94.05 | -0.1644514028 | 92.56 |
| inBrain.ai~* | 86.22 | -0.6795523504 | 90.94 |
| inMarket~~ | 80.33 | 0.1755672169 | |
| ISA (MySoapBox)~~** | 91.17 | 0.6683953561 | 91.02 |
| ITC~ | 91.73 | 0.8619088246 | 92.17 |
| Logit~~* | 91.29 | 0.0058014886 | |
| Make Opinion GmbH~~** | 90.86 | 0.1144776973 | 96.27 |
| MarketCube~** | 87.98 | 0.0000000000 | 92.56 |
| MARU Group (SA) | 93.02 | 0.2968340464 | |
| MindField Research~~ | 90.69 | 0.0000000000 | 75.22 |
| My Cashew~~** | 88.29 | -0.1068499244 | |
| MyPoints~~ | 94.23 | 0.3357477462 | 28.87 |
| On Device Research~ | 91.68 | 0.3975351364 | 91.19 |
| Opinion Capital~~ | 91.63 | 0.0000000000 | |
| Point Club~ | 93.73 | -2.7167774565 | 91.76 |
| Prodege~~ | 94.67 | 0.3357477462 | 94.16 |
| Publishers Clearing House~~** | 85.50 | 0.4498320628 | 89.60 |
| PureSpectrum~ | 91.95 | 0.0000000000 | |
| Qmee~* | 90.99 | 0.5294028850 | 95.34 |
| Research for Good (SS) | 92.64 | -1.1925044528 | |
| Revenue Universe | 89.65 | -0.7321737606 | 87.95 |
| Screen Engine/ASI~~ | 94.53 | -0.2831163464 | 96.28 |
| SocialLoop~* | 90.01 | 0.0874100257 | 95.38 |
| Tap Research | 84.80 | 0.0903241703 | 90.61 |
| TapJoy~* | 90.39 | 0.6839788849 | 90.62 |
| Tellwut~~** | 92.42 | 0.3008375144 | 72.32 |
| TheoremReach | 89.60 | -1.0548918963 | 96.07 |
| Three Hyphens~ | 93.17 | 0.5827342812 | |
| URWelcome Technologies~* | 92.08 | 0.6394464646 | 96.18 |
| Vetri Foundation~* | 92.48 | 0.2776411067 | 97.14 |
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target
Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight
Supplier Scores: Australia
12 September 2022 – 1 January 2023
QScore
Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).
Acceptance
Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.
Consistency
Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research
| Supplier | QScore | Acceptance | Consistency |
|---|---|---|---|
| AdGate Media~~ | 87.48 | -0.4027022605 | 91.97 |
| Attapoll~~** | 94.55 | 0.3140861817 | 93.39 |
| Bitburst~* | 93.00 | -0.5396835539 | 96.76 |
| ClixSense~~ | 90.05 | 0.2889958523 | 90.41 |
| Competition Panel~** | 93.01 | 0.4465553565 | 93.42 |
| Dale Network~* | 83.88 | 0.1252095936 | 91.32 |
| Dalia Research~~** | 90.44 | -0.5907423311 | 87.75 |
| DISQO | 89.75 | -0.4925820977 | 96.52 |
| GMO Research* | 93.04 | 0.2513383711 | 68.20 |
| GrowthOps~~** | 90.85 | 0.0000000000 | 87.70 |
| iAngelic Research | 91.49 | -0.2763176772 | |
| inBrain.ai~~* | 91.67 | -1.0082423072 | 92.70 |
| Make Opinion GmbH~* | 91.52 | 0.1698529006 | 93.31 |
| MarketCube~* | 90.73 | 0.0000000000 | 91.01 |
| On Device Research~~** | 92.48 | -0.1927534377 | 94.24 |
| Persona.ly | 92.29 | 0.0532039343 | 93.46 |
| Point Club | 91.39 | 92.36 | |
| Prodege | 94.36 | 0.2821409413 | 97.03 |
| Qmee | 93.68 | 0.1118691367 | 95.40 |
| Research for Good (SS) | 90.27 | -0.6636781185 | |
| Research on Mobile~~ | 89.28 | 0.0454996492 | |
| Researchify Pty Ltd~~ | 90.17 | 3.0204639159 | 80.47 |
| Revenue Universe~* | 87.32 | -0.3382710637 | 95.43 |
| Rewardia~* | 91.81 | 0.2373257569 | 95.15 |
| Tap Research~* | 87.28 | -0.2106047019 | 90.87 |
| TapJoy~* | 89.45 | 0.0765127350 | 92.00 |
| TheoremReach~* | 89.65 | 0.0269235583 | 93.60 |
| Titan~~ | 84.08 | 0.0000000000 |
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target
Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight
Supplier Scores: Brazil
12 September 2022 – 1 January 2023
QScore
Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).
Acceptance
Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.
Consistency
Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research
| Supplier | QScore | Acceptance | Consistency |
|---|---|---|---|
| A-K International* | 92.75 | 0.9104173156 | 95.87 |
| AdGate Media~* | 91.92 | 0.0426104297 | 96.76 |
| Attapoll | 92.57 | -0.2049485433 | 94.75 |
| Bitburst | 92.13 | 0.2811743086 | 95.62 |
| ClixSense | 94.00 | -0.0039037425 | 97.35 |
| Dale Network | 89.42 | -0.4644152843 | 96.98 |
| Dalia Research | 93.10 | -0.8560103509 | 96.18 |
| Dayos~~ | 91.31 | 0.0731514218 | 97.87 |
| inBrain.ai | 92.73 | 0.3205134651 | 97.06 |
| Innovative Hall~** | 92.95 | -0.8320830332 | |
| Make Opinion GmbH | 93.37 | 0.3879525408 | 94.64 |
| Market Agent | 92.88 | 0.8291060043 | 95.91 |
| MarketCube | 92.32 | 0.0000000000 | 92.48 |
| Mo Web | 92.66 | 2.0924389003 | 92.28 |
| Neobux~ | 92.56 | 1.4908380167 | 95.77 |
| On Device Research | 93.33 | 0.4759065627 | 93.15 |
| Opinaia Panel | 91.20 | -0.4602979041 | 95.56 |
| Persona.ly | 93.80 | 0.4483462746 | 95.46 |
| Point Club~ | 94.33 | 96.38 | |
| Prodege | 93.55 | -0.2635660352 | 93.85 |
| Research for Good (SS) | 91.25 | ||
| Research on Mobile~~ | 89.93 | -0.1717621822 | 93.50 |
| Revenue Universe~* | 91.15 | -1.0456624654 | 97.91 |
| Tap Research | 89.82 | -1.9926629187 | 91.69 |
| TapJoy~~ | 91.75 | 0.0857745164 | 87.62 |
| TheoremReach | 91.66 | -0.2987301263 | 94.60 |
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target
Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight
Supplier Scores: Canada
2022 September 12 – 2023 January 01
QScore
Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).
Acceptance
Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.
Consistency
Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research
| Supplier | QScore | Acceptance | Consistency |
|---|---|---|---|
| A-K International~~** | 93.18 | -0.0320400706 | |
| AdGate Media~* | 89.99 | -1.3141709873 | 95.19 |
| Attapoll* | 90.63 | 0.2081068193 | 89.45 |
| Bitburst | 89.77 | -0.1151456574 | 95.39 |
| Branded Research | 95.15 | 0.3476170331 | 96.63 |
| ClixSense~** | 92.80 | 0.0020110247 | 93.30 |
| Dale Network | 82.92 | 0.1481491396 | 95.16 |
| Dalia Research | 86.72 | -3.6085313189 | 90.16 |
| Decision Analyst~~ | 92.86 | 0.4983581633 | 91.95 |
| DISQO | 92.94 | 0.2868939362 | 95.71 |
| FeedSurvey~~ | 86.54 | 0.0000000000 | |
| General Research Lab~~ | 88.89 | 0.0000000000 | 89.60 |
| iAngelic Research | 91.21 | -0.3987109032 | 94.81 |
| InboxDollars (DR) | 93.39 | 0.0871389898 | 94.27 |
| inBrain.ai | 91.95 | -0.0892921957 | 89.88 |
| ITC | 94.19 | 1.0537243976 | 93.63 |
| Juyanba~~ | 81.09 | 0.0000000000 | 92.23 |
| Logit | 93.81 | 0.3696689843 | |
| Make Opinion GmbH | 92.05 | 0.1435808753 | 96.54 |
| MarketCube | 89.58 | 0.0000000000 | 97.18 |
| MARU Group~* | 92.04 | 0.3112925589 | 85.76 |
| MyPoints~~ | 92.07 | 0.1672269548 | |
| On Device Research | 90.53 | 0.0000000000 | |
| Persona.ly* | 91.83 | 0.3761553964 | |
| Point Club | 91.91 | 92.43 | |
| Prodege | 94.28 | 0.1672269548 | 96.98 |
| Qmee | 93.93 | 0.1727810105 | 95.84 |
| Research for Good (SS)~ | 92.42 | 0.8216198090 | 91.09 |
| Research on Mobile~~ | 83.99 | -0.0804304631 | 83.34 |
| Revenue Universe | 90.33 | -0.1365143806 | 93.85 |
| Splendid Research | 91.05 | 0.3032366759 | 92.26 |
| Survey Everyone | 88.94 | 0.6445645552 | |
| Tap Research | 89.39 | -0.0709662878 | 95.67 |
| TapJoy | 90.33 | 0.2174338945 | 95.60 |
| Tellwut | 92.21 | 0.2808275330 | 91.44 |
| TheoremReach | 91.27 | -0.1133409720 | 94.53 |
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target
Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight
Supplier Scores: China
12 September 2022 – 1 January 2023
QScore
Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).
Acceptance
Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.
Consistency
Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research
| Supplier | QScore | Acceptance | Consistency |
|---|---|---|---|
| Beijing Youli Technology Co., Ltd.* | 84.04 | -0.3964505740 | 97.09 |
| ClixSense~~** | 88.55 | -0.3676457404 | 94.52 |
| Dalia Research~~* | 88.50 | 0.0301376471 | 90.65 |
| Data100~** | 91.03 | -0.2244441068 | 95.83 |
| DataSpring* | 91.31 | -0.0450808709 | 90.97 |
| GMO Research | 90.91 | 0.0725305889 | 98.45 |
| Ignite Vision~~** | 91.90 | 0.0709334824 | 84.29 |
| Insight Works* | 89.34 | -0.0987863037 | 92.14 |
| Interface Asia~~ | 87.82 | 86.60 | |
| Juyanba~ | 84.77 | 0.0766048564 | 98.34 |
| KuRunData~* | 90.34 | 0.0678962821 | 93.64 |
| Maiwen China* | 88.88 | -0.0431210679 | 93.57 |
| Make Opinion GmbH~~** | 87.44 | -0.5710995573 | 77.63 |
| MarketCube~** | 88.80 | 0.0000000000 | 83.39 |
| MDQ~~** | 89.32 | -0.5664994693 | 88.42 |
| Prodege~~** | 90.91 | -0.5577875926 | 84.83 |
| Research for Good (SS) | 91.12 | 0.0000000000 | 92.52 |
| Revenue Universe~~ | 82.23 | -0.1074739293 | 78.54 |
| SampleBus Market Research Service Ltd | 87.17 | -0.1779837843 | 92.25 |
| Tap Research~~** | 84.99 | -0.1704281753 | 83.73 |
| TapJoy~~** | 84.31 | -0.3625028320 | 91.36 |
| TheoremReach~~** | 86.94 | -0.1894225636 | 82.18 |
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target
Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight
Supplier Scores: France
12 September 2022 – 1 January 2023
QScore
Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).
Acceptance
Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.
Consistency
Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research
| Supplier | QScore | Acceptance | Consistency |
|---|---|---|---|
| A-K International~~ | 88.22 | 0.1077784505 | 81.70 |
| AdGate Media~* | 87.04 | -0.2925965548 | 95.59 |
| Attapoll~* | 87.81 | 0.3038431378 | 93.27 |
| Bitburst~* | 89.20 | 0.1049329258 | 93.89 |
| ClixSense~** | 90.33 | 0.5947993899 | 92.20 |
| CreOnline~* | 90.37 | 0.2678672892 | 93.63 |
| Dalia Research | 88.80 | 0.2680799991 | 96.41 |
| Decision Analyst~~** | 90.38 | 0.2152769489 | 79.21 |
| Devola | 88.43 | 0.0000000000 | 93.99 |
| Gaddin.com | 91.88 | 0.1104269939 | 95.65 |
| Gamekit | 84.51 | 0.4218522062 | 92.31 |
| General Research Lab | 88.44 | 0.1354581040 | |
| Hiving~* | 90.15 | 0.3458940487 | 72.08 |
| inBrain.ai | 88.41 | 0.2270187776 | 93.30 |
| JS Media / Moolineo | 89.91 | 0.1977422985 | 95.74 |
| Make Opinion GmbH | 88.02 | 0.1874388914 | 90.78 |
| Market Cube~~* | 90.33 | 0.0000000000 | 90.57 |
| Mo Web~* | 90.18 | 0.2953237127 | 91.38 |
| Neobux~~ | 88.05 | -0.4805051300 | 97.93 |
| On Device Research~* | 88.73 | -0.4135999070 | 93.97 |
| Persona.ly~* | 87.65 | -0.1130037656 | 95.06 |
| Point Club~~ | 87.60 | 91.98 | |
| Prodege~ | 90.29 | 0.3135041985 | 93.41 |
| Qmee | 87.28 | 0.1046180424 | |
| Research on Mobile~~ | 85.48 | 0.0788482223 | 92.05 |
| Revenue Universe~* | 84.51 | -0.0491826195 | 90.89 |
| Surveoo | 91.15 | 0.4582421340 | 93.46 |
| Tap Research | 88.53 | 0.0588169241 | 88.68 |
| TapJoy~~** | 86.76 | -0.0632934681 | 91.09 |
| TheoremReach~* | 89.95 | 0.2084334627 | 94.28 |
| Trial Panel~~** | 89.05 | 0.2551225466 | 91.88 |
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target
Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight
12 September 2022 – 1 January 2023
QScore
Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).
Acceptance
Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.
Consistency
Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research
| Supplier | QScore | Acceptance | Consistency |
|---|---|---|---|
| A-K International~~** | 90.04 | 0.3042972153 | 85.42 |
| AdGate Media~ | 89.59 | -2.0675946581 | 91.95 |
| Almedia AG~~ | 87.99 | 0.0000000000 | |
| Appinio~ | 90.23 | 0.0000000000 | 92.85 |
| Attapoll~~** | 93.39 | 0.4764244142 | 96.63 |
| Bitburst~* | 91.06 | -0.2747656458 | 94.74 |
| ClixSense~* | 91.84 | 0.5792926588 | 92.64 |
| Dale Network~~* | 82.35 | -0.5944321089 | 86.32 |
| Dalia Research | 89.42 | -0.4682450954 | 93.51 |
| Decision Analyst~~ | 87.36 | 0.3945808233 | 79.49 |
| General Research Lab~~ | 89.07 | 0.0000000000 | |
| Hiving~~ | 89.17 | 0.0900660695 | 82.21 |
| inBrain.ai~~** | 90.90 | -0.9424412601 | 94.32 |
| Liidimedia oy* | 91.49 | 0.4242375165 | 96.93 |
| Make Opinion GmbH | 93.26 | 0.1913646862 | 96.35 |
| Market Agent * | 92.17 | 0.4783540978 | 86.60 |
| MarketCube* | 90.54 | 0.0000000000 | 90.21 |
| Mo Web~~** | 89.88 | 0.3999628970 | 92.52 |
| On Device Research~* | 92.15 | 0.3935313278 | 92.64 |
| Opinion Capital~~ | 89.73 | 0.0000000000 | 84.42 |
| Panel Inzicht~~ | 87.80 | 0.0000000000 | 73.05 |
| Persona.ly~* | 90.59 | 0.4990394086 | 94.63 |
| Point Club~~ | 91.50 | 92.85 | |
| Prodege | 93.70 | 0.4656946071 | 87.32 |
| Promio~~** | 90.20 | 0.3947048831 | 62.58 |
| Research for Good (SS)~ | 90.94 | 1.0583880568 | 88.78 |
| Research on Mobile~* | 89.53 | -0.0651433723 | 95.08 |
| Revenue Universe~ | 86.84 | 88.93 | |
| Splendid Research~** | 92.97 | 0.2513230008 | 96.03 |
| Tap Research | 86.79 | -0.2655126733 | 93.82 |
| TapJoy~~** | 87.02 | -0.4531775594 | 91.35 |
| TheoremReach | 90.59 | -1.0473472502 | 91.75 |
| Untiedt~~** | 91.29 | 0.4142617181 | 85.70 |
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target
Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight
Supplier Scores: India
2022 September 12 – 2023 January 01
QScore
Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).
Acceptance
Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.
Consistency
Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research
| Supplier | QScore | Acceptance | Consistency |
|---|---|---|---|
| A-K International | 89.49 | 1.0239058488 | |
| AdGate Media~~** | 84.62 | -0.3168171725 | 96.85 |
| Attapoll~~** | 87.77 | 0.5053623196 | 95.59 |
| Australian Clearing Pty Ltd~** | 89.67 | 0.0000000000 | 94.06 |
| Bitburst~~** | 86.30 | 0.0105677062 | 96.97 |
| ClixSense~~** | 90.00 | 0.1443293741 | 96.74 |
| Crownit-Link | 86.67 | 0.0000000000 | |
| Dalia Research~* | 81.06 | -1.7092402735 | 94.32 |
| Expresso | 82.57 | -1.8131537665 | |
| General Research Lab~~** | 86.18 | -0.5993241345 | 90.20 |
| GMO Research~** | 89.85 | 0.9888927081 | 94.79 |
| inBrain.ai~~** | 89.51 | 0.2617907617 | 95.80 |
| Innovative Hall | 87.51 | 0.0000000000 | 91.48 |
| Make Opinion GmbH~~** | 86.72 | 0.1504641226 | 97.18 |
| MarketCube | 87.84 | 0.0000000000 | 96.45 |
| MarketXcel~~** | 87.13 | 0.8863585900 | 90.98 |
| Neobux~~** | 90.14 | -0.8009978436 | 92.57 |
| Opinion Capital~~ | 86.15 | 0.0000000000 | 95.60 |
| Persona.ly~~** | 90.64 | -1.5348335564 | 90.33 |
| Point Club | 81.66 | 0.0000000000 | 97.47 |
| Poll Pronto~~ | 90.45 | 0.0000000000 | 90.02 |
| Prodege~~** | 91.22 | 0.5113306728 | 93.29 |
| Research on Mobile~~** | 87.58 | 0.1634172500 | 93.47 |
| Revenue Universe~~** | 85.88 | -1.0347850236 | 95.57 |
| Tap Research~~** | 88.01 | 0.0704474966 | 95.36 |
| TheoremReach~* | 87.92 | 0.2590427980 | 94.18 |
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target
Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight
Supplier Scores: Italy
12 September 2022 – 1 January 2023
QScore
Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).
Acceptance
Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.
Consistency
Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research
| Supplier | QScore | Acceptance | Consistency |
|---|---|---|---|
| A-K International~~** | 90.50 | 0.1045064767 | 89.28 |
| AdGate Media~~ | 86.35 | -0.8960386635 | 79.50 |
| Attapoll | 92.59 | 0.1613038546 | 97.88 |
| Bitburst | 90.80 | 0.0430733359 | 92.84 |
| ClixSense | 92.23 | 0.1745398465 | 86.31 |
| CreOnline | 93.23 | 0.1743873663 | 95.02 |
| Dale Network~ | 87.42 | 0.8107478133 | 91.65 |
| Dalia Research~ | 91.74 | -0.4088931836 | 95.85 |
| Decision Analyst | 92.05 | 0.0897463438 | 92.79 |
| Hiving~~** | 91.30 | 0.3952464080 | 95.32 |
| Make Opinion GmbH | 92.22 | 0.1945473265 | 96.77 |
| Market Agent~ | 89.67 | 0.1619257990 | |
| MarketCube | 92.10 | 0.0000000000 | 93.19 |
| Mo Web~* | 91.83 | 0.0333310437 | 92.32 |
| Neobux~ | 91.35 | 0.9181082171 | 94.20 |
| On Device Research~* | 89.76 | -0.0979219713 | 91.90 |
| Persona.ly | 91.35 | 0.2820779860 | 95.70 |
| Point Club | 91.03 | 96.38 | |
| Poll Pronto~ | 91.47 | 0.0000000000 | |
| Prodege | 91.32 | 0.1552109552 | 90.09 |
| Research on Mobile~~ | 87.19 | -0.5198871473 | 94.77 |
| Revenue Universe | 88.28 | -3.0221468989 | 93.38 |
| Splendid Research~~ | 92.34 | 0.2619634914 | 94.66 |
| Surveyeah | 92.12 | 0.0417321763 | 94.76 |
| Tap Research | 89.81 | -0.0598010654 | 88.87 |
| TapJoy~ | 91.07 | -0.3129393584 | 94.25 |
| TheoremReach | 91.58 | -0.0048996503 | 92.75 |
| Untiedt~~** | 89.66 | -0.3055658042 | 84.83 |
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target
Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight
Supplier Scores: Japan
2022 September 12 – 2023 January 01
QScore
Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).
Acceptance
Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.
Consistency
Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research
| Supplier | QScore | Acceptance | Consistency |
|---|---|---|---|
| Bitburst~* | 88.83 | -0.7611848977 | |
| Cross Marketing Account | 88.57 | 0.2341929403 | 85.56 |
| Dalia Research* | 90.71 | -0.3140001321 | 90.07 |
| GMO Research | 91.31 | 0.1050359000 | 88.40 |
| Make Opinion GmbH~~** | 91.01 | -0.6223962947 | 94.73 |
| MarketCube~* | 90.57 | 0.0000000000 | 93.36 |
| Monitas (Gain, Inc.)* | 92.19 | 0.0648632217 | 82.56 |
| Research for Good | 92.85 | 0.0000000000 | 86.07 |
| Research on Mobile~~ | 89.39 | -0.4829193559 | 96.27 |
| Revenue Universe~~** | 88.01 | -0.3458328598 | 93.82 |
| Tap Research~~** | 90.13 | -0.1937064896 | 89.55 |
| TapJoy | 90.91 | -0.0555923910 | 96.18 |
| TheoremReach~~* | 89.65 | -2.5106886726 | 89.69 |
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target
Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight
12 September 2022 – 1 January 2023
QScore
Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).
Acceptance
Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.
Consistency
Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research
| Supplier | QScore | Acceptance | Consistency |
|---|---|---|---|
| A-K International | 92.56 | 0.3189603899 | 96.44 |
| Attapoll~* | 93.24 | 0.3352522616 | 95.59 |
| Bitburst~* | 91.81 | 0.0556437200 | 94.85 |
| ClixSense | 93.90 | 0.3115387523 | 95.47 |
| Dale Network | 89.73 | 0.5321238005 | 91.55 |
| Dalia Research~** | 92.04 | -0.8701170441 | 93.80 |
| inBrain.ai~* | 91.80 | 0.3101825936 | 91.10 |
| Innovative Hall~~ | 92.65 | 0.7253690347 | 94.41 |
| Make Opinion GmbH~* | 93.19 | 0.1961081100 | 92.44 |
| MarketCube | 90.82 | 0.0000000000 | 95.54 |
| Mo Web | 93.08 | 0.4948949964 | 93.52 |
| Neobux~~** | 94.25 | 0.7269666475 | 92.77 |
| Opinaia Panel | 91.90 | -2.8345068114 | 94.16 |
| Persona.ly | 93.75 | 0.7353794224 | 97.76 |
| Point Club~~ | 92.67 | 0.0000000000 | 94.18 |
| Prodege~* | 92.61 | 0.2629793855 | 92.81 |
| Research for Good (SS)~ | 92.31 | 94.98 | |
| Research on Mobile~~ | 89.12 | -1.7319448083 | 92.17 |
| Revenue Universe~** | 87.38 | -0.9769692686 | 87.66 |
| Splendid Research | 92.51 | 0.3062897523 | 96.31 |
| Tap Research~* | 89.15 | -0.0634159556 | 95.81 |
| TapJoy~** | 89.76 | 0.0078375547 | 90.70 |
| TheoremReach~* | 91.88 | 0.2229734511 | 96.25 |
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target
Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight
Supplier Scores: Netherlands
12 September 2022 – 1 January 2023
QScore
Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).
Acceptance
Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.
Consistency
Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research
| Supplier | QScore | Acceptance | Consistency |
|---|---|---|---|
| AdGate Media | 85.85 | -1.2527660640 | |
| Attapoll~~** | 91.46 | 0.1267580534 | 94.21 |
| Bitburst~** | 90.04 | -0.7000524465 | 96.26 |
| Dalia Research | 90.42 | -0.3013128896 | 92.62 |
| GMO Research~~** | 91.39 | 2.4180163351 | 95.64 |
| Make Opinion GmbH | 91.23 | 0.1670126649 | 96.36 |
| Prodege | 89.29 | 0.1637710187 | |
| Rewardia | 91.81 | 0.8496347056 | 88.31 |
| Tap Research | 88.14 | -2.0569872012 | 94.48 |
| TheoremReach~~** | 89.38 | 0.4379867271 | 94.62 |
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target
Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight
Supplier Scores: Russia
12 September 2022 – 1 January 2023
QScore
Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).
Acceptance
Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.
Consistency
Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research
| Supplier | QScore | Acceptance | Consistency |
|---|---|---|---|
| A-K International~~** | 92.27 | 0.0390157772 | 94.36 |
| AdGate Media~** | 87.17 | 0.3366411080 | 90.99 |
| Amry Research~ | 92.00 | 0.0000000000 | 94.15 |
| Attapoll~~ | 90.94 | 0.0000000000 | 93.86 |
| Bitburst~~** | 89.35 | 0.0596143804 | 90.93 |
| ClixSense~~ | 91.83 | 0.2033009573 | 95.79 |
| Dalia Research~* | 88.88 | 0.5342417843 | 91.42 |
| Make Opinion GmbH~* | 91.72 | 0.5023102276 | 97.01 |
| Marketagent | 93.24 | -0.0881571582 | 97.60 |
| MarketCube~ | 90.96 | 0.0000000000 | 95.38 |
| Mo Web~* | 91.09 | 0.0061554031 | 95.03 |
| Neobux~~ | 93.15 | 0.2238729538 | 91.49 |
| Persona.ly~~** | 91.21 | 0.2747861059 | 89.24 |
| Point Club~ | 92.35 | 0.0000000000 | 93.93 |
| Prodege~ | 91.02 | 93.78 | |
| Research on Mobile~~** | 87.97 | 0.6370659158 | 90.08 |
| Survey Everyone~~ | 91.36 | 0.0000000000 | 93.20 |
| TheoremReach~* | 90.73 | -0.2540860628 | 93.70 |
| Tiburon Research | 91.61 | 0.0000000000 | |
| YouThink.io~ | 92.45 | 0.2349456854 | 88.62 |
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target
Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight
Supplier Scores: Spain
12 September 2022 – 1 January 2023
QScore
Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).
Acceptance
Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.
Consistency
Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research
| Supplier | QScore | Acceptance | Consistency |
|---|---|---|---|
| A-K International~ | 93.11 | -0.2506942283 | 88.33 |
| AdGate Media~~ | 90.03 | 0.2350081111 | 92.08 |
| Attapoll~* | 93.25 | 0.1046816746 | 93.55 |
| Bitburst* | 91.72 | -0.2836153369 | 92.48 |
| ClixSense~* | 93.92 | 0.0395712004 | 93.91 |
| CreOnline~~** | 93.12 | 0.0840761450 | 87.02 |
| Dale Network | 92.54 | 0.8952816563 | 88.83 |
| Dalia Research* | 93.17 | -0.1498748588 | 96.02 |
| Decision Analyst~~ | 93.19 | -0.6300484038 | 95.05 |
| Gaddin.com | 93.91 | -0.2359337537 | 95.52 |
| General Research Lab | 93.32 | 0.1906834638 | |
| Hiving** | 92.55 | -0.0101033749 | 96.35 |
| inBrain.ai~* | 92.98 | -0.0389027505 | 92.27 |
| Innovative Hall~ | 93.26 | -1.3985577072 | 91.54 |
| Make Opinion GmbH~* | 93.27 | 0.0653318790 | 94.04 |
| Market Agent | 94.32 | 4.3957862496 | 92.40 |
| MarketCube~* | 91.84 | 0.0000000000 | 94.67 |
| Mo Web~* | 92.45 | 0.2286423350 | 93.13 |
| Neobux~* | 93.77 | -0.0886895311 | 95.76 |
| On Device Research~* | 94.32 | -0.2529620857 | 94.73 |
| Persona.ly~* | 93.30 | 0.4377650120 | 96.07 |
| Point Club~ | 94.80 | 92.54 | |
| Prodege~ | 93.56 | -0.1887897869 | 92.70 |
| Research on Mobile~~ | 90.78 | -2.8882180972 | 92.96 |
| Revenue Universe~~** | 89.83 | -1.6200621699 | 94.92 |
| Splendid Research~ | 93.91 | 0.1685470649 | 92.52 |
| Surveoo | 93.84 | 0.0286541660 | 94.36 |
| Surveyeah~ | 95.25 | 0.3190657322 | |
| Tap Research~* | 89.98 | -0.5668139961 | 86.18 |
| TapJoy~~** | 90.21 | -0.5712604556 | 89.41 |
| TheoremReach | 91.87 | -0.0369470460 | 93.75 |
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target
Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight
Supplier Scores: United Kingdom
12 September 2022 – 1 January 2023
QScore
Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).
Acceptance
Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.
Consistency
Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research
| Supplier | QScore | Acceptance | Consistency |
|---|---|---|---|
| A-K International | 89.08 | 0.3382599381 | 94.52 |
| AdGate Media | 88.82 | -0.4488025019 | 95.24 |
| Attapoll~** | 93.10 | 0.3857454425 | 95.11 |
| Bitburst~~* | 90.57 | -0.2888566930 | 91.44 |
| Branded Research~* | 95.19 | 0.5623186350 | 96.57 |
| ClixSense | 90.40 | -0.8681843522 | 96.01 |
| Dalia Research~~** | 87.58 | -1.8783689762 | 95.24 |
| Dayos | 93.48 | 0.2626934168 | |
| Decision Analyst~~** | 91.28 | -0.1111979106 | 90.50 |
| Expresso | 88.88 | ||
| General Research Lab~~ | 90.09 | 0.0000000000 | 93.29 |
| Hiving~~ | 87.71 | 81.63 | |
| iAngelic Research~~ | 90.57 | 0.1248949608 | 90.63 |
| Inbox Dollars (UK)~ | 91.24 | 0.5427707140 | 91.87 |
| inBrain.ai~* | 90.83 | -0.3894651768 | 96.25 |
| Innovative Hall | 89.20 | 0.0000000000 | |
| Liidimedia oy | 91.64 | 0.2877384434 | 90.16 |
| Logit~ | 91.81 | -0.0794419916 | |
| Lux Surveys~~** | 92.31 | 0.0000000000 | 86.85 |
| Make Opinion GmbH~~** | 89.29 | -0.0565939404 | 96.94 |
| MarketCube~ | 91.56 | 0.0000000000 | 96.27 |
| MindMover~~** | 91.04 | 0.8090611806 | 70.27 |
| Mirats Insights~ | 65.88 | 0.0950230162 | |
| Mo Web~* | 90.08 | 0.5437721847 | 93.04 |
| MVUK - Kato~~** | 90.46 | 0.0000000000 | 87.87 |
| On Device Research~* | 93.44 | 0.3027762831 | 96.29 |
| Persona.ly* | 91.70 | 0.4884354821 | 91.41 |
| Pick Media Ltd~~** | 91.45 | 0.5480470831 | 92.25 |
| Point Club~ | 89.96 | 94.35 | |
| Prodege~* | 94.22 | 0.4534941286 | 95.65 |
| Qmee | 90.91 | 0.1815080938 | 92.20 |
| Research for Good (SS)~ | 90.17 | 0.1836806553 | 97.08 |
| Revenue Universe~* | 86.75 | 0.4189171897 | 94.77 |
| Splendid Research | 90.82 | 0.3401393007 | 87.01 |
| Survey Everyone | 89.45 | ||
| Tap Research~* | 89.11 | -0.2761345120 | 93.35 |
| TapJoy~* | 89.00 | 0.2697306854 | 94.75 |
| TheoremReach | 90.43 | -2.3815616015 | 93.21 |
| Vetri Foundation~* | 90.90 | 0.3196717386 |
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target
Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight
Supplier Scores: South Korea
12 September 2022 – 1 January 2023
QScore
Quality “grades” based on standard survey response measures (e.g., time spent on survey, attentiveness, open-ended response quality).
Acceptance
Identifies the number of buyer-accepted survey completes for each individual supplier, then compares that number to the marketplace average of buyer-accepted survey completes.
Consistency
Measures the composition of respondent attitudes/opinions over time, helping to ensure that composition bias is minimized for tracking research
| Supplier | QScore | Acceptance | Consistency |
|---|---|---|---|
| Bitburst~~** | 88.64 | -0.0063211503 | 91.66 |
| ClixSense~~ | 94.63 | 0.0869867505 | |
| Dalia Research~** | 86.42 | -1.4933677074 | 90.20 |
| DataSpring | 89.33 | 1.2794428364 | 93.22 |
| GMO Research | 90.06 | 1.0542508820 | 89.28 |
| Make Opinion GmbH* | 89.47 | 0.8656739315 | 94.97 |
| MarketCube~~ | 88.28 | 0.0000000000 | |
| MarketLink* | 90.13 | 0.4095907524 | 93.49 |
| Neobux~~** | 91.94 | 0.4908714865 | 94.73 |
| Panel Marketing Interactive | 89.41 | 0.0000000000 | |
| Persona.ly~~** | 92.64 | 1.1485782896 | 95.02 |
| Prodege~~ | 92.09 | 0.2700678086 | 95.37 |
| Research on Mobile~~ | 83.61 | -2.0807761431 | 91.12 |
| Revenue Universe~~** | 81.71 | -0.2227513419 | 88.17 |
| Tap Research~~ | 87.53 | -0.6352073048 | 88.81 |
| TapJoy~** | 86.24 | -0.0350130656 | 98.18 |
| TheoremReach~~** | 86.79 | 0.3118063852 | 85.72 |
QScore:
No tilde = no significant weighting
Single tilde (~) = weighting between 1.5 and 3.0
Double tilde (~~) = weighting over 3.0, however total n within 70% of target
Consistency Score:
No asterisk = no significant weighting
Single asterisk (*) = weighting between 1.5 and 3.0
Double asterisk (**) = weighting over 3.0, however total n within 70% of target
N/A = new supplier to program or insufficient data to weight
