Fulcrum Quality

Lucid Quality

 

Lucid Quality

The Lucid Supplier Quality Program is the first and only transparent, independent third-party sample quality measurement and ranking program – designed to ensure the highest quality human answers for market researchers and businesses seeking the most accurate insights possible.


Our method for evaluation of sample suppliers is grounded in two essential elements of survey sampling: Quality and Acceptance. Scores are calculated from Lucid platform data, Fulcrum marketplace results, and a set of benchmarking survey modules designed in concert with four of the top five market research companies and coordinated through DM2.

How Sample Suppliers Are Scored

Participating suppliers’ sample passes through the same quarterly benchmarking survey modules. These results, alongside Lucid platform data, yield key sample quality metrics.

Qscore

A percentage "grade" based on traditional quality measures of survey responses (e.g. time spent, attention to detail, open-end quality).

17% 82.0 to 90.0
21% 90.0 to 91.5
48% 91.5 to 94.0
14% 94.0 to 100.0

Qscore

A percentage "grade" based on traditional quality measures of survey responses (e.g. time spent, attention to detail, open-end quality).

 

Acceptance

The percentage of a sample provider's respondents ultimately accepted by buyers at the project level. Calculated using data from the Lucid Platform.

23% 80.0 to 91.0
30% 91.0 to 93.0
20% 93.0 to 94.0
27% 94.0 to 100.0

Acceptance

The percentage of a sample provider's respondents ultimately accepted by buyers at the project level. Calculated using data from the Lucid Platform.

 

Lucid Quality: Q4 2017

 
QScore(US)
Acceptance
GDPR Compliance
Active Measure
97.9
94.7
No GDPR Obligation
AdGate Media
90.8
86.1
Unreported
Bovitz
95.1
97.1
No GDPR Obligation
Branded Research
92.2
91.7
Actively Pursuing Compliance
CashCrate
95.1
91.7
Have Begun Planning
ClixSense
92.2
93.3
Have Begun Planning
InboxDollars
93.6
86.1
Have Begun Planning
Dalia Research
82.2
88.8
Have Begun Planning
Dayos
93.6
93.3
Have Begun Planning
FusionCash
93.6
86.0
No GDPR Obligation
MySoapBox
90.8
94.4
No GDPR Obligation
Influence Mobile
87.9
95.1
Unreported
Innovative Hall
87.9
84.6
No GDPR Obligation
MARU Group
93.6
93.7
NO GDPR Obligation
Market Cube
90.8
98.2
Actively Pursuing Compliance
P2 Sample
93.6
92.8
Actively Pursuing Compliance
iAngelic Research
92.2
92.8
Have Begun Planning
Peanut Labs
Unavailable for Q4, Q3=97.1
94.2
Actively Pursing Compliance
Persona.ly
90.8
89.5
Unreported
Prodege
96.5
91.4
Have Begun Planning
Qmee
93.6
93.0
Have Begun Planning
Revenue Universe
89.3
93.9
Unreported
SayForExample
93.6
94.4
Actively Pursuing Compliance
Research for Good
95.5
93.6
Have Begun Planning
Survey Everyone
87.9
93.0
Have Begun Planning
Tap Research
92.2
92.4
Have Begun Planning
Tellwut
93.6
92.8
No GDPR Obligation
TheoremReach
90.8
93.6
Actively Pursing Compliance
inMarket
90.8
94.1
Have Begun Planning
MyPoints
93.6
91.4
Have Begun Planning

Avoiding Bias

Understand Seller Composition for Better Blending Decisions

The program also monitors the values and behaviors that make up each sample supplier. Are respondents brand fanatics? Bargain shoppers? Early adopters of technology? These scores help you better understand composition and avoid bias.

Brand Preference
Brand Preference
68
134
Value-Seeking Behavior
Value-Seeking Behavior
81
116
Technology Usage
Technology Usage
75
119
Movie/Music Usage
Movie/Music Usage
69
131
Gamer Index
Gamer Index
76
115
100 - Platform Median

The Science of Lucid Quality

Lucid’s Supplier Quality Program is a rigorous assessment of our Fulcrum Exchange partners. The program is run quarterly and is designed to provide users with insight into response quality and partner consistency. All eligible US suppliers are required to participate in the program, which measures Q Score and Acceptance Score.

The Q Score is calculated from a 2-minute survey module designed by Chuck Miller with a minimum of 240 responses per supplier including gender and age quotas in the US. These questions are embedded as part of the pre-screening environment, providing respondents with a continuous survey experience. The methodology is fully automated, double-blind, and paced throughout fielding for improved representation and scientific rigor. The assessment provides benchmark data on the quality and make-up of sample suppliers. Quality is measured using a composite measurement derived from respondents’ attentiveness, answer consistency and quality, and the amount of time they spend within each section.

The Acceptance Score is a measure of the relative data quality approval buyers provide during the reconciliation period on a project-level basis. Suppliers who score well have higher-than-average acceptance rates per project.  The measure is calculated using Exchange completes as a weighted average by completes volume of relative acceptance rates on projects for suppliers that had a minimum of 15 completes.

The GDPR Compliance Stage is a self-reported measurement of the progress suppliers have made toward complying with the EU’s General Data Protection Regulation (GDPR). Suppliers rate their progress toward the GDPR’s 9 requirements as either “Have Begun Planning,” “Actively Pursuing Compliance,” or “Fully Achieved Compliance,” from which we categorize each supplier’s overall progress. Suppliers who do not sell EU sample have no obligation toward GDPR compliance. Lucid is currently in the “Have Begun Planning” stage. GDPR Compliance Stage reflects data from Q3 of 2017 and will be updated when the Q1 of 2018 Quality Scores are released.