Fulcrum Quality

Lucid Quality

Lucid Quality

The Lucid Supplier Quality Program is the first and only transparent, independent third-party sample quality measurement and ranking program – designed to ensure the highest quality human answers for market researchers and businesses seeking the most accurate insights possible.


Our method for evaluation of sample suppliers is grounded in two essential elements of survey sampling: Quality and Acceptance. Scores are calculated from Lucid platform data, Fulcrum marketplace results, and a set of benchmarking survey modules designed in concert with four of the top five market research companies and coordinated through DM2.

How Sample Suppliers Are Scored

Participating suppliers’ sample passes through the same quarterly benchmarking survey modules. These results, alongside Lucid platform data, yield key sample quality metrics.

Qscore

A percentage "grade" based on traditional quality measures of survey responses (e.g. time spent, attention to detail, open-end quality).

28% 94.0 to 100.0
31% 92.0 to 94.0
24% 90.0 to 92.0
17% 80.0 to 90.0

Qscore

A percentage "grade" based on traditional quality measures of survey responses (e.g. time spent, attention to detail, open-end quality).

 

Acceptance

The percentage of a sample provider's respondents ultimately accepted by buyers. Calculated using data from the Lucid Platform.

17% 94.0 to 100.0
24% 93.0 to 94.0
41% 91.0 to 93.0
17% 80.0 to 91.0

Acceptance

The percentage of a sample provider's respondents ultimately accepted by buyers. Calculated using data from the Lucid Platform.

 

Lucid Quality: End-of-Year Release

 
QScore(US)
Acceptance
GDPR Compliance
Active Measure
96.1
93.2
No GDPR Obligation
Bovitz
91.1
84.9
No GDPR Obligation
Branded Research
88.6
92.6
Actively Pursuing Compliance
CashCrate
92.8
92.9
Have Begun Planning
ClixSense
91.1
93.4
Have Begun Planning
InboxDollars
92.2
91.9
Have Begun Planning
Dalia Research
90.7
91.7
Have Begun Planning
Dayos
95.0
94.0
Have Begun Planning
FusionCash
92.2
94.1
No GDPR Obligation
Nielsen
90.8
93.2
Unreported
inMarket
90.2
93.4
Have Begun Planning
Innovative Hall
92.6
86.7
No GDPR Obligation
MySoapBox
92.0
94.9
No GDPR Obligation
Market Cube
93.2
92.1
Actively Pursuing Compliance
MARU Group
91.2
95.1
No GDPR Obligation
MyPoints
92.5
92.5
Have Begun Planning
P2Sample
95.0
92.7
Actively Pursuing Compliance
Panthera Interactive
84.5
89.6
Unreported
PeanutLabs
97.1
92.7
Actively Pursuing Compliance
Persona.ly
87.5
81.1
Unreported
Prodege
97.6
92.5
Have Begun Planning
PRZREB
87.1
93.8
Have Begun Planning
Qmee
94.1
93.1
Have Begun Planning
SayForExample
90.8
90.2
Actively Pursuing Compliance
Research for Good
94.7
94.8
Have Begun Planning
Survey Everyone
87.2
91.7
Have Begun Planning
Tap Research
94.6
92.4
Have Begun Planning
Tellwut
92.5
92.6
No GDPR Obligation
TheoremReach
92.8
94.3
Actively Pursuing Compliance

Avoiding Bias

Understand Seller Composition for Better Blending Decisions

The program also monitors the values and behaviors that make up each sample supplier. Are respondents brand fanatics? Bargain shoppers? Early adopters of technology? These scores help you better understand composition and avoid bias.

Brand Preference
Brand Preference
79.8
119.2
Value-Seeking Behavior
Value-Seeking Behavior
84.7
111.1
Technology Usage
Technology Usage
74.3
118.1
Movie/Music Usage
Movie/Music Usage
67.4
125.4
Gamer Index
Gamer Index
79.4
114.5
100 - Platform Median

The Science of Lucid Quality

The Lucid Supplier Quality Program is a rigorous assessment of Fulcrum Exchange partners designed to provide users with insight into response quality and partner consistency. All US  Exchange suppliers are required to participate in the program, run once quarterly. The program is currently available in the United States and consists the Q Score and the Acceptance Score.

The Q Score is calculated from a 2-minute survey module designed by Chuck Miller with 240 responses per supplier including gender and age quotas in the US. These questions are embedded as part of the pre-screening environment, providing respondents with a continuous survey experience. The methodology is fully automated, double-blind, and paced throughout fielding for improved representation and scientific rigor. The assessment provides benchmark data on the quality and make-up of sample suppliers. Quality is measured using a composite measurement derived from respondents’ attentiveness, answer consistency and quality, and the amount of time they spend within each section.

The Acceptance Score is a measure of the relative data quality approval buyers provide during the reconciliation period on a project-level basis. Suppliers who score well have higher-than-average acceptance rates per project.  The measure is calculated using Exchange completes as a weighted average by completes volume of relative acceptance rates on projects for suppliers that had a minimum of 15 completes.

The GDPR Compliance Stage is a self-reported measurement of the progress suppliers have made toward complying with the EU’s General Data Protection Regulation (GDPR). Suppliers rate their progress toward the GDPR’s 9 requirements as either “Have Begun Planning,” “Actively Pursuing Compliance,” or “Fully Achieved Compliance,” from which we categorize each supplier’s overall progress. Suppliers who do not sell EU sample have no obligation toward GDPR compliance. Lucid is currently in the “Have Begun Planning” stage.