Fulcrum Quality

Lucid Quality

Lucid Quality

The Lucid Supplier Quality Program is the first and only transparent, independent third-party sample quality measurement and ranking program – designed to ensure the highest quality human answers for market researchers and businesses seeking the most accurate insights possible.


Our method for evaluation of sample suppliers is grounded in three essential elements of survey sampling: Quality, Consistency, and Acceptance. Scores are calculated from Lucid platform data, Fulcrum marketplace results, and a benchmarking survey designed in concert with four of the top five market research companies and coordinated through DM2.

How Sample Suppliers Are Scored

Participating suppliers’ sample passes through the same quarterly benchmarking survey. These results, alongside Lucid platform data, yield key sample quality metrics. The data published reflects our 20 best-performing suppliers.

27% 0.3 to 0.7
37% 0.0 to 0.3
17% -0.3 to 0.0
20% -0.3 to -0.7

Composite

An overall measure of quality based on Acceptance, QScore, and Consistency. A high-level metric to compare quality — apples to apples.

 

Qscore

A percentage "grade" based on traditional quality measures of survey responses (e.g. time spent, attention to detail, open-end quality).

37% 0.5 to 1.6
23% -0.1 to 0.5
20% -0.6 to -0.1
20% -2.1 to -0.6

Qscore

A percentage "grade" based on traditional quality measures of survey responses (e.g. time spent, attention to detail, open-end quality).

 
22% 0.6 to 1.5
33% 0 to 0.6
26% -0.8 to 0
19% -2.6 to -0.8

Consistency

A measure of composition consistency over time. Calculated using respondent behavior and attitudes across a quarterly benchmarking survey.

 

Acceptance

The percentage of a sample provider's respondents ultimately accepted by buyers. Calculated using data from the Lucid Platform.

27% 0.01 to 0.04
43% 0.00 to 0.01
13% -0.02 to 0.00
17% -0.08 to -0.08

Acceptance

The percentage of a sample provider's respondents ultimately accepted by buyers. Calculated using data from the Lucid Platform.

 

Lucid Quality: A Year in Review

 
Composite
QScore(US)
Consistency
Acceptance
1. ClixSense
0.68
0.59
1.44
0.014
2. Prodege
0.57
1.48
0.24
0.008
3. Nielsen
0.53
1.59
-0.02
0.003
4. InboxDollars
0.48
0.35
1.12
-0.017
5. Active Measure
0.40
0.56
0.63
0.007
6. Survey Everyone
0.39
0.56
0.59
0.004
7. Dayos
0.16
-0.63
1.10
0.007
8. Dalia Research
0.12
0.00
0.38
-0.011
9. Tellwut
0.10
0.50
-0.20
0.005
10. Panthera Interactive
0.06
-0.15
0.37
-0.054

Avoiding Bias

Understand Seller Composition for Better Blending Decisions

The program also monitors the values and behaviors that make up each sample supplier. Are respondents brand fanatics? Bargain shoppers? Early adopters of technology? These scores help you better understand composition and avoid bias.

Brand Preference
Brand Preference
87.1
116.5
Value-Seeking Behavior
Value-Seeking Behavior
91
114.4
Technology Usage
Technology Usage
87.9
111.5
Movie/Music Usage
Movie/Music Usage
67.1
120.6
Gamer Index
Gamer Index
75.4
115.6
100 - Platform Median

If you’re a sample supplier and want to be part of the industry’s first quality benchmark program, contact us here.


If you’re a sample buyer and want to get a better understanding of Lucid Supplier Quality insights, or if you would like to recommend a supplier for the program, hit up your Fulcrum team here. Look forward to connecting!

X

Talk to Us About Quality

Sign Up for the Lucid Quality Newsletter

The Science of Lucid Quality

The Lucid Supplier Quality Program is a rigorous assessment of Fulcrum Exchange partners designed to provide users with insight into response quality and partner consistency. All new Exchange suppliers are required to participate in the program, run once quarterly. The program is currently available in the United States, Canada, and the United Kingdom and consists of a Composite Score made up of three elements: the QScore, the Consistency Score, and the Acceptance Score.

The QScore is derived from an independently designed and administered 12 minute assessment given to 400 respondents and measures two categories: Quality and Composition. The assessment is run once quarterly in each of the participating countries and provides benchmark data on the quality and make-up of sample suppliers. Quality is measured using a composite measurement derived from respondents’ attentiveness, answer consistency and quality, and the amount of time they spend within each section.

The Consistency score is a time series analysis of Composition scores also measured as part of this assessment. Composition is measured by attitudinal responses to elements including brand affinity, value-seeking behavior, technology adoption, and movie and music usage. Suppliers are measured relative to one another, normalized to a score of 100. The Consistency Score was developed to benchmark sample suppliers against themselves over time and to give buyers insight into the quarter-to-quarter reliability of the makeup of each seller’s respondents.

The Acceptance score is derived directly from surveys run on the Fulcrum platform. Uniquely calculated off the two most recent months that can no longer be reconciled, the Acceptance score represents the percentage of all completed interviews that are deemed satisfactory by the buyer and not reconciled for any perceived quality control reasons.

All program scores are calculated with the assistance of an outside consultant and rigorously checked and re-checked prior to publication in Fulcrum each quarter. For more information, visit here.