Fulcrum Quality

Lucid Quality

 

Lucid Quality

The Lucid Supplier Quality Program is the first and only transparent, independent third-party sample quality measurement and ranking program – designed to ensure the highest quality human answers for market researchers and businesses seeking the most accurate insights possible.


Our method for evaluation of sample suppliers is grounded in three essential elements of survey sampling: Quality, Consistency, and Acceptance. Scores are calculated from Lucid platform data, Fulcrum marketplace results, and a set of benchmarking survey modules designed in concert with four of the top five market research companies and coordinated through DM2.

How Sample Suppliers Are Scored

Participating suppliers’ sample passes through the same quarterly benchmarking survey modules. These results, alongside Lucid platform data, yield key sample quality metrics.

19%

93.5 to 95.5

38%

92.0 to 93.5

19%

90.0 92.0

14%

86.7 to 90.0

QScore

A "grade" based on traditional quality measures of survey responses (e.g. time spent, attention to detail, open-end quality).

Acceptance

Illustrates how far away a given supplier is from the average of all completes ultimately accepted by buyers calculated at the project level. The vertical bar above is the average and the horizontal bars represent the range of scores from this quarter. Exact scores are listed in the results below.

14%

96.0 to 97.1

24%

94.0 to 96.0

38%

93.0 to 94.0

24%

75.7 to 93.0

Consistency

A measure of composition consistency over time. Calculated using respondent behavior and attitudes across a quarterly benchmarking survey.

16.67%

92.0 to 93.4

25.00%

91.0 to 92.0

25.00%

90.4 to 91.0

33.33%

89.5 to 90.4

QScore

A "grade" based on traditional quality measures of survey responses (e.g. time spent, attention to detail, open-end quality).

Acceptance

Illustrates how far away a given supplier is from the average of all completes ultimately accepted by buyers calculated at the project level. The vertical bar above is the average and the horizontal bars represent the range of scores from this quarter. Exact scores are listed in the results below.

11.11%

92.9 to 93.3

33.33%

92.5 to 92.9

33.33%

91.5 to 92.5

22.22%

88.2 to 91.5

Consistency

A measure of composition consistency over time. Calculated using respondent behavior and attitudes across a quarterly benchmarking survey.

Coming Soon…

We have successfully completed beta fielding in Germany and you can look forward to seeing the German supplier scores reported for Q2 2018. 

Lucid Supplier Quality: 2018

Participating suppliers’ sample passes through the same quarterly benchmarking survey modules. These results, alongside Lucid platform data, yield key sample quality metrics.

Q1 2018
 
QScore
Acceptance
Consistency
GDPR Compliance
Active Measure
94.2
0.19
93.7
No Obligation
Bovitz
92.1
1.11
94.3
No Obligation
Branded Research
87.6
-0.21
94.6
Actively Pursing Compliance
ClixSense
91.6
0.73
93.7
Actively Pursing Compliance
Dalia Research
89.0
-1.81
83.0
Have Begun Planning
Dayos
91.8
0.79
95.1
Actively Pursing Compliance
FusionCash
92.2
-2.30
95.7
No Obligation
InboxDollars
92.5
-1.75
93.4
Have Begun Planning
iGain (SayForExample)
93.4
1.48
93.9
Actively Pursing Compliance
inMarket
90.8
1.16
92.3
No Obligation
Market Cube
88.1
-1.73
93.3
Actively Pursing Compliance
MyPoints
93.3
0.02
93.9
Actively Pursing Compliance
PeanutLabs
93.8
-0.48
96.3
Actively Pursing Compliance
Persona.ly
91.5
0.21
91.2
Have Begun Planning
P2Sample
93.2
0.45
93.6
Actively Pursing Compliance
Qmee
92.2
0.42
97.0
Have Begun Planning
Prodege
94.8
0.02
97.0
Actively Pursing Compliance
Research for Good
95.4
0.87
92.7
Have Begun Planning
Revenue Universe
93.3
0.15
75.8
Unreported
Tap Research
87.7
0.39
93.2
Have Begun Planning
Tellwut
*
0.70
*
No Obligation
TheoremReach
86.8
0.13
95.2
Actively Pursing Compliance
Q1 2018
 
QScore
Acceptance
Consistency
GDPR Compliance
Branded Research
91.9
-0.21
91.5
Actively Pursing Compliance
ClixSense
90.4
0.73
-
Actively Pursing Compliance
Dalia Research
89.6
-1.81
92.3
Have Begun Planning
Hiving
90.6
0.35
-
Achieved Full Compliance
iGain (SayForExample)
90.4
1.48
-
Actively Pursing Compliance
InboxDollars
90.7
-1.75
90.9
Have Begun Planning
Market Cube
91.7
-1.73
93.2
Actively Pursing Compliance
On Device Research
91.7
0.01
92.9
Unreported
Prodege
93.4
0.02
92.7
Actively Pursing Compliance
P2 Sample
89.9
0.45
88.3
Actively Pursing Compliance
Qmee
92.0
0.42
92.9
Have Begun Planning
Tap Research
90.4
0.40
92.2
Have Begun Planning

Coming Soon…

We have successfully completed beta fielding in Germany and you can look forward to seeing the German supplier scores reported for Q2 2018. 

* Consistency Score appears only for those providers measures in both Q4 2017 and Q1 2018

* US: Tellwut Consistency and QScore unavailable this quarter.

Avoiding Bias

Understand Seller Composition for Better Blending Decisions

The program also monitors the values and behaviors that make up each sample supplier. Are respondents brand fanatics? Bargain shoppers? Early adopters of technology? These scores help you better understand composition and avoid bias.

Brand Preference
Brand Preference
69
118
Value-Seeking Behavior
Value-Seeking Behavior
86
115
Technology Usage
Technology Usage
76
114
Movie/Music Usage
Movie/Music Usage
73
121
Gamer Index
Gamer Index
81
116
100 - Platform Median

The Science of Lucid Quality

Lucid’s Supplier Quality Program is a rigorous assessment of our Fulcrum Exchange partners. The program is run quarterly and is designed to provide users with insight into response quality and partner consistency. All eligible US suppliers are required to participate in the program, which measures Q Score and Acceptance Score.

The Q Score is calculated from a 2-minute survey module designed by Chuck Miller with a minimum of 240 responses per supplier including gender and age quotas in the US. These questions are embedded as part of the pre-screening environment, providing respondents with a continuous survey experience. The methodology is fully automated, double-blind, and paced throughout fielding for improved representation and scientific rigor. The assessment provides benchmark data on the quality and make-up of sample suppliers. Quality is measured using a composite measurement derived from respondents’ attentiveness, answer consistency and quality, and the amount of time they spend within each section.

The Acceptance Score illustrates how far away a given supplier is from the average of all completes ultimately accepted by buyers calculated at the project level. The measure is calculated using Exchange completes as a weighted average by completes volume of relative acceptance rates on projects for suppliers that had a minimum of 15 completes.

The Consistency Score is a time series analysis of Composition scores also measured as part of this assessment. Composition is measured by attitudinal responses to elements including brand affinity, value-seeking behavior, technology adoption, and movie and music usage. Suppliers are measured relative to one another, normalized to a score of 100. The Consistency Score was developed to benchmark sample suppliers against themselves over time and to give buyers insight into the quarter-to-quarter reliability of the makeup of each seller’s respondents.

The GDPR Compliance Stage is a self-reported measurement of the progress suppliers have made toward complying with the EU’s General Data Protection Regulation (GDPR). Suppliers rate their progress toward the GDPR’s 9 requirements as either “Have Begun Planning,” “Actively Pursuing Compliance,” or “Fully Achieved Compliance,” from which we categorize each supplier’s overall progress. Suppliers who do not sell EU sample have no obligation toward GDPR compliance. Lucid is currently in the “Actively Pursuing Compliance” stage. GDPR Compliance Stage has been updated to reflect data from Q1 of 2018.