Fulcrum

Fulcrum Quality

Fulcrum Quality

Lucid’s Fulcrum Quality is the first and only transparent, independent third-party sample quality measurement and ranking program – designed to ensure the highest quality human answers for market researchers and businesses seeking the most accurate insights possible.


Our method for evaluation of sample suppliers is grounded in three essential elements of survey sampling: Quality, Consistency, and Acceptance. Scores are calculated from Lucid platform data, Fulcrum marketplace results, and a benchmarking survey designed in concert with four of the top five market research companies and coordinated through DM2.

How Sample Suppliers Are Scored

Participating suppliers’ sample passes through the same quarterly benchmarking survey. These results, alongside Lucid platform data, yield key sample quality metrics. The data published reflects our 20 best-performing suppliers.

30% 95 to 96
53% 92 to 94
13% 81 to 91
0% < 80

Composite

An overall measure of quality based on Acceptance, QScore, and Consistency. A high-level metric to compare quality — apples to apples.

 

Qscore

A percentage "grade" based on traditional quality measures of survey responses (e.g. time spent, attention to detail, open-end quality).

30% 93 to 96
37% 91 to 92
33% 83 to 90
0% < 82

Qscore

A percentage "grade" based on traditional quality measures of survey responses (e.g. time spent, attention to detail, open-end quality).

 
31% 97 to 99
59% 95 to 96
10% 93 to 94
0% < 92

Consistency

A measure of composition consistency over time. Calculated using respondent behavior and attitudes across a quarterly benchmarking survey.

 

Acceptance

The percentage of a sample provider's respondents ultimately accepted by buyers. Calculated using data from the Lucid Platform.

20% 97 to 100
47% 94 to 96
30% 80 to 93
3% < 79

Acceptance

The percentage of a sample provider's respondents ultimately accepted by buyers. Calculated using data from the Lucid Platform.

 

Q1 2017 Results by Sample Supplier

RP = Recent Participant
 
Composite
QScore(US)
Consistency
Acceptance
RP = Recent Participant
Nielsen
96.7
95.1
95.9
99%
Active Measure
95.8
93.6
96.6
97%
Prodege
95.6
94.7
95.8
96%
MARU Group
95.6
93.5
93.5
100%
Tellwut
95.2
92.6
95.5
98%
ClixSense
95.1
92.1
97.4
96%
Qmee
95.0
91.8
RP
98%
MyPoints
94.9
92.9
95.3
96%
FusionCash
94.7
90.8
97.1
96%
SayForExample
94.4
92.1
94.8
96%
Dayos
94.3
90.1
96.5
96%
Meet Research
94.3
92.7
94.5
96%
Survey Everyone
94.1
91.9
96.6
94%
Peanut Labs
94.0
89.3
96.0
97%
WiseSample
93.6
90.3
95.5
95%
Tap Research
93.6
90.4
95.8
94%
Branded Research
93.5
89.5
95.0
96%
Research for Good
93.2
92.4
94.7
93%
Decision Analyst
93.0
93.6
95.5
90%

Avoiding Bias

Understand Seller Composition for Better Blending Decisions

The program also monitors the values and behaviors that make up each sample supplier. Are respondents brand fanatics? Bargain shoppers? Early adopters of technology? These scores help you better understand composition and avoid bias.

Brand Preference
Brand Preference
78
116
Value-Seeking Behavior
Value-Seeking Behavior
85
106
Technology Usage
Technology Usage
86
110
Movie/Music Usage
Movie/Music Usage
63
127
Gamer Index
Gamer Index
75
112
100 - Platform Median

If you’re a sample supplier and want to be part of the industry’s first quality benchmark program, contact us here.


If you’re a sample buyer and want to get a better understanding of Fulcrum Quality insights, or if you would like to recommend a supplier for the program, hit up your Fulcrum team here. Look forward to connecting!

X

Talk to Us About Quality

Sign Up for the Fulcrum Quality Newsletter

The Science of Fulcrum Quality

Fulcrum Quality is a rigorous assessment of Fulcrum Exchange partners designed to provide users with insight into response quality and partner consistency. All new Exchange suppliers are required to participate in the program, run once quarterly. The program is currently available in the United States, Canada, and the United Kingdom and consists of a Composite Score made up of three elements: the Fulcrum QScore, the Consistency Score, and the Acceptance Score.

The QScore is derived from an independently designed and administered 12 minute assessment given to 400 respondents and measures two categories: Quality and Composition. The assessment is run once quarterly in each of the participating countries and provides benchmark data on the quality and make-up of sample suppliers. Quality is measured using a composite measurement derived from respondents’ attentiveness, answer consistency and quality, and the amount of time they spend within each section.

The Consistency score is a time series analysis of Composition scores also measured as part of this assessment. Composition is measured by attitudinal responses to elements including brand affinity, value-seeking behavior, technology adoption, and movie and music usage. Suppliers are measured relative to one another, normalized to a score of 100. The Consistency Score was developed to benchmark sample suppliers against themselves over time and to give buyers insight into the quarter-to-quarter reliability of the makeup of each seller’s respondents.

The Acceptance score is derived directly from surveys run on the Fulcrum platform. Uniquely calculated off the two most recent months that can no longer be reconciled, the Acceptance score represents the percentage of all completed interviews that are deemed satisfactory by the buyer and not reconciled for any perceived quality control reasons.

All program scores are calculated with the assistance of an outside consultant and rigorously checked and re-checked prior to publication in Fulcrum each quarter. For more information, visit here.