Fulcrum Quality

Lucid Quality

 

Lucid Quality

`The Lucid Supplier Quality Program is the first and only transparent, independent third-party sample quality measurement and ranking program – designed to ensure the highest quality human answers for market researchers and businesses seeking the most accurate insights possible.


Our method for evaluation of sample suppliers is grounded in three essential elements of survey sampling: Quality, Consistency, and Acceptance. Scores are calculated from Lucid platform data, Fulcrum marketplace results, and a set of benchmarking survey modules designed in concert with four of the top five market research companies and coordinated through DM2.

How Sample Suppliers Are Scored

Participating suppliers’ sample passes through the same quarterly benchmarking survey modules. These results, alongside Lucid platform data, yield key sample quality metrics.

7%

80.0 to 88.0

32%

88.0 to 90.0

32%

90.0 to 91.0

29%

91.0 to 100.0

QScore

A "grade" based on traditional quality measures of survey responses (e.g. time spent, attention to detail, open-end quality).

Acceptance

Illustrates how far away a given supplier is from the average of all completes ultimately accepted by buyers calculated at the project level. The vertical bar above is the average and the horizontal bars represent the range of scores from this quarter. Exact scores are listed in the results below.

16%

90.0 to 93.5

36%

93.5 to 95.0

28%

95.0 to 96.0

20%

96.0 to 100.0

Consistency

A measure of composition consistency over time. Calculated using respondent behavior and attitudes across a quarterly benchmarking survey.

15%

80.0 to 90.0

23%

90.0 to 91.0

38%

91.0 to 92.0

23%

92.0 to 100.0

QScore

A "grade" based on traditional quality measures of survey responses (e.g. time spent, attention to detail, open-end quality).

Acceptance

Illustrates how far away a given supplier is from the average of all completes ultimately accepted by buyers calculated at the project level. The vertical bar above is the average and the horizontal bars represent the range of scores from this quarter. Exact scores are listed in the results below.

17%

85.0 to 89.0

25%

89.0 to 92.0

33%

92.0 to 96.0

25%

96.0 to 100.0

Consistency

A measure of composition consistency over time. Calculated using respondent behavior and attitudes across a quarterly benchmarking survey.

0%

80.0 to 90.0

40%

90.0 to 92.0

40%

92.0 to 93.0

20%

93.0 to 100.0

QScore

A "grade" based on traditional quality measures of survey responses (e.g. time spent, attention to detail, open-end quality).

Acceptance

Illustrates how far away a given supplier is from the average of all completes ultimately accepted by buyers calculated at the project level. The vertical bar above is the average and the horizontal bars represent the range of scores from this quarter. Exact scores are listed in the results below.

Consistency

A measure of composition consistency over time. Calculated using respondent behavior and attitudes across a quarterly benchmarking survey.

Coming Soon…

We have are in the process of beta testing field in Australia and you can look forward to seeing the Australian supplier scores reported for Q4 2018.

Lucid Supplier Quality: 2018

Participating suppliers’ sample passes through the same quarterly benchmarking survey modules. These results, alongside Lucid platform data, yield key sample quality metrics.

Q2 2018
 
QScore
Acceptance
Consistency
A-K International*
88.7
1.00
-
Active Measure
92.5
-0.11
95.0
AdGate Media
90.3
-1.53
94.2
Bovitz
91.9
-0.67
95.5
Branded Research
88.8
-0.24
98.7
ClixSense
89.7
-0.34
98.3
Dale Network
91.6
0.12
-
Dalia Research
86.9
-1.33
94.1
Dayos
90.4
-0.31
95.8
Decision Analyst*
90.6
1.61
92.1
FusionCash
90.4
-0.13
93.3
iAngelic Research
89.6
1.96
94.3
iGain (SayForExample)
91.5
0.06
96.0
InboxDollars
91.3
0.17
96.1
inMarket
89.6
-0.24
93.9
Market Cube
90.6
-0.50
93.5
MyPoints
90.8
-0.12
96.7
MySoapBox*
88.6
0.51
93.6
P2Sample
91.1
-0.49
95.1
PeanutLabs
84.1
-0.79
91.1
PINCHme
93.1
1.23
-
Prodege
93.7
-0.12
95.9
Qmee
89.1
-0.17
97.3
Research for Good
90.2
-1.57
93.7
Revenue Universe
90.8
1.72
94.8
Tap Research
90.2
-0.34
94.5
Tellwut
89.4
0.03
95.7
TheoremReach
89.1
-0.37
92.4
Q2 2018
 
QScore
Acceptance
Consistency
A-K International
90.3
2.25
-
Branded Research
91.8
-0.21
94.2
Dalia Research
89.6
-2.13
87.8
Hiving
90.5
-0.06
90.3
iGain (SayForExample)
90.9
0.31
91.1
InboxDollars
91.5
0.49
95.0
Market Cube
91.2
-0.67
93.2
On Device Research
92.0
0.01
94.2
P2Sample
91.2
-0.65
85.1
Prodege
94.6
0.00
96.2
Qmee
93.0
-0.10
97.1
Survey Everyone
88.5
2.16
97.5
Tap Research
91.2
-0.39
91.0
Q2 2018
 
QScore
Acceptance
Consistency
A-K International
92.0
1.58
-
ClixSense
92.2
-0.15
-
Dalia Research
92.5
-1.29
-
Hiving
91.6
0.06
-
Market Cube
91.6
-0.33
-
Mo Web
94.1
0.44
-
P2Sample
92.5
-0.32
-
Persona.ly
91.7
-0.33
-
Prodege
94.8
0.10
-
Tap Research
92.8
-0.15
-

Coming Soon…

We have are in the process of beta testing field in Australia and you can look forward to seeing the Australian supplier scores reported for Q4 2018.

*Suppliers marked with an asterisk have low base sizes for one or more Age/Gender groups that required weighting

**Consistency Score appears only for those providers measured in both Q1 2018 and Q2 2018

Avoiding Bias

Understand Seller Composition for Better Blending Decisions

The program also monitors the values and behaviors that make up each sample supplier. Are respondents brand fanatics? Bargain shoppers? Early adopters of technology? These scores help you better understand composition and avoid bias.

Brand Preference
Brand Preference
79
143
Value-Seeking Behavior
Value-Seeking Behavior
81
124
Technology Usage
Technology Usage
76
130
Movie/Music Usage
Movie/Music Usage
65
142
Gamer Index
Gamer Index
82
124
100 - Platform Median

The Science of Lucid Quality

Lucid’s Supplier Quality Program is a rigorous assessment of our Fulcrum Exchange partners. The program is run quarterly and is designed to provide users with insight into response quality and partner consistency. All eligible US suppliers are required to participate in the program, which measures QScore and Acceptance Score.

The QScore is calculated from a 2-minute survey module designed by Chuck Miller with a minimum of 240 responses per supplier including gender and age quotas in the US. These questions are embedded as part of the pre-screening environment, providing respondents with a continuous survey experience. The methodology is fully automated, double-blind, and paced throughout fielding for improved representation and scientific rigor. The assessment provides benchmark data on the quality and make-up of sample suppliers. Quality is measured using a composite measurement derived from respondents’ attentiveness, answer consistency and quality, and the amount of time they spend within each section.

The Acceptance Score illustrates how far away a given supplier is from the average of all completes ultimately accepted by buyers calculated at the project level. The measure is calculated using Exchange completes as a weighted average by completes volume of relative acceptance rates on projects for suppliers that had a minimum of 15 completes.

The Consistency Score is a time series analysis of Composition scores also measured as part of this assessment. Composition is measured by attitudinal responses to elements including brand affinity, value-seeking behavior, technology adoption, and movie and music usage. Suppliers are measured relative to one another, normalized to a score of 100. The Consistency Score was developed to benchmark sample suppliers against themselves over time and to give buyers insight into the quarter-to-quarter reliability of the makeup of each seller’s respondents.