Monthly quality report
Every month we publish how our panel performed: fraud we caught, attention-check pass rates, who took part compared with the US census, what participants earned per hour, and how fast studies filled. Every number comes from real activity on Populiva.
The first report will be published once a month has at least 500 approved submissions, so the numbers mean something.
How we compute these
Active participants: People who submitted at least one study during the month.
Confirmed fraud: Fraud cases our team confirmed during the month (for example duplicate accounts or shared PayPal accounts), per 1,000 active participants. Confirmed fraud is removed from researchers' data and refunded.
Attention checks: The share of new participants who passed every attention check in our welcome study, and the share of reviewed submissions that researchers rejected for failed attention checks.
Effective hourly pay: Reward plus bonuses for approved submissions, divided by the time from reserving a place to submitting. The average is total pay over total hours; the median is per submission. Submissions under a minute are left out.
Time to fill: Hours from a study's launch until its last place was submitted, for studies that filled during the month.
Who took part: Active participants by age, sex, and race or ethnicity, from the profiles they keep, beside census targets once those are final.