A new article on 90 Percent of Everything discusses a few ways to screen out potential “fake users” who lie about their qualifications to participate in your study:
In fact, a lot of liars can be screened out by writing a really good screener questionnaire. For example, here’s a decoy question that the Mozilla metrics team [...]