The Lab by Prova
Using evidence well involves a few practical questions: who is counted, how results are combined, what a statement can rest on, and what more information would cost. The Lab is a set of worked examples and small tools for working through those questions. The examples use illustrative records, and the tools work only with the numbers you enter.
Questions to ask of any result
Each example takes one question worth asking of any result, such as who is missing from it or what an average combines, and shows how much the answer can change what you can say.
How much can missing results change the story?
Open an encouraging result, find out how many people it counts, and see what remains unknown.
Open the example →Can an average improve when no group improves?
Keep two groups’ outcomes fixed and change who makes up the total.
Open the example →What can we actually say from this evidence?
Try three sentences against the same employment record and inspect what each one requires.
Open the example →Are these two programs reporting the same result?
Look beneath two headline rates, then compare records using a common definition.
Open the example →What does one more reporting request cost?
Change the frequency and length of a request. See staff and participant time separately.
Open the example →Would another study change this decision?
Explore a decision deadline and a longer learning purpose. The same answer can have different uses.
Open the example →Questions about your own numbers
Each tool answers one practical question about your own program, using only the numbers you enter.
What could the missing outcomes change?
Enter how many people were in a group, how many outcomes you know, and how many met the outcome. See the range the missing outcomes allow.
Open the tool →How much evidence does this decision deserve?
Describe a decision, what can still change, and what is at stake. See how much inquiry the decision can justify.
Open the tool →How much time does this reporting take?
Enter how often a report is requested and how long it takes respondents and staff. Compare it with a proposed change.
Open the tool →