Experiment Planner

Initializing WebR... Please wait.

WDD Counts Planning

Advanced Settings
TimeEstimateSELowerUpper

IRR Counts Planning

Note: If Pre-time is 0, Control Count is used as the baseline for both groups.

TimeIRR EstSE (log)LowerUpper

Proportion Events Planning

TimeEstimateSELowerUpper

Simulation Proportion Events

Note: Baseline is the breakdown of all crime types (e.g. thefts are more common than assaults), while Proportion is the baseline rate that happens for those crimes (e.g. clearances are lower for property than for violent crimes).

Total NORR TargetSim ORRBiasSE

Help & Methodology

Citation References

If you use these tools or the WDD statistic in your research, please use the following citations:

WDD Counts Planning

The Weighted Displacement Difference (WDD) tool is designed for planning experiments involving crime counts. It helps estimate the precision (Standard Error) of crime reduction estimates over time.

  • Baseline Counts: The average number of crimes per unit time (e.g., crimes per week) expected in both areas.
  • Treated Reduction: The absolute decrease in crimes you expect the treatment to cause per unit time.
  • Pre-time Periods: The number of historical time periods used for the baseline variance calculation. If set to 0, it assumes no historical data is available.
  • Unit Time: If checked, results are shown as rates per period. If unchecked, results show the cumulative reduction across the study duration.

IRR Counts Planning

The Incident Rate Ratio (IRR) tool uses the Wilson log IRR estimator. It is suitable for comparing crime rates between two areas, with or without historical (pre) data. This tool is valid if you expect a percentage reduction, but the control and treated areas have very different total crime counts (for the DiD estimate). For the continuous monitoring over time though with no pre-treated, treated and control should have similar crime counts.

  • Control/Treated Count: The baseline number of crimes per unit time in each area.
  • IRR Target: The expected ratio of the treated rate to the control rate (e.g., 0.8 for a 20% reduction).
  • Pre-time Periods: If greater than 0, the tool calculates a Difference-in-Differences (DiD) log IRR. If 0, it performs a simple post-period comparison.

Proportion Events Planning

This tool is used for planning experiments where the outcome is a proportion, such as arrest rates per crime incident. It is useful if the events have a consistent rate, like use of force, across treated and control.

  • Control/Treated Proportion: The expected probability of an event in each group (e.g., 0.4 for a 40% arrest rate).
  • Sample Size per Period: The number of crime incidents occurring in each arm of the experiment per time unit. This is used to determine the total N as time progresses.
  • Alpha Level: The significance level (default 0.05 for 95% confidence intervals).

Simulation Proportion Events

A simulation-based approach using logistic regression to plan for experiments with multiple crime types and varying baseline solution rates. This is useful if the baseline events have a different rate (like clearances for different crimes), but you expect the treatment effect to be constant. The simulation estimates a logistic regression equation of the form:

logit(P(Event)) = β0 + Σ βi·CrimeTypei + βtreat·Treat

Where:

  • Fixed Effects: The βi terms are fixed effects for each crime type, accounting for different baseline solve rates.
  • Treatment Effect: The βtreat term represents the consistent log-odds ratio reduction (or increase) applied across all crime types (calculated as ln(Target IRR)).
  • Bias & SE: By replicating this model many times, the tool estimates the potential bias and the standard error of the treatment effect at various sample sizes.

General Notes

This application runs entirely in your browser using R-WASM (WebR). Calculations are performed locally on your machine. Standard errors and confidence intervals are calculated based on the formulas described in the Crime De-Coder blog posts.

References & Further Reading