Comparative change overview — Difference-in-differences study

Question through comparative change interpretation

Flow diagram

Comparative change overviewF1.S1QuestionF1.S2Define intervention and comparisonF1.S3Align groups and periodsF1.S4Assess identification assumptionsF1.S5Estimate effectsF1.S6Assess sensitivityF1.S7ReportF1.N1Protocol and decision registerDecisionSpecificationRationaleVersionEvidenceQuestion andscopeEligibilityPermissions andethicsRegistrationapplicabilityAmendmentsF1.N2Protocol and rationale evidenceF1.S0 Start flowComparative change overviewF1.S999 End flowEnd flow

Steps

Question

State the intervention, target population and causal effect of interest.

Define intervention and comparison

Define adoption units, dates, comparison eligibility and potential spillovers or anticipation.

Align groups and periods

Align outcome periods and population definitions; distinguish panels from repeated cross-sectional samples.

Assess identification assumptions

Assess the plausibility of parallel untreated trends, no anticipation and stable measurement or composition.

Estimate effects

Choose an estimator for the adoption pattern, define aggregation and account for assignment-level dependence.

Assess sensitivity

Evaluate pre-intervention patterns, alternative controls, timing and sensitivity to assumption violations.

Report

Report group-specific patterns, estimates and uncertainty with explicit limits of the comparative counterfactual.

Comparative change overview

End flow

Tables and supporting information

Protocol and decision register

Protocol and decision registerDecisionSpecificationRationaleVersionEvidenceQuestion andscopeEligibilityPermissions andethicsRegistrationapplicabilityAmendments

Record the protocol, approvals and registration where applicable. Preserve planned decisions and amendments separately from results.

Protocol and rationale evidence

Attach the rationale and dated protocol, retaining amendments. A study registry records study details; a disease registry contains health data. The HMA–EMA Catalogue of RWD studies is one option for relevant studies. Check eligibility and applicable requirements, and record an identifier and timing if registered. Registration does not imply randomization.

Sources