Bias and evidence certainty

Assess limitations and confidence

A review without pooling still needs transparent appraisal and interpretation. Choose a certainty approach appropriate to the review question; do not invent a pooled effect or numerical certainty score.

Flow diagram

Bias and evidence certaintyF1.S1Choose appraisal approachF1.S2Study bias assessmentF1.S3Resolve disagreementsF1.S4Assess missing evidenceF1.S5Assess evidence certaintyF1.S6Qualify conclusionsF1.N1Appraisal registerStudy andresultDomainJudgmentReasonEvidenceResolutionF1.N2Evidence certaintyOutcomeDomainJudgmentRationaleEvidenceF1.S0 Start flowBias and evidence certaintyF1.S999 End flowEnd flow

Steps

Choose appraisal approach

Select design-appropriate methods and outcome-specific judgments.

Study bias assessment

Assess each contributing result with independent judgments and evidence.

Resolve disagreements

Record adjudication before interpretation.

Assess missing evidence

Consider unavailable studies, outcomes and selective reporting.

Assess evidence certainty

Evaluate limitations, consistency, directness, precision and reporting concerns per outcome.

Qualify conclusions

Link limitations to structured synthesis without computing unsupported pooled estimates.

Bias and evidence certainty

End flow

Tables and supporting information

Appraisal register

Appraisal registerStudy andresultDomainJudgmentReasonEvidenceResolution

Retain explanations and supporting citations.

Evidence certainty

Evidence certaintyOutcomeDomainJudgmentRationaleEvidence

Keep ratings and supporting evidence blank until assessed.

Sources