Network coherence, bias and certainty

Assess assumptions and evidence confidence

Use transitivity for the comparability assumption and coherence/incoherence for direct–indirect agreement. Specify the confidence framework and assessment level. A nonsignificant test is not evidence that assumptions are satisfied.

Flow diagram

Network coherence, bias and certaintyF1.S1Appraise contributing studiesF1.S2Assess transitivityF1.S3Assess coherence and heterogeneityF1.S4Plan sensitivity networksF1.S5Assess confidence by comparisonF1.N1Network assumption assessmentComparisonConcernEvidencePlannedassessmentSensitivityTransitivityCoherenceHeterogeneityMissingevidenceF1.N2Assumptions and rationaleF1.N3Method and protocol evidenceF1.S0 Start flowNetwork coherence, bias and certaintyF1.S999 End flowEnd flow

Steps

Appraise contributing studies

Use result-specific bias judgments with independent assessment and provenance.

Assess transitivity

Compare relevant effect modifiers and eligibility across treatment comparisons.

Assess coherence and heterogeneity

Specify global and local checks and account for sparse comparisons.

Plan sensitivity networks

Examine influential evidence, node definitions, assumptions and missing evidence.

Assess confidence by comparison

Integrate direct and indirect evidence limitations and avoid automatic certainty labels.

Network coherence, bias and certainty

End flow

Tables and supporting information

Network assumption assessment

Network assumption assessmentComparisonConcernEvidencePlannedassessmentSensitivityTransitivityCoherenceHeterogeneityMissingevidence

Document concerns even when statistical tests are inconclusive.

Assumptions and rationale

A nonsignificant incoherence test does not establish transitivity or prove consistency; sparse networks may be uninformative.

Method and protocol evidence

Attach the protocol, methodological sources and versioned software specification supporting these decisions. Record citations and provenance; do not enter participant identifiers.

Sources