Prediction model development specification

Specify fitting tuning and complexity

Predictors serve prediction and need not represent causal effects. Tune and select models within the development procedure, then evaluate that procedure using data not used for the corresponding fitting decisions. Retain the full executable specification.

Flow diagram

Prediction model development specificationF1.S1Specify candidate model familiesF1.S2Limit complexity and overfittingF1.S3Separate tuning from evaluationF1.S4Fit the complete developmentpipelineF1.S5Freeze model specificationF1.N1Model development planCandidatePredictorsComplexitycontrolTuningSelectioncriterionPrimary modelAlternativemodelF1.N2Assumptions and rationaleF1.N3Method and protocol evidenceF1.S0 Start flowPrediction model developmentspecificationF1.S999 End flowEnd flow

Steps

Specify candidate model families

Choose regression or machine-learning approaches for the outcome and intended use.

Limit complexity and overfitting

Prespecify predictor handling, nonlinearities, regularization and interactions.

Separate tuning from evaluation

Define tuning objective and nested resampling or an equivalent valid procedure.

Fit the complete development pipeline

Record all data-dependent steps and reproducible software settings.

Freeze model specification

Retain coefficients or artifact version, preprocessing and prediction instructions.

Prediction model development specification

End flow

Tables and supporting information

Model development plan

Model development planCandidatePredictorsComplexitycontrolTuningSelectioncriterionPrimary modelAlternativemodel

No fitted model or performance estimate is generated by this template.

Assumptions and rationale

Selecting a model using the same observations used for final performance reporting can bias the evaluation.

Method and protocol evidence

Attach the protocol, methodological sources and versioned software specification supporting these decisions. Record citations and provenance; do not enter participant identifiers.

Sources