The test-retest reliability of the experts’ answers was evaluated by repeating some of the trade-off questions and voting on them again. To evaluate face validity, the experts considered the intuitive plausibility of the relative importance of the criteria and levels implied by the weights.
As a further validity test, the experts’ consensus ranking of the 10 vignettes from stage 1 was used as a “pseudo-gold standard” to compare the ranking produced by the tool. Finally, a new sample of COVID-19 patient cases was used to check that they were appropriately differentiated with respect to the distribution of their scores from the tool.
Do you have any questions about this protocol?
Post your question to gather feedback from the community. We will also invite the authors of this article to respond.
Tips for asking effective questions
+ Description
Write a detailed description. Include all information that will help others answer your question including experimental processes, conditions, and relevant images.