PhysioNet/CinC Challenge 2021 Results

This page contains the final scores for the 2021 PhysioNet/CinC Challenge:

Official entries: only Challenge metric scores and all scores
Unofficial entries: only Challenge metric scores and all scores
Team eligibility: here (determines whether entries are official or unofficial)

These tables contain scores for the 12-lead, 6-lead, 4-lead, 3-lead, and 2-lead versions of the hidden validation and test sets. The 2021 Challenge webpage and 2021 Challenge paper describes the lead combinations and the validation and test data sources. We also included an all-lead score in the tables, which is computed as the mean of the 12-lead, 3-lead, and 2-lead scores.

We used the Challenge scoring metric that we implemented in the evaluation code repository to rank the official entries on the test set. We sorted the unofficial entries alphabetically by team name.

In these tables, you can find the following information:

The only Challenge metric scores of the official entries and only Challenge metric scores of the unofficial entries spreadsheets provide the Challenge scoring metric on the hidden datasets as well as the the run time for training the models and running the trained models. Please click on the tabs at the bottom of the spreadsheets to switch between the 12-lead, 6-lead, 4-lead, 3-lead, 2-lead and all-lead (mean of the scores on the 12-lead, 3-lead, and 2-lead scores) scores.
The all scores of the official entries and all scores of the unofficial entries spreadsheets provide more evaluation metrics: the area under the receiver operating characteristic curve (AUROC), area under the precision recall curve (AUPRC), F-measure, accuracy, and the Challenge scoring metric scores. The accuracy metric is the fraction of correctly diagnosed recordings, i.e., all classes for the recording are correct. Please click on the tabs at the bottom of the spreadsheets to switch between the 12-lead, 6-lead, 4-lead, 3-lead, and 2-lead scores
The team eligibility table contains information about all of the 2021 Challenge entries (official and unofficial entries), including satisfiaction of the rules for rankings and prize eligibility.

To refer to these tables in your publication, please cite the following papers:

Perez Alday EA, Gu A, Shah AJ, Robichaux C, Wong AI, Liu C, Liu F, Rad AB, Elola A, Seyedi S, Li Q, Sharma A, Clifford GD^*, Reyna MA^*. Classification of 12-lead ECGs: the PhysioNet/Computing in Cardiology Challenge 2020. Physiol Meas. 41 (2020). doi: 10.1088/1361-6579/abc960.

Reyna MA, Sadr N, Perez Alday EA, Gu A, Shah AJ, Robichaux C, Rad AB, Elola A, Seyedi S, Ansari S, Ghanbari H, Li Q, Sharma A, Clifford GD. Will Two Do? Varying Dimensions in Electrocardiography: the PhysioNet/Computing in Cardiology Challenge 2021. Computing in Cardiology 2021; 48: 1-4.

Supported by the National Institute of Biomedical Imaging and Bioengineering (NIBIB) under NIH grant R01EB030362.

Back