All Challenges

Here is an overview of all challenges that have been organized within the area of medical image analysis that we are aware of. They are subdivided into the following categories:

• Upcoming - Challenges for which the first submission deadline has not yet passed
• Active - Challenges that have been held and presented and which still accept new submissions
• Past - Challenges which do not accept new submissions. Datasets often still available for download. in august 2012 an email was sent out to the organizers of all challenges listed on this site. Any challenge which indicated not taking new submissions or which did not respond to the email can be found in this section.

If you know any study that would fit in this overview, please e-mail w.s.kerkstra@gmail.com.

This overview was last updated April 19, 2013.

Upcoming Challenges

Let Atrial Segmentation Challenge 2013 Website: http://lasc.isd.kcl.ac.uk/home/ Event: MICCAI, September 22, 2013

Quantification in Cerebral CT Perfusion Imaging 2013 Website: http://quantitativectp13.isi.uu.nl/ Event: MICCAI, September 22, 2013

Assessment of Mitosis Detection Algorithms 2013 Website: http://amida13.isi.uu.nl/ Event: MICCAI, September 22, 2013

Automated Segmentation of Prostate Structures (ASPS) & Multiparametric Brain Tumor Segmentation (BRATS) Website: https://wiki.cancerimagingarchive.net/display/Public/NCI-ISBI+2013+Challenge+-+Automated+Segmentation+of+Prostate+Structures Event: MICCAI, September 22, 2013

MICCAI 2013 DTI Tractography Challenge Website: http://dti-challenge.org/ Event: MICCAI, September 22, 2013

MR Brain Image Segmentation 2013 Website: http://mrbrains13.isi.uu.nl/index.php Event: MICCAI, September 26, 2013

Active Challenges

Cell Tracking Challenge Website: http://www.codesolorzano.com/celltrackingchallenge/Cell_Tracking_Challenge/Welcome.html Event: ISBI, April 11, 2013

Localization Microscopy Challenge Website: http://bigwww.epfl.ch/smlm/challenge/ Event: ISBI, April 11, 2013 Number of submissions: 25

3D Segmentation of Neurites in EM Images Website: http://brainiac.mit.edu/SNEMI3D/ Event: ISBI, April 11, 2013

Computer Aided Detection of Pulmonary Embolism Website: http://www.cad-pe.org Event: ISBI, April 11, 2013 Number of submissions: 3

3D Deconvolution Microscopy Website: http://bigwww.epfl.ch/deconvolution/challenge/ Event: ISBI, April 11, 2013 Number of submissions: 10

HARDI reconstruction challenge 2013 Website: http://hardi.epfl.ch/static/events/2013_ISBI/ Event: ISBI, April 11, 2013 Number of submissions: 27

MICCAI 2012 Grand Challenge and Workshop on Multi-Atlas Labeling Website: https://masi.vuse.vanderbilt.edu/workshop2012/index.php/Main_Page Event: MICCAI, October 1, 2012 Number of submissions: 25, Latest result: Jul 9, 2012

Prostate MR Image Segmentation 2012 (PROMISE12) Website: http://promise12.grand-challenge.org/ Event: MICCAI, October 1, 2012 Number of submissions: 13, Latest result: Jun 26, 2012

NIBAD'12: Atrophy measurement biomarkers using structural MRI for Alzheimer's disease: a challenge to assess measurement reliability and bias Website: http://picsl.upenn.edu/Miccai2012/Challenge Event: MICCAI, October 1, 2012 Number of submissions: 10, Latest result: Jun 15, 2012

RV Segmentation Challenge in Cardiac MRI Website: http://www.litislab.eu/rvsc Event: MICCAI, October 1, 2012 Latest result: Jul 5, 2012

MICCAI 2012 DTI Tractography Challenge Website: http://dti-challenge.org/ Event: MICCAI, October 1, 2012 Latest result: Jun 30, 2012

Multimodal Brain Tumor Segmentation Website: http://www2.imm.dtu.dk/projects/BRATS2012/ Event: MICCAI, October 1, 2012 Latest result: Jul 3, 2012

Neonatal Brain Segmentation 2012 Website: http://neobrains12.isi.uu.nl/index.php Event: MICCAI, October 5, 2012 Number of submissions: 6, Latest result: Jul 4, 2012

Coronary Artery Stenoses Detection and Quantification Evaluation Framework Website: http://coronary.bigr.nl/stenoses/ Event: MICCAI, October 1, 2012 Number of submissions: 12, Latest result: Jun 29, 2012

VESsel SEgmentation in the Lung 2012 (VESSEL12) Website: http://vessel12.grand-challenge.org Event: ISBI, May 2, 2012 Number of submissions: 18, Latest result: Apr 16, 2013

LOLA11: LObe and Lung Analysis 2011 Website: http://www.lola11.com/ Event: MICCAI 2011 Number of submissions: 11, Latest result: Sep 15, 2011

EMPIRE10: Evaluation of Methods for Pulmonary Image Registration 2010 Website: http://empire10.isi.uu.nl/ Overview article: http://dx.doi.org/10.1109/TMI.2011.2158349 Number of submissions: 27, Latest result: Feb 19, 2012

SKI10: Segmentation of Knee Images 2010 Website: http://www.ski10.org/ Event: MICCAI 2010 Number of submissions: 10, Latest result: Aug 3, 2012

EXACT09: Extraction of Airways from CT 2009 Website: http://image.diku.dk/exact/ Overview article: http://dx.doi.org/10.1109/TMI.2012.2209674 Number of submissions: 15

ANODE09: Automatic Nodule Detection 2009 Website: http://anode09.isi.uu.nl/ Overview article: http://dx.doi.org/10.1016/j.media.2010.05.005 Number of submissions: 12, Latest result: Aug 3, 2010

Rotterdam Coronary Artery Algorithm Evaluation Framework Website: http://coronary.bigr.nl Overview article: http://dx.doi.org/10.1016/j.media.2009.06.003 Number of submissions: 21, Latest result: Dec 18, 2011

SLIVER07: Segmentation of the Liver 2007 Website: http://sliver07.org/ Event: MICCAI 2007 Overview article: http://dx.doi.org/10.1109/TMI.2009.2013851 Number of submissions: 62, Latest result: Jul 28, 2012

High angular resolution diffusion imaging 2012 Website: http://hardi.epfl.ch/static/events/2012_ISBI/ Event: ISBI, May 2, 2012 Overview article: http://hardi.epfl.ch/static/events/2012_ISBI/_static/proceedings.pdf Number of submissions: 13, Latest result: Mar 16, 2012

Cardiac Delayed-Enhancement Magnetic Resonance Image Segmentation (cDEMRIS) 2012 Website: http://www.isd.kcl.ac.uk/cdemris/ Event: ISBI, May 2, 2012 Overview article: http://www.isd.kcl.ac.uk/cdemris/?page_id=19 Number of submissions: 10, Latest result: Mar 16, 2012

The Carotid Bifurcation Algorithm Evaluation Framework Website: http://cls2009.bigr.nl/ Event: MICCAI 2009 Overview article: http://dx.doi.org/10.1016/j.media.2011.02.004 Number of submissions: 9

Segmentation Validation Engine Website: http://sve.loni.ucla.edu/ Overview article: http://dx.doi.org/10.1016/j.neuroimage.2008.10.066 Number of submissions: 3, Latest result: Apr 27, 2012

MS Lesion Segmentation Challenge 2008 Website: http://www.ia.unc.edu/MSseg/ Event: MICCAI 2008 Number of submissions: 23, Latest result: May 5, 2012

Standardized Evaluation Methodology for 2D-3D Registration Website: http://www.isi.uu.nl/Research/Databases/GS/ Overview article: http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=1501923

Past Challenges

Mitosis Detection in Breast Cancer Histological Images (MITOS dataset) Website: http://ipal.cnrs.fr/ICPR2012/ Event: ICPR 2012 Number of submissions: 17, Latest result: Apr 16, 2013

Segmentation of neuronal structures in EM stacks 2012 Website: http://www.biomedicalimaging.org/2012/index.php/programme/isbi-challenges/13-challenges/49-contest-workshop-segmentation-of-neuronal Event: ISBI, May 2, 2012 Overview article: http://ieeexplore.ieee.org/xpl/articleDetails.jsp?arnumber=5539950 Number of submissions: 20

Particle tracking challenge 2012 Website: http://www.biomedicalimaging.org/2012/index.php/programme/isbi-challenges Event: ISBI, May 2, 2012 Number of submissions: 14, Latest result: Apr 1, 2012

Challenge US 2012: Biometric measurements from fetal ultrasound images Website: http://www.ibme.ox.ac.uk/challengeus2012 Event: ISBI, May 2, 2012 Number of submissions: 6

STACOM 2011 – Motion Tracking Challenge Website: http://cilab2.upf.edu/stacom_cesc11/index.php?option=com_content&amp Event: MICCAI 2011

STACOM 2011 – EP Simulation Challenge Website: http://cilab2.upf.edu/stacom_cesc11/index.php?option=com_content&amp Event: MICCAI 2011

The STACOM 2011 – 4D LV Segmentation Challenge Website: http://www.cardiacatlas.org/web/guest/stacom2011 Event: MICCAI 2011

DTI Tractography Challenge MICCAI 2011 Website: http://www.na-mic.org/Wiki/index.php/Events:_DTI_Tractography_Challenge_MICCAI_2011 Event: MICCAI 2011 Number of submissions: 9, Latest result: Jul 1, 2011

Neuronal Reconstruction challenge Website: http://diademchallenge.org/history.html Event: HHMI Janelia Farm Campus, sept 01 2010 Number of submissions: 120

Head & Neck Auto-segmentation Challenge 2010: Segmentation of the Parotid Glands Event: MICCAI 2010 Overview article: http://www.diagnijmegen.nl/~bram/grandchallenge2010/273.pdf Number of submissions: 6

Head & Neck Auto-segmentation Challenge 2009: Segmentation of the Mandible and Brainstem Event: MICCAI 2009 Overview article: http://www.insight-journal.org/browse/journal/50 Number of submissions: 4

Cardiac MR Left Ventricle Segmentation Challenge Website: http://smial.sri.utoronto.ca/LV_Challenge/ Event: MICCAI 2009 Overview article: http://www.insight-journal.org/browse/journal/49 Number of submissions: 9

2009 Prostate Segmentation Challenge Website: http://wiki.na-mic.org/Wiki/index.php/2009_prostate_segmentation_challenge_MICCAI Event: MICCAI 2009 Overview article: http://wiki.na-mic.org/Wiki/index.php/File:MICCAI2009SegmentationChallenge.ppt Number of submissions: 2, Latest result: Jul 20, 2009

VOLCANO'09: Volume Change Analysis of Nodules Website: http://www.via.cornell.edu/challenge/ Event: MICCAI 2009 Overview article: http://www.lungworkshop.org/2009/proc2009/353.pdf Number of submissions: 13, Latest result: Jun 24, 2009

ROC: Retinopathy Online Challenge Website: http://roc.healthcare.uiowa.edu/ Event: SPIE: Medical Imaging 2009 Overview article: http://dx.doi.org/10.1109/TMI.2009.2033909 Number of submissions: 12

3D Liver Tumor Segmentation Challenge 2008 Website: http://lts08.bigr.nl/ Event: MICCAI 2008 Number of submissions: 10

CAUSE07: Caudate Segmentation 2007 Website: http://cause07.isi.uu.nl/ Event: MICCAI 2007 Number of submissions: 23, Latest result: Apr 4, 2010