i2b2: Informatics for Integrating Biology & the Bedside - A National Center for Biomedical Computing
2012 NLP
Shared Task
NLP
email password

Announcement of Data Release and Call for Participation

2012 i2b2 Shared-Tasks and Workshop
on Challenges in Natural Language Processing for Clinical Data

Tentative Timeline
Training Data Release: 1 June, 2012
Test Data Release: 1 August, 2012
System Outputs Due: 3 August, 2012
Paper Submission: 1 September, 2012
Workshop: November, 2012 with AMIA

The 2012 i2b2 challenge is on temporal relations. The data for this task is provided by Partners HealthCare and the Beth Israel Deaconess Medical Center (MIMIC II Database). All records have been fully de-identified and manually annotated for temporal relations.

The challenge registration starts on April 14, 2012. Training data for the challenge will be released starting June 1, 2012. Test data are scheduled to be released in August 2012. The results of the challenge will be presented at the workshop organized by i2b2 at AMIA.

Data for the task will be released under a Data Use Agreement and are to be used for research only. Obtaining the data requires completing a registration and signing the Data Use Agreement.

Evaluation Dates, File Formats, and Evaluation Metrics.

The evaluation will be conducted using withheld test data. Participating teams are asked to stop development as soon as they download the test data. Each team is allowed to upload (through this website) up to three system runs for each of the tiers of the challenge. System output is expected in the form of standoff annotations, following the exact format of the ground truth annotations to be provided by the organizers.

Participants are asked to submit a short paper describing their system and analyzing their performance. Papers should be in AMIA style and should not exceed five pages. Authors of top performing systems and of particularly novel approaches will be invited to present or demo their systems at the workshop.

Tentative Schedule
April 14, 2012Registration Opens
June 1, 2012Training Data Release
August 1, 2012Test Data Release
August 3, 2012System Outputs on Test Data Due at 11:59pm Eastern Time
September 1, 2012Short Papers Due
September 21, 2012Invitations to Present at the Workshop
November, 2012Workshop

Organizing Committee:

Ozlem Uzuner, co-chair,SUNY at Albany
Anna Rumshisky, co-chair,MIT
Peter Szolovits, MIT
Lynette Hirschman,MITRE
Cheryl Clark,MITRE
John Aberdeen,MITRE
Martha Palmer,University of Colorado Boulder
Guergana Savova,Children's Hospital Boston
James Pustejovsky,Brandeis University

Please see the FAQs and announcements for more information. Questions on the challenge can be addressed to Ozlem Uzuner, i2b2nlp@albany.edu.

 

[ back to top ]
Home | Contact | Sitemap | Search
©2005 - 2017
Partners Healthcare