Download Data Sets

With the challenge concluded, all data sets are now available for download at the CMC Resource Catalog.

Important Dates

1 Dec 2006
- Web site launched
22 Jan 2007
- Registration begins
1 Feb 2007
- Training data set released
28 Feb 2007
- Registration ends
1 Mar 2007
- Test data set released
18 Mar 2007
- Last day to submit results
- Due by midnight EDT
1 Apr 2007
- Competition results announced

Final Results

This page lists final results of the 2007 Computational Medicine Center International Challenge: Classifying Clinical Free Text Using Natural Language Processing.

MICRO-AVERAGED F-1 mean = 0.7670
MICRO-AVERAGED F-1 std.dev. = 0.1325
MICRO-AVERAGED F-1 median = 0.7985

GREEN MICRO-AVERAGED F-1 is 1 standard deviation from the mean
ORANGE MICRO-AVERAGED F-1 is 2 standard deviations from the mean
RED MICRO-AVERAGED F-1 is more than 2 standard deviations from the mean

PLACE	TEAM SHORT NAME	MICRO-AVERAGED F-1	MACRO-AVERAGED F-1	COST SENSITIVE
1	Szeged	0.8908	0.7691	0.9180
2	University at Albany	0.8855	0.7291	0.9091
3	University of Turku	0.8769	0.7034	0.9126
4	PENN	0.8760	0.7210	0.9088
5	LMCO-IS & S	0.8719	0.7760	0.9009
6	GMJ_JL	0.8711	0.7334	0.8975
7	SULTRG	0.8676	0.7322	0.8998
8	MANCS	0.8594	0.6676	0.9049
9	otters	0.8509	0.6816	0.9010
10	Aseervatham	0.8498	0.6756	0.8775
11	LHC/NLM	0.8469	0.6916	0.8880
12	ohsu_dmice	0.8457	0.6542	0.8938
13	Stockholm	0.8392	0.6684	0.8699
14	Fabrizio Sebastiani	0.8375	0.6870	0.8754
15	UOE	0.8360	0.6802	0.8598
16	Davide	0.8284	0.6784	0.8804
17	SIM	0.8277	0.6959	0.8755
18	Yasui Biostatistics Team	0.8274	0.6825	0.8703
19	SUNY-Buffalo	0.8258	0.6276	0.8805
20	I2R	0.8180	0.6763	0.8449
21	LLX	0.8147	0.7343	0.8354
22	BME-TMIT	0.7992	0.6406	0.8567
23	Watson	0.7977	0.5488	0.8725
24	ErasmusMC	0.7969	0.6369	0.8424
25	NJU-NLP Group	0.7950	0.5846	0.8558
26	bozyurt	0.7916	0.5643	0.8686
27	Dharmendra	0.7900	0.5758	0.8618
28	strappa	0.7822	0.5662	0.8810
29	UMN	0.7741	0.5540	0.8525
30	cl.naist.jp	0.7657	0.5571	0.8710
31	MITRE	0.7455	0.5097	0.8574
32	BAL	0.7341	0.5936	0.8106
33	Delbecque	0.7246	0.5682	0.7960
34	ravim	0.7145	0.5522	0.7874
35	MIRACLE	0.7067	0.5109	0.8000
36	Magne Rekdal	0.6869	0.5238	0.7749
37	cu_nlp	0.6865	0.5052	0.7894
38	CNRC	0.6823	0.5089	0.8140
39	ARAMAKI	0.6786	0.4459	0.7881
40	SINAI	0.6719	0.5248	0.7590
41	Hirukote	0.6556	0.4770	0.7807
42	MERLIN	0.5768	0.3345	0.7373
43	ILMA	0.3905	0.3351	0.5099
44	CLaC	0.1541	0.1918	0.4545