CROHME: Competition on Recognition of Online Handwritten Mathematical Expressions

Menu:

• Home
• Organizers
• Previous CROHMEs
• ICFHR'14 CROHME
• Data & Tools
• Tasks 2014

The current version of CROHME is being organized along with ICFHR 2014. Look at the Call for Participation.

Previous Competitions

CROHME-III at ICDAR 2013

Here are the results from CROHME-III held at ICFHR 2013. Read the paper in [3] for more details.

Expression-level evaluation
System	Correct(%)	<= 1 error	<= 2 errors	<= 3 errors
VisionObjects	60.36	80.33	84.95	86.14
Universitat Politècnica de València	23.40	37.85	44.71	47.84
Tokyo Univ.	19.97	34.13	40.83	42.92
Univ. Sao Paulo	9.39	18.48	24.14	27.27
Sabanci University	8.35	19.08	24.44	26.23
Czech Tech. Univ.	2.68	9.69	16.24	20.72
Univ. Nantes*	18.33	32.04	40.24	42.92
Rochester Institute of Technology (RIT)*	14.31	24.74	32.19	36.21

* Systems from organizers and were not ranked.

CROHME-II at ICFHR 2012

Here are the results from CROHME-II held at ICFHR 2012. Read the paper in [2] for more details.

Results Part III (rates in %)
Lab.	STR_REC	SEG	REC/SEG	EXP	EXP1	EXP2	EXP3	STRUCT
Universitat Politècnica de València (ES)	79.91	91.94	86.35	22.84	34.77	41.15	42.39	42.39
Institute for Language and Speech Processing (GR)	55.81	71.21	85.08	3.70	6.38	9.05	10.49	9.88
IRCCyN-IVC (FR)	79.02	87.79	91.45	25.72	36.21	39.30	40.12	37.04
Rochester Institute of Technology (NY, USA)	72.17	87.57	87.67	9.47	18.52	23.25	24.90	23.87
Sabanci University (TR)	45.45	59.16	84.40	4.94	10.70	14.20	15.02	14.81
University of Waterloo (CA)	86.47	95.55	91.27	40.33	54.32	59.26	62.14	61.52
VisionObjects (FR)	95.79	98.84	96.91	62.96	79.42	82.30	82.51	80.86

CROHME-I at ICDAR 2011

CROHME-I was organized with ICDAR 2011. Results can be found below. Read the paper in [1] for more details.

Results Part I (rates in %)
Lab	Stroke reco.	Symbol seg.	Symbol reco.	Expression reco.	Ref.
Rochester Institute of Technology (NY, USA)	55.91	60.01	87.24	7.18	[1]
Sabanci University (TR)	20.90	26.66	81.22	1.66	[1]
Universitat Politècnica de València (ES)	78.73	88.07	92.22	29.28	[1]
Institute for Language and Speech Processing (GR)	48.26	67.75	86.30	0.00	[1]
IRCCyN-IVC (organizer, FR)	78.57	87.56	91.67	40.88	[1]

Results Part II (rates in %)
Lab	Stroke reco.	Symbol seg.	Symbol reco.	Expression reco.	Ref.
Rochester Institute of Technology (NY, USA)	51.58	56.50	91.29	2.59	[1]
Sabanci University (TR)	19.36	24.42	84.45	1.15	[1]
Universitat Politècnica de València (ES)	78.38	87.82	92.56	19.83	[1]
Institute for Language and Speech Processing (GR)	52.28	78.77	78.67	0.00	[1]
IRCCyN-IVC (organizer, FR)	70.79	84.23	87.16	22.41	[1]

1. CROHME2011: Competition on Recognition of Online Handwritten Mathematical Expressions

   Mouchère H., Viard-Gaudin C., Garain U., Kim D. H., Kim J. H.

   Proceedings of the 11th International Conference on Document Analysis and Recognition, ICDAR 2011, China (2011) HAL

2. ICFHR 2012 - Competition on Recognition of Online Mathematical Expressions (CROHME2012):

   Mouchère H., Viard-Gaudin C., Garain U., Kim D. H., Kim J. H.

   Proceedings of the International Conference on Frontiers in Handwriting Recognition, ICFHR 2012, Italy (2012) HAL

3. ICDAR 2013 CROHME - Third International Competition on Recognition of Online Mathematical Expressions:

   Mouchère H., Viard-Gaudin C., Zanibbi R., Garain U., Kim D. H. and Kim J. H.

   Proceedings of the International Conference on Document Analysis and Recognition, ICDAR 2013, USA (2013) PDF