Building and evaluating annotated corpora for medical NLP systems.

Philip V. Ogren; Guergana Savova; James D. Buntrock; Christopher G. Chute

Building and evaluating annotated corpora for medical NLP systems.

Philip V. Ogren, Guergana Savova, James D. Buntrock, Christopher G. Chute

Research output: Contribution to journal › Article › peer-review

Abstract

We report efforts from a pilot annotation project in which we annotated sixty clinical notes with disorder mentions. Four retrieval experts annotated the same clinical notes so that four-way inter-annotator agreement could be calculated. We find the inter-annotator agreement results encouraging to scale up the project using the same guidelines and annotation schema.

Original language	English (US)
Number of pages	1
Journal	AMIA ... Annual Symposium proceedings / AMIA Symposium. AMIA Symposium
State	Published - 2006
Externally published	Yes

ASJC Scopus subject areas

Medicine(all)

Cite this

@article{162f9e3d559f4d4eb8303585f883fdbb,

title = "Building and evaluating annotated corpora for medical NLP systems.",

abstract = "We report efforts from a pilot annotation project in which we annotated sixty clinical notes with disorder mentions. Four retrieval experts annotated the same clinical notes so that four-way inter-annotator agreement could be calculated. We find the inter-annotator agreement results encouraging to scale up the project using the same guidelines and annotation schema.",

author = "Ogren, {Philip V.} and Guergana Savova and Buntrock, {James D.} and Chute, {Christopher G.}",

year = "2006",

language = "English (US)",

journal = "AMIA ... Annual Symposium proceedings / AMIA Symposium. AMIA Symposium",

issn = "1559-4076",

publisher = "American Medical Informatics Association",

}

TY - JOUR

T1 - Building and evaluating annotated corpora for medical NLP systems.

AU - Ogren, Philip V.

AU - Savova, Guergana

AU - Buntrock, James D.

AU - Chute, Christopher G.

PY - 2006

Y1 - 2006

N2 - We report efforts from a pilot annotation project in which we annotated sixty clinical notes with disorder mentions. Four retrieval experts annotated the same clinical notes so that four-way inter-annotator agreement could be calculated. We find the inter-annotator agreement results encouraging to scale up the project using the same guidelines and annotation schema.

AB - We report efforts from a pilot annotation project in which we annotated sixty clinical notes with disorder mentions. Four retrieval experts annotated the same clinical notes so that four-way inter-annotator agreement could be calculated. We find the inter-annotator agreement results encouraging to scale up the project using the same guidelines and annotation schema.

UR - http://www.scopus.com/inward/record.url?scp=34748825515&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=34748825515&partnerID=8YFLogxK

M3 - Article

C2 - 17238668

AN - SCOPUS:34748825515

SN - 1559-4076

JO - AMIA ... Annual Symposium proceedings / AMIA Symposium. AMIA Symposium

JF - AMIA ... Annual Symposium proceedings / AMIA Symposium. AMIA Symposium

ER -

Building and evaluating annotated corpora for medical NLP systems.

Abstract

ASJC Scopus subject areas

Other files and links

Fingerprint

Cite this