Discriminative Lexical Semantic Segmentation with Gaps: Running the MWE Gamut
Abstract
We present a novel representation, evaluation measure, and supervised models for the task of identifying the multiword expressions (MWEs) in a sentence, resulting in a lexical semantic segmentation. Our approach generalizes a standard chunking representation to encode a subset of projective MWEs containing gaps, thereby enabling efficient sequence tagging algorithms for feature-rich discriminative models. Experiments on a new dataset of English web text offer the first linguistically-driven evaluation of MWE identification with truly heterogeneous expression types. Our statistical sequence model greatly outperforms a lookup-based segmentation procedure, achieving 60% F1 for MWE identification.
Full Text:
PDF (Presented at ACL 2014)Refbacks
- There are currently no refbacks.
Copyright (c) 2014 Association for Computational Linguistics

This work is licensed under a Creative Commons Attribution 4.0 International License.