Home
Curriculum Vitae
Publications
Research
Teaching
Service
Demos
Contact Information

Fall 2005

Instructors: Prof. Eduard Hovy (CS)
Prof. Jerry Hobbs (CS)
Prof. Robert Belvin (Ling)
Prof. Patrick Pantel (CS)

Course Overview:

Lexical semantics (the semantics of words) is becoming an increasingly important part of Natural Language Processing, as researchers and systems are beginning to address semantics at the large scale. This course covers aspects in NLP/AI, Semantics/Philosophy, Linguistics/Lexicography, and Ontologies/KR. This course addresses several core issues in the study of the semantics of words, including the definition of lexical semantics from various perspectives, the problem of primitives of meaning, the creation of semantically annotated corpora, ontologies, automated methods for acquiring semantic knowledge on a large scale, and a survey of related perspectives.

Assignments

There will be four homework assignments, each counting 25%.

  • Assignment 1: Due no later than September 30, 2005 at 11:59pm.
  • Assignment 2: Due no later than November 10, 2005.
  • Assignment 3: Due no later than December 1, 2005.
  • Assignment 4: Part I is due no later than November 15, 2005; Part II is due no later than November 22, 2005; Part III is due no later than December 9, 2005.

Prerequisites

There are no prerequisites for this course, though familiarity with AI, general programming, introductory linguistics, and introductory formal semantics would help.

Office Hours

TBA.

Required Text

TBA.

Recommended Texts

  • D. A. Cruse. 1986. Lexical Semantics. Cambridge University Press.
  • C. Fellbaum. 1998. WordNet: An Electronic Lexical Database. MIT Press.
  • J. Pustejovsky and S. Bergler (Eds.) 1991. Lexical Semantics and Knowledge Representation. Springer-Verlag.
  • Beth Levin. 1993. English Verb Classes and Alternations : A Preliminary Investigation. University Of Chicago Press.
  • Ray Jackendoff. 1992. Semantic Structures. MIT Press
  • The instructors will recommend foundation and cutting edge papers as weekly readings.

Topics:

Module 1 - Computational Lexical Semantics (Prof. Pantel)
Computational formulation of lexical semantics; statistics and information theory; automated methods for harvesting semantics (corpus- and web-based), applications (building a thesaurus, extracting paraphrases, discovering word classes, inducing word senses, automatically linking learned knowledge into formal ontologies)
August 25, 30; September 1, 6, 8; October 27

Module 2 - Deep Lexical Semantics (Prof. Hobbs)
Introduction to deep lexical semantics; interpretation as abduction; cognition and the cognitive lexicon; time and the word "Now"; causality and modality, similarity and the preposition "Like"
September 13, 15, 20, 27; October 13, 18, 20

Module 3 - Ontologies (Prof. Hovy)
Introduction to ontologies; semantic primitives; ontologies for shallow semantics; upper models; middle models and verb sense frames; the Omega ontology
September 22, 29; November 8, 10, 15, 17, 22

Module 4 - Linguistic Issues (Prof. Belvin)
Semantic cases, thematic relations hypothesis, semantic fields; lexical semantic decomposition; verb classes and alternations; formalisms and notation; mapping; lexicographical perspectives
October 4, 6, 11, 25; November 1, 3, 29

Module 5 - Annotation of Shallow Semantics (Prof. Hovy)
Sense annotation as in PropBank; the giant leap from senses to concepts; annotation and verification of sense and concept creation
November 17, 22

Schedule:

Lectures will be held in GFS107, Tuesdays/Thursdays 2pm-3:20pm

Date Topic Module Instructor
08/23 Lecture notes: Course overview and introduction to lexical semantics

Readings:

  • Hirst, G. 2004. Ontology and the Lexicon. In: Staab, Steffen and Studer, Rudi (editors), Handbook on Ontologies, Berlin: Springer. pp. 209-229.
  • Nirenburg, S. and Levin, L. S. 1991. Syntax-Driven and Ontology-Driven Lexical Semantics. Lecture Notes In Computer Science; Vol. 627. In Proceedings of the First SIGLEX Workshop on Lexical Semantics and Knowledge Representation. pp. 5-20. Berkeley, CA.
Intro Patrick Pantel
08/25 Lecture notes: Computational framework for modeling lexical semantics

Readings:

M1 Patrick Pantel
08/30 Lecture notes: Harvesting semantic relations from large corpora

Assignments:

  • Assignment 1 is out and due no later than September 30, 2005 at 11:59pm.

Readings:

M1 Patrick Pantel
09/01 Lecture notes: Harvesting semantic relations from the Web

Readings:

M1 Guest Lecturer: Dr. Timothy Chklovski
09/06 Lecture notes: Clustering - Discovering word classes and inducing word senses (part 1)

Readings:

M1 Patrick Pantel
09/08 Lecture notes: Clustering - Discovering word classes and inducing word senses (part 2)

Readings:

M1 Patrick Pantel
09/13 Lecture notes: Introduction to deep lexical semantics M2 Jerry Hobbs
09/15 Lecture notes: Framework for deep lexical semantics M2 Jerry Hobbs
09/20 Lecture notes: Cognition and the Cognitive Lexicon (Part 1)

Assignment 2: Example

M2 Jerry Hobbs
09/22 Semantics: Primitives or Compositionality? M3 Eduard Hovy
09/27 Lecture notes: Cognition and the Cognitive Lexicon (Part 2) M2 Jerry Hobbs
09/29 Lecture notes: Ontologies: Infrastructure and Methodology M3 Eduard Hovy
10/04 Lecture notes: What is Lexical Semantics? (part I) M4 Robert Belvin
10/06 Lecture notes: What is Lexical Semantics? (part II)

In-class exercise: Mapping Exercise

M4 Robert Belvin
10/11 Lecture notes: Case, Thematic Roles and Beyond M4 Robert Belvin
10/13 Lecture notes: Cognition and the Cognitive Lexicon (Part 3) M3 Jerry Hobbs
10/18 Lecture notes: Causality and Modality M3 Jerry Hobbs
10/20 Lecture notes: Similarity and "Like" M3 Jerry Hobbs
10/25 Lecture notes: Lexicalization Across Languages M4 Robert Belvin
10/27 Lecture notes: Ontologizing Harvested Knowledge

Readings:

M1 Patrick Pantel
11/01 Lecture notes: Empirical Grounding for Decomposition, Diathesis and Event Structure M4 Robert Belvin
11/03 Lecture notes: Varieties of Cognitive Semantic Structure M4 Guest Lecturer: Dr. Tim Clausner
11/08 Lecture notes: Ontology Content: Parsimonious to Profligate; Upper and Middle Models M3 Eduard Hovy
11/10 Lecture notes: The Omega Ontology, Annotation, and a Procedure for Middle Model Content Creation

Assignments:

M3 Eduard Hovy
11/15 Lecture notes: Creating and Testing Shallow Semantics via Annotation

Assignments:

M3 Eduard Hovy
11/17 Lecture notes: Combining and Standardizing Large-Scale Ontologies M5 Eduard Hovy
11/22 Lecture notes: Automated Methods to Build Ontology Content

Assignments:

M5 Eduard Hovy
11/29 TBA M4 Robert Belvin
12/01 Wrap-up Review Eduard Hovy, Robert Belvin, and Patrick Pantel


 

 

 

 

 

USC Home Page ISI Home Page