LIN/CSE 467/567: Computational Linguistics

Instructor Name: Dr. Cassandra Jacobs

Class Day and Time: MWF 11AM-12PM

Location: Remote (see Brightspace for Zoom link)

Number of Credits: 3-4 units

Email Address: cxjacobs@buffalo.edu

Office Hours Location: Clemens 224 (Computational Linguistics Lab)

Office Hours: Monday 12-2pm or by appointment

Teaching Assistants - Office hours:
Tianle Yang (tianleya@buffalo.edu) - 8-9am Wednesdays and Fridays
Candy Angulo Pando (candyang@buffalo.edu) - 2-3pm Tuesdays and Thursdays

Course description

This course aims to provide students with an overview of the key areas which make up the field called Computational Linguistics, an understanding of the major challenges of the field as well as the major application areas for language processing techniques, and the skills to implement fundamental language processing algorithms. This course is dual listed between CSE 467/567 and LIN 467/567.

Required Text and Materials

All reading materials will be made available on Brightspace as well as the course webpage and will consist primarily of readings from the 3rd Edition of the Jurafsky and Martin (SLP3) book Speech and Language Processing: https://web.stanford.edu/~jurafsky/slp3/, version published 2024-08-20. The book is freely available. The text is used and referenced in lectures, as well as take-home exams.

Goals

Class/lecture structure

The course is held synchronously and it is expected that you will contribute to the course community. Lectures are presented as Jupyter notebooks with Python code. Engagement with the course material and with other students is critical for a fun and fulfilling experience in the classroom for everyone — even asking or answering “basic” questions advances our learning goals.

Assignments will be submitted through Brightspace.

Grade composition

Exam format

There will be three exams for the course, each worth 30% of the final grade. Each exam will be an ORAL EXAM and will take place one-on-one with the instructor or TAs over Zoom with 20-minute appointment slots during the week during in which the exam is held; responses will be recorded and no technologies are permitted during the exam.

Grading Scales

I guarantee minimum grades — students are never curved down below the numeric grade they receive in the course. Depending on the distribution of scores, undergraduates and graduate students may be graded to a slightly different curve and some questions on assignments will be required for graduate students but bonus for undergraduate students. Here are the cutoffs for the grade categories:

Lecture and reading schedule

• Week 1 - Course introduction

• Week 2 - Mathematical Prerequisites - January 29 pre-recorded
  • Frequentist statistics
  • Probability theory and Bayes’ rule
  • Geometry
  • Objects
  • Functions
  • Python idiosyncrasies
  • Common NLP toolkits and comparisons

• Week 3 - Text preprocessing
  • What is a corpus? What are corpora?
  • Tokenization
  • Whitespace, Unicode, punctuation
  • Readings: Chapter 2

• Week 4 - Statistical language modeling
  • Computing n-gram statistics
  • N-gram smoothing, “history”, and interpolation
  • Motivating neural language models
  • Types of neural language models
  • Readings: Chapter 3 and Chapter 7

• Week 5 - Morphological structure
  • Learning and producing morphological structure
  • Word segmentation
  • Morphological induction
  • Readings: Appendix A

• Week 6 - Lexical semantics 1- EXAM - February 24-28
  • Semantic features and semantic knowledge
  • WordNet
  • LSA and word2vec
  • Readings: Chapter 19 and Chapter 23 (old); Appendix F and Appendix G (new)

• Week 7 - Lexical semantics 2
  • Transformer language models
  • Layerwise computation
  • Readings: Chapter 6 and Chapter 7

• Week 8 - Syntax 1
  • Part-of-speech tagging
  • The Viterbi algorithm
    • Readings: Chapter 8, Appendix A
  • Dependency parsing
    • Readings: Chapter 18, and Appendix D

• Week 9 - Spring Break! No class.

• Week 10 - Syntax 2
  • Shift reduce parsing
  • PCFGs
  • Challenges with parsers
  • Readings: Chapter 17, Appendix C {Appendix E Optional}

• Week 11 - Discourse and discourse structure - EXAM - March 24-28
  • Coreference resolution
  • Discourse relations
  • Annotated corpora and discourse parsers
  • Readings: Chapter 26 and Chapter 27 (old); Chapter 22 and Chapter 23 (new)

• Week 12 - Speech signal processing

• Week 13 - NLP for low-resource languages
  • Effect of typological properties on computational linguistics systems
  • Using “high-resource” languages to boost low-resource performance
  • Multilingual neural language models
  • Readings: Zoph, Yuret, May, and Knight (2016): https://aclanthology.org/D16-1163

• Week 14 - Evaluation metrics
  • Generating text
  • Computing performance
  • Inter-annotator agreement
  • Best practices for statistical NLP
  • Readings: Dror et al. (2018): https://aclanthology.org/P18-1128/

• Week 15 - Computational Psycholinguistics EXAM - April 28-May 2

• Week 16 (Monday only)

Accessibility Services and Student Resources:

If you have a disability and may require some type of instructional and/or examination accommodation, please inform me early in the semester so that we can coordinate the accommodations you may need.  If you have not already done so, please contact the Office of Accessibility Services (formerly the Office of Disability Services) University at Buffalo, 60 Capen Hall, Buffalo, NY 14260-1632; email: stu-accessibility@buffalo.edu Phone: 716-645-2608 (voice); 716-645-2616 (TTY); Fax: 716-645-3116; and on the web at http://www.buffalo.edu/studentlife/who-we-are/departments/accessibility.html. All information and documentation is confidential.

The University at Buffalo and the Graduate School of Education are committed to ensuring equal opportunity for persons with special needs to participate in and benefit from all of its programs, services and activities.

Academic Integrity:

Academic integrity is critical to the learning process. It is your responsibility as a student to complete your work in an honest fashion, upholding the expectations your individual instructors have for you in this regard. The ultimate goal is to ensure that you learn the content in your courses in accordance with UB’s academic integrity principles, regardless of whether instruction is in-person or remote. Thank you for upholding your own personal integrity and ensuring UB’s tradition of academic excellence.

It is expected that you will behave in an honorable and respectful way as you learn and share ideas. Therefore, recycled papers, work submitted to other courses, and major assistance in preparation of assignments without identifying and acknowledging such assistance are not acceptable. All work for this class must be original for this class. Please be familiar with the University and the School policies regarding plagiarism. Read the Academic Integrity Policy and Procedure for more information. Visit The Graduate School Policies & Procedures page (http://grad.buffalo.edu/succeed/current-students/policy-library.html) for the latest information.

Any use of generative AI (e.g., ChatGPT) is prohibited in this class and will be considered a violation of UB’s academic integrity policy. Details of what resources are allowed will be provided for each assignment. If you are unsure if a resource or tool is allowable, be sure to ask.

Course Evaluations:

You will have two opportunities to provide anonymous feedback about the course. In the middle of the semester, I will send you a brief questionnaire asking about what activities are contributing to your learning and what might be done to improve your learning. At the conclusion of the semester you will receive an email reminder requesting your participation in the Course Evaluation process. Please provide your honest feedback; it is important to the improvement and development of this course. Feedback received is anonymous and I do not receive copies of the Evaluations until after grades have been submitted for the semester.

Counseling Services:

As a student you may experience a range of issues that can cause barriers to learning or reduce your ability to participate in daily activities. These might include strained relationships, anxiety, high levels of stress, alcohol/drug problems, feeling down, health concerns, or unwanted sexual experiences. Counseling, Health Services and Health Promotion are here to help with these or other issues you may experience. You can learn more about these program and services by contacting:

Counseling Services

120 Richmond Quad (North Campus), 716-645-2720

202 Michael Hall (South Campus), 716-829-5900

https://www.buffalo.edu/studentlife/who-we-are/departments/counseling.html

Health Services

Michael Hall (South Campus), 716-829-3316

https://www.buffalo.edu/studentlife/who-we-are/departments/health.html

Office of Health Promotion

114 Student Union (North Campus), 716-645-2837

https://www.buffalo.edu/studentlife/who-we-are/departments/health-promotion.html

Sexual Harassment/Violence:

UB is committed to providing a safe learning environment free of all forms of discrimination and sexual harassment, including sexual assault, domestic and dating violence and stalking. If you have experienced gender-based violence (intimate partner violence, attempted or completed sexual assault, harassment, coercion, stalking, etc.), UB has resources to help. This includes academic accommodations, health and counseling services, housing accommodations, helping with legal protective orders, and assistance with reporting the incident to police or other UB officials if you so choose. Please contact UB’s Title IX Coordinator at 716-645-2266 for more information. For confidential assistance, you may also contact a Crisis Service Campus Advocate at 716-796-4399.

Please be aware UB faculty are mandated to report violence or harassment on the basis of sex or gender. This means that if you tell me about a situation, I will need to report it to the Office of Equity, Diversity and Inclusion. You will still have options about how the situation will be handled, including whether or not you wish to pursue a formal complaint. Please know that if you not wish to have UB proceed with an investigation, your request will be honored unless UB’s failure to act does not adequately mitigate the risk of harm to you or other members of the university community. You also have the option of speaking with trained counselors who can maintain confidentiality. UB’s Options for Confidentiality Disclosing Sexual Violence provides a full explanation of the resources available, as well as contact information. You may call UB’s Office of Equity, Diversity and Inclusion at 716-645-2266 for more information, and you have the option of calling that office anonymously if you would prefer not to disclose your identity.

Technology Recommendations

To effectively participate in this course, regardless of mode of instruction, the university recommends you have access to a Windows or Mac computer with webcam and broadband. Your best opportunity for success in the blended UB course delivery environment (in-person, hybrid and remote) will require these minimum capabilities.

Public health compliance in a classroom setting

UB student Behavioral Requirements in all Campus Public Spaces include:

1. Should a student need to miss class due to illness, isolation or quarantine, they are required to notify their faculty to make arrangements to make up missed work.

2. Students are responsible for following any additional directives in settings such as labs, clinical environments etc.