COVID update: Due to the pandemic the course will be offered online, both theory sessions and practical labs. We will try offer an engaging course, both at the theoretical and hands-on practical sessions.

Language Technology is increasingly present in many of the applications we use in our everyday activities (Google Home, Amazon Alexa, Siri, Google Translate, Grammar checkers, Google search engine...) and the need of experts that can develop applications based on Language Technology is an ever growing demand both in the industry and academia. This course will introduce the most commonly used techniques to build applications based on Language Technology. Thus, the attendees will learn how to apply techniques such as document classification, sequence labeling, as well as vector-based word representations (embeddings) and pretrained language models for core applications such as Opinion Mining, Named Entity Recognition, Fake News Detection or Question Answering.

The course will have a practical focus (laboratories and practical tasks) learning to use readily available LT toolkits (Spacy, Flair, etc.) based on machine and deep learning in a multilingual and multi-domain setting. The aim is to allow attendees to acquire the required autonomy to solve practical problems by applying and developing Language Technology applications. The course will be taught in English.

The course is part of the NLP master hosted by the Ixa NLP research group at the HiTZ research center of the University of the Basque Country (UPV/EHU).

Student profile

This course is targeted to graduate students and professionals from a range of disciplines (linguistics, journalism, computer science, sociology, etc.) that need an applied introduction to Language Technology. This involves identifying the required linguistic resources, appropriate tools/libraries and techniques with the aim of acquiring the required autonomy to solve practical problems by applying and developing applications based on Language Technology in different and creative ways.

For the practical content (coding exercises) some experience in python programming is recommended. Previous attendance to the Deep Learning for Natural Language Processing course is might be useful although not required.

Contents

Introduction to Applications of Language Technology

Natural Language Processing
Cross-lingual Information Extraction
LABORATORY: Stance detection with logistic regression
. Features
. Static Word Embeddings
Introduction to Flair
Introduction to Spacy

Text Classification

Fake News, Stance and Propaganda
Detection
. Fake News
. Hyperpartisanism
. Hate speech
Inference
. Fact-checking
. Stance
. Argumentation
LABORATORY: Stance Detection
. Training with Flair and Spacy

Sequence Labelling

Named Entity Recognition
. Contextual Word Representations
. Datasets
. Evaluation
Morphology
. Contextual and neural lemmatization
. Evaluation and application to high-inflected languages
LABORATORY: Train language independent neural sequence taggers with Flair
. Named Entity Recognition
. Contextual lemmatization.

Opinion Mining

Fine-grained Sentiment Analysis
Aspect-based Sentiment Analysis
Multidomain and multilingual issues
LABORATORY:
Sentiment Analysis
. Text Classification
Opinion Targets and Aspects
. Sequence Labelling

Question Answering

Redefining NLP tasks as QA
Pre-trained language models, Transformers
Multilingual transfer learning
Last words
LABORATORY Build and train a Question Answering system.

Instructors

Person 1

Rodrigo Agerri

Ramon y Cajal researcher, member of Ixa
and HiTZ

Person 2

Joseba Fernandez de Landa

FPI researcher, member of Ixa
and HiTZ

Person 3

Iker Garcia

FPI researcher, member of Ixa
and HiTZ

Practical details

General information

The classes will be held online. The practical labs will also be online, in two split groups with one lecturer in each.

Part of the Language Analysis and Processing master program.
9 theoretical sessions with corresponding programming labs (25 hours).
February 2nd to March 9th 2022, see calendar below for session times.

Course language: English.
Capacity: 60 attendants (First-come first-served).
Cost: 184 euros (180 for UPV/EHU members or if you also apply to DL4NLP course.).

Week Date Hour
1 Feb 2 15:00-17.30
2 Feb 9 15:00-17.30
3 Feb 16 15:00-17.30
4 Feb 22 17:30-20:00
Feb 23 15:00-17.30
5 March 1 17:30-20:00
March 2 15:00-17.30
6 March 8 17:30-20:00
March 9 15:00-17.30

Registration

Registration is closed on the 12th of January 2022 (or until full).
Please register by email to amaia.lorenzo@ehu.eus (subject "Registration to ILTAPP" and CC rodrigo.agerri@ehu.eus).
Also for any enquiry you might have.
The university provides official certificates (for an additional 27.96 euros). Please apply AFTER completing the course.
UPV/EHU can provide invoices addressed to universities or companies. More details are provided after registration is made.


Prerequisites
Basic Python programming experience.
Not a requirement but, previous attendance to the Deep Learning for Natural Language Processing course held the previous week will help students to better understand the underlying algorithms of Language Technology applications.
Bring your own laptop (no need to install anything).

Previous editions

Online class of July 2021.