magistraleinformatica:eln:start
Indice
Elaborazione del Linguaggio Naturale
Laurea Magistrale: Informatica.
Docente: Giuseppe Attardi Ricevimento: Friday, 11:00
| Schedule | ||
|---|---|---|
| Day | Hour | Room |
| Thursday | 11-13 | N1, Polo Fibonacci |
| Friday | 16-18 | N1, Polo Fibonacci |
Forum
Forum on Piazza
Prerequisites
- Basic Probability and Statistics
- Programming
Syllabus
- Introduction
- History
- Present and Future
- NLP and the Web
- Mathematical Background
- Probability and Statistics
- Language Model
- Hidden Markov Model
- Viterbi Algorithm
- Generative vs Discriminative Models
- Linguistic Essentials
- Part of Speech and Morphology
- Phrase structure
- Collocations
- n-gram Models
- Word Sense Disambiguation
- Word Embeddings
- Preprocessing
- Encoding
- Regular Expressions
- Segmentation
- Tokenization
- Normalization
- Machine Learning Basics
- Text Classification and Clustering
- Tagging
- Part of Speech
- Named Entity
- Sentence Structure
- Constituency Parsing
- Dependency Parsing
- Semantic Analysis
- Statistical Machine Translation
- Deep Learning
- Libraries
- NLTK
- Theano/Keras
- Tensorflow
- Applications
- Opinion Mining
- Entity Linking
- Semantic Search
- Question Answering
- Language Inference
Lecture Notes
| Date | Lecture | Notes |
|---|---|---|
| 22/9/2016 | L'età della parola | L'età della parola |
| 23/9/2016 | Introduction | Introduction |
| 29/9/2016 | Introduction to probability (Probability) | |
| 30/9/2016 | Language Modeling (Language Modeling) | Jupyter Notebook |
| 6/10/2016 | Python Tutorial (Tutorial) | Python Tutorial Notebook |
| 7/10/2016 | Python Tutorial and examples (Python: Functionals and Generators) | Homework 1 |
| 13/10/2016 | Introduction to NLTK (slides) | |
| 14/10/2016 | Segmentation and Tokenization (slides) | |
| 20/10/2016 | Text Classification (slides) | |
| 21/10/2016 | Naive Bayes Classifier (slides) | Homework n. 2 |
| 27/10/2016 | Maximum Entropy Models (slides) | |
| 28/10/2016 | Hidden Markov Model (slides) | |
| 10/11/2016 | Named Entity Recognition (slides) | |
| 11/11/2016 | MEMM (slides) | |
| 17/11/2016 | Perceptron, SVM (8-classifiers.ppt) | |
| 19/11/2016 | Deep Learning Libraries | keras-mnist-tutorial.zip |
| 24/11/2016 | Dependency Formalism (slides) | |
| 25/11/2016 | Dependency Parsing (Transition Based) | Topics for Seminars and Projects |
| 1/12/2016 | Dependency Parsing (Graph Based ) | |
| 2/12/2016 | Sentiment Analysis13-opinionmining.ppt | |
| Deep Learning Deep Learning Tutorial at NAACL 2013 | ML Course by Andrew Ng | |
| Deep Learning for NLP DL and the DeepNL Library | ||
| 15/12/2016 | Machine Translation (MT) (PBMT) | |
| PB SMT (Phrase Tables, Decoding, Evaluation) | ||
| 16/12/2016 | Universal Dependencies | |
| State of the Art in Sentiment Analysis of Tweets NRC Canada at SemEval 2013 | ||
| Relation Extraction 12-relextraction.ppt | ||
| The tsunami of Deep Learning over NLP | ||
| Andrew Ng | Nuts and Bolts of Building Applications using Deep Learning |
Textbooks
- C. Manning, H. Schutze. Foundations of Statistical Natural Language Processing. MIT Press, 2000.
- D. Jurafsky, J.H. Martin, Speech and Language Processing. 2nd edition, Prentice-Hall, 2008. See also upcoming 3rd edition.
- S. Kubler, R. McDonald, J. Nivre. Dependency Parsing. 2010.
- P. Koehn. Statistical Machine Translation. Cambridge University Press, 2010.
- S. Bird, E. Klein, E. Loper. Natural Language Processing with Python.
- I. Goodfellow, Y. Bengio, A. Courville. Deep Learning. MIT Press, 2016.
- M. Nielsen. Neural Networks and Deep Learning.
Related Courses
Natural Language Processing with Deep Learning, Stanford.
Natural Language Processing with Deep Learning, video lectures, Stanford.
Exam
Project or seminar.
Evalita 2015 Projects
- SentiPolc: Sentiment Polarity in Twitter. Primo classificato.
- NeelIt: Named Entity Recognition and Linking in Twitter. Primo classificato
Affine courses
- Apprendimento Automatico: Fondamenti
- Data Mining: fondamenti
- Information Retrieval
- Sistemi Basati sulla Conoscenza
Edizioni Precedenti
magistraleinformatica/eln/start.txt · Ultima modifica: 07/03/2018 alle 10:19 (7 anni fa) da Giuseppe Attardi