#ir2010
Study, design and analysis of IR systems which are efficient and effective to process, mine, search, cluster and classify documents, coming from textual, html or XML data collections. In particular, we will:
Project assigned during the course, plus an oral discussion concerning with the project and the course material.
Date | Argument | Refs | Speaker |
---|---|---|---|
20/10/2010 | Introduction: large data collections and new algorithmic challanges? | slides | |
25/10/2010 | Boolean retrieval: Inverted Lists = Dictionary + Postings. Query resolution via list-intersection. | Chap 1 in [MRS], and slides | |
28/10/2010 | Index construction: BSBI, SPIMI, distributed (Map-Reduce), dynamic. | Chap 4 in [MRS] and notes (drop "Snow Plow"), slides | |
04/11/2010 | The term vocabulary: parsing, tokenization, lemmatization, stemming, Thesauri, soundex, etc.. Statistical models for texts: Zipf, Luhn. | Chap 2.1, 2.2 and 5.1 in [MRS], slides | |
08/11/2010 | Faster boolean query processing: skips and phrase queries. String search: Hash Tables, Cuckoo hashing. | Chap 2.3, 2.4, and slides | |
11/11/2010 | Min-Ordered Perfect Hash. Prefix search: Tries, 2-level indexing, Front-coding. | notes and slides | |
15/11/2010 | Tolerant retrieval. | Chap 3 and 5.2 in [MRS], and slides | |
18/11/2010 | The Bloom Filter. | slides are enough | |
22/11/2010 | IL compressed storage | chaps 5 in [MRS] and slides | |
02/12/2010 | Document storage via Huffman, its canonical variant and Huffword. LZ-compression: LZ77, LZ78, gzip. | all data compression's material can be found in Chap 2 in [WMB] and slides | |
06/12/2010 | Scoring, term weighting and the vector space model. Relevance feedback and pseudo-relevance. Query expansion. top-k retrieval | chap 6, 7 and 9 in [MRS] | |
09/12/2010 | Zone indexes. Recommendation Systems (sketch). Quality of the results: Precision, Recall, F-measure. | chap 8 in [MRS] and slides | |
13/12/2010 | Lucene in action. | slides and web site | Ugo Scaiella |
16/12/2010 | Self-evaluation at home on Lucene: a small project. | ||
20/12/2010 | Self-evaluation at home on Lucene: a small project. | ||
10/01/2011 | Web search-engines: Web features and structure, advertising (sketch), crawling, consistent hash. | 19.1-19.4 in [MRS], also this note, and chap 20 | |
13/01/2011 | Web search-engines: connectivity server, doc-duplicate detection (shingling and min-hash) and link-based ranking. | 19.6 and 21 in [MRS], slides | |
17/01/2011 | Text Classification via Supervised Learning: definition and applications. | Fabrizio Sebastiani | |
20/01/2011 | Automated text categorization: the machine learning approach, the indexing step. | Fabrizio Sebastiani | |
24/01/2011 | Automated text categorization: Methods for the inductive construction of a classifier | slides | Fabrizio Sebastiani |