252-0341-01L Information Retrieval
|Semester||Spring Semester 2019|
|Periodicity||yearly recurring course|
|Language of instruction||English|
|Abstract||This course gives an introduction to information retrieval with a focus on text documents and unstructured data.|
Main topics comprise document modelling, various retrieval techniques, indexing techniques, query frameworks, optimization, evaluation and feedback.
|Objective||We keep accumulating data at an unprecedented pace, much faster than we can process it. While Big Data techniques contribute solutions accounting for structured or semi-structured shapes such as tables, trees, graphs and cubes, the study of unstructured data is a field of its own: Information Retrieval.|
After this course, you will have in-depth understanding of broadly established techniques in order to model, index and query unstructured data (aka, text), including the vector space model, boolean queries, terms, posting lists, dealing with errors and imprecision.
You will know how to make queries faster and how to make queries work on very large datasets. You will be capable of evaluating the quality of an information retrieval engine.
Finally, you will also have knowledge about alternate models (structured data, probabilistic retrieval, language models) as well as basic search algorithms on the web such as Google's PageRank.
2. Boolean retrieval: the basics of how to index and query unstructured data.
3. Term vocabulary: pre-processing the data prior to indexing: building the term vocabulary, posting lists.
4. Tolerant retrieval: dealing with spelling errors: tolerant retrieval.
5. Index construction: scaling up to large datasets.
6. Index compression: how to improve performance by compressing the index in various ways.
7. Ranked retrieval: how to ranking results with scores and the vector space model
8. Scoring in a bigger picture: taking ranked retrieval to the next level with various improvements, including inexact retrieval
9. Probabilistic information retrieval: how to leverage Bayesian techniques to build an alternate, probabilistic model for information retrieval
10. Language models: another alternate model based on languages, automata and document generation
11. Evaluation: precision, recall and various other measurements of quality
12. Web search: PageRank
The lecture structure will follow the pedagogical approach of the book (see material).
The field of information retrieval also encompasses machine learning aspects. However, we will make a conscious effort to limit overlaps, and be complementary with, the Introduction to Machine Learning lecture.
|Literature||C. D. Manning, P. Raghavan, H. Schütze, Introduction to Information Retrieval, Cambridge University Press.|
|Prerequisites / Notice||Prior knowledge in elementary set theory, logics, linear algebra, data structures, abstract data types, algorithms, and probability theory (at the Bachelor's level) is required, as well as programming skills (we will use Python).|
|Performance assessment information (valid until the course unit is held again)|
|Performance assessment as a semester course|
|ECTS credits||4 credits|
|Language of examination||English|
|Repetition||The performance assessment is only offered in the session after the course unit. Repetition only possible after re-enrolling.|
|Mode of examination||written 150 minutes|
|Additional information on mode of examination||Working on the exercises is rewarded in the sense of ETH's continuous performance assessment with up to 0.25 bonus points. In principle, it is expected that students solve all exercises. In order to control this, in three weeks indicated on the course website, there will be a graded assignment. If two of these three graded assignments are passed, then 0.25 will be added to the final grade.|
The final exam may be computer-based.
|This information can be updated until the beginning of the semester; information on the examination timetable is binding.|
|Main link||Course Website|
|Only public learning materials are listed.|
|252-0341-01 V||Information Retrieval||2 hrs|
|252-0341-01 U||Information Retrieval||1 hrs|
|No information on groups available.|
|There are no additional restrictions for the registration.|