Niao He: Catalogue data in Spring Semester 2024 |
| Name | Prof. Dr. Niao He |
| Field | Computer Science |
| Address | Professur für Informatik ETH Zürich, OAT Y 21.1 Andreasstrasse 5 8092 Zürich SWITZERLAND |
| niao.he@inf.ethz.ch | |
| URL | https://odi.inf.ethz.ch/ |
| Department | Computer Science |
| Relationship | Assistant Professor (Tenure Track) |
| Number | Title | ECTS | Hours | Lecturers | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 252-0945-18L | Doctoral Seminar Machine Learning (FS24)  Only for Computer Science Ph.D. students. This doctoral seminar is intended for PhD students affiliated with the Institute for Machine Learning. Other PhD students who work on machine learning projects or related topics need approval by at least one of the organizers to register for the seminar. | 2 credits | 1S | T. Hofmann, V. Boeva, J. M. Buhmann, R. Cotterell, N. He, G. Rätsch, M. Sachan, J. Vogt, F. Yang | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Abstract | An essential aspect of any research project is dissemination of the findings arising from the study. Here we focus on oral communication, which includes: appropriate selection of material, preparation of the visual aids (slides and/or posters), and presentation skills. | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Learning objective | The seminar participants should learn how to prepare and deliver scientific talks as well as to deal with technical questions. Participants are also expected to actively contribute to discussions during presentations by others, thus learning and practicing critical thinking skills. | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Content | Following the successful format of the previous semester, we will conduct 3 mini-workshop style sessions of about 2-3 hours in duration. Scheduling is TBD. | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Prerequisites / Notice | This doctoral seminar of the Machine Learning Laboratory of ETH is intended for PhD students who work on a machine learning project, i.e., for the PhD students of the ML lab. | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Competencies |
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| 252-5256-00L | AI for Science Seminar The deadline for deregistering expires at the end of the second week of the semester. Students who are still registered after that date, but do not attend the seminar, will officially fail the seminar. | 2 credits | 2S | N. He, Z. Shen | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Abstract | Artificial intelligence (AI) and machine learning (ML) offer significant potential to revolutionize the fundamentals of scientific computation and discovery today. The goal of this seminar course is to expose student to the recent development of "AI for Science". | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Learning objective | The aim of this course is to showcase how AI techniques, such as deep learning, can enhance scientific research in the field of Physics. Students will first learn about relevant scientific models, such as key Partial Differential Equations and their associated dynamical systems. They will also explore various AI methods designed to advance traditional approaches. Furthermore, we will guide students through the actual implementation of foundational algorithms, enabling them to address critical scientific issues hands-on. | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Content | 1. Introduction to related scientific models. 2. AI methods designed to address the scientific problem. 3. Implementation of some fundamental algorithms. | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Literature | The related papers will be released in the first session of the seminar. | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Prerequisites / Notice | Basic knowledge of multivariate calculus, linear algebra, probablilty theory. The student is assumed to be familiar with Python. | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Competencies |
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| 261-5110-00L | Optimization for Data Science | 10 credits | 3V + 2U + 4A | B. Gärtner, N. He | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Abstract | This course provides an in-depth theoretical treatment of optimization methods that are relevant in data science. | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Learning objective | Understanding the guarantees and limits of relevant optimization methods used in data science. Learning theoretical paradigms and techniques to deal with optimization problems arising in data science. | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Content | This course provides an in-depth theoretical treatment of classical and modern optimization methods that are relevant in data science. After a general discussion about the role that optimization has in the process of learning from data, we give an introduction to the theory of (convex) optimization. Based on this, we present and analyze algorithms in the following four categories: first-order methods (gradient and coordinate descent, Frank-Wolfe, subgradient and mirror descent, stochastic and incremental gradient methods); second-order methods (Newton and quasi Newton methods); non-convexity (local convergence, provable global convergence, cone programming, convex relaxations); min-max optimization (extragradient methods). The emphasis is on the motivations and design principles behind the algorithms, on provable performance bounds, and on the mathematical tools and techniques to prove them. The goal is to equip students with a fundamental understanding about why optimization algorithms work, and what their limits are. This understanding will be of help in selecting suitable algorithms in a given application, but providing concrete practical guidance is not our focus. | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Prerequisites / Notice | A solid background in analysis and linear algebra; some background in theoretical computer science (computational complexity, analysis of algorithms); the ability to understand and write mathematical proofs. | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Competencies |
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| 263-5255-00L | Foundations of Reinforcement Learning | 7 credits | 3V + 3A | N. He | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Abstract | Reinforcement learning (RL) has been in the limelight of many recent breakthroughs in artificial intelligence. This course focuses on theoretical and algorithmic foundations of reinforcement learning, through the lens of optimization, modern approximation, and learning theory. The course targets M.S. students with strong research interests in reinforcement learning, optimization, and control. | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Learning objective | This course aims to provide students with an advanced introduction of RL theory and algorithms as well as bring them near the frontier of this active research field. By the end of the course, students will be able to - Identify the strengths and limitations of various reinforcement learning algorithms; - Formulate and solve sequential decision-making problems by applying relevant reinforcement learning tools; - Generalize or discover “new” applications, algorithms, or theories of reinforcement learning towards conducting independent research on the topic. | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Content | Topics include fundamentals of Markov decision processes, approximate dynamic programming, linear programming and primal-dual perspectives of RL, model-based and model-free RL, policy gradient and actor-critic algorithms, Markov games and multi-agent RL. If time allows, we will also discuss advanced topics such as batch RL, inverse RL, causal RL, etc. The course keeps strong emphasis on in-depth understanding of the mathematical modeling and theoretical properties of RL algorithms. | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Lecture notes | Lecture slides will be posted on Moodle. | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Literature | Dynamic Programming and Optimal Control, Vol I & II, Dimitris Bertsekas Reinforcement Learning: An Introduction, Second Edition, Richard Sutton and Andrew Barto. Algorithms for Reinforcement Learning, Csaba Czepesvári. Reinforcement Learning: Theory and Algorithms, Alekh Agarwal, Nan Jiang, Sham M. Kakade. | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Prerequisites / Notice | Students are expected to have strong mathematical background in linear algebra, probability theory, optimization, and machine learning. | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Competencies |
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||