Search result: Catalogue data in Spring Semester 2024
Computer Science Master  
Minors  
Minor in Computer Graphics  
Number  Title  Type  ECTS  Hours  Lecturers  

252053800L  Shape Modeling and Geometry Processing  W  8 credits  2V + 1U + 4A  O. Sorkine Hornung  
Abstract  This course covers the fundamentals and developments in geometric modeling and geometry processing. Topics include surface modeling based on point clouds and polygonal meshes, mesh generation, surface reconstruction, mesh fairing and parameterization, discrete differential geometry, interactive shape editing, topics in digital shape fabrication.  
Learning objective  The students will learn how to design, program and analyze algorithms and systems for interactive 3D shape modeling and geometry processing.  
Content  Recent advances in 3D geometry processing have created a plenitude of novel concepts for the mathematical representation and interactive manipulation of geometric models. This course covers the fundamentals and some of the developments in geometric modeling and geometry processing. Topics include surface modeling based on point clouds and triangle meshes, mesh generation, surface reconstruction, mesh fairing and parameterization, discrete differential geometry, interactive shape editing and digital shape fabrication.  
Lecture notes  Slides and course notes  
Prerequisites / Notice  Prerequisites: Visual Computing, Computer Graphics or an equivalent class. Experience with C++ programming. Solid background in linear algebra and analysis. Some knowledge of differential geometry, computational geometry and numerical methods is helpful but not a strict requirement.  
Competencies 
 
263570400L  Artificial Intelligence for Digital Characters  W  4 credits  2V + 1A  R. Wampfler  
Abstract  This lecture provides an overview of techniques to build conversational digital characters.  
Learning objective  This lecture provides an overview of techniques to build conversational digital characters. Three main components of conversational digital characters are introduced: Chatbots, animation synthesis, and speech synthesis. Reallife application of such digital characters is demonstrated on different use cases (e.g., digital Einstein).  
Content  This lecture opens with basics on digital characters. Afterwards, the main components to build a conversational digital character are introduced. This includes the basics of natural language processing used to build a chatbot, animating a digital character based on motion capturing and deep learning, and synthesizing the speech. Further, autonomous agents based on knowledge graphs are covered. The lecture ends with reallife applications of digital characters.  
Literature  Lecture slides will be made available at the course website.  
Prerequisites / Notice  There are no prerequisites for this class. However, it will help if the student has taken an undergraduate or graduate level class in statistics or machine learning.  
Competencies 
 
252570600L  Mathematical Foundations of Computer Graphics and Vision  W  5 credits  2V + 1U + 1A  T. Aydin, A. Djelouah, B. Gözcü  
Abstract  This course presents the fundamental mathematical tools and concepts used in computer graphics and vision. Each theoretical topic is introduced in the context of practical vision or graphic problems, showcasing its importance in realworld applications.  
Learning objective  The main goal is to equip the students with the key mathematical tools necessary to understand stateoftheart algorithms in vision and graphics. In addition to the theoretical part, the students will learn how to use these mathematical tools to solve a wide range of practical problems in visual computing. After successfully completing this course, the students will be able to apply these mathematical concepts and tools to practical industrial and academic projects in visual computing.  
Content  The theory behind various mathematical concepts and tools will be introduced, and their practical utility will be showcased in diverse applications in computer graphics and vision. The course will cover topics in sampling, reconstruction, approximation, optimization, robust fitting, differentiation, quadrature and spectral methods. Applications will include 3D surface reconstruction, camera pose estimation, image editing, data projection, character animation, structureaware geometry processing, and rendering.  
263580600L  Digital Humans  W  8 credits  3V + 2U + 2A  S. Tang  
Abstract  This course covers the core technologies required to model and simulate motions for digital humans. The curriculum includes human body modeling, human motion capture, datadriven human motion synthesis, and MLbased generative models. Each topic will be extensively illustrated with examples to provide a comprehensive understanding of the subject matter.  
Learning objective  Students will learn how to estimate human pose, shape, and motion from videos and create basic human avatars from various visual inputs. Students will also learn how to represent and algorithmically generate motions for digital characters. The lectures are accompanied by exercise sessions and a capstone project.  
Content   Basic concepts of 3D representations  Human body/hand models  Human motion capture;  Neural rendering  Transformers  Generative models for digital humans  
Prerequisites / Notice  Experience with python and C++ programming, numerical linear algebra, multivariate calculus and probability theory. Solid background in deep learning, computer vision, physicsbased modeling, kinematics, and dynamics is preferred.  
Competencies 
 
Minor in Computer Vision  
Number  Title  Type  ECTS  Hours  Lecturers  
252057900L  3D Vision  W  5 credits  3G + 1A  M. Pollefeys, D. B. Baráth  
Abstract  The course covers camera models and calibration, feature tracking and matching, camera motion estimation via simultaneous localization and mapping (SLAM) and visual odometry (VO), epipolar and multview geometry, structurefrommotion, (multiview) stereo, augmented reality, and imagebased (re)localization.  
Learning objective  After attending this course, students will: 1. understand the core concepts for recovering 3D shape of objects and scenes from images and video. 2. be able to implement basic systems for visionbased robotics and simple virtual/augmented reality applications. 3. have a good overview over the current stateofthe art in 3D vision. 4. be able to critically analyze and asses current research in this area.  
Content  The goal of this course is to teach the core techniques required for robotic and augmented reality applications: How to determine the motion of a camera and how to estimate the absolute position and orientation of a camera in the real world. This course will introduce the basic concepts of 3D Vision in the form of short lectures, followed by student presentations discussing the current stateoftheart. The main focus of this course are student projects on 3D Vision topics, with an emphasis on robotic vision and virtual and augmented reality applications.  
Competencies 
 
263371000L  Machine Perception  W  8 credits  3V + 2U + 2A  J. Song, X. Chen, S. Coros, O. Hilliges, M. Kaufmann  
Abstract  Recent developments in neural networks have drastically advanced the performance of machine perception systems in a variety of areas including computer vision, robotics, and human shape modeling. This course is a deep dive into deep learning algorithms and architectures with applications to a variety of perceptual and generative tasks.  
Learning objective  Students will learn about fundamental aspects of modern deep learning approaches for perception and generation. Students will learn to implement, train and debug their own neural networks and gain a detailed understanding of cuttingedge research in learningbased computer vision, robotics, and shape modeling. The optional final project assignment will involve training a complex neural network architecture and applying it to a realworld dataset. The core competency acquired through this course is a solid foundation in deeplearning algorithms to process and interpret humancentric signals. In particular, students should be able to develop systems that deal with the problem of recognizing people in images, detecting and describing body parts, inferring their spatial configuration, performing action/gesture recognition from still images or image sequences, also considering multimodal data, among others.  
Content  We will focus on teaching: how to set up the problem of machine perception, the learning algorithms, network architectures, and advanced deep learning concepts in particular probabilistic deep learning models. The course covers the following main areas: I) Foundations of deep learning. II) Advanced topics like probabilistic generative modeling of data (latent variable models, generative adversarial networks, autoregressive models, invertible neural networks, diffusion models). III) Deep learning in computer vision, humancomputer interaction, and robotics. Specific topics include: I) Introduction to Deep Learning: a) Neural Networks and training (i.e., backpropagation) b) Feedforward Networks c) Timeseries modelling (RNN, GRU, LSTM) d) Convolutional Neural Networks II) Advanced topics: a) Latent variable models (VAEs) b) Generative adversarial networks (GANs) c) Autoregressive models (PixelCNN, PixelRNN, TCN, Transformer) d) Invertible Neural Networks / Normalizing Flows e) Coordinatebased networks (neural implicit surfaces, NeRF) f) Diffusion models III) Applications in machine perception and computer vision: a) Fully Convolutional architectures for dense perpixel tasks (i.e., instance segmentation) b) Pose estimation and other tasks involving human activity c) Neural shape modeling (implicit surfaces, neural radiance fields) d) Deep Reinforcement Learning and Applications in PhysicsBased Behavior Modeling  
Literature  Deep Learning Book by Ian Goodfellow and Yoshua Bengio  
Prerequisites / Notice  This is an advanced gradlevel course that requires a background in machine learning. Students are expected to have a solid mathematical foundation, in particular in linear algebra, multivariate calculus, and probability. The course will focus on stateoftheart research in deep learning and will not repeat the basics of machine learning Please take note of the following conditions: 1) Students must have taken the exam in Machine Learning (252053500) or have acquired equivalent knowledge 2) All practical exercises will require basic knowledge of Python and will use libraries such as Pytorch, scikitlearn, and scikitimage. We will provide introductions to Pytorch and other libraries that are needed but will not provide introductions to basic programming or Python. The following courses are strongly recommended as prerequisites: * "Visual Computing" or "Computer Vision" The course will be assessed by a final written examination in English. No course materials or electronic devices can be used during the examination. Note that the examination will be based on the contents of the lectures, the associated reading materials, and the exercises. The exam will be a 3hour endofterm exam and take place at the end of the teaching period.  
Competencies 
 
263505200L  Interactive Machine Learning: Visualization & Explainability  W  5 credits  3G + 1A  M. ElAssady  
Abstract  Visual Analytics supports the design of humanintheloop interfaces that enable humanmachine collaboration. In this course, will go through the fundamentals of designing interactive visualizations, later applying them to explain and interact with machine leaning models.  
Learning objective  The goal of the course is to introduce techniques for interactive information visualization and to apply these on understanding, diagnosing, and refining machine learning models.  
Content  Interactive, mixedinitiative machine learning promises to combine the efficiency of automation with the effectiveness of humans for a collaborative decisionmaking and problemsolving process. This can be facilitated through coadaptive visual interfaces. This course will first introduce the foundations of information visualization design based on data charecteristics, e.g., highdimensional, geospatial, relational, temporal, and textual data. Second, we will discuss interaction techniques and explanation strategies to enable explainable machine learning with the tasks of understanding, diagnosing, and refining machine learning models. Tentative list of topics: 1. Visualization and Perception 2. Interaction and Explanation 3. Systems Overview  
Lecture notes  Course material will be provided in form of slides.  
Literature  Will be provided during the course.  
Prerequisites / Notice  Basic understanding of machine learning as taught at the Bachelor's level.  
Minor in Data Management  
Number  Title  Type  ECTS  Hours  Lecturers  
227055800L  Principles of Distributed Computing  W  7 credits  2V + 2U + 2A  R. Wattenhofer  
Abstract  We study the fundamental issues underlying the design of distributed systems: communication, coordination, faulttolerance, locality, parallelism, selforganization, symmetry breaking, synchronization, uncertainty. We explore essential algorithmic ideas and lower bound techniques.  
Learning objective  Distributed computing is essential in modern computing and communications systems. Examples are on the one hand largescale networks such as the Internet, and on the other hand multiprocessors such as your new multicore laptop. This course introduces the principles of distributed computing, emphasizing the fundamental issues underlying the design of distributed systems and networks: communication, coordination, faulttolerance, locality, parallelism, selforganization, symmetry breaking, synchronization, uncertainty. We explore essential algorithmic ideas and lower bound techniques, basically the "pearls" of distributed computing. We will cover a fresh topic every week.  
Content  Distributed computing models and paradigms, e.g. message passing, shared memory, synchronous vs. asynchronous systems, time and message complexity, peertopeer systems, smallworld networks, social networks, sorting networks, wireless communication, and selforganizing systems. Distributed algorithms, e.g. leader election, coloring, covering, packing, decomposition, spanning trees, mutual exclusion, store and collect, arrow, ivy, synchronizers, diameter, allpairsshortestpath, wakeup, and lower bounds  
Lecture notes  Available.  
Literature  Lecture Notes By Roger Wattenhofer. These lecture notes are taught at about a dozen different universities through the world. Mastering Distributed Algorithms Roger Wattenhofer Inverted Forest Publishing, 2020. ISBN 9798628688267 Distributed Computing: Fundamentals, Simulations and Advanced Topics Hagit Attiya, Jennifer Welch. McGrawHill Publishing, 1998, ISBN 007709352 6 Introduction to Algorithms Thomas Cormen, Charles Leiserson, Ronald Rivest. The MIT Press, 1998, ISBN 0262530910 oder 0262031418 Disseminatin of Information in Communication Networks Juraj Hromkovic, Ralf Klasing, Andrzej Pelc, Peter Ruzicka, Walter Unger. SpringerVerlag, Berlin Heidelberg, 2005, ISBN 3540008462 Introduction to Parallel Algorithms and Architectures: Arrays, Trees, Hypercubes Frank Thomson Leighton. Morgan Kaufmann Publishers Inc., San Francisco, CA, 1991, ISBN 1558601171 Distributed Computing: A LocalitySensitive Approach David Peleg. Society for Industrial and Applied Mathematics (SIAM), 2000, ISBN 0898714648  
Prerequisites / Notice  Course prerequisites: Interest in algorithmic problems. (No particular course needed.)  
Competencies 
 
263385500L  Cloud Computing Architecture  W  9 credits  3V + 2U + 3A  A. Klimovic  
Abstract  Cloud computing hosts a wide variety of online services that we use on a daily basis, including web search, social networks, and video streaming. This course will cover how datacenter hardware, systems software, and application frameworks are designed for the cloud.  
Learning objective  After successful completion of this course, students will be able to: 1) reason about performance, energy efficiency, and availability tradeoffs in the design of cloud system software, 2) describe how datacenter hardware is organized and explain why it is organized as such, 3) implement cloud applications as well as analyze and optimize their performance.  
Content  In this course, we study how datacenter hardware, systems software, and applications are designed at large scale for the cloud. The course covers topics including server design, cluster management, largescale storage systems, serverless computing, data analytics frameworks, and performance analysis.  
Lecture notes  Lecture slides will be available on the course website.  
Prerequisites / Notice  Undergraduate courses in 1) computer architecture and 2) operating systems, distributed systems, and/or database systems are strongly recommended.  
263535400L  Large Language Models  W  8 credits  3V + 2U + 2A  R. Cotterell, M. Sachan, F. Tramèr  
Abstract  Large language models have become one of the most commonly deployed NLP inventions. In the past halfdecade, their integration into core natural language processing tools has dramatically increased the performance of such tools, and they have entered the public discourse surrounding artificial intelligence.  
Learning objective  To understand the mathematical foundations of large language models as well as how to implement them.  
Content  We start with the probabilistic foundations of language models, i.e., covering what constitutes a language model from a formal, theoretical perspective. We then discuss how to construct and curate training corpora, and introduce many of the neuralnetwork architectures often used to instantiate language models at scale. The course covers aspects of systems programming, discussion of privacy and harms, as well as applications of language models in NLP and beyond.  
Literature  The lecture notes will be supplemented with various readings from the literature.  
Minor in Information Security  
Number  Title  Type  ECTS  Hours  Lecturers  
252040800L  Cryptographic Protocols  W  6 credits  2V + 2U + 1A  M. Hirt  
Abstract  In a cryptographic protocol, a set of parties wants to achieve some common goal, while some of the parties are dishonest. Most prominent example of a cryptographic protocol is multiparty computation, where the parties compute an arbitrary (but fixed) function of their inputs, while maintaining the secrecy of the inputs and the correctness of the outputs even if some of the parties try to cheat.  
Learning objective  To know and understand a selection of cryptographic protocols and to be able to analyze and prove their security and efficiency.  
Content  The selection of considered protocols varies. Currently, we consider multiparty computation, secretsharing, broadcast and Byzantine agreement. We look at both the synchronous and the asynchronous communication model, and focus on simple protocols as well as on highlyefficient protocols.  
Lecture notes  We provide handouts of the slides. For some of the topics, we also provide papers and/or lecture notes.  
Prerequisites / Notice  A basic understanding of fundamental cryptographic concepts (as taught for example in the course Information Security) is useful, but not required.  
Competencies 
 
263460000L  Formal Methods for Information Security  W  5 credits  2V + 1U + 1A  S. Krstic, R. Sasse, C. Sprenger  
Abstract  The course focuses on formal methods for the modeling and analysis of security protocols for critical systems, ranging from authentication protocols for network security to electronic voting protocols and online banking. In addition, we will also introduce the notions of noninterference and runtime monitoring.  
Learning objective  The students will learn the key ideas and theoretical foundations of formal modeling and analysis of security protocols. The students will complement their theoretical knowledge by solving practical exercises, completing a small project, and using stateoftheart tools. The students also learn the fundamentals of noninterference and runtime monitoring.  
Content  The course treats formal methods mainly for the modeling and analysis of security protocols. Cryptographic protocols (such as SSL/TLS, SSH, Kerberos, SAML singlesign on, and IPSec) form the basis for secure communication and business processes. Numerous attacks on published protocols show that the design of cryptographic protocols is extremely errorprone. A rigorous analysis of these protocols is therefore indispensable, and manual analysis is insufficient. The lectures cover the theoretical basis for the (toolsupported) formal modeling and analysis of such protocols. Specifically, we discuss their operational semantics, the formalization of security properties, and techniques and algorithms for their verification. The second part of this course will cover a selection of advanced topics in security protocols such as abstraction techniques for efficient verification, secure communication with humans, the link between symbolic protocol models and cryptographic models as well as RFID protocols (a staple of the Internet of Things) and electronic voting protocols, including the relevant privacy properties. Moreover, we will give an introduction to two additional topics: noninterference as a general notion of secure systems, both from a semantic and a programming language perspective (type system), and runtime verification/monitoring to detect violations of security policies expressed as trace properties.  
Competencies 
 
263465600L  Digital Signatures  W  5 credits  2V + 2A  D. Hofheinz  
Abstract  Digital signatures as one central cryptographic building block. Different security goals and security definitions for digital signatures, followed by a variety of popular and fundamental signature schemes with their security analyses.  
Learning objective  The student knows a variety of techniques to construct and analyze the security of digital signature schemes. This includes modularity as a central tool of constructing secure schemes, and reductions as a central tool to proving the security of schemes.  
Content  We will start with several definitions of security for signature schemes, and investigate the relations among them. We will proceed to generic (but inefficient) constructions of secure signatures, and then move on to a number of efficient schemes based on concrete computational hardness assumptions. On the way, we will get to know paradigms such as hashthensign, onetime signatures, and chameleon hashing as central tools to construct secure signatures.  
Literature  Jonathan Katz, "Digital Signatures."  
Prerequisites / Notice  Ideally, students will have taken the DINFK Bachelors course "Information Security" or an equivalent course at Bachelors level.  
263466000L  Applied Cryptography  W  8 credits  3V + 2U + 2P  K. Paterson, F. Günther, F. Tramèr  
Abstract  This course will introduce the basic primitives of cryptography, using rigorous syntax and gamebased security definitions. The course will show how these primitives can be combined to build cryptographic protocols and systems.  
Learning objective  The goal of the course is to put students' understanding of cryptography on sound foundations, to enable them to start to build welldesigned cryptographic systems, and to expose them to some of the pitfalls that arise when doing so.  
Content  Basic symmetric primitives (block ciphers, modes, hash functions); generic composition; AEAD; basic secure channels; basic public key primitives (encryption,signature, DH key exchange); ECC; randomness; applications.  
Literature  Textbook: Boneh and Shoup, “A Graduate Course in Applied Cryptography”, http://toc.cryptobook.us/book.pdf.  
Prerequisites / Notice  Students should have taken the DINFK Bachelor's course “Information Security" (252021100) or an alternative first course covering cryptography at a similar level. / In this course, we will use Moodle for content delivery: https://moodleapp2.let.ethz.ch/course/view.php?id=22001.  
Competencies 
 
Minor in Machine Learning  
Number  Title  Type  ECTS  Hours  Lecturers  
252052600L  Statistical Learning Theory Takes place for the last time!  W  8 credits  3V + 2U + 2A  J. M. Buhmann  
Abstract  The course covers advanced methods of statistical learning:  Variational methods and optimization.  Deterministic annealing.  Clustering for diverse types of data.  Model validation by information theory.  
Learning objective  The course surveys recent methods of statistical learning. The fundamentals of machine learning, as presented in the courses "Introduction to Machine Learning" and "Advanced Machine Learning", are expanded from the perspective of statistical learning.  
Content   Variational methods and optimization. We consider optimization approaches for problems where the optimizer is a probability distribution. We will discuss concepts like maximum entropy, information bottleneck, and deterministic annealing.  Clustering. This is the problem of sorting data into groups without using training samples. We discuss alternative notions of "similarity" between data points and adequate optimization procedures.  Model selection and validation. This refers to the question of how complex the chosen model should be. In particular, we present an information theoretic approach for model validation.  Statistical physics models. We discuss approaches for approximately optimizing large systems, which originate in statistical physics (free energy minimization applied to spin glasses and other models). We also study sampling methods based on these models.  
Lecture notes  A draft of a script will be provided. Lecture slides will be made available.  
Literature  Hastie, Tibshirani, Friedman: The Elements of Statistical Learning, Springer, 2001. L. Devroye, L. Gyorfi, and G. Lugosi: A probabilistic theory of pattern recognition. Springer, New York, 1996  
Prerequisites / Notice  Knowledge of machine learning (introduction to machine learning and/or advanced machine learning) Basic knowledge of statistics.  
261512000L  Machine Learning for Health Care  W  5 credits  2V + 2A  J. Vogt, V. Boeva, G. Rätsch  
Abstract  The course will review the most relevant methods and applications of Machine Learning in Biomedicine, discuss the main challenges they present and their current technical problems.  
Learning objective  During the last years, we have observed a rapid growth in the field of Machine Learning (ML), mainly due to improvements in ML algorithms, the increase of data availability and a reduction in computing costs. This growth is having a profound impact in biomedical applications, where the great variety of tasks and data types enables us to get benefit of ML algorithms in many different ways. In this course we will review the most relevant methods and applications of ML in biomedicine, discuss the main challenges they present and their current technical solutions.  
Content  The course will consist of different topic clusters that will cover the most relevant applications of ML in Health Care, as e.g. 1) Structured time series: Temporal time series of structured data often appear in biomedical datasets, presenting challenges such as containing variables with different periodicities or being influenced by static data. 2) Medical notes: Many medical observations are stored as free text. We will analyze strategies for extracting knowledge from these textual records. 3) Medical images: Images are a fundamental piece of information in many medical disciplines. We will study how to train ML algorithms to analyze and interpret medical images effectively. 4) Genomics data: ML in genomics is still an emerging subfield. However, given that genomics data are arguably the most extensive and complex datasets in biomedicine, we expect many relevant ML applications to arise in the near future. We will review and discuss current applications and challenges in genomics data analysis. 5) Explainable/Interpretable ML: Interpretable and explainable machine learning focuses on the design of humanunderstandable models and algorithms that allow for blackbox model introspection after training, i.e., post hoc. We will explore methods to make ML models more transparent, particularly in the context of healthcare. 6) Representation Learning: Representation learning is a crucial aspect of ML in healthcare. It involves learning meaningful representations from data, which can be especially valuable in tasks like medical image analysis, feature extraction from biomedical time series data, or dimensionality reduction. We will delve into techniques for efficient representation learning to enhance the performance of healthcare ML models.  
Prerequisites / Notice  Data Structures & Algorithms, Introduction to Machine Learning, Statistics/Probability, Programming in Python, Unix Command Line. Prior attendance of additional machine learning courses is highly recommended but not formally required. Students should have a basic understanding of the current machine learning landscape, as some concepts will be briefly mentioned, with the expectation that students can delve deeper into them using current literature. This course primarily emphasizes the practical application of existing concepts and methods in healthcare data.  
Competencies 
 
263371000L  Machine Perception  W  8 credits  3V + 2U + 2A  J. Song, X. Chen, S. Coros, O. Hilliges, M. Kaufmann  
Abstract  Recent developments in neural networks have drastically advanced the performance of machine perception systems in a variety of areas including computer vision, robotics, and human shape modeling. This course is a deep dive into deep learning algorithms and architectures with applications to a variety of perceptual and generative tasks.  
Learning objective  Students will learn about fundamental aspects of modern deep learning approaches for perception and generation. Students will learn to implement, train and debug their own neural networks and gain a detailed understanding of cuttingedge research in learningbased computer vision, robotics, and shape modeling. The optional final project assignment will involve training a complex neural network architecture and applying it to a realworld dataset. The core competency acquired through this course is a solid foundation in deeplearning algorithms to process and interpret humancentric signals. In particular, students should be able to develop systems that deal with the problem of recognizing people in images, detecting and describing body parts, inferring their spatial configuration, performing action/gesture recognition from still images or image sequences, also considering multimodal data, among others.  
Content  We will focus on teaching: how to set up the problem of machine perception, the learning algorithms, network architectures, and advanced deep learning concepts in particular probabilistic deep learning models. The course covers the following main areas: I) Foundations of deep learning. II) Advanced topics like probabilistic generative modeling of data (latent variable models, generative adversarial networks, autoregressive models, invertible neural networks, diffusion models). III) Deep learning in computer vision, humancomputer interaction, and robotics. Specific topics include: I) Introduction to Deep Learning: a) Neural Networks and training (i.e., backpropagation) b) Feedforward Networks c) Timeseries modelling (RNN, GRU, LSTM) d) Convolutional Neural Networks II) Advanced topics: a) Latent variable models (VAEs) b) Generative adversarial networks (GANs) c) Autoregressive models (PixelCNN, PixelRNN, TCN, Transformer) d) Invertible Neural Networks / Normalizing Flows e) Coordinatebased networks (neural implicit surfaces, NeRF) f) Diffusion models III) Applications in machine perception and computer vision: a) Fully Convolutional architectures for dense perpixel tasks (i.e., instance segmentation) b) Pose estimation and other tasks involving human activity c) Neural shape modeling (implicit surfaces, neural radiance fields) d) Deep Reinforcement Learning and Applications in PhysicsBased Behavior Modeling  
Literature  Deep Learning Book by Ian Goodfellow and Yoshua Bengio  
Prerequisites / Notice  This is an advanced gradlevel course that requires a background in machine learning. Students are expected to have a solid mathematical foundation, in particular in linear algebra, multivariate calculus, and probability. The course will focus on stateoftheart research in deep learning and will not repeat the basics of machine learning Please take note of the following conditions: 1) Students must have taken the exam in Machine Learning (252053500) or have acquired equivalent knowledge 2) All practical exercises will require basic knowledge of Python and will use libraries such as Pytorch, scikitlearn, and scikitimage. We will provide introductions to Pytorch and other libraries that are needed but will not provide introductions to basic programming or Python. The following courses are strongly recommended as prerequisites: * "Visual Computing" or "Computer Vision" The course will be assessed by a final written examination in English. No course materials or electronic devices can be used during the examination. Note that the examination will be based on the contents of the lectures, the associated reading materials, and the exercises. The exam will be a 3hour endofterm exam and take place at the end of the teaching period.  
Competencies 
 
263500000L  Computational Semantics for Natural Language Processing  W  6 credits  2V + 1U + 2A  M. Sachan  
Abstract  This course presents an introduction to Natural language processing (NLP) with an emphasis on computational semantics i.e. the process of constructing and reasoning with meaning representations of natural language text.  
Learning objective  The objective of the course is to learn about various topics in computational semantics and its importance in natural language processing methodology and research. Exercises and the project will be key parts of the course so the students will be able to gain handson experience with stateoftheart techniques in the field.  
Content  We will take a modern view of the topic, and focus on various statistical and deep learning approaches for computation semantics. We will also overview various primary areas of research in language processing and discuss how the computational semantics view can help us make advances in NLP.  
Lecture notes  Lecture slides will be made available at the course Web site.  
Literature  No textbook is required, but there will be regularly assigned readings from research literature, linked to the course website.  
Prerequisites / Notice  The student should have successfully completed a graduate level class in machine learning (252022000L), deep learning (263321000L) or natural language processing (252300500L) before. Similar courses from other universities are acceptable too.  
263505200L  Interactive Machine Learning: Visualization & Explainability  W  5 credits  3G + 1A  M. ElAssady  
Abstract  Visual Analytics supports the design of humanintheloop interfaces that enable humanmachine collaboration. In this course, will go through the fundamentals of designing interactive visualizations, later applying them to explain and interact with machine leaning models.  
Learning objective  The goal of the course is to introduce techniques for interactive information visualization and to apply these on understanding, diagnosing, and refining machine learning models.  
Content  Interactive, mixedinitiative machine learning promises to combine the efficiency of automation with the effectiveness of humans for a collaborative decisionmaking and problemsolving process. This can be facilitated through coadaptive visual interfaces. This course will first introduce the foundations of information visualization design based on data charecteristics, e.g., highdimensional, geospatial, relational, temporal, and textual data. Second, we will discuss interaction techniques and explanation strategies to enable explainable machine learning with the tasks of understanding, diagnosing, and refining machine learning models. Tentative list of topics: 1. Visualization and Perception 2. Interaction and Explanation 3. Systems Overview  
Lecture notes  Course material will be provided in form of slides.  
Literature  Will be provided during the course.  
Prerequisites / Notice  Basic understanding of machine learning as taught at the Bachelor's level.  
263525500L  Foundations of Reinforcement Learning  W  7 credits  3V + 3A  N. He  
Abstract  Reinforcement learning (RL) has been in the limelight of many recent breakthroughs in artificial intelligence. This course focuses on theoretical and algorithmic foundations of reinforcement learning, through the lens of optimization, modern approximation, and learning theory. The course targets M.S. students with strong research interests in reinforcement learning, optimization, and control.  
Learning objective  This course aims to provide students with an advanced introduction of RL theory and algorithms as well as bring them near the frontier of this active research field. By the end of the course, students will be able to  Identify the strengths and limitations of various reinforcement learning algorithms;  Formulate and solve sequential decisionmaking problems by applying relevant reinforcement learning tools;  Generalize or discover “new” applications, algorithms, or theories of reinforcement learning towards conducting independent research on the topic.  
Content  Topics include fundamentals of Markov decision processes, approximate dynamic programming, linear programming and primaldual perspectives of RL, modelbased and modelfree RL, policy gradient and actorcritic algorithms, Markov games and multiagent RL. If time allows, we will also discuss advanced topics such as batch RL, inverse RL, causal RL, etc. The course keeps strong emphasis on indepth understanding of the mathematical modeling and theoretical properties of RL algorithms.  
Lecture notes  Lecture slides will be posted on Moodle.  
Literature  Dynamic Programming and Optimal Control, Vol I & II, Dimitris Bertsekas Reinforcement Learning: An Introduction, Second Edition, Richard Sutton and Andrew Barto. Algorithms for Reinforcement Learning, Csaba Czepesvári. Reinforcement Learning: Theory and Algorithms, Alekh Agarwal, Nan Jiang, Sham M. Kakade.  
Prerequisites / Notice  Students are expected to have strong mathematical background in linear algebra, probability theory, optimization, and machine learning.  
Competencies 

 Page 1 of 3 All