Anar al contingut (clic a Intro)
UdG Home UdG Home
Tancar
Menú

Estudia

General information

Academic year:
2024
Description:
The concept of reinforcement learning will be introduced. Model-free methods as well as function approximators will be studied. The main deep reinforcement learning (DRL) algorithms will be also introduced. Policy search and efficient sampling techniques will be seen. In the final part of the course, more advanced topics related to reinforcement learning will be introduced and students will do a project on one of them. The theoretical sessions will be accompanied by guided laboratories.
Academic credits:
6
Course coordinator:
Narcis Palomeras Rovira

Groups

Group A

Duration:
One-semester, 1st semester
Teaching staff:
Narcis Palomeras Rovira
Language of the classes:
English (100%)

Competences

  • CG3- Communicate in an effective way both orally and in writing, preparing documents and presenting projects and results with English language
  • CG5- Collect and select information to be able to evaluate the state of the art of a specific topic or subject
  • CG6- Work in multidisciplinary teams, establishing those relationships that can help to bring out the most effective cooperation and maintain them continuously
  • CB6- Possess and understand the knowledge that provides a basis or opportunity to be original in the development and/or application of ideas, often in a research context
  • CB7- That students know how to apply the knowledge acquired and their ability to solve problems in new or unfamiliar environments within broader contexts related to their area of ??study
  • CB10- That students have the learning skills to allow them to continue studying in a way that will mostly be self-directed or autonomous
  • CE1- Programming, at an advanced level, in the languages and libraries most used in intelligent field robotics
  • CE2- Analyse a problem related to intelligent autonomous systems and identify the appropriate techniques and tools to solve it
  • CE3- Understand, develop, modify and effectively apply machine learning methods.
  • CE5- Know, understand and be able to apply the algorithms that allow autonomous vehicles to localize themselves and navigate effectively
  • CE8- Understand the mathematical foundations of intelligent robotic system algorithms

Syllabus

1. Intro to RL

2. Free Model Algorithms

3. Function Approximation

4. Deep Reinforcement Learning

5. Policy Search

6. Sample Efficiency

7. Advanced RL topics

Activities

Activity type Hours with a teacher Hours without a teacher Virtual hours with a teacher Total
Analysis / case study 10,00 17,00 0 27,00
Assessment test 2,00 8,00 0 10,00
Theory class 18,00 20,00 0 38,00
Hands-on class 30,00 45,00 0 75,00
Total 60,00 90,00 0 150

Bibliography

  • Sutton and Barton (2018). An Introduction to Reinforcement Learning, 2nd Edition. MIT Press.
  • Miguel Morales (2020). Grokking Deep Reinforcement Learning. Manning.

Assessment and Grading

Assessment activities:

Description of the activity Assessment Activity % Remediable subject
Tests Test about basic RL contents 20 No
Laboratories Lab attendance and delivery 30 No
Research Project Develop a research project about and advanced RL topic 50 Yes

Grading

The evaluation will take into account the work done in the laboratory (30%), a research project (50%) and a quiz (20%).

Specific criteria for the "No show" grade:
To not participate in any activity.

Single Assessment:
The students will demonstrate their practical knowledge in the laboratory and pass an exam containing all theoretical and practical contents.

Minimum requirements to pass:
A grade equal or greater than 5 must be obtained in the equation 0.2*test + 0.3*laboratories + 0.5*project

Mentorship

Student must send an email to the professor for organizing a meeting in which whatever issue will be addressed.

Communication and interaction with students

All activities will be organized with Moodle. The students and professors will communicate by email.

Escull quins tipus de galetes acceptes que el web de la Universitat de Girona pugui guardar en el teu navegador.

Les imprescindibles per facilitar la vostra connexió. No hi ha opció d'inhabilitar-les, atès que són les necessàries pel funcionament del lloc web.

Permeten recordar les vostres opcions (per exemple llengua o regió des de la qual accediu), per tal de proporcionar-vos serveis avançats.

Proporcionen informació estadística i permeten millorar els serveis. Utilitzem cookies de Google Analytics que podeu desactivar instal·lant-vos aquest plugin.

Per a oferir continguts publicitaris relacionats amb els interessos de l'usuari, bé directament, bé per mitjà de tercers (“adservers”). Cal activar-les si vols veure els vídeos de Youtube incrustats en el web de la Universitat de Girona.