M5. Visual recognition

In this module we give to the student an overview of the latest methods based on deep learning techniques to solve visual recognition problems. The final aim is the understanding of complex scenes to build feasible systems for automatic image understanding able to answer the complex question of what objects and where are these objects in a complex scene. The students will learn a large family of successful architectures of deep convolutional networks that have been proved to solve the visual tasks of: detection, segmentation and recognition. And they are going to get the skills for designing, programming, training and evaluating complex architectures to solve vision problems.
Project title: 
Scene Understanding for automatic driving

The goal of this project is to learn the basic concepts and techniques to build deep neural networks to detect, segment and recognize specific objects, focusing on images recorded by an on-board vehicle camera for autonomous driving. 

The learning objectives are using different deep learning (DL) programming frameworks such Theano, TensorFlow and Keras and  basic DL methods such as feed forward networks (MLP) and  Convolutional  Neural Networks (CNN). It includes the understanding of standard networks for classification (AlexNet, VGG, GoogleNet, ResNet, DenseNet, SqueezeNet) detection (RCNN, Fast RCNN, Faster RCNN, YOLO) and segmentation (FCN, SegNet, UNET).  The students will learn through a project based methodology using modern collaborative tools at all stages of the project development.

The students will acquire the skills for the tasks of designing, training, tuning and evaluating neural networks to solve the problem of automatic image understanding.

Module lectures: 
Academic Year 2016-2017        
Week Date Time Lecture Lecturer University Building Room
1 Mon. Feb.27th 16:00 -18:00 Deep Learning Frameworks: Theano & Keras David Vázquez UAB CVC Sala d'Actes
1 Mon. Feb.27th 18:00 - 19:00 Project Introduction David Vázquez - LLuis Gómez UAB CVC Sala d'Actes
1 Wed. Mar. 1st 16:00 -18:00 Deep Learning Frameworks: Tensorflow & Caffe Joan Serrat - Marc Masana UAB CVC Sala d'Actes
               
2 Mon. Mar. 6th 16:00 -18:00 Architectures for Image Classification  Adriana Romero (MILA) UAB CVC Sala d'Actes
2 Mon. Mar. 6th 18:00 -19:00 Project: Traffic sign classification  David Vázquez - LLuis Gómez UAB CVC  Sala d'Actes 
2 Wed. Mar. 8th 16:00 -18:00 Recurrent Neural Networks (RNN) Adriana Romero (MILA) UAB CVC Sala d'Actes
               
3 Mon. Mar. 13th 16:00 -18:00 Architectures for Object Detection Michal Drozdzal (MILA) UAB CVC Sala d'Actes
3 Mon. Mar. 13th 18:00 -19:00 Project: Traffic sign detection David Vázquez - LLuis Gómez UAB CVC Sala d'Actes
3 Wed. Mar. 15th 16:00 -18:00 Practical Methodology Michal Drozdzal (MILA) UAB CVC Sala d'Actes
               
4 Mon. Mar. 20th 16:00 -18:00 Unsupervised Networks Vincent Dumoulin (MILA) UAB CVC Sala d'Actes
4 Mon. Mar. 20th 18:00 -19:00 Project: Traffic sign detection (follow-up) David Vázquez - LLuis Gómez UAB CVC Sala d'Actes
4 Wed. Mar. 22nd 16:00 -18:00 Architectures for Image Generation Vincent Dumoulin (MILA) UAB CVC Sala d'Actes
4 Friday. Mar. 24th  16:00 -18:00 Architectures for Image Captioning & Visual Questioning Oriol Vinyals (Google-Deepmind) UAB Edifici Q Q1/1011
               
5 Mon. Mar. 27th 16:00 -18:00 Architectures for Semantic & Instant segmentation German Ros (Toyota RI) UAB  CVC  Sala d'Actes
5 Mon. Mar. 27th 18:00 -19:00 Project: Traffic sign segmentation  David Vázquez - LLuis Gómez UAB  CVC Sala d'Actes 
5 Wed. Mar 29th 16:00 -18:00 Reinforcement Learning (RL) Mehdi Mirza (Google-Deepmind) UAB CVC Sala d'Actes 
               
6 Mon. Apr. 3rd 16:00 -18:00 Hardware for deep learning (CUDA) Juan C. Moure - Toni Espinosa UAB CVC Sala d'Actes
6 Mon. Apr. 3rd 18:00 -19:00 Project: Traffic sign segmentation (follow-up) David Vázquez - LLuis Gómez UAB CVC Sala d'Actes 
6 Wed. Apr. 5th    HOMEWORK   UAB  CVC  Sala d'Actes 
               
      Easter Holidays (fron Apr.8th to Apr.17th)        
               
7 Tue. Apr. 18th 16:00 -19:00 Project presentations David Vázquez - LLuis Gómez UAB   CVC  Sala d'Actes
               
8 Mon. Apr. 24th   HOMEWORK        
8 Wed. Apr. 26th   HOMEWORK        
               
9 Mon. May 1st   Holiday        
9 Tue. May. 2nd 16:00 -19:00 EXAM Joan Serrat UAB CVC Sala d'Actes
               

M5 Student Guide [here]