Lessons

Neural networks

  1. One neuron
  2. Many ramps
  3. Layers
  4. One neuron learns
  5. A network learns

Foundations

  1. PyTorch basics
  2. Neural network: one input
  3. Neural network: several inputs
  4. Generalization and evaluation
  5. Gradients and backpropagation
  6. MuJoCo basics
  7. Reinforcement learning basics
  8. Policy gradient
  9. Robot basics
  10. Optimizers: momentum and Adam
  11. Convolutional networks
  12. Attention and transformers
  13. Autoencoders and VAEs

Workshop

  1. Bouncing ball
  2. Network design
  3. Robot arm · Q-table
  4. Robot arm · Q-network
  5. Robot arm · imitation learning
  6. LeRobot data