EE61012: Convex Optimization in Control and Signal Processing

Welcome to this PG level subject.

Logistics of Grading

  • End Semester: 50
  • Mid Semester: 30
  • Class Tests: 10
  • Homework, Class Participation: 10

Course Content (Tentative)

Here is a basic overview of the topics that are planned to be covered.

  1. Background (1 week)
  2. Convex Sets and Convex Functions (2 weeks)
  3. Convex Optimization Problems (1 week)
  4. Lagrangian Duality (1 week)
  5. Necessary and Sufficient Optimality Conditions (1 week)
  6. Regression, Classification and Clustering Problems (1 week)
  7. ML Estimation, Hypothesis Testing, Optimal Detection (1 week)
  8. Algorithms for Convex Optimization, First Order Methods, Primal-Dual Algorithms, ADMM (2 weeks)
  9. LMIs and SDP Duality (1 week)
  10. Application of LMIs in Linear Control (1 week)
  11. Constrained Optimal Control, MPC, Application in System Identification (1 week)

Handouts

  1. Week 1 and 2
  2. Week 3
  3. Week 4
  4. Week 5
  5. Week 6
  6. Week 7
  7. Week 8
  8. Week 9
  9. Week 10
  10. Week 11

Homework Sheets

  1. Homework 1
  2. Homework 2
  3. Homework 3
  4. Homework 4
The datasets are available here.

Tests

  1. Class Tests 1 and 2
  2. Midsem Solutions

Software Packages

There are several dedicated environments that enable us to easily encode and solve convex optimization problems. We will demonstrate some examples in class using YALMIP.

  1. CVXPY.
  2. YALMIP.
  3. PYOMO.
  4. MOSEK.
  5. Casadi.
  6. JuliaOPT.

Textbooks

There is no single textbook for this subject. We will discuss a variety of topics from different books. The first reference will be followed to a large extent. You are encouraged to refer the other texts below depending on your interests.

  1. Optimization Models by G.C. Calafiore and L. El Ghaoui.
  2. Convex Optimization (freely available to download) by Boyd and Vandenberghe.
  3. Algorithms for Convex Optimization by Nisheeth K. Vishnoi.
  4. Potential function approach to proving convergence results.
  5. Optimization III: Convex and Nonlinear Programming by Ben-Tal and Nemirovski. Lecture Notes.