The number of ECE ILLINOIS faculty members.
The course objective is to provide seniors in Electrical or Computer Engineering with a basic understanding of optimization problems, viz., their formulation, analytic and computational tools for their solutions, and applications in different areas.
Same as CSE 541
The students are assigned homework problems and are asked to write MATLAB programs for numerical optimization algorithms and run them on a workstation. Some basic MATLAB files for optimization are provided.
D. P. Bertsekas, Nonlinear Programming, 1999, Athena Scientific, Belmont, MA.
Engineering Science: 1.5 credits or 50%
Engineering Design: 1.5 credits or 50%
This course is taught once a year every spring semester, and is elective for seniors in electrical and computer engineering programs. Its main objective is to provide these students with a basic understanding of optimization problems, viz., their formulation, analytic and computational tools for their solutions, and applications in different areas.
By the end of the semester, the students should be able to do the following:
1. Formulate finite-dimensional optimization problems (a)
2. Apply some sufficiency conditions to an optimization method to test whether a minimum or a maximum exists, and whether they are unique (a)
3. Tell the difference between a local optimum and a global optimum (a)
4. Use the first- and second-order conditions for unconstrained optima to calculate minima and maxima (a)
5. Use various computational algorithms for unconstrained optimization, including steepest descent, Newton's method, conjugate-direction methods, and direct search methods (a)
6. Analyze convergence of the algorithms in 5 above (a)
8. Obtain analytic solutions to some optimization problems with equality constraints, using Lagrange multipliers (a)
9. Obtain analytic solutions to some optimization problems with inequality constraints, again using Lagrange multipliers (a)
10. Use various computational algorithms for constrained optimization, including penalty function methods, primal and dual methods, penalty and barrier methods, and convex programming (a)
11. Analyze convergence of the algorithms in 10 above (a)
12. Conduct sensitivity analysis using Lagrange multipliers (a)
14. Tell whether a linear programming problem has a solution or not (a)
15. Know what duality is in linear programming (a)