Optimization

What is Convex Optimization?

Convex optimization is a special class of mathematical optimization problems, which includes least-squares and linear programming problems.

There are many advantages to recognizing or formulating a problem as a convex optimization problem. First, the problem can be solved reliably and efficiently, using interior-point methods or other special methods for convex optimization. There are also theoretical or conceptual advantages of formulating a problem as a convex optimization problem.

Mathematical Optimization

An optimization problem has the form:

\begin{align} \label{dfn:optimization} &\text{minimize} &f_0(x) \\\
&\text{subject to} &f_i(x) \le b_i, i = 1, \dots, m \end{align}

Here the vector $$x = (x_1, \dots, x_n)$$ is the optimization variable of the problem, the function $$f_0 : \mathbb{R^n} \rightarrow \mathbb{R}$$ is the objective function, $$f_i \mathbb{R^n} \rightarrow \mathbb{R}$$ are the (inequality) constraint functions, and the constants $$b_1, \dots, b_m$$ are the limits, or bounds, for the constraints.

We consider families or classes of optimization problems, characterized by particular forms of the objective and constraint functions. The optimization problem is a linear program if the objective and constraint functions $$f_0, \dots, f_m$$ are linear.