This is the current revision of this page, as edited by GhostInTheMachine(talk | contribs) at 09:56, 10 July 2024(Adding local short description: "Mathematics of convex functions and sets", overriding Wikidata description "branch of mathematics devoted to the study of properties of convex functions and convex sets"). The present address (URL) is a permanent link to this version.
Revision as of 09:56, 10 July 2024 by GhostInTheMachine(talk | contribs)(Adding local short description: "Mathematics of convex functions and sets", overriding Wikidata description "branch of mathematics devoted to the study of properties of convex functions and convex sets")
A 3-dimensional convex polytope. Convex analysis includes not only the study of convex subsets of Euclidean spaces but also the study of convex functions on abstract spaces.
Throughout, will be a map valued in the extended real numbers with a domain that is a convex subset of some vector space.
The map is a convex function if
(Convexity ≤)
holds for any real and any with If this remains true of when the defining inequality (Convexity ≤) is replaced by the strict inequality
Convex functions are related to convex sets. Specifically, the function is convex if and only if its epigraph
A function (in black) is convex if and only if its epigraph, which is the region above its graph (in green), is a convex set.A graph of the bivariate convex function
(Epigraph def.)
is a convex set.[2] The epigraphs of extended real-valued functions play a role in convex analysis that is analogous to the role played by graphs of real-valued function in real analysis. Specifically, the epigraph of an extended real-valued function provides geometric intuition that can be used to help formula or prove conjectures.
The domain of a function is denoted by while its effective domain is the set[2]
(dom f def.)
The function is called proper if and for all[2] Alternatively, this means that there exists some in the domain of at which and is also never equal to In words, a function is proper if its domain is not empty, it never takes on the value and it also is not identically equal to If is a proper convex function then there exist some vector and some such that
The convex conjugate of an extended real-valued function (not necessarily convex) is the function from the (continuous) dual space of and[3]
where the brackets denote the canonical duality The biconjugate of is the map defined by for every
If denotes the set of -valued functions on then the map defined by is called the Legendre-Fenchel transform.
Subdifferential set and the Fenchel-Young inequality
For example, in the important special case where is a norm on , it can be shown[proof 1]
that if then this definition reduces down to:
and
For any and which is called the Fenchel-Young inequality. This inequality is an equality (i.e. ) if and only if It is in this way that the subdifferential set is directly related to the convex conjugate
The biconjugate of a function is the conjugate of the conjugate, typically written as The biconjugate is useful for showing when strong or weak duality hold (via the perturbation function).
In optimization theory, the duality principle states that optimization problems may be viewed from either of two perspectives, the primal problem or the dual problem.
^Csetnek, Ernö Robert (2010). Overcoming the failure of the classical generalized interior-point regularity conditions in convex optimization. Applications of the duality theory to enlargements of maximal monotone operators. Logos Verlag Berlin GmbH. ISBN978-3-8325-2503-3.
^Borwein, Jonathan; Lewis, Adrian (2006). Convex Analysis and Nonlinear Optimization: Theory and Examples (2 ed.). Springer. ISBN978-0-387-29570-1.
^The conclusion is immediate if so assume otherwise. Fix Replacing with the norm gives If and is real then using gives where in particular, taking gives while taking gives and thus ; moreover, if in addition then because it follows from the definition of the dual norm that Because which is equivalent to it follows that which implies for all From these facts, the conclusion can now be reached. ∎
Singer, Ivan (1997). Abstract convex analysis. Canadian Mathematical Society series of monographs and advanced texts. New York: John Wiley & Sons, Inc. pp. xxii+491. ISBN0-471-16015-6. MR1461544.
Stoer, J.; Witzgall, C. (1970). Convexity and optimization in finite dimensions. Vol. 1. Berlin: Springer. ISBN978-0-387-04835-2.