Gâteaux derivative





In mathematics, the Gâteaux differential or Gâteaux derivative is a generalization of the concept of directional derivative in differential calculus. Named after René Gâteaux, a French mathematician who died young in World War I, it is defined for functions between locally convex topological vector spaces such as Banach spaces. Like the Fréchet derivative on a Banach space, the Gâteaux differential is often used to formalize the functional derivative commonly used in the calculus of variations and physics.


Unlike other forms of derivatives, the Gâteaux differential of a function may be nonlinear. However, often the definition of the Gâteaux differential also requires that it be a continuous linear transformation. Some authors, such as Tikhomirov (2001), draw a further distinction between the Gâteaux differential (which may be nonlinear) and the Gâteaux derivative (which they take to be linear). In most applications, continuous linearity follows from some more primitive condition which is natural to the particular setting, such as imposing complex differentiability in the context of infinite dimensional holomorphy or continuous differentiability in nonlinear analysis.




Contents






  • 1 Definition


  • 2 Linearity and continuity


  • 3 Higher derivatives


  • 4 Properties


  • 5 Example


  • 6 See also


  • 7 References





Definition


Suppose X and Y are locally convex topological vector spaces (for example, Banach spaces), U ⊂ X is open, and F : X → Y. The Gâteaux differential dF(u; ψ) of F at u ∈ U in the direction ψ ∈ X is defined as








dF(u;ψ)=limτ→0F(u+τψ)−F(u)τ=ddτF(u+τψ)|τ=0{displaystyle dF(u;psi )=lim _{tau rightarrow 0}{frac {F(u+tau psi )-F(u)}{tau }}=left.{frac {d}{dtau }}F(u+tau psi )right|_{tau =0}}dF(u;psi )=lim _{{tau rightarrow 0}}{frac {F(u+tau psi )-F(u)}{tau }}=left.{frac {d}{dtau }}F(u+tau psi )right|_{{tau =0}}









 

 

 

 

(1)


If the limit exists for all ψ ∈ X, then one says that F is Gâteaux differentiable at u.


The limit appearing in (1) is taken relative to the topology of Y. If X and Y are real topological vector spaces, then the limit is taken for real τ. On the other hand, if X and Y are complex topological vector spaces, then the limit above is usually taken as τ → 0 in the complex plane as in the definition of complex differentiability. In some cases, a weak limit is taken instead of a strong limit, which leads to the notion of a weak Gâteaux derivative.



Linearity and continuity


At each point u ∈ U, the Gâteaux differential defines a function


dF(u;⋅):X→Y.{displaystyle dF(u;cdot ):Xrightarrow Y.}dF(u;cdot ):Xrightarrow Y.

This function is homogeneous in the sense that for all scalars α,


dF(u;αψ)=αdF(u;ψ).{displaystyle dF(u;alpha psi )=alpha dF(u;psi ).,}dF(u;alpha psi )=alpha dF(u;psi ).,

However, this function need not be additive, so that the Gâteaux differential may fail to be linear, unlike the Fréchet derivative. Even if linear, it may fail to depend continuously on ψ if X and Y are infinite dimensional. Furthermore, for Gâteaux differentials that are linear and continuous in ψ, there are several inequivalent ways to formulate their continuous differentiability.


For example, consider the real-valued function F of two real variables defined by


F(x,y)={x3x2+y2 if (x,y)≠(0,0)0 if (x,y)=(0,0).{displaystyle F(x,y)={begin{cases}{frac {x^{3}}{x^{2}+y^{2}}}&{mbox{ if }}(x,y)neq (0,0)\0&{mbox{ if }}(x,y)=(0,0).end{cases}}}F(x,y)={begin{cases}{frac {x^{3}}{x^{2}+y^{2}}}&{mbox{ if }}(x,y)neq (0,0)\0&{mbox{ if }}(x,y)=(0,0).end{cases}}

This is Gâteaux differentiable at (0, 0), with its differential there being


dF(0,0;a,b)={a3a2+b2(a,b)≠(0,0)0(a,b)=(0,0).{displaystyle dF(0,0;a,b)={begin{cases}{frac {a^{3}}{a^{2}+b^{2}}}&(a,b)not =(0,0)\0&(a,b)=(0,0).end{cases}}}dF(0,0;a,b)={begin{cases}{frac {a^{3}}{a^{2}+b^{2}}}&(a,b)not =(0,0)\0&(a,b)=(0,0).end{cases}}

However this is continuous but not linear in the arguments (a, b). In infinite dimensions, any discontinuous linear functional on X is Gâteaux differentiable, but its Gâteaux differential at 0 is linear but not continuous.


Relation with the Fréchet derivative

If F is Fréchet differentiable, then it is also Gâteaux differentiable, and its Fréchet and Gâteaux derivatives agree. The converse is clearly not true, since the Gâteaux derivative may fail to be linear or continuous. In fact, it is even possible for the Gâteaux derivative to be linear and continuous but for the Fréchet derivative to fail to exist.


Nevertheless, for functions F from a complex Banach space X to another complex Banach space Y, the Gâteaux derivative (where the limit is taken over complex τ tending to zero as in the definition of complex differentiability) is automatically linear, a theorem of Zorn (1945). Furthermore, if F is (complex) Gâteaux differentiable at each u ∈ U with derivative


DF(u):ψ↦dF(u;ψ){displaystyle DF(u):psi mapsto dF(u;psi )}DF(u):psi mapsto dF(u;psi )

then F is Fréchet differentiable on U with Fréchet derivative DF (Zorn 1946). This is analogous to the result from basic complex analysis that a function is analytic if it is complex differentiable in an open set, and is a fundamental result in the study of infinite dimensional holomorphy.


Continuous differentiability

Continuous Gâteaux differentiability may be defined in two inequivalent ways. Suppose that F : U → Y is Gâteaux differentiable at each point of the open set U. One notion of continuous differentiability in U requires that the mapping on the product space


dF:U×X→Y{displaystyle dF:Utimes Xrightarrow Y,}dF:Utimes Xrightarrow Y,

be continuous. Linearity need not be assumed: if X and Y are Fréchet spaces, then dF(u; •) is automatically bounded and linear for all u (Hamilton 1982).


A stronger notion of continuous differentiability requires that


u↦DF(u){displaystyle umapsto DF(u),}umapsto DF(u),

be a continuous mapping


U→L(X,Y){displaystyle Uto L(X,Y),}Uto L(X,Y),

from U to the space of continuous linear functions from X to Y. Note that this already presupposes the linearity of DF(u).


As a matter of technical convenience, this latter notion of continuous differentiability is typical (but not universal) when the spaces X and Y are Banach, since L(X, Y) is also Banach and standard results from functional analysis can then be employed. The former is the more common definition in areas of nonlinear analysis where the function spaces involved are not necessarily Banach spaces. For instance, differentiation in Fréchet spaces has applications such as the Nash–Moser inverse function theorem in which the function spaces of interest often consist of smooth functions on a manifold.



Higher derivatives


Whereas higher order Fréchet derivatives are naturally defined as multilinear functions by iteration, using the isomorphisms Ln(X, Y) = L(X, Ln−1(X, Y)), higher order Gâteaux derivative cannot be defined in this way. Instead the nth order Gâteaux derivative of a function F : U ⊂ X → Y in the direction h is defined by








dnF(u;h)=dndτnF(u+τh)|τ=0.{displaystyle d^{n}F(u;h)=left.{frac {d^{n}}{dtau ^{n}}}F(u+tau h)right|_{tau =0}.}d^{n}F(u;h)=left.{frac {d^{n}}{dtau ^{n}}}F(u+tau h)right|_{{tau =0}}.









 

 

 

 

(2)


Rather than a multilinear function, this is instead a homogeneous function of degree n in h.


There is another candidate for the definition of the higher order derivative, the function








D2F(u){h,k}=limτ→0DF(u+τk)h−DF(u)hτ=∂2∂τ∂σF(u+σh+τk)|τ=σ=0{displaystyle D^{2}F(u){h,k}=lim _{tau to 0}{frac {DF(u+tau k)h-DF(u)h}{tau }}=left.{frac {partial ^{2}}{partial tau partial sigma }}F(u+sigma h+tau k)right|_{tau =sigma =0}}D^{2}F(u){h,k}=lim _{{tau to 0}}{frac {DF(u+tau k)h-DF(u)h}{tau }}=left.{frac {partial ^{2}}{partial tau partial sigma }}F(u+sigma h+tau k)right|_{{tau =sigma =0}}









 

 

 

 

(3)


that arises naturally in the calculus of variations as the second variation of F, at least in the special case where F is scalar-valued. However, this may fail to have any reasonable properties at all, aside from being separately homogeneous in h and k. It is desirable to have sufficient conditions in place to ensure that D2F(u){h, k} is a symmetric bilinear function of h and k, and that it agrees with the polarization of dnF.


For instance, the following sufficient condition holds (Hamilton 1982). Suppose that F is C1 in the sense that the mapping


DF:U×X→Y{displaystyle DF:Utimes Xto Y}DF:Utimes Xto Y

is continuous in the product topology, and moreover that the second derivative defined by (3) is also continuous in the sense that


D2F:U×X×X→Y{displaystyle D^{2}F:Utimes Xtimes Xto Y}D^{2}F:Utimes Xtimes Xto Y

is continuous. Then D2F(u){h, k} is bilinear and symmetric in h and k. By virtue of the bilinearity, the polarization identity holds


D2F(u){h,k}=12d2F(u;h+k)−d2F(u;h)−d2F(u;k){displaystyle D^{2}F(u){h,k}={frac {1}{2}}d^{2}F(u;h+k)-d^{2}F(u;h)-d^{2}F(u;k)}D^{2}F(u){h,k}={frac {1}{2}}d^{2}F(u;h+k)-d^{2}F(u;h)-d^{2}F(u;k)

relating the second order derivative D2F(u) with the differential d2F(u; −). Similar conclusions hold for higher order derivatives.



Properties


A version of the fundamental theorem of calculus holds for the Gâteaux derivative of F, provided F is assumed to be sufficiently continuously differentiable. Specifically:


  • Suppose that F : X → Y is C1 in the sense that the Gâteaux derivative is a continuous function dF : U × X → Y. Then for any u ∈ U and h ∈ X,


F(u+h)−F(u)=∫01dF(u+th;h)dt{displaystyle F(u+h)-F(u)=int _{0}^{1}dF(u+th;h),dt}F(u+h)-F(u)=int _{0}^{1}dF(u+th;h),dt

where the integral is the Gelfand–Pettis integral (the weak integral).


Many of the other familiar properties of the derivative follow from this, such as multilinearity and commutativity of the higher-order derivatives. Further properties, also consequences of the fundamental theorem, include:


  • (The chain rule)


d(G∘F)(u;x)=dG(F(u);dF(u;x)){displaystyle d(Gcirc F)(u;x)=dG(F(u);dF(u;x))}d(Gcirc F)(u;x)=dG(F(u);dF(u;x))

for all u ∈ U and x ∈ X. (Note well that, as with simple partial derivatives, the Gâteaux derivative does not satisfy the chain rule if the derivative is permitted to be discontinuous.)


  • (Taylor's theorem with remainder)


Suppose that the line segment between u ∈ U and u + h lies entirely within U. If F is Ck then

F(u+h)=F(u)+dF(u;h)+12!d2F(u;h)+⋯+1(k−1)!dk−1F(u;h)+Rk{displaystyle F(u+h)=F(u)+dF(u;h)+{frac {1}{2!}}d^{2}F(u;h)+dots +{frac {1}{(k-1)!}}d^{k-1}F(u;h)+R_{k}}F(u+h)=F(u)+dF(u;h)+{frac {1}{2!}}d^{2}F(u;h)+dots +{frac {1}{(k-1)!}}d^{{k-1}}F(u;h)+R_{k}

where the remainder term is given by

Rk(u;h)=1(k−1)!∫01(1−t)k−1dkF(u+th;h)dt{displaystyle R_{k}(u;h)={frac {1}{(k-1)!}}int _{0}^{1}(1-t)^{k-1}d^{k}F(u+th;h),dt}R_{k}(u;h)={frac {1}{(k-1)!}}int _{0}^{1}(1-t)^{{k-1}}d^{k}F(u+th;h),dt



Example


Let X{displaystyle X}X be the Hilbert space of square-integrable functions on a Lebesgue measurable set Ω{displaystyle Omega }Omega in the Euclidean space RN. The functional



E:X→R{displaystyle E:Xrightarrow mathbb {R} }E:Xrightarrow {mathbb {R}}

E(u)=∫ΩF(u(x))dx{displaystyle E(u)=int _{Omega }Fleft(u(x)right)dx}E(u)=int _{Omega }Fleft(u(x)right)dx


where F is a real-valued function of a real variable and u is defined on Ω with real values, has Gâteaux derivative


dE(u,ψ)=⟨F′(u),ψ⟩:=∫ΩF′(u(x))ψ(x)dx.{displaystyle dE(u,psi )=langle F'(u),psi rangle :=int _{Omega }F'(u(x)),psi (x),dx.}{displaystyle dE(u,psi )=langle F'(u),psi rangle :=int _{Omega }F'(u(x)),psi (x),dx.}

Indeed, the above is the limit τ → 0 of



E(u+τψ)−E(u)τ=1τ(∫ΩF(u+τψ)dx−∫ΩF(u)dx){displaystyle {frac {E(u+tau psi )-E(u)}{tau }}={frac {1}{tau }}left(int _{Omega }F(u+tau ,psi )dx-int _{Omega }F(u),dxright)}{displaystyle {frac {E(u+tau psi )-E(u)}{tau }}={frac {1}{tau }}left(int _{Omega }F(u+tau ,psi )dx-int _{Omega }F(u),dxright)}

=1τ(∫Ω∫01ddsF(u+sτψ)dsdx){displaystyle quad quad ={frac {1}{tau }}left(int _{Omega }int _{0}^{1}{frac {d}{ds}}F(u+s,tau ,psi ),ds,dxright)}{displaystyle quad quad ={frac {1}{tau }}left(int _{Omega }int _{0}^{1}{frac {d}{ds}}F(u+s,tau ,psi ),ds,dxright)}

=∫Ω∫01F′(u+sτψ)ψdsdx.{displaystyle quad quad =int _{Omega }int _{0}^{1}F'(u+stau psi ),psi ,ds,dx.}{displaystyle quad quad =int _{Omega }int _{0}^{1}F'(u+stau psi ),psi ,ds,dx.}



See also



  • Derivative (generalizations)

  • Differentiation in Fréchet spaces

  • Fractal derivative

  • Quasi-derivative

  • Quaternionic analysis



References




  • Gâteaux, R (1913), "Sur les fonctionnelles continues et les fonctionnelles analytiques", Comptes rendus hebdomadaires des séances de l'Académie des sciences, Paris, 157: 325–327, retrieved 2 September 2012.mw-parser-output cite.citation{font-style:inherit}.mw-parser-output q{quotes:"""""""'""'"}.mw-parser-output code.cs1-code{color:inherit;background:inherit;border:inherit;padding:inherit}.mw-parser-output .cs1-lock-free a{background:url("//upload.wikimedia.org/wikipedia/commons/thumb/6/65/Lock-green.svg/9px-Lock-green.svg.png")no-repeat;background-position:right .1em center}.mw-parser-output .cs1-lock-limited a,.mw-parser-output .cs1-lock-registration a{background:url("//upload.wikimedia.org/wikipedia/commons/thumb/d/d6/Lock-gray-alt-2.svg/9px-Lock-gray-alt-2.svg.png")no-repeat;background-position:right .1em center}.mw-parser-output .cs1-lock-subscription a{background:url("//upload.wikimedia.org/wikipedia/commons/thumb/a/aa/Lock-red-alt-2.svg/9px-Lock-red-alt-2.svg.png")no-repeat;background-position:right .1em center}.mw-parser-output .cs1-subscription,.mw-parser-output .cs1-registration{color:#555}.mw-parser-output .cs1-subscription span,.mw-parser-output .cs1-registration span{border-bottom:1px dotted;cursor:help}.mw-parser-output .cs1-hidden-error{display:none;font-size:100%}.mw-parser-output .cs1-visible-error{font-size:100%}.mw-parser-output .cs1-subscription,.mw-parser-output .cs1-registration,.mw-parser-output .cs1-format{font-size:95%}.mw-parser-output .cs1-kern-left,.mw-parser-output .cs1-kern-wl-left{padding-left:0.2em}.mw-parser-output .cs1-kern-right,.mw-parser-output .cs1-kern-wl-right{padding-right:0.2em}.


  • Gâteaux, R (1919), "Fonctions d'une infinité de variables indépendantes", Bulletin de la Société Mathématique de France, 47: 70–96.


  • Hamilton, R. S. (1982), "The inverse function theorem of Nash and Moser", Bull. Amer. Math. Soc., 7 (1): 65–222, doi:10.1090/S0273-0979-1982-15004-2, MR 0656198


  • Hille, Einar; Phillips, Ralph S. (1974), Functional analysis and semi-groups, Providence, R.I.: American Mathematical Society, MR 0423094.


  • Tikhomirov, V.M. (2001) [1994], "Gâteaux variation", in Hazewinkel, Michiel, Encyclopedia of Mathematics, Springer Science+Business Media B.V. / Kluwer Academic Publishers, ISBN 978-1-55608-010-4.


  • Zorn, Max (1945), "Characterization of analytic functions in Banach spaces", Annals of Mathematics, Second Series, 46 (4): 585–593, doi:10.2307/1969198, ISSN 0003-486X, JSTOR 1969198, MR 0014190.


  • Zorn, Max (1946), "Derivatives and Frechet differentials", Bulletin of the American Mathematical Society, 52 (2): 133–137, doi:10.1090/S0002-9904-1946-08524-9, MR 0014595.









-

Popular posts from this blog

Eastern Orthodox Church

Image
Not to be confused with Oriental Orthodoxy, Eastern Christianity, or Eastern Catholic Churches. "Eastern Orthodoxy", "Orthodox Church", "Orthodox Catholic Church", and "Orthodox Christian Church" redirect here. For other uses, see Orthodox (disambiguation). This article may be too long to read and navigate comfortably . The readable prose size is 132 kilobytes. Please consider splitting content into sub-articles, condensing it, or adding or removing subheadings. ( January 2018 ) Part of a series on the Eastern Orthodox Church Mosaic of Christ Pantocrator, Hagia Sophia Overview Structure Theology (History of theology) Liturgy Church history Holy Mysteries View of salvation View of Mary View of icons Background Crucifixion / Resurrection / Ascension of Jesus Christianity Christian Church Apostolic succession Four Marks of the Church Orthodoxy Organization Autocephaly Patriarchate
Read more

Understanding the information contained in the Deep Space Network XML data?

Image
up vote 1 down vote favorite NASA's Deep Space Network activity can be viewed conveniently at https://eyes.nasa.gov/dsn/dsn.html but if you would like data in a more raw XML form, it can be accessed as described in this answer Below is a small Python script that reads the XML into a list of dictionaries, and saves it to disk as a JSON. The dictionaries are organized at the higher level by dish, then by spacecraft per dish. Question: What are the most-likely meanings of all the data field contained in the Deep Space Network XML data? This is the example url from the other answer, used in the script below: https://eyes.nasa.gov/dsn/data/1365107113.xml def dictify(r,root=True): # https://stackoverflow.com/questions/2148119/how-to-convert-an-xml-string-to-a-dictionary-in-python/30923963#30923963 if root: ret
Read more

Zagreb

Image
This article is about the Croatian capital city. For other uses, see Zagreb (disambiguation). City in City of Zagreb, Croatia Zagreb City Grad Zagreb City of Zagreb Clockwise, from top: St. Mark's Square, Croatian State Archives, Zagreb Tram, Art Pavilion, Cibona & HOTO towers and Croatian National Theatre. Flag Coat of arms Zagreb Location of Zagreb in Croatia Show map of Croatia Zagreb Zagreb (Europe) Show map of Europe Coordinates: 45°49′N 15°59′E  /  45.817°N 15.983°E  / 45.817; 15.983 Coordinates: 45°49′N 15°59′E  /  45.817°N 15.983°E  / 45.817; 15.983 Country   Croatia County City of Zagreb RC diocese 1094 Free royal city 1242 Unified 1850 Subdivisions 17 city districts 218 local committees (70 settlements) Government  • Type Mayor-Council  • Mayor Milan Bandić (BM 365)  • City Assembly 51 members BM 365, ZL, NS-R (14) SDP, GLAS, HNS, HSS, NH-PS (13)
Read more