About: Neural tangent kernel

Facets (new session)
Description
Metadata
Settings
- Rule:
- Inverse Functional Properties:
- "Same As":

About: Neural tangent kernel Goto Sponge NotDistinct Permalink

An Entity of Type : owl:Thing, within Data Space : dbpedia.demo.openlinksw.com associated with source document(s)
QRcode icon

http://dbpedia.demo.openlinksw.com/c/8fqcpSkhWX

In the study of artificial neural networks (ANNs), the neural tangent kernel (NTK) is a kernel that describes the evolution of deep artificial neural networks during their training by gradient descent. It allows ANNs to be studied using theoretical tools from kernel methods. The NTK was introduced in 2018 by Arthur Jacot, Franck Gabriel and Clément Hongler. It was implicit in contemporaneous work on overparameterization.

Attributes	Values
rdfs:label	Kernel de tangent neural (ca) Neural tangent kernel (en) Kernel de tangente neural (pt)
rdfs:comment	In the study of artificial neural networks (ANNs), the neural tangent kernel (NTK) is a kernel that describes the evolution of deep artificial neural networks during their training by gradient descent. It allows ANNs to be studied using theoretical tools from kernel methods. The NTK was introduced in 2018 by Arthur Jacot, Franck Gabriel and Clément Hongler. It was implicit in contemporaneous work on overparameterization. (en) No estudo de redes neurais artificiais (RNAs), o kernel de tangente neural (KTN) é um kernel que descreve a evolução de redes neurais artificiais profundas durante seu treinamento por gradiente descendente . Ele permite que RNAs sejam estudadas usando algoritmos do tipo Máquina de vetores de suporte. O KTN foi lançado em 2018 por Arthur Jacot, Franck Gabriel e Clément Hongler. Também estava implícito em alguns trabalhos contemporâneos. (pt)
dcterms:subject	Kernel methods for machine learning
Wikipage page ID	62443864 (xsd:integer)
Wikipage revision ID	1103547779 (xsd:integer)
Link from a Wikipage to another Wikipage	Python (programming language) Kernel methods for machine learning Kernel methods Deep learning Quadratic loss function Maxima and minima Global minimum Gradient descent Convex function Convolutional neural network Recurrent neural networks Closed-form expression Feature (machine learning) Kernel method Kernel methods for vector output Kernel regression Activation function Large width limits of neural networks Affine transformation Gaussian distribution Gaussian random variable Quanta Magazine Artificial neural network Transformer (machine learning model) Positive-definite kernel Convolutional neural networks Dataset (machine learning) Independent and identically distributed random variables Ordinary differential equation Loss function Neural network Gaussian process Free and open-source
Link from a Wikipage to an external page	https://github.com/google/neural-tangents https://www.quantamagazine.org/a-new-link-to-an-old-model-could-crack-the-mystery-of-deep-learning-20211011/%7Cwebsite=
sameAs	Neural tangent kernel Neural tangent kernel Neural tangent kernel Neural tangent kernel
dbp:wikiPageUsesTemplate	dbt:Cite_web dbt:Reflist dbt:Toclimit
has abstract	En l'estudi de les xarxes neuronals artificials (ANN), el kernel de tangent neural (amb acrònim anglès NTK) és un que descriu l'evolució de les xarxes neuronals artificials profundes durant el seu entrenament per descens de gradient. Permet estudiar les ANN utilitzant eines teòriques dels mètodes nucli. Per a les arquitectures de xarxes neuronals més comunes, en el límit de l'amplada de capa gran, l'NTK es torna constant. Això permet fer declaracions senzilles de forma tancada sobre prediccions de xarxes neuronals, dinàmiques d'entrenament, generalització i superfícies de pèrdua. Per exemple, garanteix que les ANN prou amples convergeixen a un mínim global quan s'entrenen per minimitzar una pèrdua empírica. El NTK de les xarxes d'amplada gran també està relacionat amb diversos . El NTK va ser presentat el 2018 per Arthur Jacot, Franck Gabriel i Clément Hongler. Estava implícit en treballs contemporanis sobre sobreparametrització. (ca) In the study of artificial neural networks (ANNs), the neural tangent kernel (NTK) is a kernel that describes the evolution of deep artificial neural networks during their training by gradient descent. It allows ANNs to be studied using theoretical tools from kernel methods. For most common neural network architectures, in the limit of large layer width the NTK becomes constant. This enables simple closed form statements to be made about neural network predictions, training dynamics, generalization, and loss surfaces. For example, it guarantees that wide enough ANNs converge to a global minimum when trained to minimize an empirical loss. The NTK of large width networks is also related to several other large width limits of neural networks. The NTK was introduced in 2018 by Arthur Jacot, Franck Gabriel and Clément Hongler. It was implicit in contemporaneous work on overparameterization. (en) No estudo de redes neurais artificiais (RNAs), o kernel de tangente neural (KTN) é um kernel que descreve a evolução de redes neurais artificiais profundas durante seu treinamento por gradiente descendente . Ele permite que RNAs sejam estudadas usando algoritmos do tipo Máquina de vetores de suporte. Para a maioria das arquiteturas de rede neural, no limite da largura da camada, o KTN se torna constante. Isso permite que declarações simples de forma fechada sejam feitas sobre previsões de rede neural, dinâmicas de treinamento, generalização e superfícies de perda. Por exemplo, ele garante que RNAs largas o suficiente convergem para um mínimo global quando treinados para minimizar uma perda empírica. O KTN de redes de grande largura também está relacionado a vários outros limites de largura de redes neurais. O KTN foi lançado em 2018 por Arthur Jacot, Franck Gabriel e Clément Hongler. Também estava implícito em alguns trabalhos contemporâneos. (pt)
prov:wasDerivedFrom	wikipedia-en:Neural_tangent_kernel?oldid=1103547779&ns=0
page length (characters) of wiki page	19653 (xsd:nonNegativeInteger)
foaf:isPrimaryTopicOf	wikipedia-en:Neural_tangent_kernel
is Link from a Wikipage to another Wikipage of	NTK Kernel method Large width limits of neural networks Neural network Gaussian process
is Wikipage disambiguates of	NTK
is foaf:primaryTopic of	wikipedia-en:Neural_tangent_kernel

Faceted Search & Find service v1.17_git147 as of Sep 06 2024

Alternative Linked Data Documents: ODE Content Formats:

RDF

ODATA

Microdata

About

OpenLink Virtuoso version 08.03.3332 as of Dec 5 2024, on Linux (x86_64-generic-linux-glibc212), Single-Server Edition (378 GB total memory, 58 GB memory in use)
Data on this page belongs to its respective rights holders.
Virtuoso Faceted Browser Copyright © 2009-2025 OpenLink Software