default search action
Google
Google Scholar
Semantic Scholar
Internet Archive Scholar
CiteSeerX
ORCIDFrederik Kunstner
Person information
Refine list
refinements active!
zoomed in on ?? of ?? records
view refined list in
export refined list as
Conference and Workshop Papers
- 2023
[c7]Frederik Kunstner, Jacques Chen, Jonathan Wilder Lavington, Mark Schmidt:
Noise Is Not the Main Factor Behind the Gap Between Sgd and Adam on Transformers, But Sign Descent Might Be. ICLR 2023- [c6]Frederik Kunstner, Victor Sanches Portella, Mark Schmidt, Nicholas J. A. Harvey:
Searching for Optimal Per-Coordinate Step-sizes with Multidimensional Backtracking. NeurIPS 2023 - 2022
- [c5]Frederik Kunstner, Raunak Kumar, Mark Schmidt:
Homeomorphic-Invariance of EM: Non-Asymptotic Convergence in KL Divergence for Exponential Families via Mirror Descent (Extended Abstract). IJCAI 2022: 5294-5298 - 2021
- [c4]Frederik Kunstner, Raunak Kumar, Mark Schmidt:
Homeomorphic-Invariance of EM: Non-Asymptotic Convergence in KL Divergence for Exponential Families via Mirror Descent. AISTATS 2021: 3295-3303 - 2020
- [c3]Felix Dangel, Frederik Kunstner, Philipp Hennig:
BackPACK: Packing more into Backprop. ICLR 2020 - 2019
- [c2]Frederik Kunstner, Philipp Hennig, Lukas Balles:
Limitations of the empirical Fisher approximation for natural gradient descent. NeurIPS 2019: 4158-4169 - 2018
- [c1]Aaron Mishkin, Frederik Kunstner, Didrik Nielsen, Mark Schmidt, Mohammad Emtiyaz Khan:
SLANG: Fast Structured Covariance Approximations for Bayesian Deep Learning with Natural Gradient. NeurIPS 2018: 6248-6258
Informal and Other Publications
- 2024
- [i9]Frederik Kunstner, Robin Yadav, Alan Milligan, Mark Schmidt, Alberto Bietti:
Heavy-Tailed Class Imbalance and Why Adam Outperforms Gradient Descent on Language Models. CoRR abs/2402.19449 (2024) - 2023
- [i8]Frederik Kunstner, Jacques Chen, Jonathan Wilder Lavington, Mark Schmidt:
Noise Is Not the Main Factor Behind the Gap Between SGD and Adam on Transformers, but Sign Descent Might Be. CoRR abs/2304.13960 (2023) - [i7]Frederik Kunstner, Victor S. Portella, Mark Schmidt, Nick Harvey:
Searching for Optimal Per-Coordinate Step-sizes with Multidimensional Backtracking. CoRR abs/2306.02527 (2023) - 2021
- [i6]Rémi Le Priol, Frederik Kunstner, Damien Scieur, Simon Lacoste-Julien:
Convergence Rates for the MAP of an Exponential Family and Stochastic Mirror Descent - an Open Problem. CoRR abs/2111.06826 (2021) - 2020
- [i5]Sharan Vaswani, Frederik Kunstner, Issam H. Laradji, Si Yi Meng, Mark Schmidt, Simon Lacoste-Julien:
Adaptive Gradient Methods Converge Faster with Over-Parameterization (and you can do a line-search). CoRR abs/2006.06835 (2020) - [i4]Frederik Kunstner, Raunak Kumar, Mark Schmidt:
Homeomorphic-Invariance of EM: Non-Asymptotic Convergence in KL Divergence for Exponential Families via Mirror Descent. CoRR abs/2011.01170 (2020) - 2019
- [i3]Frederik Kunstner, Lukas Balles, Philipp Hennig:
Limitations of the Empirical Fisher Approximation. CoRR abs/1905.12558 (2019) - [i2]Felix Dangel, Frederik Kunstner, Philipp Hennig:
BackPACK: Packing more into backprop. CoRR abs/1912.10985 (2019) - 2018
- [i1]Aaron Mishkin, Frederik Kunstner, Didrik Nielsen, Mark Schmidt, Mohammad Emtiyaz Khan:
SLANG: Fast Structured Covariance Approximations for Bayesian Deep Learning with Natural Gradient. CoRR abs/1811.04504 (2018)
Coauthor Index
manage site settings
To protect your privacy, all features that rely on external API calls from your browser are turned off by default. You need to opt-in for them to become active. All settings here will be stored as cookies with your web browser. For more information see our F.A.Q.
Unpaywalled article links
Add open access links from 
to the list of external document links (if available).
Privacy notice: By enabling the option above, your browser will contact the API of unpaywall.org to load hyperlinks to open access articles. Although we do not have any reason to believe that your call will be tracked, we do not have any control over how the remote server uses your data. So please proceed with care and consider checking the Unpaywall privacy policy.
Archived links via Wayback Machine
For web page which are no longer available, try to retrieve content from the 
of the Internet Archive (if available).
Privacy notice: By enabling the option above, your browser will contact the API of archive.org to check for archived content of web pages that are no longer available. Although we do not have any reason to believe that your call will be tracked, we do not have any control over how the remote server uses your data. So please proceed with care and consider checking the Internet Archive privacy policy.
Reference lists
Add a list of references from 
, 
, and 
to record detail pages.
load references from crossref.org and opencitations.net
Privacy notice: By enabling the option above, your browser will contact the APIs of crossref.org, opencitations.net, and semanticscholar.org to load article reference information. Although we do not have any reason to believe that your call will be tracked, we do not have any control over how the remote server uses your data. So please proceed with care and consider checking the Crossref privacy policy and the OpenCitations privacy policy, as well as the AI2 Privacy Policy covering Semantic Scholar.
Citation data
Add a list of citing articles from and to record detail pages.
load citations from opencitations.net
Privacy notice: By enabling the option above, your browser will contact the API of opencitations.net and semanticscholar.org to load citation information. Although we do not have any reason to believe that your call will be tracked, we do not have any control over how the remote server uses your data. So please proceed with care and consider checking the OpenCitations privacy policy as well as the AI2 Privacy Policy covering Semantic Scholar.
OpenAlex data
Load additional information about publications from 
.
Privacy notice: By enabling the option above, your browser will contact the API of openalex.org to load additional information. Although we do not have any reason to believe that your call will be tracked, we do not have any control over how the remote server uses your data. So please proceed with care and consider checking the information given by OpenAlex.
last updated on 2024-07-25 20:24 CEST by the dblp team
all metadata released as open data under CC0 1.0 license
see also: Terms of Use | Privacy Policy | Imprint
dblp was originally created in 1993 at:
since 2018, dblp has been operated and maintained by:
the dblp computer science bibliography is funded and supported by:
