


default search action
Nikunj Saunshi
Person information
Refine list

refinements active!
zoomed in on ?? of ?? records
view refined list in
export refined list as
2020 – today
- 2025
 [c19]Abhishek Panigrahi, Nikunj Saunshi, Kaifeng Lyu, Sobhan Miryoosefi, Sashank J. Reddi, Satyen Kale, Sanjiv Kumar: [c19]Abhishek Panigrahi, Nikunj Saunshi, Kaifeng Lyu, Sobhan Miryoosefi, Sashank J. Reddi, Satyen Kale, Sanjiv Kumar:
 Efficient stagewise pretraining via progressive subnetworks. ICLR 2025
 [c18]Nikunj Saunshi, Nishanth Dikkala, Zhiyuan Li, Sanjiv Kumar, Sashank J. Reddi: [c18]Nikunj Saunshi, Nishanth Dikkala, Zhiyuan Li, Sanjiv Kumar, Sashank J. Reddi:
 Reasoning with Latent Thoughts: On the Power of Looped Transformers. ICLR 2025
 [i24]Dylan J. Cutler, Arun Kandoor, Nishanth Dikkala, Nikunj Saunshi, Xin Wang, Rina Panigrahy: [i24]Dylan J. Cutler, Arun Kandoor, Nishanth Dikkala, Nikunj Saunshi, Xin Wang, Rina Panigrahy:
 StagFormer: Time Staggering Transformer Decoding for RunningLayers In Parallel. CoRR abs/2501.15665 (2025)
 [i23]Tian Jin, Ellie Y. Cheng, Zachary Ankner, Nikunj Saunshi, Blake M. Elias, Amir Yazdanbakhsh, Jonathan Ragan-Kelley, Suvinay Subramanian, Michael Carbin: [i23]Tian Jin, Ellie Y. Cheng, Zachary Ankner, Nikunj Saunshi, Blake M. Elias, Amir Yazdanbakhsh, Jonathan Ragan-Kelley, Suvinay Subramanian, Michael Carbin:
 Learning to Keep a Promise: Scaling Language Model Decoding Parallelism with Learned Asynchronous Decoding. CoRR abs/2502.11517 (2025)
 [i22]Nikunj Saunshi, Nishanth Dikkala, Zhiyuan Li, Sanjiv Kumar, Sashank J. Reddi: [i22]Nikunj Saunshi, Nishanth Dikkala, Zhiyuan Li, Sanjiv Kumar, Sashank J. Reddi:
 Reasoning with Latent Thoughts: On the Power of Looped Transformers. CoRR abs/2502.17416 (2025)
 [i21]Gheorghe Comanici, Eric Bieber, Mike Schaekermann, Ice Pasupat, Noveen Sachdeva, Inderjit S. Dhillon, Marcel Blistein, Ori Ram, Dan Zhang, Evan Rosen, Luke Marris, Sam Petulla, Colin Gaffney, Asaf Aharoni, Nathan Lintz, Tiago Cardal Pais, Henrik Jacobsson, Idan Szpektor, Nan-Jiang Jiang, Krishna Haridasan, Ahmed Omran, Nikunj Saunshi, Dara Bahri, Gaurav Mishra, Eric Chu, Toby Boyd, Brad Hekman, Aaron Parisi, Chaoyi Zhang, Kornraphop Kawintiranon, Tania Bedrax-Weiss, Oliver Wang, Ya Xu, Ollie Purkiss, Uri Mendlovic, Ilaï Deutel [i21]Gheorghe Comanici, Eric Bieber, Mike Schaekermann, Ice Pasupat, Noveen Sachdeva, Inderjit S. Dhillon, Marcel Blistein, Ori Ram, Dan Zhang, Evan Rosen, Luke Marris, Sam Petulla, Colin Gaffney, Asaf Aharoni, Nathan Lintz, Tiago Cardal Pais, Henrik Jacobsson, Idan Szpektor, Nan-Jiang Jiang, Krishna Haridasan, Ahmed Omran, Nikunj Saunshi, Dara Bahri, Gaurav Mishra, Eric Chu, Toby Boyd, Brad Hekman, Aaron Parisi, Chaoyi Zhang, Kornraphop Kawintiranon, Tania Bedrax-Weiss, Oliver Wang, Ya Xu, Ollie Purkiss, Uri Mendlovic, Ilaï Deutel , Nam Nguyen, Adam Langley, Flip Korn, Lucia Rossazza, Alexandre Ramé, Sagar Waghmare, Helen Miller, Nathan Byrd, Ashrith Sheshan, Raia Hadsell Sangnie Bhardwaj, Pawel Janus, Tero Rissa, Dan Horgan, Sharon Silver, Ayzaan Wahid, Sergey Brin, Yves Raimond, Klemen Kloboves, Cindy Wang, Nitesh Bharadwaj Gundavarapu, Ilia Shumailov, Bo Wang, Mantas Pajarskas, Joe Heyward, Martin Nikoltchev, Maciej Kula, Hao Zhou, Zachary Garrett, Sushant Kafle, Sercan Arik, Ankita Goel, Mingyao Yang, Jiho Park, Koji Kojima, Parsa Mahmoudieh, Koray Kavukcuoglu, Grace Chen, Doug Fritz, Anton Bulyenov, Sudeshna Roy, Dimitris Paparas, Hadar Shemtov, Bo-Juen Chen, Robin Strudel, David Reitter, Aurko Roy, Andrey Vlasov, Changwan Ryu, Chas Leichner, Haichuan Yang, Zelda Mariet, Denis Vnukov, Tim Sohn, Amy Stuart, Wei Liang, Minmin Chen, Praynaa Rawlani, Christy Koh, JD Co-Reyes, Guangda Lai, Praseem Banzal, Dimitrios Vytiniotis, Jieru Mei, Mu Cai: , Nam Nguyen, Adam Langley, Flip Korn, Lucia Rossazza, Alexandre Ramé, Sagar Waghmare, Helen Miller, Nathan Byrd, Ashrith Sheshan, Raia Hadsell Sangnie Bhardwaj, Pawel Janus, Tero Rissa, Dan Horgan, Sharon Silver, Ayzaan Wahid, Sergey Brin, Yves Raimond, Klemen Kloboves, Cindy Wang, Nitesh Bharadwaj Gundavarapu, Ilia Shumailov, Bo Wang, Mantas Pajarskas, Joe Heyward, Martin Nikoltchev, Maciej Kula, Hao Zhou, Zachary Garrett, Sushant Kafle, Sercan Arik, Ankita Goel, Mingyao Yang, Jiho Park, Koji Kojima, Parsa Mahmoudieh, Koray Kavukcuoglu, Grace Chen, Doug Fritz, Anton Bulyenov, Sudeshna Roy, Dimitris Paparas, Hadar Shemtov, Bo-Juen Chen, Robin Strudel, David Reitter, Aurko Roy, Andrey Vlasov, Changwan Ryu, Chas Leichner, Haichuan Yang, Zelda Mariet, Denis Vnukov, Tim Sohn, Amy Stuart, Wei Liang, Minmin Chen, Praynaa Rawlani, Christy Koh, JD Co-Reyes, Guangda Lai, Praseem Banzal, Dimitrios Vytiniotis, Jieru Mei, Mu Cai:
 Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilities. CoRR abs/2507.06261 (2025)
- 2024
 [c17]Khashayar Gatmiry, Nikunj Saunshi, Sashank J. Reddi, Stefanie Jegelka, Sanjiv Kumar: [c17]Khashayar Gatmiry, Nikunj Saunshi, Sashank J. Reddi, Stefanie Jegelka, Sanjiv Kumar:
 Can Looped Transformers Learn to Implement Multi-step Gradient Descent for In-context Learning? ICML 2024
 [c16]Nikunj Saunshi, Stefani Karp, Shankar Krishnan, Sobhan Miryoosefi, Sashank Jakkam Reddi, Sanjiv Kumar: [c16]Nikunj Saunshi, Stefani Karp, Shankar Krishnan, Sobhan Miryoosefi, Sashank Jakkam Reddi, Sanjiv Kumar:
 On the Inductive Bias of Stacking Towards Improving Reasoning. NeurIPS 2024
 [i20]Abhishek Panigrahi, Nikunj Saunshi, Kaifeng Lyu, Sobhan Miryoosefi, Sashank J. Reddi, Satyen Kale, Sanjiv Kumar: [i20]Abhishek Panigrahi, Nikunj Saunshi, Kaifeng Lyu, Sobhan Miryoosefi, Sashank J. Reddi, Satyen Kale, Sanjiv Kumar:
 Efficient Stagewise Pretraining via Progressive Subnetworks. CoRR abs/2402.05913 (2024)
 [i19]Stefani Karp, Nikunj Saunshi, Sobhan Miryoosefi, Sashank J. Reddi, Sanjiv Kumar: [i19]Stefani Karp, Nikunj Saunshi, Sobhan Miryoosefi, Sashank J. Reddi, Sanjiv Kumar:
 Landscape-Aware Growing: The Power of a Little LAG. CoRR abs/2406.02469 (2024)
 [i18]Nikunj Saunshi, Stefani Karp, Shankar Krishnan, Sobhan Miryoosefi, Sashank J. Reddi, Sanjiv Kumar: [i18]Nikunj Saunshi, Stefani Karp, Shankar Krishnan, Sobhan Miryoosefi, Sashank J. Reddi, Sanjiv Kumar:
 On the Inductive Bias of Stacking Towards Improving Reasoning. CoRR abs/2409.19044 (2024)
 [i17]Khashayar Gatmiry, Nikunj Saunshi, Sashank J. Reddi, Stefanie Jegelka, Sanjiv Kumar: [i17]Khashayar Gatmiry, Nikunj Saunshi, Sashank J. Reddi, Stefanie Jegelka, Sanjiv Kumar:
 Can Looped Transformers Learn to Implement Multi-step Gradient Descent for In-context Learning? CoRR abs/2410.08292 (2024)
 [i16]Ankit Singh Rawat, Veeranjaneyulu Sadhanala, Afshin Rostamizadeh, Ayan Chakrabarti, Wittawat Jitkrittum, Vladimir Feinberg, Seungyeon Kim, Hrayr Harutyunyan, Nikunj Saunshi, Zachary Nado, Rakesh Shivanna, Sashank J. Reddi, Aditya Krishna Menon, Rohan Anil, Sanjiv Kumar: [i16]Ankit Singh Rawat, Veeranjaneyulu Sadhanala, Afshin Rostamizadeh, Ayan Chakrabarti, Wittawat Jitkrittum, Vladimir Feinberg, Seungyeon Kim, Hrayr Harutyunyan, Nikunj Saunshi, Zachary Nado, Rakesh Shivanna, Sashank J. Reddi, Aditya Krishna Menon, Rohan Anil, Sanjiv Kumar:
 A Little Help Goes a Long Way: Efficient LLM Training by Leveraging Small LMs. CoRR abs/2410.18779 (2024)
 [i15]Khashayar Gatmiry, Nikunj Saunshi, Sashank J. Reddi, Stefanie Jegelka, Sanjiv Kumar: [i15]Khashayar Gatmiry, Nikunj Saunshi, Sashank J. Reddi, Stefanie Jegelka, Sanjiv Kumar:
 On the Role of Depth and Looping for In-Context Learning with Task Diversity. CoRR abs/2410.21698 (2024)
- 2023
 [c15]Vedant Gaur, Nikunj Saunshi: [c15]Vedant Gaur, Nikunj Saunshi:
 Reasoning in Large Language Models Through Symbolic Math Word Problems. ACL (Findings) 2023: 5889-5903
 [c14]Nikunj Saunshi, Arushi Gupta, Mark Braverman, Sanjeev Arora: [c14]Nikunj Saunshi, Arushi Gupta, Mark Braverman, Sanjeev Arora:
 Understanding Influence Functions and Datamodels via Harmonic Analysis. ICLR 2023
 [c13]Abhishek Panigrahi, Nikunj Saunshi, Haoyu Zhao, Sanjeev Arora: [c13]Abhishek Panigrahi, Nikunj Saunshi, Haoyu Zhao, Sanjeev Arora:
 Task-Specific Skill Localization in Fine-tuned Language Models. ICML 2023: 27011-27033
 [i14]Abhishek Panigrahi, Nikunj Saunshi, Haoyu Zhao, Sanjeev Arora: [i14]Abhishek Panigrahi, Nikunj Saunshi, Haoyu Zhao, Sanjeev Arora:
 Task-Specific Skill Localization in Fine-tuned Language Models. CoRR abs/2302.06600 (2023)
 [i13]Vedant Gaur, Nikunj Saunshi: [i13]Vedant Gaur, Nikunj Saunshi:
 Reasoning in Large Language Models Through Symbolic Math Word Problems. CoRR abs/2308.01906 (2023)
- 2022
 [c12]Yi Zhang, Arushi Gupta, Nikunj Saunshi, Sanjeev Arora: [c12]Yi Zhang, Arushi Gupta, Nikunj Saunshi, Sanjeev Arora:
 On Predicting Generalization using GANs. ICLR 2022
 [c11]Nikunj Saunshi, Jordan T. Ash, Surbhi Goel, Dipendra Misra, Cyril Zhang, Sanjeev Arora, Sham M. Kakade, Akshay Krishnamurthy: [c11]Nikunj Saunshi, Jordan T. Ash, Surbhi Goel, Dipendra Misra, Cyril Zhang, Sanjeev Arora, Sham M. Kakade, Akshay Krishnamurthy:
 Understanding Contrastive Learning Requires Incorporating Inductive Biases. ICML 2022: 19250-19286
 [c10]Arushi Gupta, Nikunj Saunshi, Dingli Yu, Kaifeng Lyu, Sanjeev Arora: [c10]Arushi Gupta, Nikunj Saunshi, Dingli Yu, Kaifeng Lyu, Sanjeev Arora:
 New Definitions and Evaluations for Saliency Methods: Staying Intrinsic, Complete and Sound. NeurIPS 2022
 [i12]Nikunj Saunshi, Jordan T. Ash, Surbhi Goel, Dipendra Misra, Cyril Zhang, Sanjeev Arora, Sham M. Kakade, Akshay Krishnamurthy: [i12]Nikunj Saunshi, Jordan T. Ash, Surbhi Goel, Dipendra Misra, Cyril Zhang, Sanjeev Arora, Sham M. Kakade, Akshay Krishnamurthy:
 Understanding Contrastive Learning Requires Incorporating Inductive Biases. CoRR abs/2202.14037 (2022)
 [i11]Nikunj Saunshi, Arushi Gupta, Mark Braverman, Sanjeev Arora: [i11]Nikunj Saunshi, Arushi Gupta, Mark Braverman, Sanjeev Arora:
 Understanding Influence Functions and Datamodels via Harmonic Analysis. CoRR abs/2210.01072 (2022)
 [i10]Arushi Gupta, Nikunj Saunshi, Dingli Yu, Kaifeng Lyu, Sanjeev Arora: [i10]Arushi Gupta, Nikunj Saunshi, Dingli Yu, Kaifeng Lyu, Sanjeev Arora:
 New Definitions and Evaluations for Saliency Methods: Staying Intrinsic, Complete and Sound. CoRR abs/2211.02912 (2022)
- 2021
 [c9]Nikunj Saunshi, Sadhika Malladi, Sanjeev Arora: [c9]Nikunj Saunshi, Sadhika Malladi, Sanjeev Arora:
 A Mathematical Exploration of Why Language Models Help Solve Downstream Tasks. ICLR 2021
 [c8]Nikunj Saunshi, Arushi Gupta, Wei Hu: [c8]Nikunj Saunshi, Arushi Gupta, Wei Hu:
 A Representation Learning Perspective on the Importance of Train-Validation Splitting in Meta-Learning. ICML 2021: 9333-9343
 [c7]Jason D. Lee, Qi Lei, Nikunj Saunshi, Jiacheng Zhuo: [c7]Jason D. Lee, Qi Lei, Nikunj Saunshi, Jiacheng Zhuo:
 Predicting What You Already Know Helps: Provable Self-Supervised Learning. NeurIPS 2021: 309-323
 [i9]Nikunj Saunshi, Arushi Gupta, Wei Hu: [i9]Nikunj Saunshi, Arushi Gupta, Wei Hu:
 A Representation Learning Perspective on the Importance of Train-Validation Splitting in Meta-Learning. CoRR abs/2106.15615 (2021)
 [i8]Yi Zhang, Arushi Gupta, Nikunj Saunshi, Sanjeev Arora: [i8]Yi Zhang, Arushi Gupta, Nikunj Saunshi, Sanjeev Arora:
 On Predicting Generalization using GANs. CoRR abs/2111.14212 (2021)
- 2020
 [c6]Sanjeev Arora, Simon S. Du, Sham M. Kakade, Yuping Luo, Nikunj Saunshi: [c6]Sanjeev Arora, Simon S. Du, Sham M. Kakade, Yuping Luo, Nikunj Saunshi:
 Provable Representation Learning for Imitation Learning via Bi-level Optimization. ICML 2020: 367-376
 [c5]Nikunj Saunshi, Yi Zhang, Mikhail Khodak, Sanjeev Arora: [c5]Nikunj Saunshi, Yi Zhang, Mikhail Khodak, Sanjeev Arora:
 A Sample Complexity Separation between Non-Convex and Convex Meta-Learning. ICML 2020: 8512-8521
 [i7]Sanjeev Arora, Simon S. Du, Sham M. Kakade, Yuping Luo, Nikunj Saunshi: [i7]Sanjeev Arora, Simon S. Du, Sham M. Kakade, Yuping Luo, Nikunj Saunshi:
 Provable Representation Learning for Imitation Learning via Bi-level Optimization. CoRR abs/2002.10544 (2020)
 [i6]Nikunj Saunshi, Yi Zhang, Mikhail Khodak, Sanjeev Arora: [i6]Nikunj Saunshi, Yi Zhang, Mikhail Khodak, Sanjeev Arora:
 A Sample Complexity Separation between Non-Convex and Convex Meta-Learning. CoRR abs/2002.11172 (2020)
 [i5]Jason D. Lee, Qi Lei, Nikunj Saunshi, Jiacheng Zhuo: [i5]Jason D. Lee, Qi Lei, Nikunj Saunshi, Jiacheng Zhuo:
 Predicting What You Already Know Helps: Provable Self-Supervised Learning. CoRR abs/2008.01064 (2020)
 [i4]Nikunj Saunshi, Sadhika Malladi, Sanjeev Arora: [i4]Nikunj Saunshi, Sadhika Malladi, Sanjeev Arora:
 A Mathematical Exploration of Why Language Models Help Solve Downstream Tasks. CoRR abs/2010.03648 (2020)
2010 – 2019
- 2019
 [c4]Nikunj Saunshi, Orestis Plevrakis, Sanjeev Arora, Mikhail Khodak, Hrishikesh Khandeparkar: [c4]Nikunj Saunshi, Orestis Plevrakis, Sanjeev Arora, Mikhail Khodak, Hrishikesh Khandeparkar:
 A Theoretical Analysis of Contrastive Unsupervised Representation Learning. ICML 2019: 5628-5637
 [i3]Sanjeev Arora, Hrishikesh Khandeparkar, Mikhail Khodak, Orestis Plevrakis, Nikunj Saunshi: [i3]Sanjeev Arora, Hrishikesh Khandeparkar, Mikhail Khodak, Orestis Plevrakis, Nikunj Saunshi:
 A Theoretical Analysis of Contrastive Unsupervised Representation Learning. CoRR abs/1902.09229 (2019)
- 2018
 [c3]Mikhail Khodak, Nikunj Saunshi, Yingyu Liang, Tengyu Ma, Brandon Stewart, Sanjeev Arora: [c3]Mikhail Khodak, Nikunj Saunshi, Yingyu Liang, Tengyu Ma, Brandon Stewart, Sanjeev Arora:
 A La Carte Embedding: Cheap but Effective Induction of Semantic Feature Vectors. ACL (1) 2018: 12-22
 [c2]Sanjeev Arora, Mikhail Khodak, Nikunj Saunshi, Kiran Vodrahalli: [c2]Sanjeev Arora, Mikhail Khodak, Nikunj Saunshi, Kiran Vodrahalli:
 A Compressed Sensing View of Unsupervised Text Embeddings, Bag-of-n-Grams, and LSTMs. ICLR (Poster) 2018
 [c1]Mikhail Khodak, Nikunj Saunshi, Kiran Vodrahalli: [c1]Mikhail Khodak, Nikunj Saunshi, Kiran Vodrahalli:
 A Large Self-Annotated Corpus for Sarcasm. LREC 2018
 [i2]Mikhail Khodak, Nikunj Saunshi, Yingyu Liang, Tengyu Ma, Brandon Stewart, Sanjeev Arora: [i2]Mikhail Khodak, Nikunj Saunshi, Yingyu Liang, Tengyu Ma, Brandon Stewart, Sanjeev Arora:
 A La Carte Embedding: Cheap but Effective Induction of Semantic Feature Vectors. CoRR abs/1805.05388 (2018)
- 2017
 [i1]Mikhail Khodak, Nikunj Saunshi, Kiran Vodrahalli: [i1]Mikhail Khodak, Nikunj Saunshi, Kiran Vodrahalli:
 A Large Self-Annotated Corpus for Sarcasm. CoRR abs/1704.05579 (2017)
Coauthor Index
aka: Sashank Jakkam Reddi

manage site settings
To protect your privacy, all features that rely on external API calls from your browser are turned off by default. You need to opt-in for them to become active. All settings here will be stored as cookies with your web browser. For more information see our F.A.Q.
Unpaywalled article links
Add open access links from  to the list of external document links (if available).
 to the list of external document links (if available).
Privacy notice: By enabling the option above, your browser will contact the API of unpaywall.org to load hyperlinks to open access articles. Although we do not have any reason to believe that your call will be tracked, we do not have any control over how the remote server uses your data. So please proceed with care and consider checking the Unpaywall privacy policy.
Archived links via Wayback Machine
For web page which are no longer available, try to retrieve content from the  of the Internet Archive (if available).
 of the Internet Archive (if available).
Privacy notice: By enabling the option above, your browser will contact the API of archive.org to check for archived content of web pages that are no longer available. Although we do not have any reason to believe that your call will be tracked, we do not have any control over how the remote server uses your data. So please proceed with care and consider checking the Internet Archive privacy policy.
Reference lists
Add a list of references from  ,
,  , and
, and  to record detail pages.
 to record detail pages.
load references from crossref.org and opencitations.net
Privacy notice: By enabling the option above, your browser will contact the APIs of crossref.org, opencitations.net, and semanticscholar.org to load article reference information. Although we do not have any reason to believe that your call will be tracked, we do not have any control over how the remote server uses your data. So please proceed with care and consider checking the Crossref privacy policy and the OpenCitations privacy policy, as well as the AI2 Privacy Policy covering Semantic Scholar.
Citation data
Add a list of citing articles from  and
 and  to record detail pages.
 to record detail pages.
load citations from opencitations.net
Privacy notice: By enabling the option above, your browser will contact the API of opencitations.net and semanticscholar.org to load citation information. Although we do not have any reason to believe that your call will be tracked, we do not have any control over how the remote server uses your data. So please proceed with care and consider checking the OpenCitations privacy policy as well as the AI2 Privacy Policy covering Semantic Scholar.
OpenAlex data
Load additional information about publications from  .
.
Privacy notice: By enabling the option above, your browser will contact the API of openalex.org to load additional information. Although we do not have any reason to believe that your call will be tracked, we do not have any control over how the remote server uses your data. So please proceed with care and consider checking the information given by OpenAlex.
last updated on 2025-10-28 23:32 CET by the dblp team
 all metadata released as open data under CC0 1.0 license
 all metadata released as open data under CC0 1.0 license
see also: Terms of Use | Privacy Policy | Imprint


 Google
Google Google Scholar
Google Scholar Semantic Scholar
Semantic Scholar Internet Archive Scholar
Internet Archive Scholar CiteSeerX
CiteSeerX ORCID
ORCID







