- Shayne Longpre, Le Hou, Tu Vu, Albert Webson, Hyung Won Chung, Yi Tay, Denny Zhou, Quoc V. Le, Barret Zoph, Jason Wei, Adam Roberts:
The Flan Collection: Designing Data and Methods for Effective Instruction Tuning. CoRR abs/2301.13688 (2023) - Hyung Won Chung, Noah Constant, Xavier Garcia, Adam Roberts, Yi Tay, Sharan Narang, Orhan Firat:
UniMax: Fairer and more Effective Language Sampling for Large-Scale Multilingual Pretraining. CoRR abs/2304.09151 (2023) - Richard Mayne, Nic Roberts, Neil Phillips, Roshan Weerasekera, Andrew Adamatzky:
Propagation of electrical signals by fungi. CoRR abs/2304.10675 (2023) - Shayne Longpre, Gregory Yauney, Emily Reif, Katherine Lee, Adam Roberts, Barret Zoph, Denny Zhou, Jason Wei, Kevin Robinson, David Mimno, Daphne Ippolito:
A Pretrainer's Guide to Training Data: Measuring the Effects of Data Age, Domain Coverage, Quality, & Toxicity. CoRR abs/2305.13169 (2023) - Nic Roberts, Noushin Raeisi Kheirabadi, Michail-Antisthenis I. Tsompanas, Alessandro Chiolerio, Marco Crepaldi, Andrew Adamatzky:
Logical circuits in colloids. CoRR abs/2307.02664 (2023) - Sayash Kapoor, Emily Cantrell, Kenny Peng, Thanh Hien Pham, Christopher A. Bail, Odd Erik Gundersen, Jake M. Hofman, Jessica Hullman, Michael A. Lones, Momin M. Malik, Priyanka Nanayakkara, Russell A. Poldrack, Inioluwa Deborah Raji, Michael Roberts, Matthew J. Salganik, Marta Serra-Garcia, Brandon M. Stewart, Gilles Vandewiele, Arvind Narayanan:
REFORMS: Reporting Standards for Machine Learning Based Science. CoRR abs/2308.07832 (2023) - A. Feder Cooper, Katherine Lee, James Grimmelmann, Daphne Ippolito, Christopher Callison-Burch, Christopher A. Choquette-Choo, Niloofar Mireshghallah, Miles Brundage, David Mimno, Madiha Zahrah Choksi, Jack M. Balkin, Nicholas Carlini, Christopher De Sa, Jonathan Frankle, Deep Ganguli, Bryant Gipson, Andres Guadamuz, Swee Leng Harris, Abigail Z. Jacobs, Elizabeth Joh, Gautam Kamath, Mark Lemley, Cass Matthews, Christine McLeavey, Corynne McSherry, Milad Nasr, Paul Ohm, Adam Roberts, Tom Rubin, Pamela Samuelson, Ludwig Schubert, Kristen Vaccaro, Luis Villa, Felix Wu, Elana Zeide:
Report of the 1st Workshop on Generative AI and Law. CoRR abs/2311.06477 (2023) - 2022
- Mohammed E. Sayed, Jamie O. Roberts, Karen Donaldson, Stephen T. Mahon, Faiz Iqbal, Boyang Li, Santiago Franco Aixela, Georgios Mastorakis, Emil T. Jonasson, Markus P. Nemitz, Sara Bernardini, Adam A. Stokes:
Modular Robots for Enabling Operations in Unstructured Extreme Environments. Adv. Intell. Syst. 4(5) (2022) - Valérie de Crécy-Lagard, Rocio Amorin de Hegedus, Cecilia N. Arighi, Jill Babor, Alex Bateman, Ian Blaby, Crysten Blaby-Haas, Alan J. Bridge, Stephen K. Burley, Stacey Cleveland, Lucy J. Colwell, Ana Conesa, Christian Dallago, Antoine Danchin, Anita de Waard, Adam Deutschbauer, Raquel Dias, Yousong Ding, Gang Fang, Iddo Friedberg, John Gerlt, Joshua Goldford, Mark Gorelik, Benjamin M. Gyori, Christopher S. Henry, Geoffrey Hutinet, Marshall Jaroch, Peter D. Karp, Liudmyla Kondratova, Zhiyong Lu, Aron Marchler-Bauer, Maria Jesus Martin, Claire D. McWhite, Gaurav D. Moghe, Paul Monaghan, Anne Morgat, Christopher J. Mungall, Darren A. Natale, William C. Nelson, Seán I. O'Donoghue, Christine A. Orengo, Katherine H. O'Toole, Predrag Radivojac, Colbie Reed, Richard J. Roberts, Dmitri Rodionov, Irina A. Rodionova, Jeffrey DePons, Lana Saleh, Gloria M. Sheynkman, Françoise Thibaud-Nissen, Paul D. Thomas, Peter Uetz, David Vallenet, Erica Watson Carter, Peter Weigele, Valerie Wood, Elisha M. Wood-Charlson, Jin Xu:
A roadmap for the functional annotation of protein families: a community perspective. Database J. Biol. Databases Curation 2022(2022) (2022) - Andrew Adamatzky, Phil Ayres, Alexander E. Beasley, Alessandro Chiolerio, Mohammad Mahdi Dehshibi, Antoni Gandia, Elena Albergati, Richard Mayne, Anna Nikolaidou, Nic Roberts, Martin Tegelaar, Michail-Antisthenis I. Tsompanas, Neil Phillips, Han A. B. Wösten:
Fungal electronics. Biosyst. 212: 104588 (2022) - Joe Gildea, Adrian Korban, Adam Michael Roberts:
New binary self-dual codes of lengths 80, 84 and 96 from composite matrices. Des. Codes Cryptogr. 90(2): 317-342 (2022) - Steven T. Dougherty, Joe Gildea, Adrian Korban, Adam Michael Roberts:
Group LCD and group reversible LCD codes. Finite Fields Their Appl. 83: 102079 (2022) - Seyyed M. H. Haddad, Christopher J. M. Scott, Miracle Ozzoude, Courtney Berezuk, Melissa Holmes, Sabrina Adamo, Joel Ramirez, Stephen R. Arnott, Nuwan D. Nanayakkara, Malcolm A. Binns, Derek Beaton, Wendy Lou, Kelly Sunderland, Sujeevini Sujanthan, Jane Lawrence, Donna Kwan, Brian Tan, Leanne Casaubon, Jennifer Mandzia, Demetrios Sahlas, Gustavo Saposnik, Ayman Hassan, Brian Levine, Paul McLaughlin, J. B. Orange, Angela Roberts, Angela Troyer, Sandra E. Black, Dar Dowlatshahi, Stephen C. Strother, Richard H. Swartz, Sean Symons, Manuel Montero-Odasso, ONDRI Investigators, Robert Bartha:
Comparison of Diffusion Tensor Imaging Metrics in Normal-Appearing White Matter to Cerebrovascular Lesions and Correlation with Cerebrovascular Disease Risk Factors and Severity. Int. J. Biomed. Imaging 2022: 5860364:1-5860364:14 (2022) - Andrew Adamatzky, Phil Ayres, Alexander E. Beasley, Nic Roberts, Han A. B. Wösten:
Logics in Fungal Mycelium Networks. Logica Universalis 16(4): 655-669 (2022) - Adam Steel, Brenda D. Garcia, Edward Harry Silson, Caroline E. Robertson:
Evaluating the efficacy of multi-echo ICA denoising on model-based fMRI. NeuroImage 264: 119723 (2022) - Honghan Wu, Minhong Wang, Jinge Wu, Farah Francis, Yun-Hsuan Chang, Alex Shavick, Hang Dong, Michael Tin Chung Poon, Natalie K. Fitzpatrick, Adam P. Levine, Luke T. Slater, Alex Handy, Andreas Karwath, Georgios V. Gkoutos, Claude Chelala, Anoop D. Shah, Robert Stewart, Nigel Collier, Beatrice Alex, William Whiteley, Cathie Sudlow, Angus Roberts, Richard J. B. Dobson:
A survey on clinical natural language processing in the United Kingdom from 2007 to 2022. npj Digit. Medicine 5 (2022) - Sandra Kotzor, Allison Wetterlin, Adam Charles Roberts, Henning Reetz, Aditi Lahiri:
Bengali nasal vowels: lexical representation and listener perception. Phonetica 79(2): 115-150 (2022) - Stuart C. J. Robertson, Corné E. van Daalen, Johan A. du Preez:
Efficient approximations of the multi-sensor labelled multi-Bernoulli filter. Signal Process. 199: 108633 (2022) - Linting Xue, Aditya Barua, Noah Constant, Rami Al-Rfou, Sharan Narang, Mihir Kale, Adam Roberts, Colin Raffel:
ByT5: Towards a Token-Free Future with Pre-trained Byte-to-Byte Models. Trans. Assoc. Comput. Linguistics 10: 291-306 (2022) - Daniel Arnold, Sy-Toan Ngo, Ciaran M. Roberts, Yize Chen, Anna Scaglione, Sean Peisert:
Adam-based Augmented Random Search for Control Policies for Distributed Energy Resource Cyber Attack Mitigation. ACC 2022: 4559-4566 - Thomas Wang, Adam Roberts, Daniel Hesslow, Teven Le Scao, Hyung Won Chung, Iz Beltagy, Julien Launay, Colin Raffel:
What Language Model Architecture and Pretraining Objective Works Best for Zero-Shot Generalization? ICML 2022: 22964-22984 - Yael Segal, Kasia Hitczenko, Matthew Goldrick, Adam Buchwald, Angela Roberts, Joseph Keshet:
DDKtor: Automatic Diadochokinetic Speech Analysis. INTERSPEECH 2022: 4611-4615 - Curtis Hawthorne, Ian Simon, Adam Roberts, Neil Zeghidour, Josh Gardner, Ethan Manilow, Jesse H. Engel:
Multi-instrument Music Synthesis with Spectrogram Diffusion. ISMIR 2022: 598-607 - Zhuowen Zhao, Tanny Chavez, Elizabeth Holman, Guanhua Hao, Adam Green, Harinarayan Krishnan, Dylan McReynolds, Ronald Pandolfi, Eric J. Roberts, Petrus H. Zwart, Howard Yanxon, Nicholas Schwarz, Subramanian Sankaranarayanan, Sergei V. Kalinin, Apurva Mehta, Stuart Campbell, Alexander Hexemer:
MLExchange: A web-based platform enabling exchangeable machine learning workflows for scientific studies. XLOOP@SC 2022: 10-15 - Romal Thoppilan, Daniel De Freitas, Jamie Hall, Noam Shazeer, Apoorv Kulshreshtha, Heng-Tze Cheng, Alicia Jin, Taylor Bos, Leslie Baker, Yu Du, YaGuang Li, Hongrae Lee, Huaixiu Steven Zheng, Amin Ghafouri, Marcelo Menegali, Yanping Huang, Maxim Krikun, Dmitry Lepikhin, James Qin, Dehao Chen, Yuanzhong Xu, Zhifeng Chen, Adam Roberts, Maarten Bosma, Yanqi Zhou, Chung-Ching Chang, Igor Krivokon, Will Rusch, Marc Pickett, Kathleen S. Meier-Hellstern, Meredith Ringel Morris, Tulsee Doshi, Renelito Delos Santos, Toju Duke, Johnny Soraker, Ben Zevenbergen, Vinodkumar Prabhakaran, Mark Diaz, Ben Hutchinson, Kristen Olson, Alejandra Molina, Erin Hoffman-John, Josh Lee, Lora Aroyo, Ravi Rajakumar, Alena Butryna, Matthew Lamm, Viktoriya Kuzmina, Joe Fenton, Aaron Cohen, Rachel Bernstein, Ray Kurzweil, Blaise Agüera y Arcas, Claire Cui, Marian Croak, Ed H. Chi, Quoc Le:
LaMDA: Language Models for Dialog Applications. CoRR abs/2201.08239 (2022) - Daniel B. Arnold, Sy-Toan Ngo, Ciaran M. Roberts, Yize Chen, Anna Scaglione, Sean Peisert:
Adam-based Augmented Random Search for Control Policies for Distributed Energy Resource Cyber Attack Mitigation. CoRR abs/2201.11825 (2022) - Joar Skalse, Matthew Farrugia-Roberts, Stuart Russell, Alessandro Abate, Adam Gleave:
Invariance in Policy Optimisation and Partial Identifiability in Reward Learning. CoRR abs/2203.07475 (2022) - Adam Roberts, Hyung Won Chung, Anselm Levskaya, Gaurav Mishra, James Bradbury, Daniel Andor, Sharan Narang, Brian Lester, Colin Gaffney, Afroz Mohiuddin, Curtis Hawthorne, Aitor Lewkowycz, Alex Salcianu, Marc van Zee, Jacob Austin, Sebastian Goodman, Livio Baldini Soares, Haitang Hu, Sasha Tsvyashchenko, Aakanksha Chowdhery, Jasmijn Bastings, Jannis Bulian, Xavier Garcia, Jianmo Ni, Andrew Chen, Kathleen Kenealy, Jonathan H. Clark, Stephan Lee, Dan Garrette, James Lee-Thorp, Colin Raffel, Noam Shazeer, Marvin Ritter, Maarten Bosma, Alexandre Passos, Jeremy Maitin-Shepard, Noah Fiedel, Mark Omernick, Brennan Saeta, Ryan Sepassi, Alexander Spiridonov, Joshua Newlan, Andrea Gesmundo:
Scaling Up Models and Data with t5x and seqio. CoRR abs/2203.17189 (2022) - Aakanksha Chowdhery, Sharan Narang, Jacob Devlin, Maarten Bosma, Gaurav Mishra, Adam Roberts, Paul Barham, Hyung Won Chung, Charles Sutton, Sebastian Gehrmann, Parker Schuh, Kensen Shi, Sasha Tsvyashchenko, Joshua Maynez, Abhishek Rao, Parker Barnes, Yi Tay, Noam Shazeer, Vinodkumar Prabhakaran, Emily Reif, Nan Du, Ben Hutchinson, Reiner Pope, James Bradbury, Jacob Austin, Michael Isard, Guy Gur-Ari, Pengcheng Yin, Toju Duke, Anselm Levskaya, Sanjay Ghemawat, Sunipa Dev, Henryk Michalewski, Xavier Garcia, Vedant Misra, Kevin Robinson, Liam Fedus, Denny Zhou, Daphne Ippolito, David Luan, Hyeontaek Lim, Barret Zoph, Alexander Spiridonov, Ryan Sepassi, David Dohan, Shivani Agrawal, Mark Omernick, Andrew M. Dai, Thanumalayan Sankaranarayana Pillai, Marie Pellat, Aitor Lewkowycz, Erica Moreira, Rewon Child, Oleksandr Polozov, Katherine Lee, Zongwei Zhou, Xuezhi Wang, Brennan Saeta, Mark Diaz, Orhan Firat, Michele Catasta, Jason Wei, Kathy Meier-Hellstern, Douglas Eck, Jeff Dean, Slav Petrov, Noah Fiedel:
PaLM: Scaling Language Modeling with Pathways. CoRR abs/2204.02311 (2022)