Language models scale reliably with over-training and on downstream tasks
Samir Yitzhak Gadre,
Georgios Smyrnis,
Vaishaal Shankar,
Suchin Gururangan,
Mitchell Wortsman,
Rulin Shao,
Jean Mercat,
Alex Fang,
Jeffrey Li,
Sedrick Keh,
Rui Xin,
Marianna Nezhurina,
Igor Vasiljevic,
Jenia Jitsev,
Luca Soldaini,
Alex Dimakis,
Gabriel Ilharco,
Pang Wei Koh,
Shuran Song,
Thomas Kollar,
Yair Carmon*,
Achal Dave*,
Reinhard Heckel*,
Niklas Muennighoff*,
Ludwig Schmidt*
arXiv, 2024
arXiv |
code
DataComp-LM: In search of the next generation of training sets for language models
Jeffrey Li*,
Alex Fang*,
Georgios Smyrnis*,
Maor Ivgi*,
Matt Jordan,
Samir Yitzhak Gadre,
Hritik Bansal,
Etash Guha,
Sedrick Keh,
Kushal Arora,
Saurabh Garg,
Rui Xin,
Niklas Muennighoff,
Reinhard Heckel,
Jean Mercat,
Mayee Chen,
Suchin Gururangan,
Mitchell Wortsman,
Alon Albalak,
Yonatan Bitton,
Marianna Nezhurina,
Amro Abbas,
Cheng-Yu Hsieh,
Dhruba Ghosh,
Josh Gardner,
Maciej Kilian,
Hanlin Zhang,
Rulin Shao,
Sarah Pratt,
Sunny Sanyal,
Gabriel Ilharco,
Giannis Daras,
Kalyani Marathe,
Aaron Gokaslan,
Jieyu Zhang,
Khyathi Chandu,
Thao Nguyen,
Igor Vasiljevic,
Sham Kakade,
Shuran Song,
Sujay Sanghavi,
Fartash Faghri,
Sewoong Oh,
Luke Zettlemoyer,
Kyle Lo,
Alaaeldin El-Nouby,
Hadi Pouransari,
Alexander Toshev,
Stephanie Wang,
Dirk Groeneveld,
Luca Soldaini,
Pang Wei Koh,
Jenia Jitsev,
Thomas Kollar,
Alex Dimakis,
Yair Carmon,
Achal Dave*,
Ludwig Schmidt*
Vaishaal Shankar*,
arXiv, 2024
arXiv |
code
OpenLM: A minimal but performative language modeling (LM) repository
Suchin Gururangan*,
Mitchell Wortsman*,
Samir Yitzhak Gadre*,
Achal Dave*,
Maciej Kilian,
Weijia Shi,
Jean Mercat,
Georgios Smyrnis,
Gabriel Ilharco,
Matt Jordan,
Reinhard Heckel,
Alex Dimakis,
Ali Farhadi,
Vaishaal Shankar*,
Ludwig Schmidt
GitHub, 2023
code
DataComp: In search of the next generation of multimodal datasets
Samir Yitzhak Gadre*,
Gabriel Ilharco*,
Alex Fang*,
Jonathan Hayase,
Georgios Smyrnis,
Thao Nguyen,
Ryan Marten,
Mitchell Wortsman,
Dhruba Ghosh,
Jieyu Zhang,
Eyal Orgad,
Rahim Entezari,
Giannis Daras,
Sarah Pratt,
Vivek Ramanujan,
Yonatan Bitton,
Kalyani Marathe,
Stephen Mussmann,
Richard Vencu,
Mehdi Cherti,
Ranjay Krishna,
Pang Wei Koh,
Olga Saukh,
Alexander Ratner,
Shuran Song,
Hannaneh Hajishirzi,
Ali Farhadi,
Romain Beaumont,
Sewoong Oh,
Alex Dimakis,
Jenia Jitsev,
Yair Carmon,
Vaishaal Shankar,
Ludwig Schmidt
NeurIPS, 2023 (oral)
arXiv |
website |
code
Improving multimodal datasets with image captioning
Thao Nguyen,
Samir Yitzhak Gadre,
Gabriel Ilharco,
Sewoong Oh,
Ludwig Schmidt
NeurIPS, 2023
arXiv
Objaverse-XL: A Universe of 10M+ 3D Objects
Matt Deitke,
Ruoshi Liu,
Matthew Wallingford,
Huong Ngo,
Oscar Michel,
Aditya Kusupati,
Alan Fan,
Christian Laforte,
Vikram Voleti,
Samir Yitzhak Gadre,
Eli VanderBilt,
Aniruddha Kembhavi,
Carl Vondrick,
Georgia Gkioxari,
Kiana Ehsani,
Ludwig Schmidt*,
Ali Farhadi*
NeurIPS, 2023
arXiv |
website |
code
Multimodal C4: An Open, Billion-scale Corpus of Images Interleaved With Text
Wanrong Zhu*,
Jack Hessel*,
Anas Awadalla,
Samir Yitzhak Gadre,
Jesse Dodge,
Alex Fang,
Youngjae Yu,
Ludwig Schmidt,
William Yang Wang,
Yejin Choi
NeurIPS, 2023
arXiv | code
OpenFlamingo: An Open-Source Framework for Training Large Autoregressive
Vision-Language
Models
Anas Awadalla*,
Irena Gao*,
Josh Gardner,
Jack Hessel,
Yusuf Hanafy,
Wanrong Zhu,
Kalyani Marathe,
Yonatan Bitton,
Samir Yitzhak Gadre,
Shiori Sagawa,
Jenia Jitsev,
Simon Kornblith,
Pang Wei Koh,
Gabriel Ilharco,
Mitchell Wortsman,
Ludwig Schmidt
arXiv, 2023
arXiv |
blog |
code |
demo
CoWs on Pasture: Baselines and Benchmarks for Language-Driven Zero-Shot Object
Navigation
Samir Yitzhak Gadre,
Mitchell Wortsman,
Gabriel Ilharco,
Ludwig Schmidt,
Shuran Song
CVPR, 2023
arXiv | website | code
Structure From Action: Learning Interactions for Articulated Object 3D Structure
Discovery
Neil Nie,
Samir Yitzhak Gadre,
Kiana Ehsani,
Shuran Song
IROS, 2023
arXiv
Patching open-vocabulary models by interpolating weights
Gabriel Ilharco*,
Mitchell Wortsman*,
Samir Yitzhak Gadre*,
Shuran Song,
Hannaneh Hajishirzi,
Simon Kornblith,
Ali Farhadi,
Ludwig Schmidt
NeurIPS, 2022
arXiv | website
(with demo!) | code
Model soups: averaging weights of multiple fine-tuned models improves accuracy without
increasing inference time
Mitchell Wortsman,
Gabriel Ilharco,
Samir Yitzhak Gadre,
Rebecca Roelofs,
Raphael Gontijo-Lopes,
Ari S. Morcos,
Hongseok Namkoong,
Ali Farhadi,
Yair Carmon*,
Simon Kornblith*,
Ludwig Schmidt*
ICML, 2022
arXiv | code
Continuous Scene Representations for Embodied AI
Samir Yitzhak Gadre,
Kiana Ehsani,
Shuran Song,
Roozbeh Mottaghi
CVPR, 2022
arXiv | website | code
Act the Part: Learning Interaction Strategies for Articulated Object Part Discovery
Samir Yitzhak Gadre,
Kiana Ehsani,
Shuran Song
ICCV, 2021
arXiv |
website (with demo!)
End-User Robot Programming Using Mixed Reality
Samir Yitzhak Gadre,
Eric Rosen,
Gary Chien,
Elizabeth Phillips,
Stefanie Tellex,
George Konidaris
ICRA, 2019
pdf
|