GPT-4, a large-scale, multimodal model which can accept image and text inputs and produce text outputs, is developed, a Transformer-based model pre-trained to predict the next token in a document which exhibits human-level performance on various professional and academic benchmarks.
We report the development of GPT-4, a large-scale, multimodal model which can accept image and text inputs and produce text outputs. While less capable than humans in many real-world scenarios, GPT-4 exhibits human-level performance on various professional and academic benchmarks, including passing a simulated bar exam with a score around the top 10% of test takers. GPT-4 is a Transformer-based model pre-trained to predict the next token in a document. The post-training alignment process results in improved performance on measures of factuality and adherence to desired behavior. A core component of this project was developing infrastructure and optimization methods that behave predictably across a wide range of scales. This allowed us to accurately predict some aspects of GPT-4's performance based on models trained with no more than 1/1,000th the compute of GPT-4.
S. McKinney
2 papers
Todor Markov
2 papers
Jacob Menick
3 papers
I. Sutskever
26 papers
N. Keskar
5 papers
Jan Leike
6 papers
Alec Radford
12 papers
Miles Brundage
4 papers
Heewoo Jun
6 papers
Christopher Berner
3 papers
Greg Brockman
5 papers
Brooke Chan
3 papers
David Farhi
2 papers
Scott Gray
7 papers
J. Pachocki
4 papers
Michael Petrov
3 papers
Henrique Pondé de Oliveira Pinto
2 papers
Szymon Sidor
3 papers
John Schulman
14 papers
Wojciech Zaremba
9 papers
Irwan Bello
3 papers
Chris Hallacy
2 papers
Sandhini Agarwal
3 papers
Girish Sastry
5 papers
Pamela Mishkin
4 papers
Gretchen Krueger
4 papers
Barret Zoph
12 papers
Christine McLeavey
2 papers
Lama Ahmad
2 papers
Sam Altman
2 papers
Tarun Gogineni
2 papers
Johannes Heidecke
2 papers
A. Paino
3 papers
Ashley Pantuliano
2 papers
Giambattista Parascandolo
5 papers
Michelle Pokrass
2 papers
Elizabeth Proehl
2 papers
Bob Rotsted
2 papers
P. Tillet
3 papers
Hannah Wong
2 papers
Shengjia Zhao
2 papers
Adam Perelman
2 papers
Aditya Ramesh
2 papers
Akila Welihinda
2 papers
Gabriel Bernadett-Shapiro
2 papers
Leo Gao
4 papers
Ashvin Nair
3 papers
David Dohan
4 papers
Chelsea Voss
3 papers
Shibani Santurkar
4 papers
Brandon Houghton
3 papers
Arvind Neelakantan
4 papers
Mark Chen
8 papers
Jerry Tworek
5 papers
Mikhail Pavlov
4 papers
Alethea Power
3 papers
Mo Bavarian
4 papers
Clemens Winter
3 papers
F. Such
4 papers
Igor Babuschkin
3 papers
S. Balaji
2 papers
Evan Morikawa
2 papers
Mira Murati
2 papers
Peter Welinder
4 papers
Bob McGrew
4 papers
Reiichiro Nakano
3 papers
Pranav Shyam
2 papers
Eric Sigler
2 papers
Ma-teusz Litwin
3 papers
Benjamin Chess
2 papers
J. Kiros
2 papers
OpenAI Josh Achiam
1 papers
Steven Adler
1 papers
Ilge Akkaya
2 papers
Florencia Leoni Aleman
1 papers
Diogo Almeida
1 papers
Janko Altenschmidt
1 papers
Shyamal Anadkat
1 papers
Red Avila
1 papers
Valerie Balcom
1 papers
Paul Baltescu
1 papers
Haim-ing Bao
1 papers
J. Belgum
1 papers
Jake Berdine
1 papers
Lenny Bogdonoff
1 papers
Oleg Boiko
1 papers
Made-laine Boyd
1 papers
Anna-Luisa Brakman
1 papers
Tim Brooks
1 papers
Kevin Button
1 papers
Trevor Cai
1 papers
Rosie Campbell
1 papers
Andrew Cann
1 papers
Brittany Carey
1 papers
Chelsea Carlson
1 papers
Rory Carmichael
1 papers
Che Chang
1 papers
Fotis Chantzis
1 papers
Derek Chen
1 papers
Sully Chen
1 papers
Ruby Chen
1 papers
Jason Chen
1 papers
Chester Cho
1 papers
Casey Chu
1 papers
Hyung Won Chung
1 papers
Dave Cummings
1 papers
Jeremiah Currier
1 papers
Yunxing Dai
1 papers
Cory Decareaux
1 papers
Thomas Degry
1 papers
Noah Deutsch
1 papers
Damien Deville
1 papers
Arka Dhar
1 papers
Steve Dowling
1 papers
Sheila Dunning
1 papers
Adrien Ecoffet
4 papers
Atty Eleti
1 papers
Tyna Eloundou
1 papers
L. Fedus
2 papers
Niko Felix
1 papers
Sim'on Posada Fishman
1 papers
Juston Forte
1 papers
Is-abella Fulford
1 papers
Elie Georges
1 papers
C. Gibson
1 papers
Vik Goel
1 papers
Gabriel Goh
1 papers
Raphael Gontijo-Lopes
1 papers
Jonathan Gordon
1 papers
Morgan Grafstein
1 papers
Ryan Greene
1 papers
Joshua Gross
1 papers
S. Gu
1 papers
Yufei Guo
1 papers
Jesse Han
1 papers
Jeff Harris
1 papers
Yuchen He
1 papers
Mike Heaton
1 papers
Chris Hesse
1 papers
Alan Hickey
1 papers
W. Hickey
1 papers
Peter Hoeschele
1 papers
Kenny Hsu
1 papers
Shengli Hu
1 papers
Xin Hu
1 papers
Joost Huizinga
4 papers
Shantanu Jain
1 papers
Shawn Jain
1 papers
Joanne Jang
1 papers
Angela Jiang
1 papers
Roger Jiang
1 papers
Haozhun Jin
1 papers
Denny Jin
1 papers
Shino Jomoto
1 papers
B. Jonn
1 papers
Tomer Kaftan
1 papers
Lukasz Kaiser
2 papers
Ali Kamali
1 papers
I. Kanitscheider
1 papers
Tabarak Khan
1 papers
Logan Kilpatrick
1 papers
Jong Wook Kim
1 papers
Christina Kim
1 papers
Yongjik Kim
1 papers
Hendrik Kirchner
1 papers
Matthew Knight
1 papers
Daniel Kokotajlo
1 papers
Lukasz Kondraciuk
1 papers
Andrew Kondrich
1 papers
Aris Konstantinidis
1 papers
Kyle Kosic
1 papers
Vishal Kuo
1 papers
Michael Lampe
1 papers
Ikai Lan
1 papers
Teddy Lee
1 papers
Jade Leung
1 papers
Daniel Levy
1 papers
Chak Li
1 papers
Rachel Lim
1 papers
Molly Lin
1 papers
Stephanie Lin
1 papers
Theresa Lopez
1 papers
Ryan Lowe
1 papers
Patricia Lue
1 papers
A. Makanju
1 papers
Kim Malfacini
1 papers
Sam Manning
1 papers
Yaniv Markovski
1 papers
Bianca Martin
1 papers
Katie Mayer
1 papers
Andrew Mayne
1 papers
Paul McMillan
1 papers
Jake McNeil
1 papers
David Medina
1 papers
Aalok Mehta
1 papers
Luke Metz
1 papers
An-drey Mishchenko
1 papers
Vinnie Monaco
1 papers
Daniel P. Mossing
1 papers
Tong Mu
1 papers
O. Murk
1 papers
David M'ely
1 papers
Rajeev Nayak
1 papers
Richard Ngo
1 papers
Hyeonwoo Noh
1 papers
Ouyang Long
1 papers
Cullen O'Keefe
1 papers
Joe Palermo
1 papers
J. Parish
1 papers
Emy Parparita
1 papers
Alexandre Passos
1 papers
Andrew Peng
1 papers
Filipe de Avila Belbute Peres
1 papers
Michael Pokorny
1 papers
Vitchyr H. Pong
1 papers
Tolly Powell
1 papers
Boris Power
1 papers
Raul Puri
1 papers
Jack W. Rae
1 papers
Cameron Raymond
1 papers
Francis Real
1 papers
Kendra Rimbach
1 papers
Carl Ross
1 papers
Henri Roussez
1 papers
N. Ryder
1 papers
M. Saltarelli
1 papers
Ted Sanders
1 papers
Heather Schmidt
1 papers
David Schnurr
1 papers
Daniel Selsam
2 papers
Kyla Sheppard
1 papers
Toki Sherbakov
1 papers
Jessica Shieh
1 papers
Sarah Shoker
1 papers
Maddie Simens
1 papers
Jordan Sitkin
1 papers
Katarina Slama
1 papers
Ian Sohl
1 papers
Benjamin Sokolowsky
1 papers
Yang Song
1 papers
Natalie Staudacher
1 papers
Natalie Summers
1 papers
Jie Tang
1 papers
N. Tezak
2 papers
Madeleine Thompson
1 papers
Amin Tootoonchian
1 papers
Elizabeth Tseng
1 papers
Preston Tuggle
1 papers
Nick Turley
1 papers
Juan Felipe Cer'on Uribe
1 papers
Andrea Vallone
1 papers
Arun Vijayvergiya
1 papers
Carroll L. Wainwright
1 papers
Justin Jay Wang
1 papers
Alvin Wang
1 papers
Ben Wang
1 papers
Jonathan Ward
1 papers
Jason Wei
1 papers
CJ Weinmann
1 papers
Jiayi Weng
1 papers
Lilian Weng
2 papers
Matt Wiethoff
1 papers
Dave Willner
1 papers
Samuel Wolrich
1 papers
Lauren Workman
1 papers
Sherwin Wu
1 papers
Jeff Wu
1 papers
Michael Wu
1 papers
Kai Xiao
1 papers
Tao Xu
1 papers
Sarah Yoo
1 papers
Kevin Yu
1 papers
Qim-ing Yuan
1 papers
Rowan Zellers
1 papers
Chong Zhang
1 papers
Marvin Zhang
1 papers
Tianhao Zheng
1 papers
Juntang Zhuang
1 papers
William Zhuk
1 papers