ML//model//GPT//GPT-1

GPT-1 is the first GPT, released by OpenAI in June 2018 with 117M parameters. It is a decoder-only transformer, pre-trained on books and then fine-tuned for specific tasks.

GPT-1 is the first GPT, released by OpenAI in June 2018 with 117M parameters. It is a decoder-only transformer, pre-trained on books and then fine-tuned for specific tasks.

Hands on19 · feb 14Read noteI played with it in the OpenAI developer console. It just continued text, nothing more. But you could feel the potential: coherent sentences, sometimes surprising connections.