Journal Club

GPT-4 is here: what scientists think

Researchers are excited about the AI — but many are frustrated that its underlying engineering is cloaked in secrecy.

Katharine Sanderson
Nature 615, 773 (2023)
doi: https://doi.org/10.1038/d41586-023-00816-5 

Hackathon - GPT, ES6

Thank you to all that have participated in the exploration of GPT this last week and have contributed to the experiments. Let's review them today:

OpenAI platform and API

• https://platform.openai.com/overview

• https://openai.com/product#made-for-developers

• https://platform.openai.com/docs  <-- devs start here
  Suggestion - use the API documentation as curl and then convert to fetch using tools like https://www.scrapingbee.com/curl-converter/javascript-fetch. For a quick example try the image generation API.

SDK

https://episphere.github.io/gpt 

Managing keys and usage: https://platform.openai.com/account/api-keys  

Question - now that multiple people are contributing (busy example) with ES6 modules, is jsdoc ok?

UI

Not part of min.js <-- agree?

It is a good place to send keys that "disappear"

ChatML

Operating languages emerging, lets have a close look at this one,

• https://cobusgreyling.medium.com/the-introduction-of-chat-markup-language-chatml-is-important-for-a-number-of-reasons-5061f6fe2a85 

• https://github.com/openai/openai-cookbook/blob/main/examples/How_to_format_inputs_to_ChatGPT_models.ipynb 

• ... markup languages tend to develop fast, they are driven by missing abstractions. Keep an eye on this one.

Show and tell

Jonas, Lee, Daniel, Yasmmin, Aaron, {Jeya, Lorena, Nicole}? 

GPT API, dev GDP SDKs, explaining conceptIds and more

How small can a LLM be?

Link from Aaron: https://github.com/OptimalScale/LMFlow 

https://github.com/nomic-ai/gpt4all