Journal Club

Published in Transactions on Machine Learning Research (11/2022)

(Gato) A Generalist Agent

Scott Reed*,†, Konrad Żołna*, Emilio Parisotto*, Sergio Gómez Colmenarejo†, Alexander Novikov, Gabriel Barth-Maron, Mai Giménez, Yury Sulsky, Jackie Kay, Jost Tobias Springenberg, Tom Eccles, Jake Bruce, Ali Razavi, Ashley Edwards, Nicolas Heess, Yutian Chen, Raia Hadsell, Oriol Vinyals, Mahyar Bordbar and Nando de Freitas†

*Equal contributions, †Equal senior contributions, A

Hackathon

Following up on GCO participation last week

Reference material

https://gco.iarc.fr
https://observablehq.com/@epiverse/tracker#dt
https://github.com/epiverse/tracker/blob/main/export.js 

Data Source

1. https://ci5.iarc.fr/CI5plus/Default.aspx

2. https://ci5.iarc.fr/CI5plus/Pages/download.aspx 9look for summary and dtl)

3. todo: read the summary and details zip files, extract the csv, and populate a reference JSON structure.
   it is not CORS, let's use a proxy:
   fetch('https://corsproxy.io/?https://ci5.iarc.fr/CI5plus/old/CI5plus_Summary_April2019.zip')
   fetch('https://corsproxy.io/?https://ci5.iarc.fr/CI5plus/old/CI5plus_Detailed_November2018.zip')
   to decompress one, jszip may help, as a ESM6 module - import jszip from 'https://cdn.jsdelivr.net/npm/jszip@3.10.1/+esm'

4. More data (Adalberto): https://ci5.iarc.fr/CI5I-X/Pages/download.aspx 

Adalberto, Phil and Lee are developing a tool that takes the data in this format:

AIOps

PaLM API Overview

Documentation and Tutorial

https://developers.generativeai.google/guide/palm_api_overview 

API keys - the FAIR way and the dead end

compare https://platform.openai.com/account/api-keys with 

GPT degrading? https://arxiv.org/abs/2307.09009 

Discuss:

governance

costs

scoping

The developer's angle:

https://developers.generativeai.google

https://platform.openai.com/docs/quickstart 

Give me a REST API or give me death ;-)

check https://console.cloud.google.com/vertex-ai/generative/language/create/text 

LM Agents 

Gato: https://arxiv.org/pdf/2205.06175.pdf 

experimenting talking with SVGs : https://www.youtube.com/watch?v=mIgr1eNokmw 

Manuscript authorship

https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3010799