I cover Sam Altman’s statements on a ‘compute truce’ and analyse what remaining weaknesses PaLM (and likely GPT 4) have. I show what people thought would be road blocks and how they turned out not to be, with specific examples from Bing Chat and ChatGPT. I also delve into Meta’s Llama model, showing that not everything is exponential.
Topics also covered into Claude, Big Bench tests, SIQA, mechanistic interpretability, Universal Turing Machines, Midjourney version 5 (v5) and more!
https://palm-e.github.io/#demo
https://www.anthropic.com/index/core-views-on-ai-safety
https://palm-e.github.io/assets/palm-e.pdf
Someone’s opinion article. My opinion: It’s all about scale now! The Game is Over! It’s about making these models bigger, safer, compute efficient, faster at sampling, smarter memory, more modalities, INNOVATIVE DATA, on/offline, … 1/N https://t.co/UJxSLZGc71
— Nando de Freitas 🏳️🌈 (@NandoDF) May 14, 2022
https://en.wikipedia.org/wiki/Artificial_general_intelligence
https://www.wired.com/story/adaptation-if-computers-are-so-smart-how-come-they-cant-read/
https://www.searchenginejournal.com/gpt-4-is-multimodal/481993/#close
https://arxiv.org/pdf/2204.02311.pdf
https://github.com/google/BIG-bench/tree/main/bigbench/benchmark_tasks/mnist_ascii
https://github.com/google/BIG-bench/tree/main/bigbench/benchmark_tasks/temporal_sequences
https://github.com/google/BIG-bench/tree/main/bigbench/benchmark_tasks/simple_text_editing
https://github.com/google/BIG-bench/tree/main/bigbench/benchmark_tasks/hyperbaton
https://github.com/google/BIG-bench/tree/main/bigbench/benchmark_tasks/hhh_alignment
https://arxiv.org/pdf/2301.04589.pdf
https://poe.com/claude
https://arxiv.org/pdf/2302.13971.pdf
https://storage.googleapis.com/pub-tools-public-publication-data/pdf/b8c26e4347adc3453c15d96a09e6f7f102293f71.pdf
https://openai.com/blog/planning-for-agi-and-beyond
https://www.lesswrong.com/posts/PE22QJSww8mpwh7bt/agi-in-sight-our-look-at-the-game-board
https://www.lesswrong.com/posts/HguqQSY8mR7NxGopc/2022-was-the-year-agi-arrived-just-don-t-call-it-that
https://arxiv.org/pdf/2210.00881.pdf
https://github.com/google/BIG-bench/tree/main/bigbench/benchmark_tasks/gre_reading_comprehension