Weekly Top Picks #55

The beginning of the end of the transformer / hallucinations — or dreams? / Mistral open-weights 8x7B / real-world humanoid locomotion / OpenAI drama: season two / AI ouroboros / EU AI Act deal

The week at a glance

• The beginning of the end of the transformer architecture

• Hallucinations, you say? All language models do is hallucinate

• Mistral has released a very good 8x7B open-weights mixture of experts

• Real-world humanoid locomotion with reinforcement learning

• Season two of the OpenAI drama: What caused Altman’s ouster?

• AI ouroboros: New chatbots are being trained on ChatGPT’s output

• Agreement on the EU AI Act: Open-source companies get away with it