Discussion about this post

User's avatar
imthinkingthethoughts's avatar

Brilliant writing as always Alberto, something I wish you to be very proud of.

Emergence is absolutely fascinating and, from what it feels to me, inherent to intelligence?

Expand full comment
Michael Wood's avatar

We have found that transformer-based LLMs self-organize around Noun-Phrase Routes akin to how CNNs automatically create filters around edges, shapes, etc. We have also found every RAG-based hallucination to be caused by errant Noun-Phrase routes — without exception. While there is much more to learn, we've found this insight extremely useful for creating accurate chatbots. Here's a brief intro: https://youtu.be/ZBWoUVZuGao?si=f83tTbh7q12LjgsJ&t=639

Expand full comment
45 more comments...

No posts