Agreed! I like this quote by scientist Roy Amara: "we tend to overestimate the effect of a technology in the short run and underestimate the effect in the long run." That's what I think will happen with these tools, too.
Agreed! I like this quote by scientist Roy Amara: "we tend to overestimate the effect of a technology in the short run and underestimate the effect in the long run." That's what I think will happen with these tools, too.
It's not much better than the LSTM we had in 2017, the only thing we have now is 64GB mobile-device, so in theory I can run a LLM on my phone now, but the text-gen is really not much better, I can compare I still have my live code side-by-side on my system running the same gpus the guy who did it all Karpathy is doing videos now explaining how the shit works, but the thing is he just has a bigger audience now but the tech is same-same
"Attention is the only thing you need" is six years old, there is nothing new under the sun.
Agreed! I like this quote by scientist Roy Amara: "we tend to overestimate the effect of a technology in the short run and underestimate the effect in the long run." That's what I think will happen with these tools, too.
It's not much better than the LSTM we had in 2017, the only thing we have now is 64GB mobile-device, so in theory I can run a LLM on my phone now, but the text-gen is really not much better, I can compare I still have my live code side-by-side on my system running the same gpus the guy who did it all Karpathy is doing videos now explaining how the shit works, but the thing is he just has a bigger audience now but the tech is same-same
"Attention is the only thing you need" is six years old, there is nothing new under the sun.