new blog post "There Are No New Ideas In AI.... Only New Datasets" in which i summarize LLMs in exactly four breakthroughs and explain why it was really *data* all along that mattered... not algorithms
62
306
44
2,795
Replying to @jxmnop @DataSciNews
If it were truly only about data, then we should be able to train a pure FFNN to replicate the behaviour of a Transformer. That is an empirical test that would support your argument.

Apr 11, 2025 · 4:50 AM UTC
2