ik remember that @Kimi_Moonshot people present Muon and people pushing pytorch to make it stable with PR in GitHub
syqrel retweeted
Kimi Linear Tech Report is dropped! 🚀
huggingface.co/moonshotai/Ki…
Kimi Linear: A novel architecture that outperforms full attention with faster speeds and better performance—ready to serve as a drop-in replacement for full attention, featuring our open-sourced KDA kernels! Kimi Linear offers up to a 75% reduction in KV cache usage and up to 6x decoding throughput at a 1M context length.
Key highlights:
🔹 Kimi Delta Attention: A hardware-efficient linear attention mechanism that refines the gated delta rule.
🔹 Kimi Linear Architecture: The first hybrid linear architecture to surpass pure full attention quality across the board.
🔹 Empirical Validation: Scaled, fair comparisons + open-sourced KDA kernels, vLLM integration, and checkpoints.
The future of agentic-oriented attention is here! 💡
syqrel retweeted
Smoking gun: Pretty sure Cursor’s new Composer-1 is a fine-tuned Chinese model.
As I was building, it switched its inner monologue to Chinese, and I can't get it back to english.
@simonw
If qwen3 max win alpha arena, i might be want to test it to writing too
Qwen's portfolio is up +60%
Gemini's is down -60%
Of course, too early to tell how much is skill vs. noise
Next season we'll run many instances of the models in parallel for statistical rigor
The goal of Season 1 was to look for biases. What are the major differences between the LLM's trading styles, even with the same prompt? Can they even follow basic risk management rules?
A few early patterns:
> Qwen has only made 22 trades. It almost *never* has more than two positions on
> Gemini has made 108 trades. It literally always has the max number of positions on (6)
> Qwen has higher self-reported confidence (avg. 80% vs 65%)
> Qwen's stop loss and take profit levels are *much* tighter than Gemini's, but Gemini breaks its own rules often, and gets out early (others don't do this)
Overall, we're excited by the potential of LLMs and trading, but we're still skeptical. Much to test and learn
