Flyte enables production-grade orchestration for machine learning workflows and data processing created to accelerate local workflows to production.

Flyte

<@U06L1LH4V6G> a new mamba vision paper <https://arxiv.org/abs/2407.08083v1|https://arxiv.org/abs/2407.08083v1>

<https://github.com/NVlabs/MambaVision|https://github.com/NVlabs/MambaVision>

Thanks for sharing this <@U064WSJQ9Q8>. It's truly fascinating! I'm seeing a few other situations where Mamba and attention are combined. Attention is hard to beat.

The authors recently released Mamba 2. I haven't had a chance to go through it yet but it seemed heavy on the maths. From the abstract, their claim appears to be that SSMs and attention may be reformulated as each other. I suspect that Mamba's future is bright

Mistral also going Mamba -
<https://venturebeat.com/ai/mistral-releases-codestral-mamba-for-faster-longer-code-generation/>