Mamba Models a possible replacement for Transformers?

https://twitter.com/subhrokomol/status/1761889215514808587 All AI chatbots right now like Bard or ChatGPT are based on a architecture called Transformers. It is really useful thanks to a special mechanism called self attention that helps the models...