Akmmus AI is a newly established NLP-focused AI research lab from Trichy, India. Our broad areas of research interest are natural language processing and deep learning. Specifically, we are interested in large language models and the relevant topics.
Nothing here yet.
Mar 22, 2024 · 2 min read · TLDR - LLAMAFACTORY, a unified framework that integrates a suite of cutting-edge efficient LLM fine-tuning methods. It allows users to flexibly customize the fine-tuning of 100+ LLMs without the need for coding through the built-in web UI LLAMABOARD....
Join discussion
Mar 12, 2024 · 2 min read · TLDR - Gemini 1.5 Pro is a new LLM in Google's Gemini family known for its advanced capabilities. Gemini 1.5 Pro outperforms models like Claude 2.1 and GPT-4 Turbo by handling up to 10 million tokens of information context (vs. 200k and 128k respecti...
Join discussion
Mar 9, 2024 · 2 min read · TLDR - Large Language Models (LLMs) offer new capabilities but evaluating their alignment with human preferences is difficult. Chatbot Arena is a new open platform introduced to specifically address this evaluation challenge. For evaluation, this pla...
Join discussion
Mar 9, 2024 · 2 min read · TLDR - Training Large Language Models (LLMs) presents significant memory challenges because of their large sizes. Approaches like LoRA typically underperform training with full-rank weights in both pre-training and fine-tuning stages since they limit...
Join discussion
Mar 9, 2024 · 2 min read · TLDR - Large language models (LLMs) are getting larger to achieve better performances, but their large sizes create bottlenecks for deployment. Model compression techniques, like pruning, make LLMs smaller by removing some parameters while maintainin...
Join discussion
