GGraham Andanje·Aug 6Cache EvictionCache eviction for optimizing KV Cache memory size9 min read·fata-fanaka.hashnode.dev
GGraham Andanje·Jul 31Model Quantizationquantization and numeric precision for model quantization to reduce compute and memory footprint5 min read·fata-fanaka.hashnode.dev
GGraham Andanje·Jul 30Neural Architecture SearchModel optimization through automated architecture search3 min read·fata-fanaka.hashnode.dev
GGraham Andanje·Jul 27Knowledge distillationResponse based knowledge distillation as a way of optimizing ai models for inference3 min read·fata-fanaka.hashnode.dev
GGraham Andanje·Jul 25Model PruningAn introduction to model optimization through pruning3 min read·fata-fanaka.hashnode.dev
AAbstract Algorithms·Mar 14Types of LLM Quantization: By Timing, Scope, and MappingPTQ, QAT, INT8, INT4, and NF4 explained through timing, scope, and mapping choices.17 min read·abstractalgorithms.hashnode.dev1
AAbstract Algorithms·Mar 8LLM Model Quantization: Why, When, and How to Deploy Smaller, Faster ModelsCut GPU memory and latency by converting FP16 weights to INT8 or INT4 — without retraining from scratch.13 min read·abstractalgorithms.hashnode.dev
SSeci84·Jul 23, 2025About MeI’m an AI engineer with extensive experience in model development, optimization, and deployment. My passion lies in building intuitive and efficient ecosystems and platforms for developers. I believe that the future of AI lies in the seamless integra...3 min read·seci84.hashnode.dev
OOmkar Kasture·Feb 5, 2025Deep Learning with Keras and TesorFlowPart 3- Custom Training Loop, Hyperparameter Tunning, Model Optimization3 min read·omkarkasture.hashnode.dev
DDeepak Kumar Mohanty·Oct 26, 2024Residuals vs. Cost Functions: Key Differences in Machine Learning EvaluationDive into the essential differences between residuals and cost functions in machine learning. Understand how each concept impacts model evaluation and learn5 min read·kumarblog-1.hashnode.dev