---
title: "#knowledge-distillation articles | Hashnode"
description: "Explore 7 articles tagged #knowledge-distillation on Hashnode. Tutorials, guides, and how-tos from the community."
url: "https://hashnode.com/tag/knowledge-distillation"
---

Tag

# #knowledge-distillation

7 posts · 0 followers

[Vishal Chandak](https://hashnode.com/@chandakvishal) · [Aug 22](https://hashnode.com/posts/from-massive-to-miniature-how-small-language-models-are-engineered/6a89b3ff7facf32611b351bf)

### [From Massive to Miniature: How Small Language Models Are Engineered](https://forwardstack.hashnode.dev/from-massive-to-miniature-how-small-language-models-are-engineered?utm_source=hashnode&utm_medium=feed)

Distillation, quantization, fine-tuning, and the engineering trade-offs behind practical SLMs.

17 min read · [forwardstack.hashnode.dev](https://forwardstack.hashnode.dev/from-massive-to-miniature-how-small-language-models-are-engineered?utm_source=hashnode&utm_medium=feed)

[Graham Andanje](https://hashnode.com/@fata-fanaka) · [Jul 27](https://hashnode.com/posts/knowledge-distillation/6a67b13009a2e6ca7c61744e)

### [Knowledge distillation](https://fata-fanaka.hashnode.dev/knowledge-distillation?utm_source=hashnode&utm_medium=feed)

Response based knowledge distillation as a way of optimizing ai models for inference

3 min read · [fata-fanaka.hashnode.dev](https://fata-fanaka.hashnode.dev/knowledge-distillation?utm_source=hashnode&utm_medium=feed)

[Retzam Tarle](https://hashnode.com/@retzam) · [Mar 9](https://hashnode.com/posts/the-distillation-dilemma/69aec7c409af683389c82bed)

### [The Distillation Dilemma: Anthropic, OpenAI, and the Security Predicament for Frontier AI Labs](https://retzam.hashnode.dev/the-distillation-dilemma?utm_source=hashnode&utm_medium=feed)

AI Series: Mid-Series Special 12

6 min read · [retzam.hashnode.dev](https://retzam.hashnode.dev/the-distillation-dilemma?utm_source=hashnode&utm_medium=feed)

[Prabakaran Marimuthu](https://hashnode.com/@prabakarviji) · [Apr 2, 2025](https://hashnode.com/posts/apples-way-of-using-machine-learning-in-wearables-through-knowledge-distillation/67ed33ed3bdf873aa1f1c81e)

### [Apple’s Way of using Machine Learning in Wearables Through Knowledge Distillation](https://prabs.xyz/blog/apples-way-of-using-machine-learning-in-wearables-through-knowledge-distillation?utm_source=hashnode&utm_medium=feed)

Apple uses knowledge distillation in wearables for efficient, continuous health monitoring through accelerometry, revolutionizing health tracking

3 min read · [prabs.xyz](https://prabs.xyz/blog/apples-way-of-using-machine-learning-in-wearables-through-knowledge-distillation?utm_source=hashnode&utm_medium=feed)

[Gabi Dobocan](https://hashnode.com/@gabidobo) · [Nov 25, 2024](https://hashnode.com/posts/cross-lingual-aspect-based-sentiment-analysis-a-new-frontier/674480fdecf37f5854c27d6b)

### [Cross-Lingual Aspect-Based Sentiment Analysis: A New Frontier](https://blog.telepat.io/cross-lingual-aspect-based-sentiment-analysis-a-new-frontier?utm_source=hashnode&utm_medium=feed)

Understanding Aspect-Based Sentiment Analysis in Different Languages Businesses worldwide collect vast quantities of user reviews and feedback across different languages. However, mining sentiments accurately from these reviews poses numerous languag...

5 min read · [blog.telepat.io](https://blog.telepat.io/cross-lingual-aspect-based-sentiment-analysis-a-new-frontier?utm_source=hashnode&utm_medium=feed)

[Venkat R](https://hashnode.com/@venkat163) · [Jul 27, 2024](https://hashnode.com/posts/learning-from-less-data-and-building-smaller-models/66a4731e589b12977cd562dd)

### [Learning from Less Data and Building Smaller Models](https://venkatr.hashnode.dev/learning-from-less-data-and-building-smaller-models?utm_source=hashnode&utm_medium=feed)

Learning from Less Data: Techniques and Applications Introduction In the age of big data, machine learning models typically need large datasets to perform well. However, gathering and labeling vast amounts of data can be tough and costly. Data-effici...

5 min read · [venkatr.hashnode.dev](https://venkatr.hashnode.dev/learning-from-less-data-and-building-smaller-models?utm_source=hashnode&utm_medium=feed)
