obliterate.exe (@chrisoo1)

How i built a frontier level llm guardrail

This is built using the combination of microsoft presidio and qwen 3 guard , This production script offloads Presidio (CPU) and Qwen3Guard (GPU) to worker threads via asyncio.to_thread and gathers the

4 min readchris001.hashnode.dev

1d ago

4-bit NF4 quantization for llama guard 3

this quantization will help for users with low vram and get desired result but note using 4 bit quantization has its drawback. import torch from transformers import AutoTokenizer, AutoModelForCausalLM

1 min readchris001.hashnode.dev

1d ago

Building the Interception Script: Middleware for Local LLMs

A guard model cannot defend a system if it is not placed directly in the path of network traffic. To utilize Llama Guard or Qwen3Guard effectively, you must construct an API gateway that intercepts al

7 min readchris001.hashnode.dev

1d ago

Multilingual and Nuanced Filtering using Qwen3Guard

While Llama Guard excels in binary classification, Alibaba's Qwen3Guard (released in late 2025) offers a more nuanced approach. Built on the Qwen3 architecture, the Qwen3Guard-Gen-8B model natively su

5 min readchris001.hashnode.dev

1d ago

Implementing a Robust Input and Output Filter with Meta's Llama Guard 3

When deploying a local Large Language Model (LLM), ensuring safety and alignment requires a dedicated moderation layer. Meta’s Llama Guard 3 (specifically the 8B parameter version) serves as a special

5 min readchris001.hashnode.dev

1d ago

obliterate.exe

About

Available for

obliterate.exe's blogs

How i built a frontier level llm guardrail

4-bit NF4 quantization for llama guard 3

Building the Interception Script: Middleware for Local LLMs

Multilingual and Nuanced Filtering using Qwen3Guard

Implementing a Robust Input and Output Filter with Meta's Llama Guard 3

obliterate.exe

About

Available for

obliterate.exe's blogs

How i built a frontier level llm guardrail

4-bit NF4 quantization for llama guard 3

Building the Interception Script: Middleware for Local LLMs

Multilingual and Nuanced Filtering using Qwen3Guard

Implementing a Robust Input and Output Filter with Meta's Llama Guard 3

obliterate.exe

About

Available for

obliterate.exe's blogs

How i built a frontier level llm guardrail

4-bit NF4 quantization for llama guard 3

Building the Interception Script: Middleware for Local LLMs

Multilingual and Nuanced Filtering using Qwen3Guard

Implementing a Robust Input and Output Filter with Meta's Llama Guard 3

Search Hashnode

obliterate.exe

About

Available for

obliterate.exe's blogs

How i built a frontier level llm guardrail

4-bit NF4 quantization for llama guard 3

Building the Interception Script: Middleware for Local LLMs

Multilingual and Nuanced Filtering using Qwen3Guard

Implementing a Robust Input and Output Filter with Meta's Llama Guard 3