Comparing Five Ways to Catch a Backdoor, Live

Overview

Most backdoor-detection papers evaluate on large models behind a GPU cluster, which makes it hard to build intuition about when a detection signal actually shows up. This project is a small, self-contained lab that does the whole loop on a single laptop GPU: plant a backdoor in a small instruction-tuned model, then run several published detection ideas side by side and compare what each one sees on clean versus triggered input.

Method

A small model is fine-tuned with LoRA on a poisoned instruction dataset until the trigger reliably forces a fixed output. Several independent detection signals — each drawn from a different published idea about where a backdoor “shows up” inside a model’s internals — are then run against the same clean and triggered prompts, producing a side-by-side comparison table instead of a single pass/fail number.

Results

The full pipeline — poisoning, verifying attack success, and scanning — runs end-to-end on an 8 GB consumer GPU in minutes. Signal clarity turned out to depend heavily on model depth: a very small model reaches acceptable attack success quickly, but the detection signals separate clean from triggered inputs much more convincingly on a somewhat larger model with more transformer layers, which suggests that “detectability” itself is partly a function of scale rather than the detector alone.

2026

Back to top ↑

2025

Toward a Field-Based View of LLM Backdoors

1 minute read

Overview Existing LLM backdoor scanners mostly search for an object: a trigger string, a target string, or a memorized leaked example. This project explores ...

Back to top ↑

2024

Osmium Project Tasks

1 minute read

Overview In this project, we developed an Android application to estimate the location of cellular network cells using Received Signal Strength Indicator (RS...

Back to top ↑

2023

Back to top ↑

2021

Sonic pi

less than 1 minute read

My sonic pi project : . این پست من مربوط به پوروژه سونیک پای بنده است

Back to top ↑

2020

مصاحبه

1 minute read

My works and wishes Success secret مصاحبه با جناب اقا پارسا: ایشون بسیار ادم سخت کوشی بودن و گفتن که حتی در دوران دانشجویی شون درس هم میدادن 1 به موار...

My works and wishes

less than 1 minute read

Its my favorite university This is oxford: In England The best unniversity. this university is first inthe world. this university have best descover...

Back to top ↑