BLOG / ENGINEERING

Engineering notes

How zn works inside: measurements you can reproduce, methodology, and the failures we fixed along the way.

Latest note/Engineering/

Introducing Galvanize 2: more attacks caught, far fewer false alarms

Galvanize 2 is our new prompt-injection detector, fine-tuned from Horizon Labs' open small model. On our held-out test set it catches 83.4% of attacks with a 0.81% false positive rate, and it stops flagging long legitimate documents. Here are the numbers, the weak spots and how we measured.

Read the note 6 min read · John Silver
ARCHIVE

All engineering notes

9 published
Engineering4 min

zn-gate 1.4.1 and what leaves your machine

1.4.0 sent tool output to our API without redaction when an API key was set. 1.4.1 removes that path, makes the cloud opt-in and redacted, and we deleted the text our API had stored. Here is exactly what happened and what to do.

John SilverRead
Engineering5 min

How we rebuilt our prompt-injection dataset after it quietly lied to us

Our fused gate beat a Meta model on our benchmark, and then we found real benign text scoring above attacks inside our own classifier. A post-mortem of the v13d failure and the full rebuild behind v15: family blueprints, deterministic paraphrases, group-aware splits, and the gaps we left open on purpose.

John SilverRead
Engineering13 min

Seventeen failed runs and one flat sigmoid: how we built the supA gate

Our injection detector scored 0.498-0.509 on everything we gave it. The root cause was a training objective that never saw a label, and the fix was embarrassingly ordinary: supervised end-to-end training. The full debugging story, the recipe, the numbers, and what the new gate still cannot do.

John SilverRead