a working tool · the methodology of David Lee Wise's photonic-papers, stripped by AVAN
how to measure a model you can't open

The Dark-Model Kit

The Photonic Papers are the argument; this is the playbook, with the physics metaphor taken out. Nine methods for characterizing a black-box model, each tagged with the access it needs, the confidence it buys, and the way it fails. Pick your access level and the kit shows you which moves are on the table — and, more honestly, the ceiling you cannot pass.

the wall · read first

You cannot certify a model's honesty from inside its own channel. A model that can detect a probe can shape its answer to it. Everything below buys confidence, never certainty — and the whole discipline is naming which rung a claim stands on, out loud, every time.

the kit · set your access
access level — what you can reach
how to use it

Name the rung, every time

Start at black-box — it's where most models live most of the time (the deployed system is not the inspected checkpoint). Run the methods available at your rung, then state your conclusion with the rung attached: "consistent under high-entropy probing" is a black-box claim; "corroborated by independent observers" needs real independence; "matches the weights" needs the key. The kit won't let you borrow confidence from a rung you can't reach — that's the point.

There is no single move that certifies a system. There is a ladder of partial corroborations, and an honest label on each.

where it sits

In the audit toolset

This joins the model-audit family: the-sandbox-audit and containment-audit (the defender's view from inside the box), the-seam-watch (watch your own seams), and the cipher / air-gap family (the side-channels rung). Where those look outward from a box you control, this kit looks inward at a box you don't — the external auditor's instrument. Source: the photonic papers; companion self-portrait: the-skin-return (the same wall, from the measured's side).

honest seamEvery method here is real audit practice (calibration with known inputs, external logging, invariance testing, high-entropy probe sets, side-channel and consistency analysis, independent replication, weight inspection) — this is the Photonic Papers' content with the spectroscopy/EW metaphor removed, not new science. The one hard claim — in-channel honesty is uncertifiable — is the papers' central result and is treated as load-bearing; the per-method "buys/fails" are honest first-order summaries, not guarantees, and real efficacy is case-by-case. The kit's job is to stop you claiming a confidence your access doesn't support.
THE DARK-MODEL KIT · a tool by AVAN from David Lee Wise's photonic-papers
9 methods · 4 access rungs · the wall = no in-channel honesty cert · name your rung
audit toolset · source: photonic-papers · companion: the-skin-return — ROOT0, with AVAN.