| A01 | 10 non-loopback or malformed endpoints are refused | all refused | 10/10 refused | pass |
| A02 | Blocked endpoint never reaches the network layer | fetch not called | rejected: Non-loopback runtime endpoint blocked; fetch called=false | pass |
| A03 | HTTP redirect from a runtime is refused, not followed | failureCode=redirect_refused | status=unavailable; code=redirect_refused | pass |
| A04 | Oversized runtime response is cut off | failureCode=response_too_large | code=response_too_large | pass |
| A05 | Hung runtime hits the timeout | failureCode=timeout | code=timeout | pass |
| A06 | Malformed JSON from a runtime cannot pass as healthy | status=unavailable | status=unavailable; code=invalid_payload | pass |
| A07 | Closed port is reported unreachable, not healthy | failureCode=unreachable | code=unreachable | pass |
| B01 | Model listing is never presented as inference speed | inference listed under notTested | status=responding; models=1 | pass |
| B02 | Inference report never contains prompt or output text | no prompt/output in report | prompt echoed=false; output echoed=false | pass |
| B03 | A failed inference creates no fake samples | error raised | rejected: Local Ollama inference returned HTTP 404 | pass |
| B04 | Missing token counters stay null, not invented | evalTokens=null | tokens=null; tok/s=null | pass |
| C01 | Fit estimate is labelled heuristic with speed unknown | heuristic_not_measured | heuristic_not_measured; speed=unknown | pass |
| C02 | 90B model on a 8 GB free-RAM host is not marked fitting | likely_insufficient_ram | likely_insufficient_ram | pass |
| C03 | Nonsense model descriptors are rejected | all rejected | 5/5 rejected | pass |
| C04 | Duplicate model ids in a catalog are rejected | error | rejected: Model ids in a catalog must be unique | pass |
| D01 | No GPU probe means GPU is "unknown", never invented | gpu.status=unknown | gpu=unknown; npu=unknown | pass |
| D02 | Garbage nvidia-smi output yields "unknown" | unknown | unknown,unknown,unknown,unknown,unknown | pass |
| D03 | Valid nvidia-smi output is parsed from the probe only | detected, VRAM from output | gpu=detected; vramBytes=8589934592 | pass |
| D04 | A tool on PATH is reported as found, never "working" | no capability implied | tools.* are PATH presence only | pass |
| E01 | Tampered report fails the integrity seal | verify=false | original=true; tampered=false | pass |
| E02 | Seal survives a JSON round-trip | verify=true | round-trip verified | pass |
| E03 | Secret patterns are redacted from text | no token in output | [REDACTED] API_KEY=[REDACTED] [REDACTED] [REDACTED] | pass |
| E04 | HTML report escapes untrusted markup | no <script> element | escaped | pass |
| E05 | Markdown report neutralises table-breaking input | pipes escaped | pipe escaped in model name | pass |
| F01 | Benchmark is labelled non-AI and bounded | type=synthetic_cpu_workload_not_ai_inference | synthetic_cpu_workload_not_ai_inference; samples=3; oversize run rejected: runs must be 2..30 | pass |
| F02 | Unlike workloads are refused as not comparable | error | rejected: Workloads are not comparable | pass |
| G01 | Privacy audit does not claim runtime egress is safe | modelRuntimeEgress=not_tested | egress=not_tested; remote allowed=false | pass |
| H01 | Skill installer is idempotent and never overwrites | second run skips; custom file kept | first written=24/skipped=1; second written=0; custom kept=true | pass |
| H02 | Installer writes the documented path for all six IDEs | 6 layouts, 25 skills each | claude:25 cursor:25 codex:25 gemini:25 copilot:25 opencode:25 | pass |
| H03 | Installer refuses a symlinked project root | error (or skipped when the OS forbids symlinks) | rejected: Project must be a real directory (not a symlink) | pass |
| H04 | Installer refuses a symlinked .claude directory | error (or skipped) | rejected: Refusing to traverse a symlink or non-directory: .claude | pass |
| H05 | Installer dry-run writes nothing | no files created | planned=25; file exists=false | pass |
| I01 | Report server: 401 without token, 405 for POST, 127.0.0.1 only | 401 / 200 / 405 / 127.0.0.1 | none=401; wrong=401; valid=200; POST=405; bind=127.0.0.1 | pass |
| I02 | Server refuses a weak token and an unsealed report | both refused | weak token: rejected: A strong 24+ character token required; bad seal: rejected: Not a valid sealed LocalSutra report | pass |
| J01 | Negative control: unsupported runtime kind is refused | error | rejected: Runtime must be ollama or llama | pass |
| J02 | Negative control: empty catalog is refused | error | rejected: Bounded model catalog (1..200 entries) required | pass |
| J03 | Negative control: oversized JSON input is refused | error | rejected: Input must be a bounded regular file | pass |