WattSutra AI — Independent self-audit

2026-11-16T17:56:27.058Z · WattSutra 0.2.1 · Node v24.15.0 · win32/x64

PASSverdict (scoped)
17/18checks verified
0failed
NOT_RUNenergy, carbon, cost gates

Evidence integrity, claim hygiene, comparison fairness and packaging. Energy, carbon and cost gates are NOT_RUN: no hardware meter was used.

Live sample

Baseline trial 1.185 ms vs candidate sieve 0.254 ms. Ratio 4.66x, 95% bootstrap interval [3.46, 5.34]. Latency gate PASS. Timings are from the machine that ran this audit, not an energy claim.

Findings

IDCheckStatusSeverityEvidenceReproduce
A01Benchmark runs verify and keep quality parityverifiedinfobaseline 9a1da4495e209034f9ee4c77481ef39150d65938e70d0bf8a36d6114c0d904b9 candidate 07d0c0ac64c6fa76987341a166ef263b1fbb18c3f6bf4aeb61cfd76a1819f2e3; prime count 2262, sum 21171191wattsutra bench --manifest fixtures/baseline.json
A02Edited reports are rejected (integrity hash)verifiedinfomutated wallMs.mean; verifyRun threw integrity mismatchnode --test tests/
A03Internally inconsistent reports are rejected even with a recomputed hashverifiedinfomean edited, hash recomputed; validateRunShape recomputed stats from samples and refusednode --test tests/
A04Measured runs contain no energy, carbon or cost valuesverifiedinfoenergyKWh/carbonGCO2e/cost are null; injected energyKWh=0.5 was refusedwattsutra bench
A05Incomparable workloads are refusedverifiedinfon=20000 vs n=3000 refusedwattsutra compare
A06Quality mismatch yields a FAIL gateverifiedinfogate=FAILwattsutra compare
A07Environment mismatch downgrades the gate to REVIEW_REQUIREDverifiedinfomismatched: cpuModelwattsutra compare
A08Too few samples never earns PASSverifiedinfon=2 per run, gate=REVIEW_REQUIREDwattsutra compare
A09Estimator applies no default ratesverifiedinfounknown: energyKWh, operationalGCO2e, costwattsutra estimate (empty assumptions)
A10Estimator rejects unknown fields and ambiguous energy inputverifiedinfotypo key and dual energy inputs refusedwattsutra estimate
A11Modeled and imported values are labelledverifiedinfokinds: modeled, imported-meter-observation (attributionUnverified=true)wattsutra estimate
A12HTML report escapes hostile contentverifiedinfopayload escaped; CSP meta present: truewattsutra report --format html
A13Hashing is deterministic regardless of key orderverifiedinfocanonical JSON, code-unit key ordernode --test tests/
A14Skills and agent manifest are consistentverifiedinfo20 skills, 20 manifest entrieswattsutra audit
A15No credentials in shipped filesverifiedinforegex scan for GitHub, npm, AWS, OpenAI-style keys and private keys: no matcheswattsutra audit
A16Installer refuses to overwrite customised skillsverifiedinfosecond install refused to clobber edited SKILL.mdwattsutra install
A17Hardware energy instrumentnot-runinfoRAPL unavailable; tools: nvidia-smi=unavailable, powermetrics=unavailable, scaphandre=unavailable; measuredEnergyAvailable=falsewattsutra doctor
A18Statistical confidenceverifiedlowlatency gate PASS; n=12/12; ratio 4.66x; 95% bootstrap interval [3.46, 5.34]; CV baseline 42.6%wattsutra compare

Honest limits