LineageSutra AI · v0.2.0 · offline, read-only

Independent audit report

Trace what flows. Understand what breaks. Evidence-first SQL lineage by Vatsal Shah.

Self-audit run by lineagesutra-ai 0.2.0. PASS means every executed check passed; it is not a certification, a guarantee, or an independent third-party opinion. Items that were not verified are listed under "What was NOT verified".

28/28checks passed
54/54gold cases exact
100.0%edge precision
100.0%edge recall
708 ms2,000-view scan
1085 ms20k-node impact

Lineage accuracy on the gold corpus

PASS

Hand-labelled corpus of 54 cases, scored on exact edge sets (column, indirect and table edges) plus required warnings. The labels were written by the author before the parser was run, so this is a regression corpus, not an independent benchmark, and it is small. Tags: basic 4/4, join 6/6, negative 11/11, expr 9/9, postgres 2/2, indirect 3/3, cte 2/2, subquery 3/3, setop 2/2, wildcard 5/5, ddl 7/7, naming 5/5, tsql 1/1, mysql 1/1, adversarial 3/3, dbt 1/1.

Lineage accuracy on the gold corpus
CaseStatusDetail
direct-copyPASS3 TP, 0 FP, 0 FN
qualified-aliasPASS2 TP, 0 FP, 0 FN
alias-without-asPASS2 TP, 0 FP, 0 FN
join-qualifiedPASS6 TP, 0 FP, 0 FN
join-unqualified-resolved-by-schemaPASS6 TP, 0 FP, 0 FN
join-ambiguous-columnPASS4 TP, 0 FP, 0 FN; warnings: column-unknown: select item: id: ambiguous/unresolved column owner
join-usingPASS6 TP, 0 FP, 0 FN
self-joinPASS4 TP, 0 FP, 0 FN
expression-arithmeticPASS4 TP, 0 FP, 0 FN
aggregate-group-byPASS4 TP, 0 FP, 0 FN
case-expressionPASS3 TP, 0 FP, 0 FN
cast-formsPASS3 TP, 0 FP, 0 FN
window-functionPASS4 TP, 0 FP, 0 FN
nested-functionsPASS3 TP, 0 FP, 0 FN
extract-and-truncPASS3 TP, 0 FP, 0 FN
interval-literalPASS2 TP, 0 FP, 0 FN
count-starPASS1 TP, 0 FP, 0 FN
distinctPASS2 TP, 0 FP, 0 FN
filter-order-limitPASS4 TP, 0 FP, 0 FN
having-clausePASS4 TP, 0 FP, 0 FN
cte-chain-propagates-filterPASS3 TP, 0 FP, 0 FN
subquery-in-fromPASS2 TP, 0 FP, 0 FN
scalar-subquery-correlatedPASS6 TP, 0 FP, 0 FN
in-subquery-filterPASS5 TP, 0 FP, 0 FN
union-allPASS4 TP, 0 FP, 0 FN
union-column-count-mismatchPASS4 TP, 0 FP, 0 FN; warnings: column-unknown: Set operation branches have 2 vs 1 columns; positional lineage not trusted
wildcard-known-schemaPASS3 TP, 0 FP, 0 FN
wildcard-qualified-joinPASS7 TP, 0 FP, 0 FN
wildcard-unknown-schemaPASS1 TP, 0 FP, 0 FN; warnings: column-unknown: Wildcard over ext cannot be expanded (schema not declared in scanned sources)
wildcard-through-viewPASS6 TP, 0 FP, 0 FN
wildcard-defined-later-in-filePASS4 TP, 0 FP, 0 FN
ctasPASS2 TP, 0 FP, 0 FN
insert-select-column-listPASS3 TP, 0 FP, 0 FN
insert-select-declared-schemaPASS3 TP, 0 FP, 0 FN
insert-values-no-lineagePASS0 TP, 0 FP, 0 FN
view-column-listPASS3 TP, 0 FP, 0 FN
materialized-viewPASS2 TP, 0 FP, 0 FN
or-replace-if-not-existsPASS2 TP, 0 FP, 0 FN
schema-qualified-suffix-resolutionPASS2 TP, 0 FP, 0 FN
quoted-identifiers-fold-to-lowercasePASS2 TP, 0 FP, 0 FN
tsql-bracket-identifiersPASS2 TP, 0 FP, 0 FN
backtick-identifiersPASS2 TP, 0 FP, 0 FN
unicode-identifiersPASS2 TP, 0 FP, 0 FN
comment-containing-fake-sqlPASS2 TP, 0 FP, 0 FN
string-literal-containing-fromPASS2 TP, 0 FP, 0 FN
dollar-quoted-body-ignoredPASS2 TP, 0 FP, 0 FN
merge-unsupportedPASS0 TP, 0 FP, 0 FN; warnings: unsupported: MERGE statements are not analyzed
dynamic-sql-unsupportedPASS0 TP, 0 FP, 0 FN; warnings: unsupported: Dynamic SQL (EXECUTE IMMEDIATE / EXEC) cannot be analyzed | unsupported: EXECUTE statements are not analyzed
jinja-template-unsupportedPASS0 TP, 0 FP, 0 FN; warnings: unsupported: Templated/dynamic SQL cannot be fully resolved | unsupported: Templated relation cannot be resolved
recursive-cte-flaggedPASS2 TP, 0 FP, 0 FN; warnings: unsupported: Recursive CTE r: self-reference lineage is not expanded
table-function-flaggedPASS0 TP, 0 FP, 0 FN; warnings: column-unknown: select item: a: ambiguous/unresolved column owner | unsupported: Table function unnest() is not analyzed
standalone-select-flaggedPASS0 TP, 0 FP, 0 FN; warnings: unsupported: Standalone SELECT has no target dataset; only CREATE TABLE/VIEW AS and INSERT ... SELECT are analyzed
unclosed-ddl-flaggedPASS0 TP, 0 FP, 0 FN; warnings: parse: Unclosed DDL for t
view-cycle-flaggedPASS0 TP, 0 FP, 0 FN; warnings: column-unknown: Wildcard over a cannot be expanded (schema incomplete) | column-unknown: Wildcard over b cannot be expanded (schema incomplete) | cycle: Dependency cycle: a -> b -> a

Safety, integrity and adversarial inputs

PASS

Read-only behaviour, determinism, tamper detection, hostile files, hostile SQL, fuzzing and offline guarantees, each verified by running code during this audit.

Safety, integrity and adversarial inputs
CheckStatusDetail
scan is read-only (source tree hash unchanged)PASSSHA-256 of every fixture file identical before and after scanning
scan is deterministicPASStwo scans produce seal 1034fe6e71bbb108...
output is independent of file orderPASSforward and reversed file order give the same seal
tampering is detected (3 mutation kinds)PASSedited node, deleted edge and forged hash all fail verification
impact is monotonic when edges are addedPASSadding an edge never removes a finding
compare reports an added edgePASSdelta: column:customers.email->extra_view.mail#direct
core and reporting contain no network or subprocess codePASSstatic check of packages/core and packages/reporting (audit.mjs excluded: it spawns the test runner on request)
HTML report escapes hostile dataset namesPASSa dataset named <script>alert(1)</script> is rendered as inert text
Markdown report keeps hostile names inside code spansPASSnames are wrapped in backticks, never interpreted as markup
symlink escape testNOT_RUNcannot create symlinks on this host (EPERM)
oversized SQL file is rejectedPASSa 2.1 MB file is refused (limit 2,000,000 bytes)
file-count cap is enforcedPASS6 files with maxFiles=3 is refused
instructions inside SQL comments are inert dataPASScomment text is dropped by the tokenizer and never reaches reports or agents
ambiguous column ownership never yields a definite edgePASSunqualified column over two undeclared tables becomes a warning
3000 seeded random token streams never crash or hang the parserPASS0 unexpected exceptions; slowest input 0.8 ms
500-deep nested parentheses are handledPASSfinished in 1 ms without stack overflow
5000-column table and view parse correctlyPASS5000 column edges in 268 ms

Performance (measured on this machine)

PASS

Synthetic workload, not your data. CPU: Intel(R) Core(TM) Ultra 7 155U, 14 threads.

Performance (measured on this machine)
CheckStatusDetail
scan of 2,000 chained views over 50 tablesPASSmedian 708 ms over 3 runs (min 651, max 824); 550 files, 232 KiB SQL, 19900 edges
synthetic graph has no unexpected warningsPASS0 warnings
impact traversal on a 20,000-dataset graphPASSmedian 1085 ms over 5 runs; 19999 downstream columns found (expected 19999)

Package and agent-skill integrity

PASS

Structure, naming and secret checks over the files that ship in this package.

Package and agent-skill integrity
CheckStatusDetail
25 skills, each with matching name frontmatterPASS25 skill directories, all with valid SKILL.md
20 agent roles in manifest and .claude/agents, all files existPASS20 manifest entries, 20 Claude Code agent files
JSON schemas parsePASS2 schema files
8 workflows and 10 rules presentPASS8 workflows, 10 rules
required project files presentPASSREADME.md, LICENSE, SECURITY.md, CHANGELOG.md, llms.txt, package.json
no credentials or private keys in the treePASSregex scan for GitHub, npm and AWS tokens and private-key headers (tests excluded)

What was NOT verified

NOT_RUN

Listed so that absence of evidence is not mistaken for evidence.

What was NOT verified
CheckStatusDetail
SQLGlot / full dialect parser adapterNOT_RUNNot implemented. The built-in parser covers a documented subset and does not certify any dialect.
Live database metadata, freshness and data testsNOT_RUNNever attempted. No connections are opened and no rows are read.
Native activation inside Cursor, Codex, Gemini CLI, Copilot, OpenCodeNOT_RUNSkill files are copied and checked; native invocation by each host is NOT_TESTED.
MCP Inspector / third-party MCP client validationNOT_RUNThe MCP server is verified with a scripted JSON-RPC client only.
Independent third-party security review or penetration testNOT_RUNNone performed. This audit is a self-audit by the project.
Signed provenance of this reportNOT_RUNThe SHA-256 seal detects edits; it does not prove who produced the report.

Environment

Environment
KeyValue
nodev24.15.0
platformwin32/x64
osWindows_NT 10.0.26300
cpuIntel(R) Core(TM) Ultra 7 155U
threads14
memoryGiB31.4
cino

Reproduce this audit yourself

npx lineagesutra-ai audit --out audit-out
npx lineagesutra-ai audit --root ./sql --out audit-out   # also audit your own SQL folder
git clone https://github.com/shahvatsalofficial/lineagesutra-ai && cd lineagesutra-ai && npm test && npm run proof

Honest limits