The persisted (chatId, sourceId)→node table was a shared namespace across independent chunk/batch jobs: each chunk's extractor mints local ids fresh (p1..pN), so later chunks collided with earlier ones — propositions silently skipped as 'already resolved' (coverage checkpointed anyway: permanent silent loss) and edges resolved onto the wrong nodes (the 'everything links to everything' mush). Owner ruling 2026-09-29: mergeFindings resolves THIS job's ids in memory, nothing persists between jobs; cross-job identity is the auditor's linkTo verdicts alone. - contracts: NodeMapping dies; NotesSource.contentFp — sha256 of the text at the last run, the re-import guard (unchanged re-import = TRUE no-op, no model calls, no usage; changed text re-runs; legacy unstamped sources re-run once) - merger: job-local resolution map, in-submit duplicate ids skip once, edges resolve extractor-local ids only - ports/store: appendMapping/readMappings, LEDGER_FILES.mappings, rewriteLedgers.mappings gone (stale data/graph/mappings.jsonl just stops being read) - session-clusters: birthSessionOf is provenance-only — the legacy mapping-line fallback for provenance-empty notes nodes dies - deletion: no mapping rows to strip; stats lose mappingsRemoved - replay-layout batches nodes by first provenance point - graph.test pins the new independence semantics (re-merge re-creates; duplicate ids within one submit resolve once); extraction tests pin per-chunk merges + the fingerprint guard
76 lines
3.7 KiB
TypeScript
76 lines
3.7 KiB
TypeScript
/**
|
|
* BIRTH-SESSION CLUSTERING (wave 7, owner-locked 2026-09-23): embeddings
|
|
* are dead — a proposition's cluster is the SESSION THAT CREATED IT,
|
|
* derived deterministically from provenance. Cluster labels are session
|
|
* names (the chat title or the imported file's path): no model call, no
|
|
* key, no configuration. What the agglomerative pass grouped by MEANING
|
|
* proximity, this groups by WHERE KNOWLEDGE WAS BORN — the owner's call
|
|
* that the session that minted a set of propositions is the honest
|
|
* "region of the world model" they belong to.
|
|
*
|
|
* Birth session (owner ruling 2026-09-23): a node's FIRST surviving
|
|
* provenance point's chatId — the create line's first point at read time
|
|
* (getGraph merges lines by id, first line defines, provenance unions in
|
|
* line order — so provenance[0] is the birth point of the surviving
|
|
* lines). This makes deletion self-healing with ZERO special handling:
|
|
* delete-nodes strips a session's create lines and its provenance points;
|
|
* a SURVIVING shared node re-attributes to its earliest remaining
|
|
* contributor (provenance[0] walks forward), and a node left with NO
|
|
* provenance at all is simply unclustered. The partition is derived on
|
|
* every read — there is no persisted partition to invalidate.
|
|
*
|
|
* Notes imports are birth-sessions too (owner ruling 2026-09-23): their
|
|
* nodes carry a "src_…" source id instead of a chat id; the caller labels
|
|
* them with the file's path (kind: file in the session views). The old
|
|
* mapping-line fallback for provenance-empty notes nodes is GONE (owner,
|
|
* 2026-09-29): every merge writes provenance points, and the mappings
|
|
* ledger itself died with per-job in-memory resolution — provenance is
|
|
* the one birth record.
|
|
*
|
|
* Browser-safe pure logic (no node builtins, no fs): same contract style
|
|
* as the rest of the core graph derivation. Not re-exported through the
|
|
* core barrel — the shell reads clusters from the snapshot; only the
|
|
* server-side derivations (snapshot, settle) and tests import this.
|
|
*/
|
|
import type { GraphNode } from "./contracts.ts";
|
|
|
|
/** One birth-session cluster: the session id + the SORTED member node
|
|
* ids born in it. The shape is deliberately the { members } contract
|
|
* the layout consumer takes; `id` rides along for consumers that need
|
|
* the session identity (the snapshot's cluster id + label join). */
|
|
export interface BirthSessionCluster {
|
|
/** The birth session's id — a chatId or a notes source id ("src_…"). */
|
|
id: string;
|
|
/** Node ids born in this session, sorted. */
|
|
members: string[];
|
|
}
|
|
|
|
/** A node's birth session: its first surviving provenance point's chatId.
|
|
* null when the node carries no provenance at all (legacy data). */
|
|
export function birthSessionOf(node: GraphNode): string | null {
|
|
return node.provenance[0]?.chatId ?? null;
|
|
}
|
|
|
|
/**
|
|
* The birth-session partition over the given node LINES: dedupes by id
|
|
* (first line defines — the getGraph rule), groups by birth session, and
|
|
* returns the groups size-desc with members sorted (deterministic output:
|
|
* ties break by session id ascending). A node with no provenance is left
|
|
* unclustered — it belongs to no session the graph can name.
|
|
*/
|
|
export function birthSessionPartition(nodes: readonly GraphNode[]): BirthSessionCluster[] {
|
|
const members = new Map<string, string[]>();
|
|
const seen = new Set<string>();
|
|
for (const node of nodes) {
|
|
if (seen.has(node.id)) continue;
|
|
seen.add(node.id);
|
|
const birth = birthSessionOf(node);
|
|
if (birth === null) continue;
|
|
const bucket = members.get(birth);
|
|
if (bucket) bucket.push(node.id);
|
|
else members.set(birth, [node.id]);
|
|
}
|
|
return [...members.entries()]
|
|
.map(([id, list]) => ({ id, members: [...list].sort() }))
|
|
.sort((a, b) => b.members.length - a.members.length || (a.id < b.id ? -1 : 1));
|
|
} |