Files
learnharness/config.ts
T
amosblomqvist 085fdc1a98 Payload slimming, pre-signing half: the asar stops shipping the world
The measured problem (330MB DMG / 1066MB app): electron-builder's
dependency collector packed the whole production dep tree into
app.asar (502MB) regardless of the files allow-list, because
normalizeFiles turns the array into one {filter} fileSet whose
entries ALL feed the per-dep copier (its implicit '**/*' passing
everything), and unpacked the native rungs into a 150MB
app.asar.unpacked. The launcher needs nothing but electron + node
builtins — the server ships via extraResources.

The fix (electron-builder.yml files): gitignore-style negation
ordering — '!**/*' first excludes everything, then only
electron/** and package.json re-include. The same list reaches the
per-dep filter, where app-builder-lib's destination-path quirk
(stat.moduleFullFilePath in util/filter.js) means no dep file can
ever re-include: all 566 modules collect zero files (DEBUG-mode
verified). Locale trim rides along (mac.electronLanguages: en).

Result on a fresh desktop:dist: app.asar 502MB -> 16KB (shell only:
electron/main.cjs, preload.cjs, package.json), app.asar.unpacked
gone, Frameworks 288MB -> 239MB, app 1066MB -> 367MB, DMG 330MB ->
144MB. Resources/server curation untouched (127MB, sharp native +
pdfjs traced and verified live).

Live verification against the packaged app: server spawn via
ELECTRON_RUN_AS_NODE on its kernel-assigned port, model slots via
PUT /api/settings/models, chat round-trip streaming an exact echo,
read tool on a PDF through the pdfjs path (exact text extracted),
image attach through the vision slot, GET /api/graph snapshot and
render-settings.

Docs full-accuracy pass (owner-approved scope): README +
docs/architecture.md swept of the dead embeddings / graph-context
injection / cluster-namer / semantic-clusters story (wave-7
casualties), MODELS/config roster rewritten to the BYOK slot
chain, EXTRACTION.chunkTokens -> graph.extractionChunkTokens,
route count 16 -> 25, steer_ctx_ dropped, seam table re-pointed at
the prober graph tools; docs/research/stt.md:50's "we already ship
transformers.js" premise corrected; config.ts orphaned EXTRACTION
doc block (left over from eed4b4e) deleted.

Note for master: npm prune still owed in the master tree (~690MB
stale @huggingface/onnxruntime trees absent from the lockfile);
worktree tree is clean and verified.
2026-09-24 20:50:52 +03:00

147 lines
7.2 KiB
TypeScript

import path from "node:path";
import { fileURLToPath } from "node:url";
/** Repository root (this file is at <root>/config.ts). */
export const ROOT = path.dirname(fileURLToPath(import.meta.url));
/**
* THE data-location seam (the Electron contract, 2026-09-17): LH_DATA_DIR
* relocates every MUTABLE record — chat sessions, graph ledgers, the
* embedding model cache — when set. The desktop shell points it at
* userData so nothing is written inside the read-only .app bundle
* (macOS translocation guarantees the bundle is read-only anyway).
* Unset (plain web dev / repo work) it resolves to the repo's data/,
* byte-for-byte as before. Read-only assets (prompts) stay ROOT-anchored
* on purpose: they ship inside the app bundle by design.
*/
const DATA_ROOT = process.env.LH_DATA_DIR
? path.resolve(process.env.LH_DATA_DIR)
: path.join(ROOT, "data");
export const PATHS = {
root: ROOT,
/** Teacher system prompt — the agent's instructions (src/agent/). */
teacherPrompt: path.join(ROOT, "src", "agent", "system-prompt.md"),
data: DATA_ROOT,
/** Chat sessions (AI SDK UIMessage transcripts, one JSON file per chat). */
chats: path.join(DATA_ROOT, "chats"),
graph: path.join(DATA_ROOT, "graph"),
} as const;
// ─── Models ────────────────────────────────────────────────────────────────
// BYOK ALL THE WAY DOWN (owner, 2026-09-22): there are NO factory default
// models. Every engine resolves from the user's model slots (settings.json
// models section: strong/cheap/vision) over per-role/ChatSettings overrides,
// and a chain that ends empty REFUSES honestly (503 models_not_configured).
// .env stays for secrets (API keys) only. What remains here are ENGINE
// CONSTRUCTION FACTS: the thinking-level scale and the default order.
export type ThinkingLevel = "off" | "minimal" | "low" | "medium" | "high" | "xhigh" | "max";
/** Every agent role in the app. The conversation pair (prober/teacher)
* resolves chat.model → strong slot; background roles resolve their own
* override → tier slot (core/settings-resolution.ts ROLE_SLOT). */
export type ModelRole =
| "prober"
| "teacher"
| "researcher"
| "demoBuilder"
| "visualMaker"
| "pdfReader"
| "extractor"
| "auditor";
/**
* The LIVE graph store (src/store/graph.ts) — owned by the app's extraction
* pipeline. Line shapes: src/core/contracts.ts.
*/
export const LEDGER_FILES = {
nodes: path.join(PATHS.graph, "nodes.jsonl"),
edges: path.join(PATHS.graph, "edges.jsonl"),
events: path.join(PATHS.graph, "events.jsonl"),
mappings: path.join(PATHS.graph, "mappings.jsonl"),
sessions: path.join(PATHS.graph, "sessions.jsonl"),
/** Per-message extraction coverage (contracts/graph.ts CoverageEntry;
* the checkpoint's replacement for chat extractions — notes keep
* sessions.jsonl, whole-file as they are). */
coverage: path.join(PATHS.graph, "coverage.jsonl"),
} as const;
/**
* Notes-import bookkeeping (NOT a ledger): one JSON map, src-id → NotesSource
* record (contracts/graph.ts) — the file path + import time + the run's usage
* log. Read-modify-write like a chat file, not append-only like the ledgers.
*/
export const SOURCES_FILE = path.join(PATHS.graph, "sources.json");
/** The layout ledger (read-modify-write like sources.json): nodeId →
* {x,y} resting positions from the incremental settle (core/layout.ts).
* Carries an updatedAt stamp for future live-physics conflict handling. */
export const POSITIONS_FILE = path.join(PATHS.graph, "positions.json");
/**
* Graph render settings (the settings-panel controls): one small JSON blob,
* read-modify-write. Shared shape/sanitizer: src/core/render-settings.ts.
*/
export const RENDER_SETTINGS_FILE = path.join(PATHS.graph, "render-settings.json");
/**
* DEFAULT settings — THE default model + thinking level + knowledge-context
* budget (owner, 2026-09-18): the new-session surfaces' controls are the
* settings page for the default model. There is NO baked-in default —
* BYOK first boot shows "no model" until the user picks one, and their
* last choice IS the default from then on. One small JSON blob,
* read-modify-write, written only through app/api/settings/defaults.
*/
export const DEFAULT_SETTINGS_FILE = path.join(DATA_ROOT, "default-settings.json");
/**
* THE USER SETTINGS RECORD (settings-storage wave, 2026-09-19): one
* versioned, DELTA-shaped JSON blob at the data-dir seam holding every
* non-secret product preference — general, chat defaults, agent (background
* model/thinking overrides + tool toggles + prompt-override switches),
* appearance, graph. Explicit user choices only: ABSENT keys resolve to the
* factory defaults compiled into src/core/settings.ts (FACTORY_SETTINGS), so
* a software update that adds a knob (new tool, new role, new appearance
* field) needs no migration — old records simply lack the new keys. The
* version field is a PRIVATE schema counter for breaking shape changes
* only (field renamed/meaning changed), unrelated to the app release
* version. Secrets (API keys, login tokens) NEVER live here — auth.json /
* .env.local keep that role. Migrated FROM: default-settings.json folds
* into the record's `chat` section on first read (the old file is left in
* place, inert).
*/
export const SETTINGS_FILE = path.join(DATA_ROOT, "settings.json");
/**
* User prompt-override files (settings-storage wave, 2026-09-19): the
* per-segment system-prompt overrides mirroring the SOURCE layout
* (src/agent/prompts/) — the shared base as prompts/system-prompt.md,
* fragments as prompts/teacher/<file> / prompts/prober/<file>. File
* PRESENCE alone is not the override: settings.json's agent.prompts map
* (segmentPath → boolean) is the explicit switch, so a user can keep a
* customized file on disk but run the source default to compare. The
* segment list itself is ALWAYS derived from source at runtime (the
* loader in src/store/prompt-overrides.ts) — code updates that add,
* remove, or reorder fragments adapt automatically; an override keyed to
* a vanished segment stops composing but stays on disk.
*/
export const PROMPTS_OVERRIDE_DIR = path.join(DATA_ROOT, "prompts");
/**
* THE AUTH/KEY STORE (auth-keys wave, 2026-09-19): BYOK provider keys in a
* flat {VAR: value} JSON map — the SAME file the Electron app has always
* hand-edited (owner decision: option A, zero migration). Desktop main.cjs
* passes LH_AUTH_FILE pointing at userData/auth.json (mode 0600); in dev
* (no Electron) the default is the repo-root auth.json (gitignored, same
* pattern as .env.local — a worktree may symlink it to the master copy).
* The SERVER reads/writes this file directly at call time (no restart to
* change a key); it reflects the values into process.env at boot with
* FILL-GAP precedence — real environment variables (incl. .env.local in
* dev) always win (src/server/keys.ts). Hand-edits still work: the file is
* re-read from disk on every API access. Secrets NEVER go in settings.json
* — this file keeps that role, alongside .env.local.
*/
export const AUTH_FILE = process.env.LH_AUTH_FILE
? path.resolve(process.env.LH_AUTH_FILE)
: path.join(ROOT, "auth.json");