Files
ARCADIA-Studio/docs/validation.md
T

50 lines
6.4 KiB
Markdown
Raw Blame History

This file contains ambiguous Unicode characters
This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.
# V2 validation record — 2026-09-05
Arcadia Studio 0.2.0 was built and exercised on Windows and native Ubuntu 24.04.2/WSLg, using Rust 1.98.1 and Iced 0.14. Historical V1 reports are not counted as V2 evidence. Remote CI and the declared Rust 1.90 minimum were not executed.
## Automated evidence
| Area | Observed result |
|---|---|
| Windows final source | All 93 tests pass: 56 core, 25 desktop and 12 actual HTTP/storage tests. Workspace formatting, strict all-target Clippy and optimized desktop/server build pass. |
| Native Linux | Full 91-test baseline and strict workspace Clippy passed, then both subsequent desktop-only fixes passed the latest 25 desktop tests and strict desktop all-target Clippy. Together these native runs cover the current 93 tests; a final full-workspace 93-test invocation was not performed. Formatting and final optimized desktop/server build pass. |
| Core invariants | Typed whole-model equality, deterministic V1 migration, exact strings/coordinates, strict input, atomic failure/undo, all-record identity/deletion, nested projection, roles/allocations, scenarios/states, reviewed transition baselines, Mission mapping and placement relocation. |
| Desktop behavior | Lossless graphical drafts, typed reference choices, constructor preservation, shared perspective and placement edits, modal guards, invalid save/source recovery, counterpart focus/decision context and history. Behavior/Data authoring preserves architecture while updating ordered semantic occurrences. |
| Service | Real HTTP ETags/concurrent writes, restart, invalid candidates, dry runs, bounded queries, body/auth/Host limits, exclusive store lock/capacity and transition/artifact/source workflows on Windows and Ubuntu. |
| Contracts and examples | Both reST contracts render to HTML5 with Docutils report/halt level 2 and no warnings. V2 text/JSON examples compare exactly with zero diagnostics: 39 elements, 23 relations, 3 diagrams, 10 traces and 2 artifacts. V1 examples are explicitly named migration fixtures. |
A stale legacy-fixture include path initially failed a final test invocation. Both references were corrected and the complete suite rerun successfully. No compiler warning or failed check is being treated as a passing result.
## Actual native interface evidence
The lead's [native acceptance record](../harness/verification-v2-native.md) and fresh [independent Windows review](../harness/review-v2-final-ui.md) document actual Computer Use, not screenshots inferred from source.
- Lead Windows: original repaired Capella OA/SA/transition inspection; Studio source colors/live located lint/rejected Apply/Revert; process, repeated scenario and state navigation; new/empty model; OA→SA creation and explicit reverse creation/undo; modal background guards.
- Lead Windows: opened actual REST-edited source, observed changed project/function/CAD fields, edited CAD revision and saved. External file modification then caused a visible save refusal with external bytes preserved.
- Fresh Windows reviewer: graphical fragment→branch→exchange authoring with a quoted guard and filtered references; saved model; minimum 1100×700, default 1440×900 and 2560-wide layouts; state-route selection/details and 150% nested typography on rebuilt executables.
- Lead Linux: actual file dialog/save/reopen, shared Energy perspective edit, explicit manual trace, diagram layer changes, placement identity/drag/relocation and artifact ownership. Continuous merged-text input, Keep target, target-change invalidation, reviewed commit and reverse preview were operated after fixes.
- Final packaged Windows: independently created a scenario Action with function/lifeline references, saved/reopened it, and verified the architecture retained its three original function placements.
- Final packaged Linux: lead launched the exact refreshed executable, reopened that Windows-authored file, and observed its 40 elements/23 relations/zero checks, preserved nested SA architecture and rendered saved Action. Closed normally with exit 0 and no stderr.
Native Linux ran with Mesa software Vulkan:
~~~sh
WGPU_BACKEND=vulkan VK_DRIVER_FILES=/usr/share/vulkan/icd.d/lvp_icd.x86_64.json ./arcadia-studio
~~~
## Independent findings and disposition
Requirements, correctness, native UI/runtime and architecture reviews were completed by agents independent of the relevant implementation. Material findings were reproduced, fixed and reverified. These included transition baseline stability and target-specific decisions, external save protection, sequence ordering and Fragment defaults, Mission mapping, graphical field parity, modal ownership, reference filtering, placement focus, behavior selection, merged-input focus and nested typography. Final focused reviews reported no new material finding.
The original [UI review](../harness/review-v2-ui-runtime.md), [correctness review](../harness/review-v2-correctness.md), [requirements/architecture review](../harness/review-v2-requirements-architecture.md) and [final regression review](../harness/review-v2-final-regressions.md) retain their intermediate observations and later dispositions. Pending items in those historical sections are closed by the later final/native records.
## Service and release evidence
The [service verification record](server.md#verification) covers optimized Windows/Linux processes, health/create/update/stale-delete/auth/store-lock/restart/SIGTERM checks and native systemd unit validation. The separate [API transfer review](../harness/review-v2-api-transfer.md) records the Windows source→REST→native desktop transfer. Docker execution, remote deployment and systemd installation were not performed. No test service or Studio acceptance window is intentionally left running.
[Linux verification](../harness/verification-v2-linux.md) records native commands and executable hashes. [Package verification](../harness/verification-v2-packages.md) records archive inventories and executable equality. Release bundles contain both desktop/server binaries, examples, rendered/source contracts, documentation, deployment recipes and acceptance records.
## Limits
Graphics adapter coverage beyond the tested Windows and Ubuntu/WSLg environment, accessibility certification and production-scale performance are untested. LA/PA, execution/simulation, full Capella/SysML conformance, native Capella interchange, autosave and direct desktop-hosted editing remain outside the [specified prototype](scope.md).