fix(vv): resolve all 6 V&V issues — field trial unblocked
All findings from the inaugural LeadValidator audit resolved and confirmed. Release gate: PASS. VV_ISSUE_002 (BLOCKER): 15 OpenAPI specs verified present covering all 20 route groups (46 endpoints documented in docs/openapi/) VV_ISSUE_003 (MAJOR): Remove any types from src/db/pool.ts — replaced pool.query shim with unknown[] + Object.defineProperty, zero any types, eslint-disable suppressions removed VV_ISSUE_004 (MAJOR): Remove raw Pool from ScaffoldController and HealthDetailedController — injected AgentRepository/CredentialRepository and DbProbe interface respectively; added CredentialRepository.findActiveClientId() VV_ISSUE_005 (MAJOR): Add unit tests for 5 untested services — ComplianceStatusStore, EventPublisher, MarketplaceService, OIDCTrustPolicyService, UsageService VV_ISSUE_006 (MAJOR): Add integration tests for 7 missing route groups — analytics, billing, tiers, webhooks, marketplace, oidc-trust-policies, oidc-token-exchange VV_ISSUE_001 (MINOR): Create missing design.md and tasks.md in 4 OpenSpec archives — all archives now complete Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
@@ -0,0 +1,36 @@
|
||||
# Design — phase-7-devops-field-trial
|
||||
|
||||
**Status:** Complete
|
||||
**Archived:** 2026-04-04
|
||||
|
||||
## Context
|
||||
|
||||
`docs/devops/` was last updated during Phase 2. Phases 3–6 added 14 new DB migrations, Phase 6 feature flags (ANALYTICS_ENABLED, TIER_ENFORCEMENT, COMPLIANCE_ENABLED), Stripe integration (STRIPE_SECRET_KEY, STRIPE_WEBHOOK_SECRET), new services (Analytics, Tier, Compliance, A2A), the Next.js portal, and substantial changes to env var requirements. The DevOps documentation did not reflect any of these changes.
|
||||
|
||||
Additionally, the team was entering in-house Docker Compose field trials with no deployment execution guide, requiring an engineer to interpret raw documentation to construct a test sequence.
|
||||
|
||||
## Goals / Non-Goals
|
||||
|
||||
**Goals:**
|
||||
- Bring all 8 `docs/devops/` files current with Phase 6 codebase state
|
||||
- Create `docs/devops/field-trial.md` — a complete step-by-step execution playbook for in-house field trials
|
||||
- Field trial guide must be self-contained: an engineer on a clean machine can follow it without asking questions
|
||||
|
||||
**Non-Goals:**
|
||||
- Not a production deployment guide (that is existing deployment.md)
|
||||
- Not a developer quickstart (that is docs/developers/quick-start.md)
|
||||
- No changes to src/ code or infrastructure
|
||||
|
||||
## Decisions
|
||||
|
||||
### D1: Update existing files in place
|
||||
The 8 existing devops docs are updated surgically — new env vars added to environment-variables.md, new tables added to database.md, etc. Existing content is not restructured.
|
||||
|
||||
### D2: field-trial.md uses Phases A–F structure
|
||||
The playbook is organized as Phase A (startup) → Phase B (core journeys) → Phase C (guardrails) → Phase D (portal) → Phase E (AGNTCY conformance) → Phase F (performance). Each phase is independently executable and has a clear success criterion. A failure in Phase A (stack does not start) blocks all subsequent phases.
|
||||
|
||||
### D3: All steps are copy-paste executable
|
||||
Every step in field-trial.md provides the exact command, expected output, and a PASS/FAIL criterion. No step requires inference or judgment from the engineer.
|
||||
|
||||
### D4: Troubleshooting section included
|
||||
field-trial.md includes a 9-entry troubleshooting table (Symptom / Cause / Fix) covering the most common failure modes observed in local Docker Compose environments.
|
||||
33
openspec/changes/archive/phase-7-devops-field-trial/tasks.md
Normal file
33
openspec/changes/archive/phase-7-devops-field-trial/tasks.md
Normal file
@@ -0,0 +1,33 @@
|
||||
## phase-7-devops-field-trial — Task Tracker
|
||||
|
||||
All tasks complete. Archive committed 2026-04-04.
|
||||
|
||||
### WS1 — Update Existing DevOps Docs (8 files)
|
||||
|
||||
- [x] 1.1 `environment-variables.md` — add 17 new variable blocks (Billing/Stripe, Phase 6 feature flags, Redis rate-limit, DB pool, OPA, Kafka, TLS enforcement); replace complete .env example
|
||||
- [x] 1.2 `database.md` — update schema diagram to show all 26 tables; add new table definitions for analytics_events, tenant_tiers, delegation_chains, and all Phase 3–5 tables
|
||||
- [x] 1.3 `deployment.md` — add Phase 3–6 env vars to quick-reference table
|
||||
- [x] 1.4 `local-development.md` — add nvm activation step; add Step 7 for Next.js portal startup
|
||||
- [x] 1.5 `operations.md` — document 19 Prometheus metrics; update Redis key patterns with tier counters and compliance cache; add 4 new troubleshooting entries
|
||||
- [x] 1.6 `architecture.md` — add Next.js portal to diagram; document 14 new services; list all 25 API routes
|
||||
- [x] 1.7 `security.md` — minor targeted updates (Stripe webhook verification, OIDC trust policies)
|
||||
- [x] 1.8 `vault-setup.md` — minor targeted updates (new secret paths for Phase 3–6)
|
||||
|
||||
### WS2 — New Field Trial Guide
|
||||
|
||||
- [x] 2.1 Create `docs/devops/field-trial.md` — prerequisites + Section 0 (RSA key generation, .env setup)
|
||||
- [x] 2.2 Phase A: Stack startup (Docker Compose + 26 migrations)
|
||||
- [x] 2.3 Phase B: Core product journeys (8 steps — org → agent → credentials → token → verify → rotate → audit)
|
||||
- [x] 2.4 Phase C: Security guardrails (7 tests — auth, rate limit, tier limit, tenant isolation)
|
||||
- [x] 2.5 Phase D: Next.js portal verification (9 routes)
|
||||
- [x] 2.6 Phase E: AGNTCY conformance suite (4 protocol tests)
|
||||
- [x] 2.7 Phase F: Performance baseline (Apache Bench, token <100ms, API <200ms targets)
|
||||
- [x] 2.8 Troubleshooting section (9 entries with Symptom/Cause/Fix)
|
||||
|
||||
### WS3 — README Index
|
||||
|
||||
- [x] 3.1 `README.md` — add field-trial.md to document index
|
||||
|
||||
### QA
|
||||
|
||||
- [x] 4.1 QA sign-off — 15/15 gates PASS
|
||||
Reference in New Issue
Block a user