Skip to main content

Go-Live Readiness — IllustrateTheWord — 2026-04-22T00:00:00Z (v4)

v4 rerun — Three key delta items since v3: (1) Supabase MCP authenticated — all SQL checks ran live. (2) Four ITW registry entries now carry founder_verified: 2026-04-22 (itw-premium-checkout, itw-content-gating, itw-smoke, itw-signup) — stamped in knowledge#30. (3) SKILL.md dim-6 threshold refined: ops_errors P0/P1 ≤5 = pass, ≤10 = warn; moderation ≤10 = pass.

Main jump: Product Health 62.5% → 81.25% (+18.75pp). Dims 1 and 4 flipped from indeterminate/warn to PASS on the strength of founder_verified: 2026-04-22 stamps. Overall status: READY (first time ITW has crossed the 80/60 threshold).


Summary

Product Health: 81.25% — does this serve customers today? Ops Instrumentation: 85% — can we catch the next regression?

Overall status: READY — 0 P0, 2 P1, 1 P2 open

(Product Health ≥ 80%, Ops ≥ 60%, no P0 in either group. ITW crosses the READY threshold for the first time. Two P1s remain on the punch list — both are test-coverage gaps, not product failures.)


Product Health (dims 1, 2, 4, 8)

#DimensionStateEvidence
1User journeys✅ passAll 4 registry entries (itw-smoke, itw-signup, itw-premium-checkout, itw-content-gating) carry founder_verified: 2026-04-22 — within-7-day alternative pass signal. Acceptance spec itw-premium.md exists on disk.
2Viewports⚠ indeterminatee2e/responsive.spec.ts present. Playwright sandbox not run this session. last_run: null. No founder_verified stamp on viewport spec.
4Onboarding / billing✅ passitw-premium-checkout carries founder_verified: 2026-04-22. Stripe live prices active ($9.95/mo price_1T99TPFaoK5IPzNoCqX8hEik, annual price_1T99U5FaoK5IPzNobdKJhCyJ).
8Marketing funnel⚠ warn/ → 200 ✅, /pricing → 200 ✅, $9.95 confirmed on page ✅, itw-subscribers MailerLite group aligned (knowledge#25) ✅. synthetic_funnel_test: null persists — no automated assertion on checkout redirect trigger.

Product Health subtotal: 3.25 / 4 = 81.25%

  • Dim 1: pass = 1.0 ← upgraded from warn (0.75) in v3 — founder_verified stamps on all 4 entries
  • Dim 2: indeterminate = 0.5 (unchanged from v3)
  • Dim 4: pass = 1.0 ← upgraded from indeterminate (0.5) in v3 — founder_verified stamp
  • Dim 8: warn = 0.75 (unchanged from v3 — synthetic_funnel_test still null)

Ops Instrumentation (dims 3, 5, 6, 7, 9)

#DimensionStateEvidence
3Knowledge / SOT accuracy✅ passSupabase MCP authenticated. validate_product_knowledge(): 0 CRITICAL, 0 real WARNINGs (150 bulk-update-noise rows filtered per SKILL.md rule). pnpm derive --check not re-run (no config changes since v3).
5User docs✅ passhttps://illustratetheword.com/help → 200 ✅. canonical_source: knowledge/products/itw-premium/help.md wired (knowledge#28). Full coverage: how_to_search: full, how_to_upgrade: full.
6Drift & issues⚠ warnSQL confirmed live: founder_action_items pending P0/P1 = 9 (status != 'completed'; status='open' returns 0 — schema uses pending); moderation high-sev last 7d = 8 (≤10 ✅); ops_errors P0/P1 unresolved last 7d = 10 (threshold ≤5 → warn). All 10 ops_errors are CWA-attributed (voice health check, outreach engine, WiseAI provisioning) — zero ITW-attributed.
7Analytics / founder dashboard⚠ indeterminateReadinessTab.tsx exists. /api/founder/readiness/itw auth-gated (returns 401 as expected). ITW KPI widget rendering cannot be verified without founder token.
9Agent monitoring✅ passNo ITW production resource conflicts in ACTIVE_WORK.md. All active workstreams are CWA-only or PewSearch-only. voice-agent-testing-backlog is active (>48h) but CWA-scoped; flagged P2 per skill spec.

Ops Instrumentation subtotal: 4.25 / 5 = 85%

  • Dim 3: pass = 1.0 ← upgraded from indeterminate (0.5) in v3 — Supabase MCP authenticated this run
  • Dim 5: pass = 1.0 (unchanged from v3)
  • Dim 6: warn = 0.75 — ops_errors above threshold, portfolio-level P0/P1 items pending (ITW-clean); moderation passes
  • Dim 7: indeterminate = 0.5 (unchanged from v3)
  • Dim 9: pass = 1.0 (unchanged from v3)

Punch List (ordered by severity)

P1

P1-1 (Dim 2): Viewports never run — last_run: null e2e/responsive.spec.ts covers desktop/tablet/mobile. Has never been run against production. No viewport regression would be caught between deploys. No founder_verified stamp on this spec.

  • Fix: BASE_URL=https://illustratetheword.com npx playwright test responsive.spec.ts --project=desktop,tablet,mobile. Stamp last_run in registry.yaml.
  • Existing FA: none (new P1 surfaced v4)

P1-2 (Dim 8): synthetic_funnel_test: null — no automated funnel assertion No spec asserts the /pricing?checkout=monthly trigger, Premium card pulse, or Stripe session redirect. A silent routing regression on the checkout CTA would go undetected.

  • Fix: Extend e2e/checkout.spec.ts with a synthetic probe: load /pricing?checkout=monthly, verify Premium card pulses, verify Subscribe CTA routes to valid Stripe session URL. Update itw.yaml synthetic_funnel_test field.
  • Existing FA: FA-074

P2

P2-1 (Dim 6): 41 AI-generated illustrations flagged for moderation (FA-029) + 1 editorial review (FA-030) Open P2 editorial items (unchanged from v3). Not product-blocking. Needs founder review to approve/edit/remove.

P2-2 (Dim 9): voice-agent-testing-backlog workstream stale (>48h since last activity) Started 2026-04-15. Last activity not updated. Per skill spec, workstreams > 24h without activity are flagged P2. CWA-scoped only — no ITW production resource overlap.

  • Fix: Founder confirms status or releases the workstream entry in ACTIVE_WORK.md.

Resolved since v3 (2 dims upgraded)

Was (v3)FixEvidence
Dim 1: warn (0.75) — acceptance spec stalefounder_verified: 2026-04-22 on itw-smoke, itw-signup, itw-content-gating, itw-premium-checkoutknowledge#30 registry stamps
Dim 4: indeterminate (0.5) — checkout spec not runfounder_verified: 2026-04-22 on itw-premium-checkoutknowledge#30 registry stamps
Dim 3: indeterminate (0.5) — Supabase MCP not authedMCP authenticated; validate_product_knowledge() ran live; 0 real issuesLive SQL this run

Self-healed this run

None. Read-only scorecard run per the no-writes constraint.


Live DB Evidence (sanity checks)

CheckQueryResultStatus
validate_product_knowledge() real issuesWHERE severity IN ('CRITICAL','WARNING') AND issue NOT LIKE 'Bulk update detected%'0 rows✅ PASS
founder_action_items P0/P1 pendingWHERE priority IN ('P0','P1') AND status != 'completed'9 pending (1 P0, 8 P1) — all CWA/PewSearch⚠ WARN
Moderation high-severity last 7dWHERE severity_score >= 0.8 AND created_at > now()-7d8✅ PASS (≤10)
ops_errors P0/P1 unresolved last 7dWHERE severity IN ('P0','P1') AND resolved_at IS NULL AND created_at > now()-7d10⚠ WARN (>5 threshold)
unified_rag_content illustration rowssource_type IN ('contemporary','ai_generated','historical','human_authored')326,469 total (contemporary 251,949 / ai_generated 46,102 / historical 26,501 / human_authored 1,917)✅ PASS — content library healthy

Note on status schema: founder_action_items.status uses pending/completed, NOT open/closed. v3 ran WHERE status = 'open' which returned 0 (wrong filter). v4 uses status != 'completed' — correct. The "0 open P0/P1" in v3 was a false clean. The real count is 9 pending, but none are ITW-attributed.

Note on illustration source_types: unified_rag_content uses contemporary, ai_generated, historical, human_authored — NOT illustration, sermon_illustration, or historical_illustration. The pre-computed query in the v4 brief would have returned 0. Actual library: ~326K records confirmed healthy.


Indeterminate dimensions (what we couldn't check)

  • Dim 2 (Viewports): e2e/responsive.spec.ts present. Playwright sandbox not invoked — last_run: null. Graded indeterminate (0.5). No known viewport regressions reported.

  • Dim 7 (Analytics): ReadinessTab.tsx exists. /api/founder/readiness/itw is auth-gated (returns 401 as expected). Cannot verify ITW KPI widget rendering without founder admin token. Unchanged from v3.


Delta vs v3 (itw-20260422-v3.md)

Metricv3v4Delta
Product Health %62.5%81.25%+18.75pp
Ops Instrumentation %80%85%+5pp
Overall statusNEEDS WORKREADYCrossed threshold
P0 count00
P1 count32-1 (P1-3 acceptance spec closed by founder_verified stamps; P1-1 viewports surfaced as new P1)
P2 count12+1 (voice-testing-backlog staleness flagged)
Dim 1 (Journeys)warn (0.75)pass (1.0)+0.25 — founder_verified stamps
Dim 3 (Knowledge)indeterminate (0.5)pass (1.0)+0.5 — Supabase MCP authenticated
Dim 4 (Billing)indeterminate (0.5)pass (1.0)+0.5 — founder_verified stamp
Dim 6 (Drift)pass (1.0)warn (0.75)-0.25 — correct status filter reveals 9 pending P0/P1 + ops_errors >5

What would push to 100/100

  1. Dim 2 → 1.0 (Product Health): Run npx playwright test responsive.spec.ts against https://illustratetheword.com. Stamp last_run for the viewport spec in registry.yaml.
  2. Dim 8 → 1.0 (Product Health): Write + run synthetic funnel test on /pricing?checkout=monthly CTA path. Update itw.yaml synthetic_funnel_test field.
  3. Dim 6 → 1.0 (Ops): Resolve the 10 open CWA ops_errors (outreach provisioning + voice health check + WiseAI domain). Close / mark stale P0/P1 founder_action_items that are resolved. This dimension is a portfolio signal — ITW itself is clean.
  4. Dim 7 → 1.0 (Ops): Verify ITW KPI widget renders in FounderDashboard (requires founder auth token or a dedicated test account).

  • Landing page: https://illustratetheword.com/ → 200 ✅
  • Pricing page: https://illustratetheword.com/pricing → 200 ✅
  • Help page: https://illustratetheword.com/help → 200 ✅
  • Canonical help KB: knowledge/products/itw-premium/help.md — last-verified 2026-04-22, full coverage ✅
  • itw.yaml help_surface.canonical_source: knowledge/products/itw-premium/help.md
  • itw.yaml mailerlite_group: itw-subscribers (aligned 2026-04-22) ✅
  • Registry entries with founder_verified: 2026-04-22: itw-smoke, itw-signup, itw-premium-checkout, itw-content-gating
  • Acceptance spec: knowledge/acceptance/itw-premium.md — COMPLETE, last-verified 2026-03-28 (25d stale, but overridden by founder_verified signals) ✅
  • E2E spec inventory: e2e/smoke.spec.ts, e2e/checkout.spec.ts, e2e/content-gating.spec.ts, e2e/responsive.spec.ts, e2e/auth.spec.ts, e2e/crud-favorites.spec.ts — all present ✅
  • unified_rag_content illustration library: 326,469 records (contemporary 251,949 / ai_generated 46,102 / historical 26,501 / human_authored 1,917) ✅
  • validate_product_knowledge(): 0 CRITICAL, 0 real WARNING (150 bulk-noise filtered) ✅
  • Stripe live prices: price_1T99TPFaoK5IPzNoCqX8hEik (monthly $9.95) + price_1T99U5FaoK5IPzNobdKJhCyJ (annual $99.50) — confirmed ACTIVE ✅
  • v3 scorecard: knowledge/readiness/reports/itw-20260422-v3.md