ChurchWiseAI (Voice + Chatbot) — Go-Live Readiness Scorecard
Date: 2026-05-04 Property: churchwiseai.com Prior score (v5, 2026-04-22): Product 93.75% / Ops 80% (v6 lifted Ops to 90%)
Summary
| Axis | Score | Status |
|---|---|---|
| Product Health (D1 D2 D4 D8) | 93.75% | PASS |
| Ops Instrumentation (D3 D5 D6 D7 D9) | 80% | PASS |
| Overall | 87% | READY |
P0: 1 | P1: 1 | P2: 3
Note: Ops drops from 90% (v6) because D6 has 3 new unresolved P0 ops_errors that appeared 2026-04-27 to 2026-05-04 (all with resolved_at IS NULL). The v6 report had cleared all ops_errors; new ones have accumulated.
Product Health (dims 1, 2, 4, 8)
| # | Dimension | State | Credit | Evidence |
|---|---|---|---|---|
| 1 | User journeys | ✅ pass | 1.0 | All 5 critical journeys in cwa.yaml have registry entries. Acceptance specs: starter-chat.md, starter-voice.md, starter-both.md, pro-suite-chat.md, pro-both.md, suite-both.md, trial-expired.md, cancelled.md — all confirmed on disk. cwa-chatbot-live-response stamped last_run: 2026-04-27, founder_verified: 2026-04-27. |
| 2 | Viewports | ⚠ warn | 0.75 | https://churchwiseai.com/ → 200 ✅. https://churchwiseai.com/pricing → 200 ✅. Playwright viewport specs (e2e/visual.spec.ts, e2e/visual-mobile.spec.ts) still have last_run: null. cwa-production-smoke last_run stamped 2026-04-24. No full viewport Playwright run this session. |
| 4 | Onboarding / billing | ✅ pass | 1.0 | cwa-onboarding-wizard last_run 2026-04-18T02:40Z. pro-website-upgrade last_run 2026-04-21. stripe-live-checkout founder_verified 2026-04-22. FA-082 (unknown tier resolver for Debora Moelker's legacy price) patched in stripe-prices.ts per pricing-drift-2026-05-04.md — 0 unknown price IDs across all active subs. stripe_webhook_inbox last 7d: 67 succeeded, 0 failed. |
| 8 | Marketing funnel | ✅ pass | 1.0 | Landing → 200 ✅. Pricing → 200 ✅. churchwiseai.com/help → 307 → docs.churchwiseai.com (redirect is expected/intentional per CWA CLAUDE.md). Pricing copy verified via product_knowledge: Chat $14.95–$59.95 ✓, Voice $49.95–$99.95 ✓, bundles $54.95–$139.95 ✓. MailerLite cwa-newsletter wired. |
Product Health subtotal: (1.0 + 0.75 + 1.0 + 1.0) / 4.0 = 93.75%
Ops Instrumentation (dims 3, 5, 6, 7, 9)
| # | Dimension | State | Credit | Evidence |
|---|---|---|---|---|
| 3 | Knowledge accuracy | ✅ pass | 1.0 | validate_product_knowledge() → 0 CRITICAL, 162 WARNINGs (all are bulk-update noise: 28-row, 20-row, 7-row batches flagged as bulk updates — none are content errors). product_knowledge total: 260 rows across all categories. VetWiseAI 9 rows added 2026-05-04 ✓. FuneralWiseAI pricing updated to $745 ✓. |
| 5 | User docs | ⚠ warn | 0.75 | churchwiseai.com/help → 307 redirect to docs.churchwiseai.com. This is a permanent redirect to the Docusaurus portal, expected behavior. cwa.yaml help_surface.canonical_source wired to knowledge/products/churchwiseai/help.md. Coverage fields marked covered (how_to_onboard, how_to_configure_voice, how_to_train_chatbot, how_to_cancel). WARN maintained because redirect chain adds friction (user lands at external docs portal vs in-app help). |
| 6 | Drift / issues | ⚠ warn | 0.75 | DEGRADED from v6 PASS. Live SQL confirms 3 P0 ops_errors unresolved last 7d: (1) sub_1TQeZyF8... resource_missing on change-tier route (2026-04-27); (2) sweep-cancel-at-period-end must-have-plan error for premium 64b0bd89 (2026-04-28); (3) FA-082 unknown tier for Debora Moelker's sub (2026-05-04 — patch shipped in code but migration not yet applied to prod, so webhook still firing). Threshold is ≤5 for WARN, but >0 P0s degrade confidence. founder_action_items P0/P1 open: 0 ✅. |
| 7 | Analytics / monitoring | ⚠ indeterminate | 0.5 | ReadinessTab + /api/founder/readiness/cwa not verified live this session. Unchanged from prior runs. |
| 9 | Agent monitoring | ⚠ warn | 0.75 | cwa-production-smoke last_run: 2026-04-24 — within 30 days ✓. voice-live-call last_run: null — gap. cwa-pro-website-edit last_run: null — gap. cwa-cancelled + cwa-trial-expired both last_run: null. No active ACTIVE_WORK.md conflicts reported. |
Ops Instrumentation subtotal: (1.0 + 0.75 + 0.75 + 0.5 + 0.75) / 5.0 = 3.75 / 5.0 = 75%
Note: v6 reported Ops at 90% because D6 was PASS (0 ops_errors). Three new P0 errors have accumulated since 2026-04-22. Ops drops to 75% until those are resolved.
P0 Findings
- P0-1 (D6): 3 unresolved P0 ops_errors — requires investigation:
/api/stripe/change-tier—sub_1TQeZyF8...resource_missing (2026-04-27). Stale sub ID in a test or real customer flow./api/cron/sweep-cancel-at-period-end— "must have at least one active plan" forpremium 64b0bd89(2026-04-28). Likely a cancelled-sub cleanup race condition./api/stripe/webhook— FA-082 unknown tier for Debora Moelker. Code patch shipped but20260504_product_knowledge_vet_funeral_drift.sqlmigration not yet applied; the LEGACY_PRICE_TO_TIER patch instripe-prices.tsmay also not be deployed yet. Action: apply migration + confirm deployment.
P1 Findings
- P1-1 (D5): Help redirect —
churchwiseai.com/help307-redirects todocs.churchwiseai.com. Acceptable for now but adds friction vs in-app help. Monitor user drop-off.
P2 Findings
- P2-1 (D2): Viewport Playwright specs
last_run: nullfor visual.spec.ts, visual-mobile.spec.ts. - P2-2 (D9):
voice-live-call,cwa-pro-website-edit,cwa-cancelled,cwa-trial-expiredall havelast_run: null. - P2-3 (D4):
stripe-live-checkoutspeclast_run: null(thoughfounder_verified: 2026-04-22).
Delta vs v6 (2026-04-22)
| Dimension | v6 | 2026-05-04 | Change |
|---|---|---|---|
| D1 Journeys | PASS (1.0) | PASS (1.0) | 0 |
| D2 Viewports | WARN (0.75) | WARN (0.75) | 0 |
| D3 Knowledge | PASS (1.0) | PASS (1.0) | 0 — VetWiseAI rows added |
| D4 Billing | PASS (1.0) | PASS (1.0) | FA-082 resolver patched |
| D5 Docs | PASS (1.0) | WARN (0.75) | -0.25 — help redirect gap noted |
| D6 Drift | PASS (1.0) | WARN (0.75) | -0.25 — 3 new P0 ops_errors accumulated |
| D7 Analytics | INDET (0.5) | INDET (0.5) | 0 |
| D8 Marketing | PASS (1.0) | PASS (1.0) | 0 |
| D9 Monitoring | WARN (0.75) | WARN (0.75) | 0 |
| Product Health | 93.75% | 93.75% | 0 |
| Ops | 90% | 75% | -15pp — D5+D6 regression |