Skip to main content

Test Specs — Full Catalog

One YAML spec per feature/test. These are the canonical source of truth — Playwright files implement them, the DB mirrors them, agents query them.

110 specs total  |  2 critical path

Critical Path Specs

These cover customer-money or customer-data flows. A PR that touches their linked_code_files requires a verified Playwright run.

SpecPropertyPlaywright
Payment: Complete Checkout to ActivationChurchWiseAIjourneys (conceptual)
Stripe Live Checkout + Webhook ProvisioningChurchWiseAIstripe-e2e-validator.spec.ts

All Specs by Property

ChurchWiseAI

SpecCategoryTierCritical
Cancelled Subscription — Service Endslifecycleall-tiers
Pro Both (Chat + Voice) Bundle — Full Acceptance SpecAdmin Dashboardpro-both
Pro Suite Chat Tier — Full Acceptance SpecAdmin Dashboardpro-suite-chat
SermonWise Pro Tier ($19.95/mo)Admin Dashboardsermonwise-pro
Starter Both (Chat + Voice) Tier — Full Acceptance SpecAdmin Dashboardstarter-both
Starter Chat Tier — Full Acceptance SpecAdmin Dashboardstarter-chat
Starter Voice Tier — Full Acceptance SpecVoice Agentstarter-voice
Pro Suite Both Bundle ($139.95/mo)Admin Dashboardsuite-both
Trial Expired — Graceful Downgrade SpecAdmin Dashboardtrial-expired
Accessibility: WCAG 2.1 AA Compliancecomplianceall
Analytics: Dashboard Metrics Accuracy and CalculationAdmin Dashboardpro-both
API: Care Agent Configuration and BehaviorAPI / Integrationpro-both
API: Magic Link Emails and Unsubscribe VerificationAPI / Integrationall
API: Endpoint Coverage and Schema ValidationAPI / Integrationall
API: Environment Variable IntegrationAPI / Integrationall
API: New Endpoints in Latest ReleaseAPI / Integrationall
API: Stripe Payment Synthetic TestingAPI / Integrationall
Feature Claims — Marketing vs ImplementationUI / Visualany
Pricing Pages Match Canonical pricing.yamlUI / Visualanonymous
Product Knowledge Alignment — Chatbot/Voice InfoChatbotany-chat
Stale Copy Detection — Marketing Text AccuracyUI / Visualany
CRUD: Care Agent ConfigurationAdmin Dashboardpro-both
CRUD: Church Settings and ProfileAdmin Dashboardstarter-chat
CRUD: Training Documents and Knowledge BaseAdmin Dashboardpro-chat
CRUD: Chatbot Configuration — Create, Update, DeleteAdmin Dashboardstarter-chat
CRUD: Visitor and Prayer Request ContactsAdmin Dashboardstarter-chat
CRUD: Social Media Campaigns (ShareWiseAI)Admin Dashboardsuite-both
CRUD: Social Platform Connections (ShareWiseAI)Admin Dashboardsuite-both
CRUD: Social Media Posts (ShareWiseAI)Admin Dashboardsuite-both
CRUD: Social Media Organization Settings (ShareWiseAI)Admin Dashboardsuite-both
Pastor Discovery — First Visit to churchwiseai.comUX / Flowanonymous
Pastor Evaluates — Pricing, Features, DemoUX / Flowanonymous
Pastor Signs Up — Pricing to Checkout to ProvisioningOnboardingany
Pastor Onboarding — Guided Setup WizardOnboardingany
Pastor Daily Dashboard UseAdmin Dashboardany
Pastor Configures Chatbot Personality + Knowledge BaseAdmin Dashboardany-chat
Pastor Sets Denomination + Theological LensAdmin Dashboardany
Pastor Upgrades Plan from DashboardOnboardingstarter-chat
Admin Dashboard: Feature Completeness and UXAdmin Dashboardall
Edge Case: Chatbot API Security and Error HandlingSecurityall
Edge Case: Cross-Site Isolation and Data SeparationSecurityall
Edge Case: Input Validation and Injection PreventionSecurityall
Edge Case: API Rate Limiting and Abuse PreventionSecurityall
Error Handling: Graceful Recovery and User GuidanceUX / Flowall
User Journey: Admin Daily Dashboard UseAdmin Dashboardstarter-chat
User Journey: Denomination-Specific Content QualityUX / Flowstarter-chat
User Journey: Pro Both (Voice + Chat Bundle)UX / Flowpro-both
User Journey: Pro Chat and Suite Chat (Chat-Only Tiers)UX / Flowpro-chat
User Journey: Starter Both (Voice + Chat Bundle)UX / Flowstarter-both
User Journey: Starter Chat CustomerUX / Flowstarter-chat
User Journey: Suite Both (Highest Tier Voice + Chat Bundle)UX / Flowsuite-both
User Journey: Trial Expired (14-Day Chat Plan Trial Ends)UX / Flowstarter-chat
Bug Regression: Demo Church Phone Labels (CWA)Chatbotstarter-voice
Bug Regression: Missing Post-Signup Explanation (CWA)Onboardingstarter-chat
Bug Regression: Pricing Tier Indecision (CWA)Onboardingany-chat
Legal: Required Pages and Accessibilitycomplianceall
Integration: Cross-Property Data Isolation and LinksAPI / Integrationall
Onboarding: First-Time User Experience and Setup ClarityUX / Flowstarter-chat
Full Pastor Journey — Google to Signed UpUX / Flowanonymous-to-starter
Payment: Complete Checkout to Activationpayment_processingall
Performance: Lighthouse Metrics and Core Web VitalsUI / Visualall
Persona: Board Leader Mark — Technology EvaluatorUX / Flowanonymous
Persona: Committee Buyer — Board Meeting DecisionUX / Flowanonymous
Persona: Deacon Bob — Board Member SkepticUX / Flowanonymous
Persona: Karen — Privacy ParanoidSecurityanonymous
Persona: Mark — Mega Church IT DirectorAPI / Integrationstarter
Persona: Pastor Ezekiel — AI SkepticUX / Flowanonymous
Persona: Pastor Maria — Catholic Tradition JourneyUX / Flowstarter
Persona: Pastor Steve — Burned by Bad TechUX / Flowstarter
Persona: Pastor Ruth — Tiny Church, Budget-ConsciousUX / Flowstarter-chat
Persona: Youth Pastor Jake — Mobile FirstUI / Visualstarter
Production Smoke — All Sites UpUI / Visualanonymous
Security — Auth, RBAC, Input ValidationSecurityanonymous
Security: HTTP Headers and CSP ConfigurationSecurityall
Design: Brand Consistency (Colors, Typography, Logo)UI / Visualall
Content: Accuracy Against Product Knowledgeseo_complianceall
SEO: Page Metadata and Structured Dataseo_complianceall
SermonWise Discovery — How Pastors Find ItUX / Flowanonymous
SermonWise Understanding — How It WorksUX / Flowanonymous
SermonWise Daily Use — Sermon Prep WorkflowUX / Flowsermonwise-pro
Bug Regression: SermonWise Missing Homily Formatcontent_accuracysermonwise-pro
Smoke Tests — Basic Sanity ChecksUI / Visualanonymous
Smoke Tests: External Integrations (Stripe, Anthropic, LiveKit)API / Integrationall
Smoke Journey: Chatbot Signup FlowUX / Flowstarter-chat
Smoke Journey: Suite Both Premium SignupUX / Flowsuite-both
Production Smoke — All Three Sites Status CheckUI / Visualall
Production Journey Tests — End-to-End on Live SitesUX / Flowall
Smoke Tests — ShareWiseAI Social Media PlatformUI / Visualsuite-both
Stripe Live Checkout + Webhook ProvisioningOnboardingany
Landing Pages — Theology Accuracy & InclusivityUI / Visualanonymous
Crisis Response — Sensitive Pastoral Topics (Safety)Securityany-chat
Chatbot Theological Vocabulary by DenominationChatbotany-chat
Theological Vocabulary — All Traditions (LensLines)Chatbotany-chat
Baptist Theological Vocabulary & PracticesChatbotstarter-chat
Catholic Theological Vocabulary & PracticesChatbotstarter-chat
Orthodox Theological Vocabulary & PracticesChatbotstarter-chat
Pentecostal Theological Vocabulary & PracticesChatbotstarter-chat
Reformed Theological Vocabulary & PracticesChatbotstarter-chat
Church Visitor Uses Chatbot on Church PageChatbotany
Visual Regression: Desktop UIUI / Visualall
Visual Regression: Mobile UIUI / Visualall

IllustrateTheWord

SpecCategoryTierCritical
IllustrateTheWord Premium Tier ($9.95/mo)Admin Dashboarditw-premium
Cross-Property Integration: ITW → SermonWiseUX / Flowitw-premium
Bug Regression: ITW 'This Sunday' Irrelevant ResultsUI / Visualanonymous

PewSearch

SpecCategoryTierCritical
PewSearch Premium Page ($9.95/mo)Admin Dashboardpewsearch-premium
PewSearch Pro Website ($19.95/mo)Admin Dashboardpewsearch-pro-website
Cross-Property Upsell: PewSearch → ChurchWiseAIUX / Flowpewsearch-premium
Bug Regression: PewSearch Search Returns All ChurchesUI / Visualanonymous
PewSearch — Church Claim FlowUX / Flowanonymous-to-premium

SermonWise

SpecCategoryTierCritical
SermonWise — Signup and Generate First SermonUX / Flowsermonwise-pro