Skip to main content

Manual Test Path: Father Michael — Roman Catholic Priest

Persona: Father Michael Brennan, 52, parish priest at a 400-family Catholic parish in suburban New Jersey. Has a parish secretary (Mrs. Delgado) who handles most admin. Parish council makes technology decisions — Father Michael needs to present a case. Concerned about theological accuracy (Marian devotions, sacraments, holy days of obligation). Gets 20+ calls/week — many about Mass times, confession schedule, baptism/marriage prep. Uses no church management software. Parish website is 8 years old.

Why this persona matters: Catholic parishes have specific theological vocabulary (Mass not "service," sacraments, holy days, RCIA, etc.). The AI must handle Catholic-specific content without Protestant framing. Also tests the PewSearch Premium flow (directory listing for a larger parish).

Products to test: CWA Pro Chat ($34.95/mo), PewSearch Premium ($9.95/mo), CWA Voice Starter ($39.95/mo) Payment: Live Stripe, real credit card Email: Use a DIFFERENT email than the Protestant test (separate customer)


Part 1: PewSearch Premium ($9.95/mo)

Step 1 — Discovery via PewSearch

  • Open pewsearch.com in an incognito window
  • Search for a Catholic church (use a real parish name from the directory, or search "Catholic" + a city)
  • Find a church detail page (/churches/[slug])
  • Is there a chatbot widget on the page? (Basic auto-provisioned, 1 tool)
  • Does the chatbot say anything theologically inappropriate for a Catholic context?
  • Look for "Is this your church?" or claim CTA

Step 2 — Claim Flow

  • Click "Claim this church" or "Is this your church?"
  • What is the claim flow? Walk through every step
  • Enter Father Michael's contact info
  • Is there a phone verification or email verification?
  • Complete the claim

Step 3 — PewSearch Premium Upgrade

  • After claiming, find the upgrade to Premium ($9.95/mo)
  • What does Premium include? Is it clear?
  • Complete Stripe checkout with real card
  • Verify confirmation

Step 4 — PewSearch Admin Dashboard

  • Access the PewSearch admin (/admin/[token])
  • What can you edit? Hours, staff, description, photos?
  • Edit service times — use Catholic terminology: "Mass Schedule" not "Service Times"
    • Saturday Vigil: 5:00 PM
    • Sunday: 7:30 AM, 9:00 AM, 10:30 AM, 12:00 PM
    • Daily Mass: Mon-Fri 8:00 AM
    • Confession: Saturday 3:30-4:30 PM
  • Does the form accommodate Catholic scheduling patterns? (Multiple Sunday Masses, daily Mass, confession times)
  • Save changes — do they appear on the public church page?
  • Is there an AI/chatbot upsell in the PewSearch admin? (Should be — cross-sell to CWA)

Part 2: ChurchWiseAI Pro Chat ($34.95/mo)

Step 5 — Discovery from PewSearch Upsell

  • From the PewSearch admin, find the CWA upsell
  • Click through to churchwiseai.com
  • OR open churchwiseai.com directly
  • Navigate to /pricing
  • Find the Pro Chat plan at $34.95/mo
  • What extra features does Pro have vs Starter? Is this clear on the pricing page?
  • Click "Get Started" on Pro Chat

Step 6 — Onboarding (/onboard)

  • Does the plan pre-select Pro Chat?
  • Enter the parish name (use the same one you claimed on PewSearch)
  • Enter Father Michael's info (use the DIFFERENT email)
  • Does it match to the PewSearch church you already claimed? (It should, silently)
  • Complete the form
  • Continue to Stripe checkout

Step 7 — Stripe Checkout

  • Does it say "14 days free"?
  • Product: "ChurchWiseAI Pro Chat" — $34.95/mo after trial?
  • Description accurate for Pro tier? (Should mention more agents, tools, analytics)
  • No voice mentions? (Chat-only plan)
  • Complete payment

Step 8 — Post-Checkout + Email

  • Success page — dashboard link?
  • Check email — welcome message received?
  • MailerLite — subscriber added?
  • Click through to dashboard

Step 9 — Dashboard (Pro Features)

  • What tabs do you see? Pro should have MORE than Starter:
    • Overview, Requests, Care, Settings, Upgrade — same as Starter
    • Analytics — Pro feature, should be VISIBLE
    • Training — Pro feature, should be VISIBLE (FAQ management, document upload)
  • Is the plan shown as "Pro Chat"?

Step 10 — Pro-Only Features

  • FAQ Management — Can you add custom Q&A?
    • Add: "What are the Mass times?" → answer with the schedule
    • Add: "How do I schedule a baptism?" → answer with parish process
    • Add: "When is confession?" → answer with schedule
  • Document Upload — Can you upload a parish bulletin PDF?
  • Analytics Dashboard — Does it show? (No data yet, but should load)
  • Widget Customization — Can you change chatbot colors, welcome message?
  • Training Simulator — Can you test the chatbot with your new FAQ data?

Step 11 — Chatbot Testing (Catholic Context)

  • Open the hosted chat page
  • Send: "What time is Mass on Sunday?"
  • Send: "I need to schedule my child's baptism"
  • Send: "When can I go to confession?"
  • Send: "What is RCIA?" (Rite of Christian Initiation of Adults)
  • Send: "Can you tell me about the Blessed Mother?"
  • Send: "I'm going through a divorce and feel lost"
  • Does the chatbot use Catholic terminology correctly?
    • "Mass" not "service"
    • "Sacraments" not "ordinances"
    • "Parish" not "church" (when contextually appropriate)
    • "Father" not "Pastor" for the priest
  • Does the theological lens work? (Pro tier should have denomination config)
  • Set the denomination to "Roman Catholic" in settings
  • Re-test the same questions — do responses improve?

Step 12 — Agents Check

  • How many agents are visible? (Pro should have more than Starter's 2)
  • Which agents? Care + Coordinator + ???
  • Can you configure agent behavior?

Part 3: CWA Voice Starter ($39.95/mo)

Step 13 — Voice Plan Addition

  • From the CWA dashboard, find the Upgrade tab
  • Can you add Voice to your existing Pro Chat plan?
  • OR does it require a new subscription? (Should be able to upgrade to a bundle)
  • What's the upgrade path shown?
  • If separate checkout needed, go to /pricing and select Voice Starter

Step 14 — Voice Checkout

  • Complete Stripe checkout for Voice ($39.95/mo)
  • Is it clear this is voice-only, separate from chat?
  • OR did you upgrade to a bundle? Note the pricing

Step 15 — Voice Dashboard

  • Does a "Calls" tab now appear in the dashboard?
  • Is there a phone number assigned?
  • Can you see call logs? (Empty, but should load)
  • Is there voice agent configuration?

Step 16 — Voice Testing (if phone number assigned)

  • Call the assigned number
  • Does it answer?
  • Say: "What time is Mass?"
  • Say: "I'd like to speak with Father Michael"
  • Say: "I need to talk to someone about a prayer request"
  • Does the voice agent use Catholic terminology?
  • Does it capture the prayer request?
  • Check the dashboard — does the call log appear? Prayer request captured?

Part 4: Cross-Product Verification

Step 17 — PewSearch ↔ CWA Connection

  • Go back to the PewSearch church detail page
  • Has the chatbot upgraded from basic to Pro? (Should reflect the CWA subscription)
  • Test the chatbot on PewSearch — does it use the FAQ you added?
  • Does the PewSearch admin show CWA subscription status?

Step 18 — Stripe Dashboard

  • How many subscriptions for this email? (Should be 2-3: PewSearch Premium + CWA Pro Chat + CWA Voice)
  • Are all active/trialing correctly?
  • Product names professional and clear?

Step 19 — Email Audit

  • How many emails did Father Michael receive total?
  • List each one: sender, subject, brand
  • Any confusing cross-branding? (PewSearch email mentioning CWA or vice versa)
  • MailerLite subscriber lists — correct segmentation?

Catholic-Specific Checks

These are unique to the Catholic persona and test theological sensitivity:

CheckExpectedActualPass?
"Mass" not "service" in AI responsesYes
Confession schedule handled correctlyYes
RCIA explained accuratelyYes
Marian references respectful and accurateYes
Sacrament terminology correctYes
"Father" title used (not "Pastor")Yes
Holy Days of Obligation mentioned when relevantYes
Catholic social teaching referenced appropriatelyYes
No Protestant framing of Catholic conceptsYes

Notes During Testing

StepWhat HappenedBug/Issue?Severity