Pastor Configures Chatbot Personality + Knowledge Base

  Property: ChurchWiseAI   Category: Admin Dashboard Tier: any-chat Persona: pastor-admin Touchpoint: /admin/[token] (Training + Agents tabs)

Preconditions

• Active chatbot subscription (any chat tier)
• Logged in as church admin
• Onboarding complete

Steps

#	Action	Expected Result
1	Navigate to Training tab	Response templates list loads, existing entries visible
2	Add a new response template: Q='What time is Sunday service?' A='We meet at 10am'	Template saved, appears in list immediately
3	Navigate to Agents tab	Available agents shown based on tier (2 for Starter, 4 for Pro)
4	Edit Care Agent persona — set custom name and greeting	Changes saved, previewed in agent card
5	Navigate to Knowledge Base tab	KB entries list loads
6	Add a KB entry about the church's food pantry ministry	Entry saved and indexed for RAG retrieval
7	Test chatbot: ask about food pantry	Chatbot returns the newly added KB info in its response
8	Test chatbot: ask the service time question	Custom response template returned verbatim

Known Failure Modes

• Template not returned by chatbot — RAG or template matching broken
• KB entry not showing in responses — vector indexing failure
• Agent persona changes not persisting — DB write failure
• Pro agents showing on Starter tier — entitlement bug

References

• Playwright spec: e2e/delivers/churchwiseai/06-chatbot-config.spec.ts
• Code files:
  • src/app/admin/[token]/
  • src/app/api/admin/kb-proxy/
  • src/app/api/admin/agents/
  • src/app/api/chatbot/stream/route.ts

Notes

This is the core retention loop — pastors who configure their chatbot stay. KB entries go to unified_rag_content (327K rows — NEVER bulk delete). Response templates are in organization_settings or a separate table.