Analytics: Dashboard Metrics Accuracy and Calculation
Property: ChurchWiseAI Category: Admin Dashboard
Tier:
pro-both
Persona: pastor-admin
Touchpoint: /admin/[token]/analytics
Preconditions
- Analytics dashboard deployed
- Test data with messages and contacts available
Steps
| # | Action | Expected Result |
|---|---|---|
| 1 | Check total messages today | Count matches actual chatbot messages sent today. Updated in real-time. |
| 2 | Check messages per hour chart | Hourly breakdown accurate. Peak hours show higher counts. X-axis shows 24-hour timeline. |
| 3 | Check top questions list | Most common visitor questions ranked. Counts match database. Most frequent first. |
| 4 | Check sentiment breakdown | Positive/Negative/Neutral messages categorized. Percentages add to 100%. Sample messages visible. |
| 5 | Check visitor/prayer request counts | Visitor count + Prayer count matches total contacts. No double-counting. |
| 6 | Check trending topics | Most asked topics ranked. Helps pastor understand congregational needs. |
| 7 | Verify date range filter | Can select date range. Metrics recalculate. Today/This Week/This Month presets work. |
| 8 | Check export to CSV | Can download analytics as CSV. Data matches dashboard. Useful for reports. |
Known Failure Modes
- Metrics don't match reality — pastor loses trust in data
- Sentiment wrong — AI classification inaccurate
- Missing recent data — analytics lag behind
- Double-counting contacts — inflated numbers
References
- Playwright spec:
e2e/journeys/admin-daily-dashboard.spec.ts - Code files:
Notes
Tests analytics accuracy. Pastors make decisions based on metrics (spend, content strategy, follow-up priorities). Wrong metrics = wrong decisions. Must verify counts, sentiment, trends, and export all match data sources.