Analytics & Dashboard
Monitor HolyQA performance and understand your congregation's engagement patterns.
Dashboard Overview
Analytics Timeline
Your HolyQA dashboard provides insights into how your congregation engages with your content. Analytics are most useful after HolyQA has been live for at least a week.
Access Your Analytics
View detailed analytics and performance metrics in your dashboard.
View Dashboard →Dashboard Sections
Your HolyQA dashboard is organized into specialized tabs, each providing specific insights and functionality:
📊 Analytics Tab
Comprehensive performance and engagement analytics with visual charts and metrics.
- • Question volume and trends
- • Response time performance
- • Content type distribution
- • Search quality metrics
- • Most asked topics
- • Daily activity patterns
🔧 Website Integration Tab
Configure and test your website embed with live preview functionality.
- • Live embed preview testing
- • Widget, iframe, and fullpage options
- • Customization settings
- • Ready-to-copy integration code
💳 Billing & Usage Tab
Monitor your plan usage and manage subscription settings.
- • Q&A Credits
- • Sermon library capacity
- • Overage tracking and billing
- • Plan upgrade options
📁 Content Management Tab
Upload, manage, and organize your church content for HolyQA.
- • File uploads (PDF, audio, video, text)
- • YouTube video and playlist integration
- • Website content indexing
- • Content processing status tracking
- • Content organization and deletion
Analytics Metrics
Your dashboard provides comprehensive insights into HolyQA's performance and your congregation's engagement:
Response Time
How quickly HolyQA responds to questions (measured as time to first byte)
Success Rate
Percentage of questions answered successfully without errors
Search Quality
Answer quality ratings and response success rates
Questions Asked
Total and monthly question counts from your congregation
Daily Activity
Question patterns and peak usage times
Content Performance
Which content types are most referenced
Testing Before Deployment
Before adding HolyQA to your website, use the dashboard's built-in preview functionality to test your configuration:
Live Preview Testing
The Website Integration tab includes a live preview that lets you test all embed types and configurations before deploying to your website.
- Navigate to the Website Integration tab in your dashboard
- Select your preferred embed type (widget, iframe, or fullpage)
- Customize appearance and behavior settings
- Use the live preview to test functionality
- Ask test questions to verify responses and citations
- Copy the generated code once satisfied with the configuration
Benefits of Preview Testing
- Verify HolyQA responds correctly to questions about your content
- Test different embed types to find the best fit for your website
- Ensure customization settings match your church's branding
- Confirm mobile responsiveness and user experience
- Avoid integration issues by testing before deployment
Understanding Your Analytics
Interpreting Performance Metrics
Response Time Performance
Measures how quickly HolyQA begins responding to questions. Under 3 seconds is excellent, under 5 seconds is good. Higher times may indicate system load or complex queries.
Search & Response Quality
Shows how well HolyQA finds relevant content and answers questions. Includes Answer Quality ratings (Excellent/Good/Fair/Needs Improvement), success rates for finding helpful responses, and response style indicators (Concise/Detailed/Comprehensive).
Content Type Distribution
Shows the breakdown of your uploaded content (YouTube, audio, video, PDF, text). Balanced content types often provide better coverage for diverse questions.
Actionable Insights
- Upload more content on frequently asked topics shown in "Most Asked Topics"
- Review content that gets low search quality scores
- Monitor daily activity patterns to understand congregation engagement
- Use token usage metrics to understand response complexity and costs
Q&A Alert Notifications
Stay informed when users ask questions to your AI assistant with customizable email alerts.
How It Works
Configure Q&A alert notifications in your dashboard to receive emails when congregation members ask questions. Choose between instant alerts or batched notifications to match your preferred notification style.
Configuration Options
Alert Frequency
- Instant: Receive an email immediately after each question
- Batch: Receive an email after a specified number of questions (e.g., every 10 questions)
Email Settings
- Recipients: Add multiple email addresses (comma-separated)
- Default: If no emails specified, alerts go to your account email
- Content: Each alert includes the question and AI response
Alert Email Contents
- User's question text (verbatim)
- AI assistant's complete response
- Timestamp of when the question was asked
- For batch alerts: Total number of questions in the batch
- Quick link to view all analytics in your dashboard
💡 Best Practices
- Use instant alerts for low-traffic churches or when immediate awareness is important
- Use batch alerts (10-20 questions) for high-traffic churches to avoid email overload
- Configure multiple recipients (pastor, admin staff) for redundancy
- Review alerts to identify common questions and improve your content
Weekly Usage Reports
HolyQA automatically sends comprehensive weekly email reports every Monday with detailed usage analytics and billing information.
Report Contents
Usage Summary
- Q&A Credits (current vs. limit)
- Sermon library capacity usage
- Overage amounts and charges
- Billing period information
Activity Metrics
- Questions this month and week
- Daily average question volume
- Success rate and response performance
- Most asked topics and active days
Content Analysis
- Total content items and word count
- Content type breakdown (YouTube, video, audio, PDF, text)
- Processing status and performance
Performance Data
- Average response times
- System reliability metrics
- Error rates and success statistics
Report Settings
Weekly reports are sent to your account email address every Monday morning. These reports are mandatory and cannot be unsubscribed from as they contain essential billing and usage information required for account management.
Important Notice
Weekly reports include critical billing information, usage alerts, and overage notifications. These emails are required for all accounts to ensure transparency in usage and billing. Make sure to check your email regularly and whitelist emails from HolyQA.
Usage Monitoring
Plan Limits Overview
Monitor your plan usage through the Billing & Usage tab to stay within limits and plan for growth:
- Q&A credits: Monthly Q&A allowance (soft limit with overage billing)
- Sermon Library: Total number of sermons and content items uploaded (hard limit)
- Total Words: Word count across all your uploaded content
Sermon Library Explained
Each piece of content you upload (YouTube video, PDF, audio file, etc.) counts as one sermon in your library. Your plan limit is the total number of sermons you can store. Purchase a Sermon Boost add-on (+200 sermons) if you need more capacity.
Usage Monitoring Best Practices
- Check the Billing & Usage tab regularly to monitor sermon library capacity
- Plan content uploads to stay within your sermon limits
- Monitor Q&A credit trends to predict overage charges
- Consider upgrading before reaching limits to avoid service interruption
- Use analytics to optimize content strategy within your plan limits
Need Help?
If you're experiencing issues or have questions, we're here to help.
Documentation
Check our troubleshooting guide for common solutions
When contacting support, please include your church name and a detailed description of the issue.