Analytics & Dashboard

Dashboard Overview

Your HolyQA dashboard provides insights into how your congregation engages with your content. Analytics are most useful after HolyQA has been live for at least a week. View detailed analytics and performance metrics in your dashboard.

Dashboard Sections

Your HolyQA dashboard is organized into specialized tabs, each providing specific insights and functionality:

Analytics Metrics

Your dashboard provides comprehensive insights into HolyQA's performance and your congregation's engagement:

Testing Before Deployment

Before adding HolyQA to your website, use the dashboard's built-in preview functionality to test your configuration. The Website Integration tab includes a live preview that lets you test all embed types and configurations before deploying to your website.

1. Navigate to the Website Integration tab in your dashboard
2. Select your preferred embed type (widget, iframe, or fullpage)
3. Customize appearance and behavior settings
4. Use the live preview to test functionality
5. Ask test questions to verify responses and citations
6. Copy the generated code once satisfied with the configuration

Benefits of Preview Testing

• Verify HolyQA responds correctly to questions about your content
• Test different embed types to find the best fit for your website
• Ensure customization settings match your church's branding
• Confirm mobile responsiveness and user experience
• Avoid integration issues by testing before deployment

Understanding Your Analytics

Interpreting Performance Metrics

Response Time Performance

Measures how quickly HolyQA begins responding to questions. Under 3 seconds is excellent, under 5 seconds is good. Higher times may indicate system load or complex queries.

Search & Response Quality

Shows how well HolyQA finds relevant content and answers questions. Includes Answer Quality ratings (Excellent/Good/Fair/Needs Improvement), success rates for finding helpful responses, and response style indicators (Concise/Detailed/Comprehensive).

Content Type Distribution

Shows the breakdown of your uploaded content (YouTube, audio, video, PDF, text). Balanced content types often provide better coverage for diverse questions.

Actionable Insights

• Upload more content on frequently asked topics shown in "Most Asked Topics"
• Review content that gets low search quality scores
• Monitor daily activity patterns to understand congregation engagement
• Use token usage metrics to understand response complexity and costs

Q&A Alert Notifications

Stay informed when users ask questions to your AI assistant with customizable email alerts. Configure Q&A alert notifications in your dashboard to receive emails when congregation members ask questions. Choose between instant alerts or batched notifications to match your preferred notification style.

Configuration Options

Alert Frequency

• Instant: Receive an email immediately after each question
• Batch: Receive an email after a specified number of questions (e.g., every 10 questions)

Email Settings

• Recipients: Add multiple email addresses (comma-separated)
• Default: If no emails specified, alerts go to your account email
• Content: Each alert includes the question and AI response

Alert Email Contents

• User's question text (verbatim)
• AI assistant's complete response
• Timestamp of when the question was asked
• For batch alerts: Total number of questions in the batch
• Quick link to view all analytics in your dashboard

Best Practices

• Use instant alerts for low-traffic churches or when immediate awareness is important
• Use batch alerts (10-20 questions) for high-traffic churches to avoid email overload
• Configure multiple recipients (pastor, admin staff) for redundancy
• Review alerts to identify common questions and improve your content

Weekly Usage Reports

HolyQA automatically sends comprehensive weekly email reports every Monday with detailed usage analytics and billing information.

Report Contents

Usage Summary

• Q&A Credits (current vs. limit)
• Sermon library capacity usage
• Overage amounts and charges
• Billing period information

Activity Metrics

• Questions this month and week
• Daily average question volume
• Success rate and response performance
• Most asked topics and active days

Content Analysis

• Total content items and word count
• Content type breakdown (YouTube, video, audio, PDF, text)
• Processing status and performance

Performance Data

• Average response times
• System reliability metrics
• Error rates and success statistics

Report Settings

Weekly reports are sent to your account email address every Monday morning. These reports are mandatory and cannot be unsubscribed from as they contain essential billing and usage information required for account management.

Usage Monitoring

Plan Limits Overview

Monitor your plan usage through the Billing & Usage tab to stay within limits and plan for growth:

• Q&A credits: Monthly Q&A allowance (soft limit with overage billing)
• Sermon Library: Total number of sermons and content items uploaded (hard limit)
• Total Words: Word count across all your uploaded content

Each piece of content you upload (YouTube video, PDF, audio file, etc.) counts as one sermon in your library. Your plan limit is the total number of sermons you can store. Purchase a Sermon Boost add-on (+200 sermons) if you need more capacity.

Usage Monitoring Best Practices

• Check the Billing & Usage tab regularly to monitor sermon library capacity
• Plan content uploads to stay within your sermon limits
• Monitor Q&A credit trends to predict overage charges
• Consider upgrading before reaching limits to avoid service interruption
• Use analytics to optimize content strategy within your plan limits