Reports and Analytics¶

Complete Guide to Reporting, Analytics, and Data Insights in PulseLMS¶

This comprehensive guide covers all reporting capabilities, analytics features, and data logging in PulseLMS. Learn how to monitor learner progress, generate insights, and make data-driven decisions about your learning programs.

Table of Contents¶

Overview of Reporting
Course Reports
Logs Report
Live Logs
Activity Report
Course Participation Report
Course Completion Report
Activity Completion Report
Competency Breakdown
Statistics Report
Site-Wide Reports
Site Logs
Site Live Logs
Performance Overview
Security Overview
Config Changes
Spam Cleaner
Course Overview Statistics
Learning Analytics
Analytics Overview
Analytics Models
Students at Risk
Insights and Predictions
Custom Reports
Logging System
Standard Log Store
Database Log Store
Log Retention
Privacy and Logs
Report Interpretation
Best Practices

Overview of Reporting¶

Why Reporting Matters¶

Effective reporting and analytics in PulseLMS enable you to:

Monitor Progress - Track learner advancement through courses
Identify Issues - Spot struggling students before they fall behind
Measure Engagement - Understand how users interact with content
Ensure Compliance - Document completion for regulatory requirements
Improve Content - Use data to enhance course design
Demonstrate ROI - Prove the value of training initiatives

Types of Reports¶

PulseLMS offers several categories of reports:

Category	Scope	Primary Users
Course Reports	Individual course data	Instructors, Course Managers
Site Reports	Platform-wide data	Administrators
Analytics	Predictive insights	Administrators, Managers
Custom Reports	User-defined queries	Power Users, Administrators

Accessing Reports¶

Course-Level Reports: 1. Navigate to your course 2. Click on Reports in the course navigation menu 3. Select the desired report type

Site-Level Reports: 1. Go to Site Administration 2. Navigate to Reports section 3. Choose the appropriate report

Common Report Features¶

Most PulseLMS reports share these capabilities:

Feature	Description
Filtering	Narrow results by date, user, activity, etc.
Sorting	Order results by any column
Pagination	Navigate through large result sets
Export	Download data in various formats
Print	Generate printer-friendly versions

Export Formats¶

PulseLMS supports multiple export formats:

Format	Extension	Best For
CSV	.csv	Spreadsheet analysis, data import
Excel	.xlsx	Microsoft Excel users
ODS	.ods	LibreOffice users
PDF	.pdf	Formal reports, printing
JSON	.json	API integration, developers
HTML	.html	Web viewing, email embedding

Course Reports¶

Course reports provide detailed insights into activity within a specific course. These reports are essential for instructors and course managers to understand learner engagement and progress.

Logs Report¶

The Logs Report is the most comprehensive record of all activities within a course. Every user action is recorded and can be reviewed.

Accessing the Logs Report¶

Enter your course
Go to Reports > Logs
Configure filters as needed
Click Get these logs

Available Filters¶

Filter	Options	Description
Participant	All participants, specific user	Filter by user
Date	All days, specific date	Filter by date
Activity	All activities, specific activity	Filter by activity
Actions	All actions, View, Add, Update, Delete	Filter by action type
Origin	Web, CLI, WS (web services), Restore	Filter by access method
IP Address	Specific IP	Filter by client location
Educational level	Teaching, Participating, Other	Filter by context

Log Entry Details¶

Each log entry contains:

Field	Description	Example
Time	When the action occurred	Jan 15, 2026, 2:30 PM
User full name	Who performed the action	John Smith
Affected user	User impacted (if applicable)	Jane Doe
Event context	Where it happened	Quiz: Final Exam
Component	System component	Quiz
Event name	Specific action	Quiz attempt started
Description	Detailed narrative	The user with id '42' started quiz...
Origin	Access method	Web
IP address	Client IP	192.168.1.100

Common Log Queries¶

Finding when a specific student accessed content: 1. Select the student from Participant dropdown 2. Set Activity to the specific content 3. Set Actions to "View" 4. Click Get these logs

Tracking grade changes: 1. Select the student (or all participants) 2. Set Actions to "Update" 3. Look for "Grade" in the Event name column

Auditing quiz attempts: 1. Set Activity to the specific quiz 2. Look for these events: - Quiz attempt started - Quiz attempt submitted - Quiz attempt reviewed - Grade item updated

Exporting Logs¶

Configure your filters
Click Get these logs
At the bottom of the results, click Download table data as
Select your preferred format
The file will download to your device

Log Interpretation Examples¶

Example 1: Verifying Assignment Submission

Time: Jan 15, 2026, 11:59 PM
User: Sarah Johnson
Event: A submission has been submitted
Context: Assignment: Research Paper
Origin: Web
IP: 203.45.67.89

This confirms Sarah submitted her assignment at the deadline.

Example 2: Tracking Course Access

Time: Jan 16, 2026, 8:00 AM
User: Michael Brown
Event: Course viewed
Context: Course: Introduction to Marketing
Origin: Web
IP: 10.0.0.15

This shows Michael accessed the course from an internal network.

Example 3: Identifying Potential Issues

Time: Jan 16, 2026, 3:00 AM
User: Unknown User
Event: Login failed
Context: System
Origin: Web
IP: 45.123.45.67

Multiple failed logins from the same IP may indicate a security concern.

Live Logs¶

Live Logs provide real-time monitoring of course activity, automatically refreshing to show the latest actions.

Accessing Live Logs¶

Enter your course
Go to Reports > Live logs
Watch the live feed (refreshes every 60 seconds)

Features¶

Feature	Description
Auto-refresh	Updates every 60 seconds automatically
Real-time view	See activity as it happens
Pause/Resume	Stop auto-refresh for detailed review
User filtering	Focus on specific participants

Use Cases¶

During Exams: - Monitor quiz activity in real-time - Verify all students have started - Watch for unusual patterns

Live Virtual Sessions: - Track attendance - Monitor resource access during sessions - Verify participation

System Maintenance: - Identify active users before maintenance - Monitor system after updates - Check for error patterns

Live Logs Display¶

Each entry shows: - Time of action - User name (linked to profile) - Action performed - Activity or resource affected - IP address

Interpretation Tips¶

Normal Patterns: - Sequential activity times - Appropriate content access - Expected user locations

Concerning Patterns: - Rapid successive actions (possible automation) - Access from unexpected locations - Unusual hours of activity - Multiple failed attempts

Activity Report¶

The Activity Report provides a summary of views and interactions for each activity and resource in your course.

Accessing the Activity Report¶

Enter your course
Go to Reports > Activity report
View the comprehensive activity summary

Report Columns¶

Column	Description
Activity	Name of the activity or resource
Views	Total number of times viewed
Related blog entries	Associated blog posts
Last access	Most recent view date/time

Understanding Views¶

What counts as a view: - Opening a page or resource - Accessing a quiz (before starting) - Viewing an assignment description - Accessing a forum

What doesn't count as a view: - Appearing in course listings - Seeing activity in navigation - Cached page loads

Using the Activity Report¶

Identifying Popular Content: - High view counts indicate engaging content - Use to determine which resources are most valuable - Helps prioritize content updates

Finding Unused Resources: - Zero or low view counts suggest: - Content may be poorly positioned - Students may not understand its importance - Content may need better introduction

Tracking Recent Activity: - Last access column shows currency - Old dates may indicate abandoned content - Helps identify stale materials

Example Activity Report Analysis¶

Activity                    Views    Last Access
---------------------------------------------------
Course Introduction         245      Jan 16, 2026 8:00 AM
Syllabus                    198      Jan 16, 2026 7:45 AM
Week 1 Lecture Notes        412      Jan 16, 2026 9:30 AM
Week 1 Quiz                 187      Jan 15, 2026 11:59 PM
Week 1 Discussion Forum     356      Jan 16, 2026 10:15 AM
Supplementary Reading       23       Jan 5, 2026 2:00 PM
Video: Introduction         89       Jan 14, 2026 4:30 PM

Insights from this data: - Week 1 materials are actively used - Supplementary Reading has low engagement (consider promoting it) - Discussion Forum has high engagement (social learning working) - Video might benefit from promotion or repositioning

Course Participation Report¶

The Course Participation Report shows which students have (or haven't) participated in specific activities.

Accessing the Participation Report¶

Enter your course
Go to Reports > Course participation
Configure filters
Click Show report

Filter	Options	Purpose
Activity module	All activities, specific type	Focus on assignment, quiz, etc.
Look back period	Days (1-365)	Time frame to analyze
Roles	Student, Teacher, etc.	Which users to include
Groups	All groups, specific group	Filter by group membership
Actions	Post, View	Type of participation

Report Output¶

The report displays: - User name (clickable to profile) - Action count (number of times participated) - Participation indicator (Yes/No based on threshold)

Use Cases¶

Tracking Discussion Participation: 1. Set Activity module to "Forum" 2. Set Actions to "Post" 3. Set Look back to desired period 4. Identify students who haven't posted

Monitoring Assignment Views: 1. Set Activity module to "Assignment" 2. Set Actions to "View" 3. Find students who haven't viewed assignment instructions

Identifying Inactive Students: 1. Set Activity module to specific required content 2. Set Look back to course duration 3. Contact students with no participation

Sending Messages to Non-Participants¶

The participation report includes messaging capabilities:

Generate the report
Select users who haven't participated (checkboxes)
Click With selected users...
Choose Send a message
Compose and send reminder

Example Participation Analysis¶

Scenario: Forum Discussion Due Weekly

Configure report: - Activity module: Forum - Look back: 7 days - Roles: Student - Actions: Post

Results:

Student Name          Posts    Participated?
----------------------------------------------
Alice Williams        3        Yes
Bob Thompson          0        No
Carol Martinez        2        Yes
David Lee             0        No
Emma Brown            5        Yes

Action: Select Bob and David, send reminder about discussion requirement.

Course Completion Report¶

The Course Completion Report provides a comprehensive overview of completion status for all enrolled students.

Accessing the Report¶

Enter your course
Go to Reports > Course completion
View the completion matrix

Prerequisites¶

Before using this report: 1. Enable completion tracking in course settings 2. Configure course completion criteria 3. Set activity completion for relevant activities

Report Columns¶

Column	Description
Name	Student name (linked to profile)
Email	Student email address
Activity columns	One column per tracked activity
Course complete	Overall completion status
Completion date	When course was completed

Completion Indicators¶

Symbol	Meaning
Green checkmark	Completed
Blue circle	In progress
Red X	Not completed/Failed
Gray dash	Not yet started
Clock icon	Pending manual completion

Filtering Options¶

Filter	Description
First name	Filter by name initial
Surname	Filter by surname initial
Group	Filter by course group
Show inactive	Include suspended users

Sorting Options¶

Click any column header to sort: - Name (alphabetical) - Any activity (by completion status) - Course complete (by status) - Date (by completion date)

Exporting Completion Data¶

Generate the desired report view
Click Download at the bottom
Select format:
Excel spreadsheet
CSV file
ODS file
Save to your device

Interpreting Completion Data¶

High Completion Rate (>90%): - Course requirements are clear - Content is accessible - Support systems are working

Medium Completion Rate (70-90%): - Some students may need additional support - Review completion criteria difficulty - Check for technical barriers

Low Completion Rate (<70%): - Investigate common failure points - Survey students about challenges - Consider course redesign - Review completion criteria

Manual Completion Override¶

Teachers can manually complete activities for students:

Find the student in the report
Click on the incomplete activity cell
Choose Complete or Incomplete
Optionally add a note

Use cases: - Evidence submitted outside LMS - Technical issues prevented tracking - Accommodations required

Activity Completion Report¶

The Activity Completion Report focuses specifically on individual activity completion across all students.

Accessing the Report¶

Enter your course
Go to Reports > Activity completion
View the completion status matrix

Report Structure¶

The report displays a matrix with: - Rows: Students enrolled in the course - Columns: All activities with completion tracking enabled - Cells: Completion status for each student/activity combination

Completion Status Icons¶

Icon	Status	Description
Empty checkbox	Not complete	Activity not yet completed
Checked box (gray)	Completed manually	Student self-marked complete
Checked box (green)	Completed automatically	System determined complete
Checked box (blue tick)	Completed with pass	Achieved passing grade
Checked box (red tick)	Completed but failed	Completed but below pass mark

Filtering the Report¶

By Group: - Select a specific group from dropdown - View only group members

By First Name: - Filter by first name initial - Useful for large courses

By Surname: - Filter by surname initial - Helps locate specific students

Understanding Activity Types¶

Different activities show completion differently:

Quizzes: - Complete = Submitted attempt - Pass = Achieved passing grade - Fail = Below passing threshold

Assignments: - Complete = Submission made - Pass = Passing grade received - Fail = Failing grade received

Resources (Pages, Files): - Complete = Viewed/Accessed

Forums: - Complete = Posted reply (if configured) - Or viewed (if view completion)

Bulk Editing Completion¶

Check boxes next to student names
Click With selected users...
Choose bulk action:
Mark complete
Mark incomplete
Reset completion

Exporting Activity Completion¶

Click the download button and select: - Comma separated values (CSV) - Microsoft Excel (XLSX) - OpenDocument Spreadsheet (ODS)

Common Use Cases¶

Pre-Meeting Review: Before student advising meetings, review completion status to understand progress.

Identifying Struggling Students: Sort by completion count to find students behind pace.

Compliance Documentation: Export completion data for regulatory audits.

Grading Verification: Confirm all activities completed before final grades.

Competency Breakdown¶

The Competency Breakdown report shows how students are progressing toward defined competencies through course activities.

Understanding Competencies¶

Competencies in PulseLMS represent skills or knowledge that learners should develop. They: - Are defined at the site or course level - Link to learning plans - Connect to activities that evidence achievement - Can have rating scales (Not competent, Competent, Proficient)

Accessing the Report¶

Enter your course
Go to Reports > Competencies
View the competency breakdown

Report Components¶

Summary View: - Total competencies in course - Number linked to activities - Average proficiency across learners

Detail View: - Individual student competency ratings - Evidence activities - Rating history

Competency Rating Scale¶

Rating	Description
Not yet competent	Has not demonstrated competency
Competent	Meets minimum requirements
Proficient	Exceeds expectations
Not yet rated	Awaiting assessment

Filtering Options¶

Filter	Purpose
Competency	Focus on specific competency
Student	View individual progress
Rating	Filter by competency level
Time period	Historical analysis

Evidence Tracking¶

For each competency, view: - Activities that provide evidence - Date evidence was generated - Type of evidence (grade, completion, etc.) - Who rated the competency

Manual Competency Rating¶

Instructors can manually rate competencies:

Click on a student's competency
Select the new rating
Add a note explaining the rating
Save the rating

Exporting Competency Data¶

Generate the desired view
Click Export
Select format
Download the file

Integration with Learning Plans¶

Competency progress integrates with: - Site-wide learning plans - Individual development plans - Certification requirements - Career pathways

Statistics Report¶

The Statistics Report provides numerical analysis of course activity over time.

Accessing Statistics¶

Enter your course
Go to Reports > Statistics
Select report parameters
View or generate report

Prerequisites¶

Statistics must be enabled: 1. Site Administration > Server > Statistics 2. Enable statistics 3. Set processing schedule 4. Wait for initial processing

Report Parameters¶

Parameter	Options
Report type	Logins, Activity, User enrollments
Time period	Daily, Weekly, Monthly
Roles	All, Students, Teachers, etc.
Display format	Table, Chart, Both

Available Statistics¶

Logins: - Total logins over period - Unique logins per day/week/month - Peak login times - Login trends

Views: - Total content views - Views by activity type - Views per user - View patterns

Posts: - Forum posts over time - Assignment submissions - Quiz attempts - Collaborative activity

Interpreting Statistics¶

Login Patterns:

Day        Logins    Unique Users
-----------------------------------
Monday     245       89
Tuesday    312       102
Wednesday  287       95
Thursday   298       98
Friday     156       67
Saturday   45        23
Sunday     78        34

Insights: - Peak activity mid-week - Significant drop on weekends - Consider assignment due dates affecting patterns

Graphical Representation¶

Statistics can be displayed as: - Line graphs (trends over time) - Bar charts (comparisons) - Tables (detailed numbers)

Exporting Statistics¶

Generate desired statistics
Click Export
Choose format (CSV, Excel, ODS)
Download for further analysis

Best Practices¶

Regular Review: - Check weekly for trends - Compare to previous periods - Identify anomalies early

Action on Insights: - Low engagement = outreach needed - Peak times = optimal communication - Declining trends = investigate cause

Site-Wide Reports¶

Site-wide reports provide administrators with platform-level visibility into all system activity.

Site Logs¶

Site Logs capture every action across the entire PulseLMS platform.

Accessing Site Logs¶

Go to Site Administration
Navigate to Reports > Logs
Configure filters
Click Get these logs

Filter Options¶

Filter	Description
Course	All courses, specific course, site level
Participant	All users, specific user
Date	All days, specific date
Activity	All activities, specific type
Actions	Create, Read, Update, Delete
Education level	Teaching, Participating, Other
Origin	Web, CLI, Web services, Restore
IP Address	Specific IP or range

Site-Level Events¶

Events captured at site level include: - User authentication (login/logout) - User account changes - Role assignments - System configuration changes - Plugin activities - Scheduled task execution - Web service calls

High-Value Site Log Queries¶

Failed Login Attempts: 1. Set Course to "Site" 2. Set Actions to "Failed" 3. Look for authentication events

Administrative Actions: 1. Set Participant to admin user 2. Set Date range of interest 3. Review all administrative activity

Course Creation/Deletion: 1. Set Course to "All courses" 2. Set Actions to "Create" or "Delete" 3. Filter for course-related events

Security Monitoring¶

Use site logs to monitor: - Unauthorized access attempts - Privilege escalation - Data export activities - Bulk operations - Configuration changes

Exporting Site Logs¶

Apply desired filters
Generate the log view
Click Download table data as
Select format (CSV, Excel, ODS, JSON)
Save for archival or analysis

Site Live Logs¶

Site Live Logs provide real-time monitoring of all platform activity.

Accessing Site Live Logs¶

Go to Site Administration
Navigate to Reports > Live logs
Watch the auto-refreshing feed

Features¶

Feature	Description
Real-time updates	Refreshes every 60 seconds
All site activity	Includes all courses and site-level
Course filter	Focus on specific course
Pause capability	Stop refresh for detailed review

Use Cases¶

During Major Events: - Organization-wide training launches - Important exam periods - System updates or migrations

Troubleshooting: - Investigating reported issues - Monitoring after configuration changes - Verifying system functionality

Security Monitoring: - Watching for suspicious activity - Monitoring during security events - Real-time incident response

Performance Overview¶

The Performance Overview report helps administrators monitor system health and performance.

Accessing Performance Overview¶

Go to Site Administration
Navigate to Reports > Performance overview
Review the dashboard

Metrics Displayed¶

Server Metrics: | Metric | Description | Healthy Range | |--------|-------------|---------------| | Load average | CPU utilization | < 0.7 per core | | Memory usage | RAM utilization | < 80% | | Disk space | Storage availability | > 20% free | | Database connections | Active DB sessions | Within pool limit |

Application Metrics: | Metric | Description | Healthy Range | |--------|-------------|---------------| | Page load time | Average response | < 3 seconds | | Cache hit rate | Cache effectiveness | > 90% | | Database query time | DB responsiveness | < 100ms avg | | Active sessions | Concurrent users | Within license |

Performance Warnings¶

The system displays warnings for: - High CPU or memory usage - Low disk space - Slow database queries - Cache misses - Failed background tasks

Interpreting Performance Data¶

Slow Page Loads: Possible causes: - Database optimization needed - Caching not configured - Too many complex activities - External resource delays

High Memory Usage: Possible causes: - Too many concurrent users - Memory leak in plugin - Insufficient server resources - Large file processing

Database Issues: Possible causes: - Missing indexes - Large log tables - Complex reports running - Backup in progress

Actions from Performance Data¶

Issue	Action
Slow queries	Review and optimize database
Low cache hit	Increase cache size, review configuration
High load	Consider load balancing
Disk space low	Archive logs, clean temp files

Security Overview¶

The Security Overview provides insights into the security status of your PulseLMS installation.

Accessing Security Overview¶

Go to Site Administration
Navigate to Reports > Security overview
Review the security status

Security Checks¶

Check	Description	Status
Register globals	PHP security setting	Should be Off
Data directory location	Ensure outside web root	Critical
https/http	Secure connection status	Should be HTTPS
Default admin username	Generic username risk	Should be changed
Guest access	Guest login availability	Review policy
Open user profiles	Profile visibility	Review policy
Debug messages	Error display to users	Should be Off
Backup location	Backup file security	Should be secure
Cron password	Web-based cron security	Should be set
User password policy	Password requirements	Should be strong
Email change confirmation	Email verification	Should be enabled
Cookie prefix	Session security	Should be unique

Security Status Indicators¶

Status	Meaning
OK (Green)	Meets security standards
Info (Blue)	Informational, review recommended
Warning (Yellow)	Potential security concern
Critical (Red)	Immediate attention required

Acting on Security Findings¶

For each issue, the report provides: - Description of the risk - Recommendation for resolution - Link to relevant configuration

Priority Resolution Order: 1. Critical (Red) items immediately 2. Warning (Yellow) items this week 3. Info (Blue) items scheduled review

Config Changes¶

The Config Changes report tracks all modifications to system settings.

Accessing Config Changes¶

Go to Site Administration
Navigate to Reports > Config changes
Review the change history

Report Contents¶

Field	Description
Date	When the change occurred
User	Who made the change
Plugin	Affected component
Setting	Configuration item changed
Old value	Previous setting
New value	Current setting

Filtering Options¶

Filter	Purpose
Date range	Focus on specific period
User	Track specific admin's changes
Plugin	Focus on component
Setting	Track specific setting

Use Cases¶

Change Auditing: - Track who changed what - Document configuration history - Support compliance requirements

Troubleshooting: - Identify when problems started - Correlate with configuration changes - Rollback guidance

Documentation: - Maintain configuration change log - Support change management processes - Training for new administrators

Example Config Change Log¶

Date                User           Plugin      Setting         Old        New
-------------------------------------------------------------------------------
Jan 15, 2026 10:00  admin          core        forcelogin      0          1
Jan 15, 2026 10:15  admin          auth_ldap   host            ldap1      ldap2
Jan 14, 2026 14:30  sitemanager    enrol_self  defaultenrol    0          1
Jan 14, 2026 09:00  admin          core        backup_auto     0          1

Exporting Config Changes¶

Set desired filters
Click Download
Select format
Save for records

Spam Cleaner¶

The Spam Cleaner helps identify and remove spam content from user profiles and course content.

Accessing Spam Cleaner¶

Go to Site Administration
Navigate to Reports > Spam cleaner
Configure search parameters

Search Parameters¶

Parameter	Description
Search text	Keywords to find
Fields to search	Description, First name, URL, etc.
Account age	New accounts only
Profile completeness	Minimal profiles

Common Spam Indicators¶

Indicator	Description
Promotional URLs	Links to external sites
Generic text	Boilerplate spam content
New account	Created recently with no activity
Incomplete profile	Minimal legitimate information
Known spam words	Typical spam terminology

Cleaning Actions¶

For identified spam profiles:

Review - Examine the profile for legitimacy
Delete Profile Data - Remove profile information
Delete User - Remove the account entirely
Suspend User - Disable without deletion

Safety Measures¶

Before mass deletion: - Review a sample manually - Confirm no false positives - Consider suspension first - Document actions taken

Preventing Spam¶

Configuration recommendations: - Require email verification - Enable CAPTCHA - Limit profile editing for new users - Moderate new user content

Course Overview Statistics¶

Course Overview Statistics provide aggregate data about all courses on the platform.

Accessing Course Statistics¶

Go to Site Administration
Navigate to Reports > Course overview
Review the statistics

Statistics Available¶

Enrollment Statistics: | Metric | Description | |--------|-------------| | Total enrollments | All user-course relationships | | Active enrollments | Currently enrolled users | | Completed courses | Users who completed | | Average enrollment | Users per course |

Course Statistics: | Metric | Description | |--------|-------------| | Total courses | All courses on platform | | Active courses | Courses with recent activity | | Visible courses | Publicly listed courses | | Hidden courses | Not visible to students |

Activity Statistics: | Metric | Description | |--------|-------------| | Total activities | All activities across courses | | Average per course | Activities per course | | By type | Breakdown by activity type |

Category Breakdown¶

View statistics by course category: - Number of courses per category - Enrollments per category - Completions per category - Activity levels

Time-Based Analysis¶

Compare statistics across periods: - This month vs. last month - This quarter vs. last quarter - Year-over-year comparison

Exporting Overview Data¶

Generate the desired view
Click Export
Select format
Download for analysis

Learning Analytics¶

PulseLMS includes a powerful learning analytics engine that uses data to predict and improve learning outcomes.

Analytics Overview¶

What is Learning Analytics?¶

Learning analytics uses data about learners and learning contexts to: - Understand learning patterns - Predict outcomes - Intervene proactively - Improve course design

Key Concepts¶

Term	Definition
Model	Algorithm that analyzes data patterns
Indicator	Data point that signals behavior
Insight	Actionable finding from analysis
Prediction	Forecast of likely outcome
Target	What the model predicts (e.g., completion)

Analytics Flow¶

Data Collection → Model Processing → Insights Generated → Actions Taken
      ↓                 ↓                   ↓                  ↓
   Logs            Calculations        Notifications       Intervention
   Grades          Predictions         Reports             Support
   Activity        Risk Scores         Alerts              Outreach

Accessing Analytics¶

For Administrators: 1. Site Administration > Analytics 2. Configure models and settings

For Instructors: 1. Course > Reports > Insights 2. View predictions and recommendations

For Students: 1. Dashboard > Learning analytics 2. View personal insights (if enabled)

Analytics Models¶

Analytics models are the engines that process data and generate predictions.

Built-in Models¶

Students at Risk of Dropping Out: - Predicts students likely to abandon course - Based on engagement patterns - Triggers early intervention

No Teaching: - Identifies courses without instructor activity - Helps quality assurance - Ensures student support

Upcoming Activities Due: - Reminds about approaching deadlines - Reduces missed submissions - Improves completion rates

Model Components¶

Each model consists of:

Component	Description
Target	What to predict
Indicators	Data points analyzed
Time splitting	How time is segmented
Predictions processor	What to do with predictions

Understanding Indicators¶

Cognitive Depth: - Measures depth of engagement - Submission > View > No action - Weighted by activity type

Social Breadth: - Measures social engagement - Forum posts, comments, peer reviews - Collaborative activities

Activities Due: - Upcoming deadlines - Overdue items - Completion status

Grades: - Current standing - Grade trends - Comparison to peers

Model Training¶

Models improve over time: 1. Collect initial data 2. Make predictions 3. Observe actual outcomes 4. Adjust algorithms 5. Improve accuracy

Model Configuration¶

Administrators can configure: - Which models are enabled - Sensitivity thresholds - Who receives insights - How often models run - What actions trigger

Creating Custom Models¶

Advanced administrators can create custom models:

Go to Site Administration > Analytics > Analytics models
Click Create new model
Select target and indicators
Configure time splitting
Set up predictions processor
Save and enable

Students at Risk¶

The Students at Risk prediction model identifies learners who may struggle or drop out.

How It Works¶

The model analyzes: - Login frequency - Activity completion rate - Grade trends - Forum participation - Resource access patterns - Time spent in course

Risk Indicators¶

Indicator	Weight	Description
No login (1 week)	High	Haven't accessed course
Declining grades	High	Grades trending down
Missing assignments	High	Overdue submissions
Low completion	Medium	Behind on activities
No forum posts	Low	Not participating socially
Minimal time	Medium	Short session durations

Risk Levels¶

Level	Description	Action
High risk	Very likely to drop out	Immediate outreach
Medium risk	Showing warning signs	Proactive support
Low risk	Some concerning patterns	Monitor closely
No risk	On track	Standard support

Viewing At-Risk Students¶

For Instructors: 1. Go to course > Reports > Insights 2. View list of at-risk students 3. See specific risk factors 4. Access contact information

For Administrators: 1. Site Administration > Reports > Insights 2. View site-wide at-risk students 3. Filter by course, category, cohort

Taking Action¶

For each at-risk student:

Review Details - Understand specific concerns
Check History - Look at recent activity
Reach Out - Send personalized message
Offer Support - Provide resources or assistance
Document - Record intervention
Follow Up - Monitor for improvement

Insight Actions¶

When viewing an insight: - Useful - Confirm the insight was helpful - Not useful - Provide feedback - Dismiss - Mark as addressed - Contact student - Send direct message

Measuring Effectiveness¶

Track intervention outcomes: - Did outreach occur? - Did student respond? - Did behavior change? - Did student complete?

Insights and Predictions¶

Insights are actionable notifications generated by analytics models.

Accessing Insights¶

Dashboard Widget: The Insights block shows recent insights requiring attention.

Insights Page: 1. Navigate to course or site 2. Go to Reports > Insights 3. View all pending insights

Insight Structure¶

Each insight contains: | Field | Description | |-------|-------------| | Student | Who the insight is about | | Prediction | What the model predicts | | Confidence | How certain the prediction is | | Time range | When prediction applies | | Actions | Suggested interventions |

Confidence Levels¶

Confidence	Meaning
Very high	>90% certainty
High	70-90% certainty
Medium	50-70% certainty
Low	<50% certainty

Managing Insights¶

Bulk Actions: 1. Select multiple insights 2. Choose action: - Mark as useful - Mark as not useful - Dismiss all - Send bulk message

Individual Actions: 1. Click on insight for details 2. Review prediction data 3. Take appropriate action 4. Mark insight status

Insight Notifications¶

Configure who receives insight notifications: - Course teachers - Course managers - Site administrators - Specific users

Notification methods: - PulseLMS messages - Email - Mobile push (if app enabled)

Tracking Outcomes¶

After actioning insights: 1. Record what action was taken 2. Monitor student progress 3. Compare predicted vs. actual outcome 4. This data improves model accuracy

Custom Reports¶

Custom reports allow you to create tailored reports beyond standard offerings.

Report Builder Overview¶

The Report Builder enables: - Selecting data sources - Choosing columns - Applying filters - Setting conditions - Scheduling reports - Sharing with others

Accessing Report Builder¶

Go to Site Administration
Navigate to Reports > Report builder
Create or edit reports

Creating a Custom Report¶

Step 1: Basic Settings 1. Click New report 2. Enter report name 3. Add description 4. Select primary data source

Step 2: Choose Columns Available columns depend on data source: - User fields (name, email, ID, custom fields) - Course fields (name, category, dates) - Enrollment data - Completion data - Grade data - Log data

Step 3: Apply Filters Add filters to narrow results: - Date ranges - Specific users or roles - Course categories - Completion status - Custom field values

Step 4: Set Conditions Conditions always apply (vs. user-adjustable filters): - Only active users - Only visible courses - Specific time periods

Step 5: Configure Output - Set default sorting - Limit results - Choose display format

Example Custom Reports¶

Example 1: Completion by Department

Data source: User enrollments
Columns: Department, Course Name, Completed, Completion Date
Filters: Date range, Category
Conditions: Status = Active
Group by: Department

Example 2: Instructor Activity Summary

Data source: Course activities
Columns: Teacher Name, Course, Activities Created, Last Activity
Filters: Date range
Conditions: Role = Teacher
Sort: Last Activity (descending)

Example 3: Overdue Assignments

Data source: Assignment submissions
Columns: Student, Course, Assignment, Due Date, Status
Filters: Course category
Conditions: Status = Not submitted, Due < Today
Sort: Due Date (ascending)

Scheduling Reports¶

Automate report generation:

Open your custom report
Click Schedule
Configure:
Frequency (daily, weekly, monthly)
Time to run
Recipients
Format (CSV, Excel, PDF)
Save schedule

Access Level	Description
Private	Only you can see
Course	Visible to course teachers
Category	Visible to category managers
System	Visible to all administrators

Report Dashboard¶

Create a report dashboard: 1. Select frequently used reports 2. Add to dashboard 3. View multiple reports in one place 4. Refresh on demand

Logging System¶

The logging system is the foundation of all reporting in PulseLMS. Understanding how logs work helps you effectively use reports.

Standard Log Store¶

The Standard Log Store writes events to the database for immediate querying.

How It Works¶

User Action → Event Triggered → Log Entry Created → Stored in Database

Each event capture includes: - Timestamp - User ID - Course context - Event type - Additional data

Configuring Standard Log¶

Go to Site Administration
Navigate to Plugins > Logging > Manage log stores
Enable/disable Standard log
Configure settings

Settings¶

Setting	Description	Recommendation
Buffer size	Events before write	50-100
Buffer write interval	Seconds between writes	30
JSON format	Extra data format	Enable

Event Types¶

Category	Examples
Core	Login, logout, course view
Course	Enrolled, completed, reset
Activity	Submission, attempt, grade
User	Profile update, message sent
System	Task run, cache cleared

Querying the Standard Log¶

Standard logs are queried through: - Reports interface - Custom reports - Direct database queries (advanced)

Database Log Store¶

The Database Log Store provides additional logging capabilities for legacy event storage.

Differences from Standard Log¶

Feature	Standard Log	Database Log
Event format	New event system	Legacy event system
Flexibility	More extensible	Basic logging
Performance	Optimized	Heavier
Recommended	Yes	Only if needed

When to Enable¶

Enable Database Log when: - Third-party plugins require it - Legacy reports depend on it - Transitioning from older version

Configuration¶

Go to Plugins > Logging > Manage log stores
Enable Database log
Configure retention settings

Log Retention¶

Log retention policies balance compliance needs with storage constraints.

Setting Retention Period¶

Go to Site Administration
Navigate to Plugins > Logging > Manage log stores
For each log store, set retention period

Retention Options¶

Period	Use Case
Never delete	Full compliance requirements
1 year	Standard retention
6 months	Moderate retention
3 months	Minimal retention
1 month	Storage constrained

Compliance Considerations¶

Before setting retention: - Check regulatory requirements - Review organizational policies - Consider audit needs - Document decisions

Storage Impact¶

Estimate storage needs:

Daily events × Days retained × Average event size = Storage needed

Example:
10,000 events/day × 365 days × 500 bytes = ~1.8 GB/year

Archival Options¶

Before deleting old logs: 1. Export to external storage 2. Compress archived data 3. Store securely off-platform 4. Document archive location

Cleanup Process¶

When retention triggers: 1. Scheduled task identifies old logs 2. Logs older than threshold are deleted 3. Database space is reclaimed 4. Deletion is logged

Privacy and Logs¶

Logs contain personal data and must be handled according to privacy regulations.

Personal Data in Logs¶

Logs may contain: - User identifiers - IP addresses - Activity timestamps - Content accessed - Grades and submissions

Under GDPR and similar regulations: - Logs are personal data - Users have right to access - Users may request deletion - Retention must be justified

Privacy and Performance Settings¶

Go to Site Administration
Navigate to Users > Privacy and policies
Configure data retention
Set up data requests handling

Handling Data Requests¶

Subject Access Requests: 1. User requests their data 2. Administrator generates export 3. Logs are included in export 4. Provide to user

Deletion Requests: 1. User requests deletion 2. Evaluate against retention policy 3. Delete where permitted 4. Document exceptions

Anonymization¶

When full deletion isn't possible: - Replace user ID with placeholder - Remove IP addresses - Maintain aggregate data - Document anonymization

Audit Trail Considerations¶

Some logs must be retained for: - Security investigations - Compliance audits - Legal requirements - Dispute resolution

Document which logs are exempt from deletion requests.

Report Interpretation¶

Understanding how to interpret reports is as important as knowing how to generate them.

Reading Completion Data¶

Completion Metrics¶

Metric	Calculation	Good Value
Completion rate	Completed / Enrolled × 100	>80%
Average time to complete	Sum of completion times / Completed	Varies by course
Dropout rate	(Started - Completed) / Started × 100	<20%

Cohort Analysis¶

Compare completion across: - Departments - Roles - Time periods - Course categories - Enrollment methods

Identifying Issues¶

Low Completion Rate: - Check for bottleneck activities - Review activity completion data - Survey incomplete learners - Analyze dropout timing

High Variability: - Look for group differences - Check for technical issues - Review access patterns

Understanding Engagement Metrics¶

Engagement Indicators¶

Indicator	What It Shows
Login frequency	Platform engagement
Time in course	Content engagement
Activity completion	Progress
Forum participation	Social engagement
Resource downloads	Self-directed learning

Engagement Benchmarks¶

Level	Logins/Week	Activities/Week	Forum Posts/Week
High	5+	10+	3+
Medium	2-4	5-9	1-2
Low	1	1-4	0
None	0	0	0

Acting on Engagement Data¶

Engagement Level	Action
None	Immediate outreach
Low	Supportive check-in
Medium	Encouragement
High	Recognition

Analyzing Log Data¶

Common Log Patterns¶

Healthy Activity:

Regular logins (2-3x weekly)
Sequential content access
Quiz attempts after study
Steady progress

Concerning Activity:

Long gaps between logins
Skipping foundational content
Multiple failed quiz attempts
Irregular patterns

Log Analysis Techniques¶

Frequency Analysis: - Count events per user - Identify outliers - Compare to averages

Sequence Analysis: - Review event order - Check for expected paths - Identify shortcuts or loops

Timing Analysis: - Calculate session durations - Identify peak times - Look for unusual hours

Creating Actionable Insights¶

From Data to Action¶

1. Observation: 30% of students haven't started Module 3
2. Analysis: Module 2 quiz has 45% failure rate
3. Hypothesis: Module 2 quiz is a barrier
4. Action: Review quiz difficulty, provide remediation
5. Measure: Track completion after changes

Communicating Findings¶

When sharing reports: - Lead with key findings - Provide context - Include visualizations - Recommend actions - Set follow-up dates

Best Practices¶

Report Generation¶

Choosing the Right Report¶

Need	Report
Who did what when	Logs
Real-time activity	Live logs
Content popularity	Activity report
Student progress	Completion reports
Skill development	Competency breakdown
Predictions	Analytics insights

Efficient Report Use¶

Start with questions - Know what you're looking for
Use filters - Narrow to relevant data
Export wisely - Only download what you need
Document findings - Record insights for future reference
Act on data - Reports are valuable only if actioned

Report Scheduling¶

Report	Frequency	Audience
Completion summary	Weekly	Instructors
At-risk students	Daily	Instructors
Site statistics	Monthly	Administrators
Security overview	Weekly	Administrators
Config changes	Daily	Administrators

Data Quality¶

Ensuring Accurate Reports¶

Enable tracking - Completion must be configured
Verify settings - Check all activities have completion
Test logging - Confirm events are captured
Clean data - Remove test accounts and courses

Common Data Issues¶

Issue	Cause	Solution
Missing completion	Tracking disabled	Enable in course settings
No log data	Log store disabled	Enable log stores
Inaccurate counts	Test data included	Filter or clean test data
Old data	No retention policy	Set appropriate retention

Privacy and Security¶

Report Access Control¶

Configure who can access what:

Role	Access Level
Student	Own data only
Teacher	Course students
Course Manager	Category courses
Administrator	All data

Sensitive Data Handling¶

Minimize exposure - Only share necessary data
Anonymize when possible - Remove identifiers for aggregate reports
Secure exports - Protect downloaded files
Document access - Track who accessed what

Compliance Checklist¶

Before sharing reports: - [ ] Is access authorized? - [ ] Is data minimized? - [ ] Is the purpose legitimate? - [ ] Is transmission secure? - [ ] Is retention defined?

Continuous Improvement¶

Using Reports to Improve¶

Course Improvement Cycle:

1. Analyze completion data
2. Identify problem areas
3. Gather learner feedback
4. Make improvements
5. Measure impact
6. Repeat

Platform Improvement Cycle:

1. Review site statistics
2. Identify usage patterns
3. Optimize configuration
4. Add needed features
5. Monitor results

Benchmarking¶

Track key metrics over time: - Completion rates by quarter - Login frequency trends - Support ticket volumes - Page load times - User satisfaction scores

Report Templates¶

Create templates for common needs: - Weekly instructor dashboard - Monthly management summary - Quarterly compliance report - Annual program review

Troubleshooting Reports¶

Common Issues¶

Reports Show No Data¶

Possible causes: 1. Completion tracking not enabled 2. Log stores disabled 3. Filter settings too restrictive 4. No activity in time period 5. Permissions insufficient

Solutions: 1. Enable completion in course settings 2. Enable log stores in Site Administration 3. Clear filters and try again 4. Expand date range 5. Check user role and permissions

Reports Are Slow¶

Possible causes: 1. Large date range 2. All-user query 3. Database not optimized 4. Statistics not calculated

Solutions: 1. Narrow date range 2. Filter to specific users or groups 3. Schedule for off-peak times 4. Ensure cron runs regularly

Completion Not Updating¶

Possible causes: 1. Completion conditions not met 2. Cron not running 3. Cache needs clearing 4. Activity completion not set

Solutions: 1. Review completion requirements 2. Verify cron schedule 3. Purge caches 4. Configure activity completion

Export Failed¶

Possible causes: 1. Report too large 2. Timeout occurred 3. Permissions issue 4. Disk space low

Solutions: 1. Apply filters to reduce size 2. Increase timeout settings 3. Check file permissions 4. Free disk space

Getting Help¶

If you encounter persistent issues: 1. Check error logs 2. Review system requirements 3. Test with minimal configuration 4. Document reproduction steps 5. Contact system administrator

Summary¶

PulseLMS provides comprehensive reporting and analytics capabilities to help you:

Monitor learner progress with completion reports
Track all activity with detailed logs
Predict outcomes with learning analytics
Analyze engagement with activity reports
Secure your platform with security reports
Audit changes with configuration logs

Effective use of reports enables data-driven decisions that improve learning outcomes and organizational training effectiveness.

Quick Reference¶

Report Access Locations¶

Report	Location
Course Logs	Course > Reports > Logs
Live Logs	Course > Reports > Live logs
Activity Report	Course > Reports > Activity report
Participation	Course > Reports > Course participation
Completion	Course > Reports > Course completion
Site Logs	Site Admin > Reports > Logs
Security	Site Admin > Reports > Security overview
Analytics	Site Admin > Analytics

Export Format Quick Guide¶

Format	Best For
CSV	Spreadsheet analysis
Excel	Microsoft Excel users
ODS	LibreOffice users
PDF	Formal documentation
JSON	Developer integration

Key Metrics Quick Reference¶

Metric	Target	Warning
Completion rate	>80%	<60%
Login frequency	Weekly	Monthly
Activity completion	>90%	<70%
At-risk students	<10%	>25%

Next: Backup and Restore

Previous: Site Configuration