Graybar and Mobile Coach conducted a study to measure the effectiveness of chatbot-driven training reinforcement. The goal was to assess how a chatbot could help participants of the Navigating Your Career e-learning course retain key concepts and take meaningful career development actions after completing the training.
Study Design
Participants in the Navigating Your Career course were divided into two groups:
- Test Group: Received chatbot follow-ups for 8 weeks post-training.
- Control Group: Did not receive chatbot support.
At the end of the 8-week period, both groups were surveyed to measure knowledge retention and career actions taken based on course content. A follow-up survey was also conducted at 12 weeks to assess sustained engagement.
Key Findings
1. Chatbot Users Were More Likely to Create Development Plans
- Test Group: 11.67% of participants created a development plan.
- Control Group: Only 2.5% created a development plan.
Insight: Participants with chatbot support were nearly 5 times more likely to develop a formal career plan.
2. Increase in Development Item Completion
- Test Group: 10% completed at least one development item.
- Control Group: 7.5% completed a development item.
Insight: The chatbot group had a modest increase in completing career-related tasks, though the effect was smaller than in structured planning.
3. Greater Engagement in Career Development Over Time
- Test Group: 31.67% made updates to their career development plan
- Control Group: 25% made updates.
Insight: Chatbot users were 26% more likely to continue their career development activities beyond the initial training period.
Conclusions
This study demonstrates that chatbot-based training reinforcement significantly improves structured career planning and sustained engagement in professional development. While both groups took some career actions, the chatbot’s greatest impact was in helping participants formalize and sustain their growth efforts. Organizations looking to enhance training effectiveness may benefit from chatbot-driven reinforcement to boost post-training engagement and action-taking.
Career Actions Data
Test Group | Yes | No |
Has Development Plan | 11.67% | 88.33% |
Has Development Item | 10.00% | 90.00% |
Has Update Since 5/1/24 | 31.67% | 68.33% |
Control Group | Yes | No |
Has Development Plan | 2.50% | 97.50% |
Has Development Item | 7.50% | 92.50% |
Has Update Since 5/1/24 | 25.00% | 75.00% |
Get a Demo
Learn how Mobile Coach’ chatbot platform will help you drive real engagement with your audience to achieve the key behaviors and results you want.
