ROI or ROE to evaluate your training courses?

Between ROI (Return On Investment), which promises reassuring figures, and ROE (Return On Expectations), which aims to capture qualitative transformation, training managers juggle metrics that are often insufficient to justify their spending. What if cognitive science were the key to measuring what really matters for decision-making?

Why traditional methods of measuring training ROI fail

Classic methods for evaluating the return on investment of training have major gaps. They promise a clarity that proves illusory given the complexity of how employees learn.

The limits of a purely financial approach

The traditional ROI formula ((benefits - costs) / costs × 100) looks simple in theory for assessing returns. In practice, it runs into the impossibility of isolating the direct effect of a training program on the company's overall performance.

Concrete example: A financial services company invested €80,000 in sales training and saw revenue increase by €300,000 the following quarter. But how do you separate the impact of the training from other factors such as seasonality, marketing campaigns or market trends? This difficulty often makes the traditional ROI calculation approximate.

Cognitive science research shows that the impact of learning often unfolds over the long term, which makes any immediate, purely financial ROI measurement obsolete.

The illusion of satisfaction indicators

Post-training questionnaires, the famous “happy sheets” used as a first level of evaluation, are perhaps the most widespread and least relevant metric. Studies show an almost non-existent correlation between employees' immediate satisfaction and the real impact on their skills.

This phenomenon is explained by what cognitive science calls the “illusion of mastery”: the subjective feeling of understanding a subject says nothing about the ability to apply it concretely on the job.

Learners can be perfectly satisfied with a training course without having made real progress in mastering the subject, which is a problem for sponsors and investors.

The trap of engagement metrics with no real impact

Completion rate, time spent on the platform or the number of modules viewed are all indicators that measure activity without guaranteeing real effectiveness for the training function.

An employee can spend hours on a traditional LMS without it translating into a real transformation of their professional practices or an improvement in their performance ratio.

Engagement does not guarantee learning, just as reading a manual does not guarantee acquiring a skill whose ROI can be measured.

💡 Good to know: Discover our complete article on the LMS and this tool will hold no secrets for you.

ROI and ROE: two complementary approaches to evaluating your training

Faced with the limits of traditional methods, two complementary concepts are emerging to assess the real impact of your training projects.

ROI (Return On Investment): measuring the financial impact

Definition and calculation

Training ROI is calculated using the rate-of-return formula: (Financial gains generated - Training costs) / Training costs × 100.

Its main advantage is that it translates training impact into language that CFOs and shareholders understand directly.

It makes it possible to compare different investments on a common basis, which supports annual budget trade-offs and the financial profitability of projects.

Application to training

In the context of training, costs include not only direct costs (purchasing the solution, average trainer cost) but also indirect costs (time learners spend in training).

Gains can include improved productivity, reduced losses or increased sales attributable to training, with precise tracking of these elements.

Methodologies such as those of Donald Kirkpatrick and Jack Phillips propose isolating the effect of training through triangulation and comparative analysis, which makes the ROI calculation easier.

Limits in the context of skills development

Financial ROI fails to capture intangible benefits such as a better social climate or talent retention, which are nonetheless essential to overall risk levels.

It tends to favor training with short-term impact over deeper transformations that take longer to show up in net results.

The real value of a skill for the company goes far beyond its immediate monetary translation.

ROE (Return On Expectations): valuing real transformation

Definition and principles

ROE focuses on meeting expectations defined upfront rather than on a financial calculation after the fact, which differs fundamentally from the traditional ROI approach.

This ROE method, developed in response to the limits of return on investment, puts transformation objectives at the center of the evaluation system.

It reflects a strategic vision in which training is a lever for developing human capital rather than a mere cost center.

Building expectations and objectives in from the start

Unlike ROI, which comes after the training, designing training with an ROE approach begins even before the learning path is defined.

It requires a precise definition of stakeholder expectations: learners, managers, leadership and end customers, in order to better assess the expected return.

This approach aligns training with measurable objectives that are truly relevant to the organization and its human assets.

Complementarity with ROI

Return on expectations does not replace return on investment but complements it by adding qualitative dimensions that are essential to any informed decision.

By clearly defining expectations, it paradoxically makes later quantitative measurement easier, so ROI can be calculated more accurately.

The combined approach gives a more complete and nuanced assessment of training impact, from both a financial and a skills development point of view.

The cognitive science and AI approach: measuring what really matters

Traditional methods fail because they ignore how the human brain actually learns. Combining cognitive science with educational AI finally provides a robust framework for evaluating and maximizing the effectiveness of training.

Indicators aligned with the human brain

Cognitive science distinguishes three critical levels of transformation:

1. Lasting memorization: Spacing, active retrieval and immediate feedback maximize retention, ensuring a better long-term ROI.
2. Practical application: The real measure is not “knowing that” (declarative knowledge) but “knowing how” (procedural knowledge). A relevant assessment measures the ability to transfer learning to authentic professional situations.
3. Behavior change: The ultimate indicator is an observable, lasting change in professional practices. These cumulative micro-changes produce the major evolution being sought.

How educational AI is revolutionizing impact measurement

Artificial intelligence turns these cognitive principles into powerful operational tools, finally enabling precise, continuous measurement of ROI.

Granular and predictive analysis

Didask's educational AI analyzes every interaction to:

• Precisely identify sticking points and progress made
• Reveal not only whether the objective is reached, but how
• Predict the likely impact of a training program based on identified patterns of success
• Adjust learning paths in real time to maximize effectiveness

Automatic personalization: the real ROI multiplier

Automatic personalization based on each learner's specific needs:

• Reduces the time needed to build skills by 40%
• Increases the on-the-job application rate by 35% on average
• Generates an ROI 3 to 5 times higher than standardized approaches

Practical guide: concrete tools to measure the impact of your training

Beyond theoretical concepts, implementation requires specific tools and methods. Here is how to turn these principles into measurable actions.

Take a pragmatic approach: an approximate ROI is better than no measurement

Faced with real-world constraints, training managers often give up on measuring rather than adopting an imperfect but workable approach. This puts at risk the ability to demonstrate the value of training.

A pragmatic approach is needed: start with simple indicators and gradually enrich your evaluation system. Even an imperfect evaluation helps you continuously improve your programs.

Indicators to track: from basic to advanced

These basic indicators, although imperfect, give immediate feedback on the training experience. However, a participant can enjoy a session without necessarily changing their professional practices. That is why it is crucial to progressively enrich these metrics with behavioral indicators.

The complete cost checklist: capturing the real investment

An accurate ROI calculation starts with an exhaustive assessment of the investment. Beyond the explicit invoices, hidden costs often account for up to 60% of the real cost of training.

Differences by delivery mode

In-person: recurring costs (travel, rooms, trainers). Digital: concentrated initial investment, then near-zero marginal cost. Considerable economies of scale in digital (ROI grows with the number of learners).

The before/after method: isolating the real impact of training

To measure impact precisely, the “before/after” technique remains essential, but it requires a rigorous methodology.

Methodological principles:

• Create assessments that are comparable but not identical (to avoid memorization bias)
• Include control questions on areas not covered by the training
• Use triangulation to isolate the training effect from other variables

In practice:

1. Pre-test: Assessment of initial skills one week before the training
2. Immediate post-test: Measurement of acquisition right after the training
3. Control questions: 20% of questions outside the program to detect the placebo effect
4. Differential analysis: Comparison of progress between trained and untrained areas

This technique, drawn from Jack Phillips' models, makes it possible to calculate the net impact of training and establish a more precise ROI.

Fighting forgetting: the Ebbinghaus curve and cold evaluations

The dramatic effect of forgetting on your ROI

The Ebbinghaus forgetting curve shows an alarming reality: without intervention, we lose up to 80% of acquired information within a week. After 48 hours, 75% has already disappeared. This cognitive reality invalidates any ROI calculation based solely on immediate evaluations.

Strategies to maximize retention and ROI:

• Cold evaluations: Tests at 1, 3 and 6 months after training
• Spaced repetition: Micro-reviews scheduled using the Leitner algorithm
• Smart flashcards: Adaptive questions based on previous errors
• Immediate application: Practice within 72 hours of learning

These techniques not only measure the true effectiveness of training but also strengthen it, creating double value for the organization.

Micro-challenges: turning learning into professional habits

Designing measurable post-training application challenges turns passive learning into observable behavior change.

The Didask AI assistant: a unique revealer of real impact

Didask's educational AI assistant offers a unique window into how knowledge is applied after training. Unlike generic chatbots, this intelligent assistant draws on cognitive science to support the concrete application of skills.

Warning signals to watch for in the questions asked:

• Same questions repeated by several learners (= gap in the training)
• Requests for clarification on notions assumed to be acquired
• Low use of the assistant on critical modules
• Gap between theoretical knowledge and practical application questions
• Questions revealing fundamental misunderstandings

This usage data reveals learners' real needs in the field and guides the necessary educational adjustments, creating a continuous ROI improvement loop.

ROI calculator: estimate the potential impact of your training with Didask

5 steps to implement a transformative ROI measurement

1. Define the expected behavior changes
   • Identify observable and quantifiable behaviors
   • Involve managers and learners in the definition
   • Create a chain of evidence between training and business results
2. Build in strategic measurement points
   • Before training: skills baseline
   • During: engagement and progress
   • Immediately after: knowledge acquisition
   • After 1, 3 and 6 months: on-the-job application and retention
3. Collect data methodically
   • Automate collection through the platform
   • Mix quantitative (scores, time) and qualitative (feedback, observations) data
   • Use the AI assistant as a sensor of real usage
4. Analyze and calculate the real ROI
   • Isolate the training effect from other variables
   • Value both tangible and intangible gains
   • Compare against the initial objectives (ROE)
5. Optimize continuously
   • Adjust content based on the data
   • Reinforce the weak points identified
   • Communicate successes to secure future budgets

Conclusion

ROI or ROE? The real question is not choosing between these two approaches but transcending them to measure what really matters: the effective transformation of professional behaviors and its impact on business results. Cognitive science now gives us the keys to understand and optimize human learning mechanisms, while educational artificial intelligence makes it possible to operationalize this knowledge at scale.

At Didask, we have developed a unique approach that combines cognitive science expertise with cutting-edge technology to guarantee not only a measurable return on investment but a real transformation of skills. Stop settling for training whose impact remains unclear or questionable. Adopt an approach grounded in scientific evidence to maximize every euro invested in developing your talent and improve the overall performance of your human capital.