What are ratings used for?
Use ratings to run multiple criteria evaluation to assess and compare alternatives such concepts, products, prototypes, logos, or strategies.
What is a multicriteria evaluation?
A multicriteria evaluation is a process used to evaluate and compare multiple alternatives based on a set of predefined criteria.
It involves scoring each alternative on each criterion and calculating a weighted score that reflects the overall performance or quality of the alternative based on the relative importance of each criterion.
The results of a multicriteria evaluation can be used to identify the best alternative or to prioritize alternatives based on specific needs and goals.
What is the weighted score?
In a multicriteria evaluation, the weighted score is a measure of the overall performance or quality of an alternative based on the scores it received on various evaluation criteria.
The weighted score is calculated by assigning weights to each criterion, which reflect the relative importance of the criterion in the evaluation.
The weighted score for each alternative is calculated by multiplying the average rating it received on each criterion by the weight of that criterion, and then summing the products. For example, if an alternative received a score of 4 out of 5 on criterion A (weighted 4), a score of 3 out of 4 on criterion B (weighted 3), and a score of 2 out of 3 on criterion C (weighted 3), its weighted score would be calculated as follows:
(4 x 4) + (3 x 3) + (2 x 3) = 16 + 9 + 6 = 31
The weighted scores of all alternatives can then be compared to determine the alternative with the highest overall performance.
How does rating work?
You can add as many criteria as needed and prioritize them by assigning different coefficients.
To ensure that evaluation results are not influenced by negative group biases, you can set up permissions wisely. For example, you can randomize the order of the cards, prevent participants from evaluating their own ideas, and hide other people's evaluations during the session.
Once participants have evaluated the cards individually, you can quickly display the results in the following ways:
- Assess the relative strength of each idea with the bubble chart
- Analyze the breakdown of the evaluations by criterion or by user for each card in detail
Some examples of evaluation criteria
By adding your own criteria, you can conduct multiple criteria evaluations for different contexts and purposes. For example:
- Evaluate new products with NUF (New, Useful, Feasible)
- Manage an innovation portfolio (Real, Win, Worth)
- Evaluate risks (Impact, Probability)
- Prioritize daily tasks (Urgency, Importance)
- Hire a new employee (Technical skills, Human skills, Experience, Fit with company)