Various Risk Metrics


Decision Tree Software gives you a plethora of metrics for a decision tree. You can choose the metric you want to see in the Options analyzer carousel. Say, you have created the following decision tree.

Sample decision tree used throughout the Risk Metrics topic to demonstrate how different metrics (expected value, standard deviation, semi-variance and others) are computed.

Now, if you expand the Options Analyzer tab, you will see you can choose lots of metrics to display in the chart and the metric table.

Options Analyzer tab expanded with the list of selectable metrics (expected value, standard deviation, entropy, value at risk and more) for the chart carousel and metric table.

The metrics are made available based on the decision context. For example, if a decision tree does not contain any uncertainty (chance node) then uncertainty/risk-related metrics will not be visible in the Metric selection panel.

Usually, the following metrics are available to display in the metric table and charts carousel.

Expected Value

The expected value is the metric calculated by the following formula.

Mathematical formula for expected value as the sum of each outcome X multiplied by its probability P(X).

Where X is a Random variable that represents each outcome and P(X) is the probability of that outcome. For example, if you have the following decision tree,

Two-investment decision tree with tooltips showing Investment A expected value of 600 dollars (50/50 chance of 1000 or 200) and Investment B expected value of 400 dollars (50/50 chance of 500 or 300).

the Expected value of Investment A is EV = 0.5 * 1000$ + 0.5 * 200$ = 600$

The expected value chart shows the metrics as shown below.

Expected Value chart in the Options Analyzer carousel comparing the expected values of the two investments from the sample decision tree.

Most Likelihood Value

The most likelihood value is the value that has the highest probability to occur. In a decision tree as shown below, for Investment B, the most likely value is the Worst Case outcome because, in the chance node, the Worst case has the highest probability (0.8) among all events within that chance node.

Decision tree illustrating the most likelihood value metric: for Investment B the worst-case outcome carries the highest probability (0.8) so it is reported as the most likely value.

Standard Deviation

A standard deviation is a measure that indicates how the values of an uncertain outcome are different. For example, in class A, if the students' exam scores are 50, 58, 55, 52, then we can say that their scores are very similar and variation is very low. On the other hand, in a class named class B, if the students' exam scores are 10, 100, 70, 40 then we can say there is very high variation among the scores. The average score of class B is 55. The average score of class A is 53.75. If we just compare the average, we will think that class A is doing better. But, looking into the score of class B, we can see that class B is actually consistent and all students are performing almost similarly. If the low variation is important for you, then only the average won't give you the correct picture. You need a metric that can tell you how the values are dispersed. Standard Deviation is the metric that can tell you that.

When the outcomes are uncertain, we call the outcome a Random variable. The standard deviation of random variable X is often written as σ or σx.

For a discrete random variable the standard deviation is calculated by the following formula:

Mathematical formula for standard deviation showing the square root of the probability-weighted sum of squared deviations from the expected value.

Here, x is a Random outcome, and P(X = x) is the probability of the random outcome x. E(X) is the expected value.

Semi-Variance

Semi-variance as a measure of risk is formally defined as:

Formula for semi-variance as a downside risk measure: probability-weighted sum of squared shortfalls below the aspiration level A.

Where xis a random outcome, P(xi) is the probability of the outcome xi. A is a threshold constant such that payoff less than A would be considered as a failure. For example, you might have an aspiration level for getting a certain salary when choosing a job. If a job pays less than a certain amount as a salary, you will not even think about that job offer. How to set your aspiration level in the Decision Tree software? You can open the Payoff popup and double-click the Criteria to open the objective editor.

Payoffs popup with the right-click context menu open on the profit objective showing an Edit command, used to open the objective editor and set an aspiration level.

Once the objective editor is opened, you can set your aspiration level like this:

Objective editor dialog with the Aspiration Level field filled in, defining the threshold below which payoffs count as a shortfall for semi-variance and other downside metrics.

Please note that,

  1. The Aspiration level can be set only for the Number and Monetary type objectives.
  2. If the aspiration level is not set, then the Decision Tree software will consider the Expected Value to be the aspiration level and it will calculate the semi-variance using the Expected value as the aspiration level.
  3. If you have more than one objective, then naturally every objective may have its own aspiration level. Then, it is not meant to calculate a Semivariance based on any single aspiration level, right? Therefore, the decision tree software will use the Expected Value (or Expected Utility) to be the aspiration level and the semi-variance will be calculated based on that Expected value as the aspiration level.

Maximum Regret

Maximum regret is the metric that indicates, if you choose an option, at maximum how much you can regret by not choosing other options. It is discussed in detail on the Decision Criteria page.

Baumol's Risk Measure

William Baumol purposes the following Risk Index:

Baumol's Risk Index formula: expected value minus k times the standard deviation, where k is derived from the chosen significance level.

Where E is the Expected value, σ is the standard deviation, and k is some constant selected by the investor representing his/her safety requirement such that the return is unlikely to fall below it. In the decision tree software, the "k" is calculated from an input named "significance level". This significance level is the same concept used in the 'Value at Risk' calculation.

Chebycheff's inequality:

The probability of a payoff below E - k .σ is bounded by 1/k2

Therefore, the value of k can be calculated based on the significance level. The software will ask your significance level α in the Carousel when you select Baumol's Risk measure metric.

Significance level input field used by Decision Tree Analyzer to compute k for Baumol's Risk Measure and to set the confidence level for Value at Risk.

Roy's safety first rule

According to A.D. Roy, investors are mainly concerned with avoiding the possibility of "disaster". Roy proposed that risk is measured in terms of the probability that the future outcome will be lower than a threshold (aspiration level) level. Roy's risk index is defined as follows:

Roy's safety-first rule formula expressing risk as the probability that the future outcome falls below the aspiration level d.

Where 'd' is the aspiration level? In the section on the "Semi Variance" metric, we have explained how to set the aspiration level for an objective.

Objective editor with the aspiration level filled in, the same input used to enable Roy's safety-first risk metric in the Options Analyzer.

Once you set the aspiration level, you will see the metric "Roy's safety first rule" available in the metrics panel.

Entropy

When you watch a movie, if you can predict the sequence of events, then you do not feel any suspense and eventually, do not enjoy the movie, right? How do you measure the suspense of a movie? You will say, the less you can predict, the more suspense you will feel. Right?

That is the idea of Entropy. Entropy is a metric that measures how little you can predict from random variable outcomes. "Probability" measures how likely one uncertain state can occur. And Entropy measures the degree of uncertainties in a Random variable. In another word, it measures the level of surprise. A Uniform Probability Distribution has the highest entropy because every possible outcome in that distribution has an equal chance to happen so you will always be in suspense with a uniform probability distribution. But what about a Normal Distribution? Using a normal distribution, outcomes are highly predictable around the Mean, so a Normal Probability distribution has lower entropy than a uniform probability distribution.

Named after Boltzmann's Η-theorem, Shannon defined the entropy Η of a discrete random variable X as

Shannon entropy formula: negative sum of P(x) times log base b of P(x) over all possible outcomes, measuring unpredictability of a random variable.

Where b is the base of the logarithm used. In the Decision Tree Software, you can change the base as "e", "2" or "10" by changing the unit as nat, Shannon, or Hart.

Entropy chart with the unit dropdown open showing Shannon, nat, and Hart, so the logarithm base used in the entropy formula can be switched. Bars show Action 1 at 0.83 Shannon and Action 2 at 0.33 Shannon.

There is a dropdown you can see in the Entropy Chart panel. 

Dropdown in the Entropy chart panel offering Payoff Variation or Event Variation, controlling whether identical-payoff events are grouped before computing entropy.

What do these options mean? Ok, think about the following decision tree,

Sample decision tree used to demonstrate entropy: Investment 1 has three events but two share the same  outcome, so the effective number of payoff outcomes is two.

In this tree, We see that, for Investment 1, there is a total of 3 events, where two of them give you the same outcome, 220$. So, if you are concerned about the actual revenue outcome, then you have basically two uncertainties, 180$ or 220$, not 3. Right? Therefore, if you select "Payoff Variation", then the software will group the events based on final outcome and consider an event different from another if the final outcome is different. As we see, there are basically two events, 180$ event and 220$, based on final outcome. So, the entropy will be calculated, based on this fact. But, say, you do not worry about the final outcome, rather, you are concerned, about how many events can occur, then, there are 3 events. You can select the option "Event variation". You will see the software will calculate entropy based on considering 3 outcomes. 

Let's see the calculation result in the Entropy panel.

Entropy chart in Payoff Variation mode: with two distinct payoff outcomes ( and ), Decision Tree Analyzer reports 0.72 Shannon entropy.

When there are two outcomes, (based on payoff variation), the entropy is calculated as 0.72 Shanon.

Now, let's change the dropdown selection to Event variation. 

Entropy chart in Event Variation mode where each event counts separately even when payoffs coincide, producing a higher entropy figure than the payoff variation view.

So, it makes sense, right? When you considered only 2 outcomes, you had higher predictability. You knew the outcome will be either 180$ or 220$. So, you had less suspense compared to when you had to worry about 3 outcomes. When using "Event Variation", the number of outcomes is considered based on the name of the event, not the final payoff. So, naturally, you will be in more suspense if you consider 3 outcomes rather than 2 outcomes. 

Value at Risk

Value at Risk expressed as VaR(α) is a common risk index used by practitioners and in particular by financial institutions. It is defined as the maximum dollar amount expected to be lost at a pre-defined confidence level. In the Decision Tree software, you can choose to display the Value at Risk metric from the metrics panel. Then the chart in the carousel will let you set a level of confidence or significance level (α) as shown below.

Value at Risk metric displayed in Decision Tree Analyzer, showing the maximum dollar loss at the chosen significance level for each compared option.

Range Chart

A Range chart shows the Minimum Possible value and the Maximum Possible value of an option as a range. Looking at the range chart, a decision maker can quickly understand the risks and expectations, and then he/she can choose an option based on Maximin/Leximin criterion. The Range chart also helps the decision maker to understand the dominance among options. Which option dominates another option either deterministically or stochastically.

Range chart plotting the minimum and maximum possible payoff for each option as a range, helping a decision maker compare worst case and best case side by side.


Last updated on Feb 13, 2022