Model and Analyze Markov Chain and Markov Decision Process.

Video Demonstration for Rational Will

Your policy-maker at hand.

Model Markov Decision Process with the modern and intuitive wizard

Markov Decision Process from SpiceLogic offers a very rich modeling application. It starts with a wizard that captures all the necessary information from you to create the model.
Markov Decision Process Transition Probabilities

Automatically generates a policy decision graph based on your input.

Know what action to take in a situation from this decision graph.
Markov Decision Graph

Visual Interface for all Markov Decision Process parameters

Notice how the transition matrix and state reward can be set from the visual graphical interface. The policy and Markov chain is calculated and displayed at the same time.
Markov Decision Process

Use Multi-Criteria attributes to model the reward of a state.

SpiceLogic Markov Decision Process offers a rich wizard user interface for identifying multiple objectives/criteria and setting the reward to a state intuitively.
State Reward

Model your Reward with Utility Function

The state reward can be modeled with a sophisticated Utility function as well.
Utility function for reward

Prioritize your multiple-criteria that are used for rewards in a given state.

Using Analytic Hierarchy Process priority algorithms, your multiple criteria can be prioritized using pairwise comparisons. The consistency ratio is also calculated and displayed while you do the pairwise comparison. Even the Transitivity rule can be enforced.
Pairwise Comparison

Use the custom expression in a Markov Chain to predict a custom state

You can even use custom expressions using the state names to predict a custom state of your Markov chain.
Custom Expression for Markov Chain

A plethora of charts on Markov Chain and Markov Decision Process

A lot of charts are available for you to get various perspectives on the Markov decision process.
charts

A Part of our Rational Will software

This Markov Decision Process Software is also available in our composite (bundled) product Rational Will®, where you get a streamlined user experience of many decision modeling tools. Therefore, if you get Rational WIll, you won't need to acquire this software separately.