Markov Chain Calculator

Model and analyze Markov Chain with rich Graphical Wizard.

FREE, get it now (for Windows)

Free · direct download

128 citationsin peer-reviewed research 100% offlineyour data never leaves your machine

When a process moves between states with probabilities attached, guessing stops helping.

Model the chain, watch it evolve, and read the steady state straight off the chart.

The work · 6 capabilities
01

Freeware - no nags, no ads and fully-functional

Let's answer the first question that you might be asking. It is Freeware, so what is the catch? The catch is that it shows a very little small link at the top right corner of the app, clicking that link will show you our featured decision analysis product Rational Will®, as you can see in the screenshots. And that's it.
Markov chain calculator
02

Wizard-based guided User Experience

The Markov Chain Calculator software lets you model a simple time-invariant Markov chain easily by asking questions in screens after screens. Therefore it becomes a pleasure to model and analyze a Markov Chain.
Read the walkthrough
Markov Chain Calculator
03

Calculated Results in the Charts

Lots of useful charts are available to analyze the Markov chain. The charts can be popped out to a separate window to display all at the same time.
Charts
04

Chart Data can be shown as Table or exported to Excel

Every chart in this application is featured with a context menu (right mouse click) that lets you view the data table in a data grid, or export the table directly to Excel. You can copy the data table as CSV too. Also, you can copy the chart image to Clipboard, or save it as PNG or JPG.
chart features
05

Custom State Expression with a Rich Math Editor

It won't be fun if you cannot forecast a composite or custom state. Yes, a rich math-based expression editor is available where you can drag and drop a state into the expression editor and use a lot of built-in math functions. The chart tab will show the chart for your custom expression.
Custom Expression
06

Check Rational Will for advanced Markov Decision Process.

This Markov Chain Calculator lets you model a Markov chain with States but no rewards can be attached to a state. If you want to attach Utility or Reward to a state and then if you want to calculate the Expected Utility or Cumulative utility of a state, then you will need to use our Decision tree software which is bundled in our flagship product Rational Will®. In our Decision Tree software, you will be able to add one or more Actions from a State and then you will see an evaluated policy as a Markov Decision Process. Therefore, if you get Rational WIll, you won't need to acquire this software separately.

Cited in 128 peer-reviewed papers.
Used for coursework at 291 universities.

Researchers do not cite tools they cannot defend. When a method has to hold up under review, the software behind it gets scrutinized too.

Browse the research index
  • Ichlasul Amal, et al. Meningkatkan Kepatuhan Terhadap Standar Pakan Nasional: Pendekatan AHP Berbasis Pemangku Kepentingan untuk Peningkatan Kualitas Jagung di Sulawesi Selatan. Jurnal Ilmu Peternakan Halu Oleo, 2026. DOI
  • Jiyoung Shim. Exploring the Relative Importance of Reading Material Selection Factors Using AHP. Journal of the Korean Society for Information Management, 2026. DOI
  • T. G. Asresehegn, V. Valencia, S. Schulz, G. Woldewahid, G. Gebrehawariat, R. P. O. Schulte. Community responses to land degradation: Insights from land restoration bright-spot communities in the Ethiopian Highlands. Environmental Development, 2026. DOI

The three most recent entries from our research index.

University of North Carolina at Charlotte · University of Sharjah · University of manchester · Chulalongkorn University · Colorado State University · Institut Teknologi Bandung · Institut Teknologi Sepuluh Nopember · IPB UNIVERSITY · and 283 more.

Source: our student-license survey, 291 universities and counting.

Terms that have become rare.

01

Your data never leaves your machine.

Fully offline desktop software. Your models and results never touch a server, ours or anyone's. Nothing to upload, nothing to leak.

02

You buy it once. It is yours.

A true perpetual license, sold this way since 2007. No subscription meter running while you finish the work.

03

One-to-one support from a human domain expert.

Not a chatbot, not a call center. Support is a live conversation with the engineers who build the software. One call away, on Zoom or Teams, free.

Stuck at 11 p.m. with a model due Friday? Talk to our engineers.

Every trial and every license includes free live 1:1 sessions on Zoom or Teams. You will talk to a real human, a domain expert who builds this software, and we will help you model your actual problem. No chatbot, no call center, no ticket queue.

Weigh it yourself. The trial is the full product: free, offline, on your machine.

FREE, get it now (for Windows)

Free · direct download