Markov Chain Calculator

Free Windows software for discrete Markov chains. Define the states and transition probabilities through a graphical wizard, watch the chain evolve step by step, read the steady state distribution straight off the chart, and export the numbers to Excel. It is fully functional and free, with no ads and no locked features, so a student can finish an assignment and a reliability engineer can sanity check a model on the same afternoon. When the problem grows to include decisions, costs and utilities, the same modelling ideas carry into our decision analysis products.

FREE, get it now (for Windows)

Free · direct download

Documentation Video tutorials (1)

Markov Chain Calculator video demonstration

128 citationsin peer-reviewed research 100% offlineyour data never leaves your machine

Want to calculate a Markov chain right now? The free online calculator runs in your browser: enter a transition matrix, get the steady state. No download or installation required.

Open the free online calculator

When a process moves between states with probabilities attached, guessing stops helping.

Model the chain, watch it evolve, and read the steady state straight off the chart.

Freeware - no nags, no ads and fully-functional

Let's answer the first question that you might be asking. It is Freeware, so what is the catch? The catch is that it shows a very little small link at the top right corner of the app, clicking that link will show you our featured decision analysis product Rational Will®, as you can see in the screenshots. And that's it.

Wizard-based guided User Experience

The Markov Chain Calculator software lets you model a simple time-invariant Markov chain easily by asking questions in screens after screens. Therefore it becomes a pleasure to model and analyze a Markov Chain.

Read the walkthrough

Calculated Results in the Charts

Lots of useful charts are available to analyze the Markov chain. The charts can be popped out to a separate window to display all at the same time.

Chart Data can be shown as Table or exported to Excel

Every chart in this application is featured with a context menu (right mouse click) that lets you view the data table in a data grid, or export the table directly to Excel. You can copy the data table as CSV too. Also, you can copy the chart image to Clipboard, or save it as PNG or JPG.

Custom State Expression with a Rich Math Editor

It won't be fun if you cannot forecast a composite or custom state. Yes, a rich math-based expression editor is available where you can drag and drop a state into the expression editor and use a lot of built-in math functions. The chart tab will show the chart for your custom expression.

Check Rational Will for advanced Markov Decision Process.

This Markov Chain Calculator lets you model a Markov chain with States but no rewards can be attached to a state. If you want to attach Utility or Reward to a state and then if you want to calculate the Expected Utility or Cumulative utility of a state, then you will need to use our Decision tree software which is bundled in our flagship product Rational Will®. In our Decision Tree software, you will be able to add one or more Actions from a State and then you will see an evaluated policy as a Markov Decision Process. Therefore, if you get Rational WIll, you won't need to acquire this software separately.

Cited in 128 peer-reviewed papers.
Used for coursework at 292 universities.

Researchers do not cite tools they cannot defend. When a method has to hold up under review, the software behind it gets scrutinized too.

Browse the research index

Ichlasul Amal, et al. Meningkatkan Kepatuhan Terhadap Standar Pakan Nasional: Pendekatan AHP Berbasis Pemangku Kepentingan untuk Peningkatan Kualitas Jagung di Sulawesi Selatan. Jurnal Ilmu Peternakan Halu Oleo, 2026. DOI
Jiyoung Shim. Exploring the Relative Importance of Reading Material Selection Factors Using AHP. Journal of the Korean Society for Information Management, 2026. DOI
T. G. Asresehegn, V. Valencia, S. Schulz, G. Woldewahid, G. Gebrehawariat, R. P. O. Schulte. Community responses to land degradation: Insights from land restoration bright-spot communities in the Ethiopian Highlands. Environmental Development, 2026. DOI

The three most recent entries from our research index.

University of North Carolina at Charlotte · University of Sharjah · University of manchester · Chulalongkorn University · Colorado State University · Institut Teknologi Bandung · Institut Teknologi Sepuluh Nopember · IPB UNIVERSITY · and 284 more.

Source: our student-license survey, 292 universities and counting.

Ready to use Markov Chain Calculator?

Download the complete free product and run it locally on Windows. No signup, subscription, or sales call.

Free to download. Your work stays on your machine.