From: Comparative effectiveness research on patients with acute ischemic stroke using Markov decision processes
No. of cases
States at t2
Actions at t2
i 1
i 2
i 3
i 4
i 5
i 6
a 1
a 2
a 3
a 4
a 5
19
2
0
1
17
......