From: Comparative effectiveness research on patients with acute ischemic stroke using Markov decision processes
No. of cases
States at t1
Actions at t1
i 1
i 2
i 3
i 4
i 5
i 6
a 1
a 2
a 3
a 4
a 5
22
2
0
1
16
......