| State |  | Stage 1 |  |  | Stage 2 |  | |||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Code | i 1 | i 2 | i 3 | i 4 | i 5 | i 6 | Case | a 1 | a 2 | a 3 | a 4 | a 5 | Rewards at t2 | Case | a 1 | a 2 | a 3 | a 4 | a 5 | Rewards at t3 |
(10031) | 3 | 1 | 0 | 1 | 1 | 1 | 57 | 0 | 0 | 1 | 0 | 1 | 1.00 | 51 | 1 | 0 | 0 | 1 | 1 | 1.00 |
(10032) | 3 | 1 | 0 | 1 | 1 | 2 | 40 | 0 | 0 | 0 | 0 | 1 | 5.00 | 41 | 1 | 0 | 1 | 1 | 0 | 5.00 |
(10033) | 3 | 1 | 0 | 1 | 1 | 3 | 38 | 0 | 0 | 1 | 1 | 1 | 7.33 | 39 | 0 | 1 | 0 | 0 | 1 | 6.00 |