Table 6 Optimal combination of treatments for a variety of states at Stage 1
No. of cases | States at t1 | Actions at t1 | Rewards at t2* | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Â | i 1 | i 2 | i 3 | i 4 | i 5 | i 6 | a 1 | a 2 | a3 | a 4 | a 5 | Â |
130 | 3 | 1 | 0 | 1 | 2 | 2 | 0 | 1 | 0 | 1 | 1 | 4.000 |
122 | 3 | 1 | 0 | 1 | 2 | 1 | 0 | 1 | 0 | 1 | 1 | 1.000 |
57 | 3 | 1 | 0 | 1 | 1 | 1 | 0 | 0 | 1 | 0 | 1 | 1.000 |
51 | 3 | 1 | 0 | 1 | 2 | 3 | 1 | 0 | 0 | 0 | 1 | 6.283 |
50 | 2 | 1 | 0 | 1 | 2 | 1 | 1 | 0 | 1 | 0 | 1 | 2.000 |
43 | 2 | 1 | 0 | 1 | 2 | 2 | 1 | 1 | 0 | 0 | 1 | 3.700 |
41 | 3 | 0 | 0 | 1 | 2 | 1 | 0 | 1 | 0 | 0 | 1 | 0.344 |
40 | 3 | 1 | 0 | 1 | 1 | 2 | 0 | 0 | 0 | 0 | 1 | 5.000 |
38 | 3 | 1 | 0 | 1 | 1 | 3 | 0 | 0 | 1 | 1 | 1 | 7.333 |
35 | 3 | 0 | 0 | 1 | 2 | 2 | 1 | 1 | 0 | 1 | 1 | 1.750 |
33 | 3 | 0 | 0 | 1 | 2 | 3 | 1 | 0 | 0 | 0 | 0 | 12.000 |
31 | 2 | 1 | 0 | 1 | 1 | 1 | 1 | 0 | 1 | 1 | 1 | 0.694 |
30 | 2 | 1 | 0 | 1 | 1 | 2 | 1 | 0 | 1 | 1 | 1 | 2.056 |
23 | 2 | 1 | 0 | 1 | 1 | 3 | 0 | 0 | 1 | 1 | 1 | 7.000 |
22 | 2 | 0 | 0 | 1 | 1 | 1 | 0 | 0 | 0 | 0 | 1 | 0.667 |
22 | 2 | 0 | 0 | 1 | 2 | 1 | 0 | 0 | 0 | 0 | 1 | 1.000 |
21 | 2 | 1 | 0 | 1 | 2 | 3 | 1 | 1 | 1 | 1 | 1 | 5.571 |
20 | 3 | 0 | 0 | 1 | 1 | 1 | 0 | 0 | 1 | 1 | 1 | 2.000 |
18 | 2 | 0 | 0 | 1 | 2 | 2 | 0 | 1 | 0 | 0 | 1 | 1.000 |
18 | 3 | 0 | 0 | 1 | 1 | 2 | 0 | 0 | 1 | 1 | 1 | 4.500 |
18 | 3 | 1 | 0 | 1 | 3 | 1 | 0 | 1 | 0 | 0 | 1 | 3.000 |
17 | 2 | 0 | 0 | 1 | 2 | 3 | 0 | 1 | 0 | 1 | 1 | 4.636 |
16 | 2 | 0 | 0 | 1 | 1 | 2 | 1 | 0 | 1 | 0 | 1 | 5.200 |
11 | 3 | 1 | 0 | 1 | 3 | 2 | 0 | 1 | 0 | 0 | 1 | 2.000 |
10 | 3 | 0 | 0 | 1 | 1 | 3 | 1 | 1 | 1 | 1 | 1 | 6.000 |
10 | 3 | 1 | 0 | 1 | 4 | 1 | 0 | 0 | 1 | 1 | 0 | 1.500 |
10 | 3 | 1 | 1 | 1 | 2 | 3 | 1 | 1 | 1 | 1 | 1 | 6.100 |
9 | 2 | 1 | 0 | 1 | 3 | 1 | 0 | 0 | 1 | 0 | 1 | 2.000 |
8 | 3 | 1 | 1 | 1 | 2 | 2 | 0 | 1 | 0 | 0 | 1 | 0.000 |
6 | 2 | 1 | 0 | 1 | 4 | 2 | 0 | 0 | 0 | 0 | 1 | 0.333 |