***********************************************************
Pendulum using Ordinary Bellman Equation
***********************************************************

Options used when running:

4: Pendulum
20: Order --- this means we will have 20^4 weights to tune
1: No value averaging
0: Ordinary Bellman
200: Number of interations of value iteration
16: Number of threads used by value iteration (set to your number of cores)
16: Number of threads used to evaluate a policy (set to your number of cores)
1: Evaluate policy after every iteration
0: Print results to file
out_Ordinary_Pendulum.txt: The file to print the results to

Console output:

Select environment:
[0] Mountain Car
[1] Puddle World
[2] Acrobot
[3] Cart Pole
[4] Pendulum Swing-Up and Balance
[5] Bicycle
Selection: 4
Enter the order (state is 2 dimensional): 20
Select value averaging:
[0] Yes
[1] No
Selection: 1
Select maxQ Variant:
[0] Ordinary Bellman
[1] Consistent Bellman
Selection: 0
Enter number of iterations of value iteration: 200
Enter number of threads for value-iteration (we suggest # available cores): 16
Enter number of threads for policy evaluation (we suggest # available cores): 16
Evaluate policy every how-many iterations? 1
Select Print results to file:
[0] Yes
[1] No
Selection: 0
Enter filename: out_Ordinary_Pendulum.txt

Initially: Time near-vertical = 0
Iteration: 1	Time near-vertical = 0
Iteration: 2	Time near-vertical = 0
Iteration: 3	Time near-vertical = 0
Iteration: 4	Time near-vertical = 0
Iteration: 5	Time near-vertical = 0
Iteration: 6	Time near-vertical = 0
Iteration: 7	Time near-vertical = 0
Iteration: 8	Time near-vertical = 0.66
Iteration: 9	Time near-vertical = 0.9
Iteration: 10	Time near-vertical = 0.4
Iteration: 11	Time near-vertical = 2.86
Iteration: 12	Time near-vertical = 2.99
Iteration: 13	Time near-vertical = 2.98
Iteration: 14	Time near-vertical = 2.82
Iteration: 15	Time near-vertical = 2.87
Iteration: 16	Time near-vertical = 4.67
Iteration: 17	Time near-vertical = 4.91
Iteration: 18	Time near-vertical = 5.03
Iteration: 19	Time near-vertical = 5.13
Iteration: 20	Time near-vertical = 5.17
Iteration: 21	Time near-vertical = 5.25
Iteration: 22	Time near-vertical = 5.25
Iteration: 23	Time near-vertical = 5.27
Iteration: 24	Time near-vertical = 5.3
Iteration: 25	Time near-vertical = 5.28
Iteration: 26	Time near-vertical = 5
Iteration: 27	Time near-vertical = 4.83
Iteration: 28	Time near-vertical = 4.34
Iteration: 29	Time near-vertical = 4.1
Iteration: 30	Time near-vertical = 4.34
Iteration: 31	Time near-vertical = 3.53
Iteration: 32	Time near-vertical = 0.46
Iteration: 33	Time near-vertical = 5.77
Iteration: 34	Time near-vertical = 6.54
Iteration: 35	Time near-vertical = 6.66
Iteration: 36	Time near-vertical = 6.75
Iteration: 37	Time near-vertical = 6.82
Iteration: 38	Time near-vertical = 6.88
Iteration: 39	Time near-vertical = 6.97
Iteration: 40	Time near-vertical = 7
Iteration: 41	Time near-vertical = 7.06
Iteration: 42	Time near-vertical = 7.11
Iteration: 43	Time near-vertical = 7.13
Iteration: 44	Time near-vertical = 7.15
Iteration: 45	Time near-vertical = 7.17
Iteration: 46	Time near-vertical = 7.19
Iteration: 47	Time near-vertical = 7.2
Iteration: 48	Time near-vertical = 7.22
Iteration: 49	Time near-vertical = 7.23
Iteration: 50	Time near-vertical = 7.25
Iteration: 51	Time near-vertical = 7.26
Iteration: 52	Time near-vertical = 7.27
Iteration: 53	Time near-vertical = 7.28
Iteration: 54	Time near-vertical = 7.3
Iteration: 55	Time near-vertical = 7.31
Iteration: 56	Time near-vertical = 7.32
Iteration: 57	Time near-vertical = 7.34
Iteration: 58	Time near-vertical = 7.35
Iteration: 59	Time near-vertical = 7.36
Iteration: 60	Time near-vertical = 7.36
Iteration: 61	Time near-vertical = 7.37
Iteration: 62	Time near-vertical = 7.38
Iteration: 63	Time near-vertical = 7.39
Iteration: 64	Time near-vertical = 7.4
Iteration: 65	Time near-vertical = 7.42
Iteration: 66	Time near-vertical = 7.42
Iteration: 67	Time near-vertical = 7.43
Iteration: 68	Time near-vertical = 7.44
Iteration: 69	Time near-vertical = 7.45
Iteration: 70	Time near-vertical = 7.45
Iteration: 71	Time near-vertical = 7.46
Iteration: 72	Time near-vertical = 7.47
Iteration: 73	Time near-vertical = 7.48
Iteration: 74	Time near-vertical = 7.48
Iteration: 75	Time near-vertical = 7.48
Iteration: 76	Time near-vertical = 7.48
Iteration: 77	Time near-vertical = 7.49
Iteration: 78	Time near-vertical = 7.49
Iteration: 79	Time near-vertical = 7.49
Iteration: 80	Time near-vertical = 7.49
Iteration: 81	Time near-vertical = 7.5
Iteration: 82	Time near-vertical = 7.5
Iteration: 83	Time near-vertical = 7.51
Iteration: 84	Time near-vertical = 7.51
Iteration: 85	Time near-vertical = 7.51
Iteration: 86	Time near-vertical = 7.51
Iteration: 87	Time near-vertical = 7.52
Iteration: 88	Time near-vertical = 7.52
Iteration: 89	Time near-vertical = 7.52
Iteration: 90	Time near-vertical = 7.53
Iteration: 91	Time near-vertical = 7.53
Iteration: 92	Time near-vertical = 7.53
Iteration: 93	Time near-vertical = 7.54
Iteration: 94	Time near-vertical = 7.54
Iteration: 95	Time near-vertical = 7.55
Iteration: 96	Time near-vertical = 7.56
Iteration: 97	Time near-vertical = 7.57
Iteration: 98	Time near-vertical = 7.57
Iteration: 99	Time near-vertical = 7.57
Iteration: 100	Time near-vertical = 7.57
Iteration: 101	Time near-vertical = 7.59
Iteration: 102	Time near-vertical = 7.59
Iteration: 103	Time near-vertical = 7.6
Iteration: 104	Time near-vertical = 7.61
Iteration: 105	Time near-vertical = 7.61
Iteration: 106	Time near-vertical = 7.61
Iteration: 107	Time near-vertical = 7.61
Iteration: 108	Time near-vertical = 7.61
Iteration: 109	Time near-vertical = 7.62
Iteration: 110	Time near-vertical = 7.62
Iteration: 111	Time near-vertical = 7.62
Iteration: 112	Time near-vertical = 7.62
Iteration: 113	Time near-vertical = 7.62
Iteration: 114	Time near-vertical = 7.62
Iteration: 115	Time near-vertical = 7.62
Iteration: 116	Time near-vertical = 7.62
Iteration: 117	Time near-vertical = 7.62
Iteration: 118	Time near-vertical = 7.62
Iteration: 119	Time near-vertical = 7.62
Iteration: 120	Time near-vertical = 7.62
Iteration: 121	Time near-vertical = 7.63
Iteration: 122	Time near-vertical = 7.63
Iteration: 123	Time near-vertical = 7.63
Iteration: 124	Time near-vertical = 7.63
Iteration: 125	Time near-vertical = 7.63
Iteration: 126	Time near-vertical = 7.63
Iteration: 127	Time near-vertical = 7.63
Iteration: 128	Time near-vertical = 7.63
Iteration: 129	Time near-vertical = 7.63
Iteration: 130	Time near-vertical = 7.63
Iteration: 131	Time near-vertical = 7.63
Iteration: 132	Time near-vertical = 7.63
Iteration: 133	Time near-vertical = 7.63
Iteration: 134	Time near-vertical = 7.63
Iteration: 135	Time near-vertical = 7.63
Iteration: 136	Time near-vertical = 7.63
Iteration: 137	Time near-vertical = 7.63
Iteration: 138	Time near-vertical = 7.63
Iteration: 139	Time near-vertical = 7.63
Iteration: 140	Time near-vertical = 7.63
Iteration: 141	Time near-vertical = 7.63
Iteration: 142	Time near-vertical = 7.63
Iteration: 143	Time near-vertical = 7.63
Iteration: 144	Time near-vertical = 7.63
Iteration: 145	Time near-vertical = 7.63
Iteration: 146	Time near-vertical = 7.63
Iteration: 147	Time near-vertical = 7.63
Iteration: 148	Time near-vertical = 7.63
Iteration: 149	Time near-vertical = 7.63
Iteration: 150	Time near-vertical = 7.63
Iteration: 151	Time near-vertical = 7.63
Iteration: 152	Time near-vertical = 7.63
Iteration: 153	Time near-vertical = 7.63
Iteration: 154	Time near-vertical = 7.63
Iteration: 155	Time near-vertical = 7.63
Iteration: 156	Time near-vertical = 7.63
Iteration: 157	Time near-vertical = 7.63
Iteration: 158	Time near-vertical = 7.63
Iteration: 159	Time near-vertical = 7.63
Iteration: 160	Time near-vertical = 7.63
Iteration: 161	Time near-vertical = 7.63
Iteration: 162	Time near-vertical = 7.63
Iteration: 163	Time near-vertical = 7.63
Iteration: 164	Time near-vertical = 7.63
Iteration: 165	Time near-vertical = 7.63
Iteration: 166	Time near-vertical = 7.63
Iteration: 167	Time near-vertical = 7.63
Iteration: 168	Time near-vertical = 7.63
Iteration: 169	Time near-vertical = 7.63
Iteration: 170	Time near-vertical = 7.63
Iteration: 171	Time near-vertical = 7.63
Iteration: 172	Time near-vertical = 7.63
Iteration: 173	Time near-vertical = 7.63
Iteration: 174	Time near-vertical = 7.63
Iteration: 175	Time near-vertical = 7.63
Iteration: 176	Time near-vertical = 7.63
Iteration: 177	Time near-vertical = 7.63
Iteration: 178	Time near-vertical = 7.63
Iteration: 179	Time near-vertical = 7.63
Iteration: 180	Time near-vertical = 7.63
Iteration: 181	Time near-vertical = 7.63
Iteration: 182	Time near-vertical = 7.63
Iteration: 183	Time near-vertical = 7.63
Iteration: 184	Time near-vertical = 7.63
Iteration: 185	Time near-vertical = 7.63
Iteration: 186	Time near-vertical = 7.63
Iteration: 187	Time near-vertical = 7.63
Iteration: 188	Time near-vertical = 7.63
Iteration: 189	Time near-vertical = 7.63
Iteration: 190	Time near-vertical = 7.63
Iteration: 191	Time near-vertical = 7.63
Iteration: 192	Time near-vertical = 7.63
Iteration: 193	Time near-vertical = 7.63
Iteration: 194	Time near-vertical = 7.63
Iteration: 195	Time near-vertical = 7.63
Iteration: 196	Time near-vertical = 7.63
Iteration: 197	Time near-vertical = 7.63
Iteration: 198	Time near-vertical = 7.63
Iteration: 199	Time near-vertical = 7.63
Iteration: 200	Time near-vertical = 7.63
Printing results to out_Ordinary_Pendulum.txt

