***********************************************************
Bicycle using Consistent Bellman Equation
***********************************************************

Options used when running:

5: Bicycle
8: Order --- this means we will have 8^6 = 262,144 weights to tune
0: YES value averaging
1: Consistent Bellman
2000: Number of interations of value iteration
16: Number of threads used by value iteration (set to your number of cores)
16: Number of threads used to evaluate a policy (set to your number of cores)
10: Evaluate policy after every iteration
0: Print results to file
out_Consistent_Bicycle.txt: The file to print the results to

Console output:

Select environment:
[0] Mountain Car
[1] Puddle World
[2] Acrobot
[3] Cart Pole
[4] Pendulum Swing-Up and Balance
[5] Bicycle
Selection: 5
Enter the order (state is 6 dimensional): 8
Select value averaging:
[0] Yes
[1] No
Selection: 0
Select maxQ Variant:
[0] Ordinary Bellman
[1] Consistent Bellman
Selection: 1
Enter number of iterations of value iteration: 2000
Enter number of threads for value-iteration (we suggest # available cores): 16
Enter number of threads for policy evaluation (we suggest # available cores): 16
Evaluate policy every how-many iterations? 10
Select Print results to file:
[0] Yes
[1] No
Selection: 0
Enter filename: out_Consistent_Bicycle.txt

Initially: Goal reached (0-1 Boolean) = 0
Iteration: 10	Goal reached (0-1 Boolean) = 0
Iteration: 20	Goal reached (0-1 Boolean) = 0
Iteration: 30	Goal reached (0-1 Boolean) = 0
Iteration: 40	Goal reached (0-1 Boolean) = 0
Iteration: 50	Goal reached (0-1 Boolean) = 0
Iteration: 60	Goal reached (0-1 Boolean) = 0
Iteration: 70	Goal reached (0-1 Boolean) = 0
Iteration: 80	Goal reached (0-1 Boolean) = 0
Iteration: 90	Goal reached (0-1 Boolean) = 0
Iteration: 100	Goal reached (0-1 Boolean) = 0
Iteration: 110	Goal reached (0-1 Boolean) = 0
Iteration: 120	Goal reached (0-1 Boolean) = 0
Iteration: 130	Goal reached (0-1 Boolean) = 0
Iteration: 140	Goal reached (0-1 Boolean) = 0
Iteration: 150	Goal reached (0-1 Boolean) = 1
Iteration: 160	Goal reached (0-1 Boolean) = 1
Iteration: 170	Goal reached (0-1 Boolean) = 1
Iteration: 180	Goal reached (0-1 Boolean) = 1
Iteration: 190	Goal reached (0-1 Boolean) = 1
Iteration: 200	Goal reached (0-1 Boolean) = 1
Iteration: 210	Goal reached (0-1 Boolean) = 1
Iteration: 220	Goal reached (0-1 Boolean) = 1
Iteration: 230	Goal reached (0-1 Boolean) = 1
Iteration: 240	Goal reached (0-1 Boolean) = 1
Iteration: 250	Goal reached (0-1 Boolean) = 1
Iteration: 260	Goal reached (0-1 Boolean) = 1
Iteration: 270	Goal reached (0-1 Boolean) = 1
Iteration: 280	Goal reached (0-1 Boolean) = 1
Iteration: 290	Goal reached (0-1 Boolean) = 1
Iteration: 300	Goal reached (0-1 Boolean) = 1
Iteration: 310	Goal reached (0-1 Boolean) = 1
Iteration: 320	Goal reached (0-1 Boolean) = 1
Iteration: 330	Goal reached (0-1 Boolean) = 1
Iteration: 340	Goal reached (0-1 Boolean) = 1
Iteration: 350	Goal reached (0-1 Boolean) = 1
Iteration: 360	Goal reached (0-1 Boolean) = 1
Iteration: 370	Goal reached (0-1 Boolean) = 1
Iteration: 380	Goal reached (0-1 Boolean) = 1
Iteration: 390	Goal reached (0-1 Boolean) = 1
Iteration: 400	Goal reached (0-1 Boolean) = 0.75
Iteration: 410	Goal reached (0-1 Boolean) = 0.8125
Iteration: 420	Goal reached (0-1 Boolean) = 0.6875
Iteration: 430	Goal reached (0-1 Boolean) = 0.6875
Iteration: 440	Goal reached (0-1 Boolean) = 0.9375
Iteration: 450	Goal reached (0-1 Boolean) = 1
Iteration: 460	Goal reached (0-1 Boolean) = 0.875
Iteration: 470	Goal reached (0-1 Boolean) = 0.9375
Iteration: 480	Goal reached (0-1 Boolean) = 1
Iteration: 490	Goal reached (0-1 Boolean) = 0.75
Iteration: 500	Goal reached (0-1 Boolean) = 0.8125
Iteration: 510	Goal reached (0-1 Boolean) = 0.6875
Iteration: 520	Goal reached (0-1 Boolean) = 0.625
Iteration: 530	Goal reached (0-1 Boolean) = 0.5
Iteration: 540	Goal reached (0-1 Boolean) = 0.8125
Iteration: 550	Goal reached (0-1 Boolean) = 0.8125
Iteration: 560	Goal reached (0-1 Boolean) = 0.8125
Iteration: 570	Goal reached (0-1 Boolean) = 0.5625
Iteration: 580	Goal reached (0-1 Boolean) = 0.8125
Iteration: 590	Goal reached (0-1 Boolean) = 0.4375
Iteration: 600	Goal reached (0-1 Boolean) = 0.75
Iteration: 610	Goal reached (0-1 Boolean) = 0.625
Iteration: 620	Goal reached (0-1 Boolean) = 1
Iteration: 630	Goal reached (0-1 Boolean) = 0.875
Iteration: 640	Goal reached (0-1 Boolean) = 0.6875
Iteration: 650	Goal reached (0-1 Boolean) = 0.9375
Iteration: 660	Goal reached (0-1 Boolean) = 0.9375
Iteration: 670	Goal reached (0-1 Boolean) = 1
Iteration: 680	Goal reached (0-1 Boolean) = 0.9375
Iteration: 690	Goal reached (0-1 Boolean) = 1
Iteration: 700	Goal reached (0-1 Boolean) = 1
Iteration: 710	Goal reached (0-1 Boolean) = 1
Iteration: 720	Goal reached (0-1 Boolean) = 0.875
Iteration: 730	Goal reached (0-1 Boolean) = 1
Iteration: 740	Goal reached (0-1 Boolean) = 0.875
Iteration: 750	Goal reached (0-1 Boolean) = 1
Iteration: 760	Goal reached (0-1 Boolean) = 1
Iteration: 770	Goal reached (0-1 Boolean) = 1
Iteration: 780	Goal reached (0-1 Boolean) = 1
Iteration: 790	Goal reached (0-1 Boolean) = 1
Iteration: 800	Goal reached (0-1 Boolean) = 1
Iteration: 810	Goal reached (0-1 Boolean) = 1
Iteration: 820	Goal reached (0-1 Boolean) = 0.9375
Iteration: 830	Goal reached (0-1 Boolean) = 0.8125
Iteration: 840	Goal reached (0-1 Boolean) = 0.8125
Iteration: 850	Goal reached (0-1 Boolean) = 0.875
Iteration: 860	Goal reached (0-1 Boolean) = 0.875
Iteration: 870	Goal reached (0-1 Boolean) = 1
Iteration: 880	Goal reached (0-1 Boolean) = 0.9375
Iteration: 890	Goal reached (0-1 Boolean) = 0.9375
Iteration: 900	Goal reached (0-1 Boolean) = 0.9375
Iteration: 910	Goal reached (0-1 Boolean) = 1
Iteration: 920	Goal reached (0-1 Boolean) = 1
Iteration: 930	Goal reached (0-1 Boolean) = 1
Iteration: 940	Goal reached (0-1 Boolean) = 1
Iteration: 950	Goal reached (0-1 Boolean) = 1
Iteration: 960	Goal reached (0-1 Boolean) = 1
Iteration: 970	Goal reached (0-1 Boolean) = 1
Iteration: 980	Goal reached (0-1 Boolean) = 1
Iteration: 990	Goal reached (0-1 Boolean) = 1
Iteration: 1000	Goal reached (0-1 Boolean) = 1
Iteration: 1010	Goal reached (0-1 Boolean) = 1
Iteration: 1020	Goal reached (0-1 Boolean) = 1
Iteration: 1030	Goal reached (0-1 Boolean) = 1
Iteration: 1040	Goal reached (0-1 Boolean) = 1
Iteration: 1050	Goal reached (0-1 Boolean) = 1
Iteration: 1060	Goal reached (0-1 Boolean) = 1
Iteration: 1070	Goal reached (0-1 Boolean) = 1
Iteration: 1080	Goal reached (0-1 Boolean) = 1
Iteration: 1090	Goal reached (0-1 Boolean) = 0.9375
Iteration: 1100	Goal reached (0-1 Boolean) = 1
Iteration: 1110	Goal reached (0-1 Boolean) = 1
Iteration: 1120	Goal reached (0-1 Boolean) = 1
Iteration: 1130	Goal reached (0-1 Boolean) = 1
Iteration: 1140	Goal reached (0-1 Boolean) = 1
Iteration: 1150	Goal reached (0-1 Boolean) = 1
Iteration: 1160	Goal reached (0-1 Boolean) = 1
Iteration: 1170	Goal reached (0-1 Boolean) = 1
Iteration: 1180	Goal reached (0-1 Boolean) = 1
Iteration: 1190	Goal reached (0-1 Boolean) = 1
Iteration: 1200	Goal reached (0-1 Boolean) = 1
Iteration: 1210	Goal reached (0-1 Boolean) = 1
Iteration: 1220	Goal reached (0-1 Boolean) = 1
Iteration: 1230	Goal reached (0-1 Boolean) = 1
Iteration: 1240	Goal reached (0-1 Boolean) = 1
Iteration: 1250	Goal reached (0-1 Boolean) = 1
Iteration: 1260	Goal reached (0-1 Boolean) = 1
Iteration: 1270	Goal reached (0-1 Boolean) = 1
Iteration: 1280	Goal reached (0-1 Boolean) = 1
Iteration: 1290	Goal reached (0-1 Boolean) = 1
Iteration: 1300	Goal reached (0-1 Boolean) = 1
Iteration: 1310	Goal reached (0-1 Boolean) = 1
Iteration: 1320	Goal reached (0-1 Boolean) = 1
Iteration: 1330	Goal reached (0-1 Boolean) = 1
Iteration: 1340	Goal reached (0-1 Boolean) = 1
Iteration: 1350	Goal reached (0-1 Boolean) = 1
Iteration: 1360	Goal reached (0-1 Boolean) = 1
Iteration: 1370	Goal reached (0-1 Boolean) = 1
Iteration: 1380	Goal reached (0-1 Boolean) = 1
Iteration: 1390	Goal reached (0-1 Boolean) = 1
Iteration: 1400	Goal reached (0-1 Boolean) = 1
Iteration: 1410	Goal reached (0-1 Boolean) = 1
Iteration: 1420	Goal reached (0-1 Boolean) = 1
Iteration: 1430	Goal reached (0-1 Boolean) = 1
Iteration: 1440	Goal reached (0-1 Boolean) = 1
Iteration: 1450	Goal reached (0-1 Boolean) = 1
Iteration: 1460	Goal reached (0-1 Boolean) = 1
Iteration: 1470	Goal reached (0-1 Boolean) = 1
Iteration: 1480	Goal reached (0-1 Boolean) = 1
Iteration: 1490	Goal reached (0-1 Boolean) = 1
Iteration: 1500	Goal reached (0-1 Boolean) = 1
Iteration: 1510	Goal reached (0-1 Boolean) = 1
Iteration: 1520	Goal reached (0-1 Boolean) = 1
Iteration: 1530	Goal reached (0-1 Boolean) = 1
Iteration: 1540	Goal reached (0-1 Boolean) = 1
Iteration: 1550	Goal reached (0-1 Boolean) = 1
Iteration: 1560	Goal reached (0-1 Boolean) = 1
Iteration: 1570	Goal reached (0-1 Boolean) = 1
Iteration: 1580	Goal reached (0-1 Boolean) = 1
Iteration: 1590	Goal reached (0-1 Boolean) = 1
Iteration: 1600	Goal reached (0-1 Boolean) = 1
Iteration: 1610	Goal reached (0-1 Boolean) = 1
Iteration: 1620	Goal reached (0-1 Boolean) = 1
Iteration: 1630	Goal reached (0-1 Boolean) = 1
Iteration: 1640	Goal reached (0-1 Boolean) = 1
Iteration: 1650	Goal reached (0-1 Boolean) = 1
Iteration: 1660	Goal reached (0-1 Boolean) = 1
Iteration: 1670	Goal reached (0-1 Boolean) = 1
Iteration: 1680	Goal reached (0-1 Boolean) = 1
Iteration: 1690	Goal reached (0-1 Boolean) = 1
Iteration: 1700	Goal reached (0-1 Boolean) = 1
Iteration: 1710	Goal reached (0-1 Boolean) = 1
Iteration: 1720	Goal reached (0-1 Boolean) = 1
Iteration: 1730	Goal reached (0-1 Boolean) = 1
Iteration: 1740	Goal reached (0-1 Boolean) = 1
Iteration: 1750	Goal reached (0-1 Boolean) = 1
Iteration: 1760	Goal reached (0-1 Boolean) = 1
Iteration: 1770	Goal reached (0-1 Boolean) = 1
Iteration: 1780	Goal reached (0-1 Boolean) = 1
Iteration: 1790	Goal reached (0-1 Boolean) = 1
Iteration: 1800	Goal reached (0-1 Boolean) = 1
Iteration: 1810	Goal reached (0-1 Boolean) = 1
Iteration: 1820	Goal reached (0-1 Boolean) = 1
Iteration: 1830	Goal reached (0-1 Boolean) = 1
Iteration: 1840	Goal reached (0-1 Boolean) = 1
Iteration: 1850	Goal reached (0-1 Boolean) = 1
Iteration: 1860	Goal reached (0-1 Boolean) = 1
Iteration: 1870	Goal reached (0-1 Boolean) = 1
Iteration: 1880	Goal reached (0-1 Boolean) = 1
Iteration: 1890	Goal reached (0-1 Boolean) = 1
Iteration: 1900	Goal reached (0-1 Boolean) = 1
Iteration: 1910	Goal reached (0-1 Boolean) = 1
Iteration: 1920	Goal reached (0-1 Boolean) = 1
Iteration: 1930	Goal reached (0-1 Boolean) = 1
Iteration: 1940	Goal reached (0-1 Boolean) = 1
Iteration: 1950	Goal reached (0-1 Boolean) = 1
Iteration: 1960	Goal reached (0-1 Boolean) = 1
Iteration: 1970	Goal reached (0-1 Boolean) = 1
Iteration: 1980	Goal reached (0-1 Boolean) = 1
Iteration: 1990	Goal reached (0-1 Boolean) = 1
Iteration: 2000	Goal reached (0-1 Boolean) = 1
Printing results to out_Consistent_Bicycle.txt

