Recently,I am trying to control a marco traffic system with the general value iteration adaptive dynamic programming algorithm.However,the results do not reach my expectation.
Here is the pseudo code:
action network is used to approximate the control model network is used to approximate the traffic system critic network is used to approximate the value function
So can anyone who are skilled at approximate dynamic programming figure out the possible reason ? Thanks a lot.