[問題] A3C Actor Gradient

作者: longlyeagle (長鷹寶寶實驗室)   2017-10-08 10:31:47
Working on A3C deep reinforcement learning.
Since I am too lazy to modify the last layer of my NN to softmax,
I use a softmax filter to let the linear layer directly target
the softmax output.
The algorithm works in my test cases for now.
But it might go wrong when the reward is on a different scale.
Can anyone help me to check if my implementation is correct?
https://goo.gl/FV8sFu
作者: longlyeagle (長鷹寶寶實驗室)   2017-11-05 22:07:00
It turns out that the current test case willmake correct result target to 1 after softmaxand the wrong result to 0That's why the reward will work in its currentscale

Links booklink

Contact Us: admin [ a t ] ucptt.com