[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: Modifying the TD Code in PDP++
Ok, I was inspired to make my current TD code work outside the BG/PFC
framework and tested it out on the simple TD example from my
"Computational Explorations.." textbook, chapter 6. Everything seems
to work fine, and as an extra bonus I added the 3 lines (in the right
places.. ;) to implement the Daw & Touretzky
subtract-the-average-reward variant. Just click on the sub_avg
button in the rew field in the RewPredLayerSpec...
the updated code is in an updated version of this file:
ftp://grey.colorado.edu/pub/oreilly/pdp++/pdp++_2.3a_src.tar.gz
and I put the TD example in:
ftp://grey.colorado.edu/pub/oreilly/misc/lba_rl.tar.gz
just run new_rl_cond.proj.gz with the new version of leabra++ from the
src tar above.
Cheers,
- Randy