How to use Actor Critic models in Sample Factory

[lz-666d]

Hello, thank you for your excellent work, excellent RL framework! I was recently reading an open source code which uses your SampleFactory framework to create actor-critic models, but I didn't find the code for it. So I would like to know how to create actor-critic using SampleFactory and find the code to create actor-critic in the open source code I read.

[alex-petrenko]

Hi @lz-666d !
Does this documentation help? https://www.samplefactory.dev/03-customization/custom-models/
You can customize parts of the default model (encoder, core, decoder) or you're allowed to register an entirely new model yourself!
Let me know if you need help with specific implementation issues