Question about Shared-Head Actor–Critic Implementation

[yijionglin]

Hi there,

I’m trying to use the actor–critic framework to learn a policy in my custom environment, and I was wondering whether there is any example code for using a shared-head actor–critic architecture. I’m currently using the ActorCriticCNN class, but it seems that it does not support a shared head. Do I need to manually modify this base class to implement a shared-head structure?

Thanks,
Bourne

[garylvov]

I believe this is in the works for the future: #114 (comment)

For now, I recommend modifying the base class; that's what I've done in my internal codebase

[yijionglin]

Hi @garylvov,

Thank you very much. I was wondering whether you might be able to share your code when convenient. If now is not the right time, please feel free to disregard this request.

Many thanks,
Boourne