MCTS search tree navigation

[gdaddi]

Hi,

I am solving an MDP model with MCTS-DPW and am trying to traverse the search tree to follow the highest value actions up to a specific action.

For example, I have actions=[0,1,2] and initial_state=A. I am looking for the highest-value sequence of actions up to the first action=0.

a, info = action_info(model, state) 
action_sequence = find_sequence_of_actions(info, action_type)

Are there any utilities that I can use to get this sequence, or do I have to write a function myself?

Thanks

[gdaddi]

Wrote a function myself.