A very simple C++11 Templated MCTS (Monte Carlo Tree Search) implementation with examples for openFrameworks.

MCTS Code Based on the Java (Simon Lucas - University of Essex) and Python (Peter Cowling, Ed Powley, Daniel Whitehouse - University of York) impelementations at http://mcts.ai/code/index.html

The code is not tailored for any specific use case. It's very generic (but perhaps not generic enough?) It's probably not very optimized, my priority was on readability and flexibility (I wrote it to understand MCTS). It supports variable number of agents, and variable number of actions per step, and is templated. See examples for how to design your 'State' and 'Action' classes.

Usage

State state; // contains the current state, it must comply with the State interface Action action; // contains an action that can be applied to a State, and bring it to a new State UCT<State, Action> uct; // Templated class. Builds a partial decision tree and searches it with UCT MCTS // OPTIONAL init uct params uct.uct_k = sqrt(2); uct.max_millis = 0; uct.max_iterations = 100; uct.simulation_depth = 5; loop { // run uct mcts on current state and get best action action = uct.run(state); // apply the action to the current state state.apply_action(action); }

Dependencies:

Library itself

None (C++11)

Examples

openFrameworks 0.9.0

should work on any platform, but project files currently exist only for Windows / VS2015