Package ai.libs.jaicore.search.algorithms.mdp.mcts

Class MCTS<N,​A>

  • Type Parameters:
    N - Type of states (nodes)
    A - Type of actions
    All Implemented Interfaces:
    java.lang.Iterable<org.api4.java.algorithm.events.IAlgorithmEvent>, java.util.concurrent.Callable<IPolicy<N,​A>>, java.util.Iterator<org.api4.java.algorithm.events.IAlgorithmEvent>, org.api4.java.algorithm.IAlgorithm<IMDP<N,​A,​java.lang.Double>,​IPolicy<N,​A>>, org.api4.java.common.control.ICancelable, org.api4.java.common.control.ILoggingCustomizable
    Direct Known Subclasses:
    BRUE, DNGMCTS, EnsembleMCTS, FixedCommitmentMCTS, PlackettLuceMCTS, SPUCT, TAGMCTS, UCT, UUCT
    public class MCTS<N,​A>
extends ai.libs.jaicore.basic.algorithm.AAlgorithm<IMDP<N,​A,​java.lang.Double>,​IPolicy<N,​A>>

    • Constructor Summary

      Constructors 
      Constructor Description
      MCTS​(IMDP<N,​A,​java.lang.Double> input, IPathUpdatablePolicy<N,​A,​java.lang.Double> treePolicy, IPolicy<N,​A> defaultPolicy, double maxIterations, double gamma, double epsilon, boolean tabooExhaustedNodes)  

    • Method Summary

      All Methods Instance Methods Concrete Methods 
      Modifier and Type Method Description
      IPolicy<N,​A> call()  
      void enforcePrefixPathOnAllRollouts​(org.api4.java.datastructure.graph.ILabeledPath<N,​A> path)  
      org.api4.java.datastructure.graph.ILabeledPath<N,​A> getEnforcedPrefixPath()  
      java.lang.String getLoggerName()  
      int getNumberOfRealizedPlayouts()  
      IPathUpdatablePolicy<N,​A,​java.lang.Double> getTreePolicy()  
      boolean hasTreePolicyReachedLeafs()  
      org.api4.java.algorithm.events.IAlgorithmEvent nextWithException()  
      void setLoggerName​(java.lang.String name)  

      • Methods inherited from class ai.libs.jaicore.basic.algorithm.AAlgorithm

        activate, announceTimeoutDetected, avoidReinterruptionOnShutdownOnCurrentThread, cancel, checkAndConductTermination, checkTermination, computeTimeoutAware, getActivationTime, getConfig, getId, getInput, getListeners, getNumCPUs, getRemainingTimeToDeadline, getState, getTimeout, getTimeoutPrecautionOffset, hasNext, hasThreadBeenInterruptedDuringShutdown, interruptThreadAsPartOfShutdown, isCanceled, isShutdownInitialized, isStopCriterionSatisfied, isTimeouted, iterator, next, post, registerActiveThread, registerListener, resolveShutdownInterruptOnCurrentThread, setConfig, setDeadline, setMaxNumThreads, setNumCPUs, setState, setTimeout, setTimeout, setTimeoutPrecautionOffset, shutdown, terminate, unregisterActiveThread, unregisterThreadAndShutdown

      • Methods inherited from class java.lang.Object

        clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

      • Methods inherited from interface java.lang.Iterable

        forEach, spliterator

      • Methods inherited from interface java.util.Iterator

        forEachRemaining, remove

    • Constructor Detail

      • MCTS

        public MCTS​(IMDP<N,​A,​java.lang.Double> input,
            IPathUpdatablePolicy<N,​A,​java.lang.Double> treePolicy,
            IPolicy<N,​A> defaultPolicy,
            double maxIterations,
            double gamma,
            double epsilon,
            boolean tabooExhaustedNodes)

    • Method Detail

      • nextWithException

        public org.api4.java.algorithm.events.IAlgorithmEvent nextWithException()
                                                                 throws java.lang.InterruptedException,
                                                                        org.api4.java.algorithm.exceptions.AlgorithmExecutionCanceledException,
                                                                        org.api4.java.algorithm.exceptions.AlgorithmTimeoutedException,
                                                                        org.api4.java.algorithm.exceptions.AlgorithmException
        Throws:
        java.lang.InterruptedException
        org.api4.java.algorithm.exceptions.AlgorithmExecutionCanceledException
        org.api4.java.algorithm.exceptions.AlgorithmTimeoutedException
        org.api4.java.algorithm.exceptions.AlgorithmException

      • getNumberOfRealizedPlayouts

        public int getNumberOfRealizedPlayouts()

      • call

        public IPolicy<N,​A> call()
                        throws java.lang.InterruptedException,
                               org.api4.java.algorithm.exceptions.AlgorithmExecutionCanceledException,
                               org.api4.java.algorithm.exceptions.AlgorithmTimeoutedException,
                               org.api4.java.algorithm.exceptions.AlgorithmException
        Throws:
        java.lang.InterruptedException
        org.api4.java.algorithm.exceptions.AlgorithmExecutionCanceledException
        org.api4.java.algorithm.exceptions.AlgorithmTimeoutedException
        org.api4.java.algorithm.exceptions.AlgorithmException

      • enforcePrefixPathOnAllRollouts

        public void enforcePrefixPathOnAllRollouts​(org.api4.java.datastructure.graph.ILabeledPath<N,​A> path)

      • getEnforcedPrefixPath

        public org.api4.java.datastructure.graph.ILabeledPath<N,​A> getEnforcedPrefixPath()

      • setLoggerName

        public void setLoggerName​(java.lang.String name)
        Specified by:
        setLoggerName in interface org.api4.java.common.control.ILoggingCustomizable
        Overrides:
        setLoggerName in class ai.libs.jaicore.basic.algorithm.AAlgorithm<IMDP<N,​A,​java.lang.Double>,​IPolicy<N,​A>>

      • hasTreePolicyReachedLeafs

        public boolean hasTreePolicyReachedLeafs()

      • getLoggerName

        public java.lang.String getLoggerName()
        Specified by:
        getLoggerName in interface org.api4.java.common.control.ILoggingCustomizable
        Overrides:
        getLoggerName in class ai.libs.jaicore.basic.algorithm.AAlgorithm<IMDP<N,​A,​java.lang.Double>,​IPolicy<N,​A>>