Package ai.libs.jaicore.search.algorithms.mdp.mcts.uct

Class AUpdatingPolicy<N,​A>

  • All Implemented Interfaces:
    IPathUpdatablePolicy<N,​A,​java.lang.Double>, IPolicy<N,​A>, org.api4.java.common.control.ILoggingCustomizable
    Direct Known Subclasses:
    UCBPolicy
    public abstract class AUpdatingPolicy<N,​A>
extends java.lang.Object
implements IPathUpdatablePolicy<N,​A,​java.lang.Double>, org.api4.java.common.control.ILoggingCustomizable

    • Constructor Detail

      • AUpdatingPolicy

        public AUpdatingPolicy​(double gamma,
                       boolean maximize)

    • Method Detail

      • getLabelOfNode

        public NodeLabel<A> getLabelOfNode​(N node)

      • getScore

        public abstract double getScore​(N node,
                                A action)

      • getActionBasedOnScores

        public abstract A getActionBasedOnScores​(java.util.Map<A,​java.lang.Double> scores)

      • updatePath

        public void updatePath​(org.api4.java.datastructure.graph.ILabeledPath<N,​A> path,
                       java.util.List<java.lang.Double> scores)
        Note that this is a transposition-based and hence, only partially path-dependent, update. The labels are associated to nodes of the original MDP (states) and not to nodes in the MCTS search tree (paths)! This means that, in fact, several paths are (partially) updated simultanously. However, on all other paths crossing the nodes on the updated paths, only those situations are updated and not the situations in higher nodes of the search tree.
        Specified by:
        updatePath in interface IPathUpdatablePolicy<N,​A,​java.lang.Double>

      • getAction

        public A getAction​(N node,
                   java.util.Collection<A> possibleActions)
        Specified by:
        getAction in interface IPolicy<N,​A>

      • isMaximize

        public boolean isMaximize()

      • getLoggerName

        public java.lang.String getLoggerName()
        Specified by:
        getLoggerName in interface org.api4.java.common.control.ILoggingCustomizable

      • setLoggerName

        public void setLoggerName​(java.lang.String name)
        Specified by:
        setLoggerName in interface org.api4.java.common.control.ILoggingCustomizable

      • getGamma

        public double getGamma()

      • setBehaviorWhenActionForNotFullyExploredStateIsRequested

        public void setBehaviorWhenActionForNotFullyExploredStateIsRequested​(EBehaviorForNotFullyExploredStates behaviorWhenActionForNotFullyExploredStateIsRequested)