Package com.microsoft.semantickernel.services

Interface TextAIService

    • Field Summary

      Fields 
      Modifier and Type Field Description
      static int MAX_RESULTS_PER_PROMPT
      The maximum number of results per prompt
      static int MAXIMUM_INFLIGHT_AUTO_INVOKES
      The maximum number of auto-invokes that can be in-flight at any given time as part of the current asynchronous chain of execution.

    • Field Detail

      • MAX_RESULTS_PER_PROMPT

        static final int MAX_RESULTS_PER_PROMPT
        The maximum number of results per prompt
        See Also:
        Constant Field Values

      • MAXIMUM_INFLIGHT_AUTO_INVOKES

        static final int MAXIMUM_INFLIGHT_AUTO_INVOKES
        The maximum number of auto-invokes that can be in-flight at any given time as part of the current asynchronous chain of execution.

        This is a fail-safe mechanism. If someone accidentally manages to set up execution settings in such a way that auto-invocation is invoked recursively, and in particular where a prompt function is able to auto-invoke itself, we could end up in an infinite loop. This const is a backstop against that happening. We should never come close to this limit, but if we do, auto-invoke will be disabled for the current flow in order to prevent runaway execution. With the current setup, the way this could possibly happen is if a prompt function is configured with built-in execution settings that opt-in to auto-invocation of everything in the kernel, in which case the invocation of that prompt function could advertise itself as a candidate for auto-invocation. We don't want to outright block that, if that's something a developer has asked to do (e.g. it might be invoked with different arguments than its parent was invoked with), but we do want to limit it. This limit is arbitrary and can be tweaked in the future and/or made configurable should need arise.

        See Also:
        Constant Field Values