Package ai.djl.basicdataset.nlp

Class CookingStackExchange

  • All Implemented Interfaces:
    RawDataset<java.nio.file.Path>, ai.djl.training.dataset.Dataset
    public class CookingStackExchange
extends java.lang.Object
implements RawDataset<java.nio.file.Path>
    A text classification dataset contains questions from cooking.stackexchange.com and their associated tags on the site.

    • Nested Class Summary

      Nested Classes 
      Modifier and Type Class Description
      static class  CookingStackExchange.Builder
      A builder to construct a CookingStackExchange.

      • Nested classes/interfaces inherited from interface ai.djl.training.dataset.Dataset

        ai.djl.training.dataset.Dataset.Usage

    • Method Summary

      All Methods Static Methods Instance Methods Concrete Methods 
      Modifier and Type Method Description
      static CookingStackExchange.Builder builder()
      Creates a builder to build a CookingStackExchange.
      java.nio.file.Path getData()
      Returns a plain java object.
      java.lang.Iterable<ai.djl.training.dataset.Batch> getData​(ai.djl.ndarray.NDManager manager)
      void prepare​(ai.djl.util.Progress progress)

      • Methods inherited from class java.lang.Object

        clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

      • Methods inherited from interface ai.djl.training.dataset.Dataset

        getData, matchingTranslatorOptions, prepare

    • Method Detail

      • getData

        public java.nio.file.Path getData()
                           throws java.io.IOException
        Returns a plain java object.
        Specified by:
        getData in interface RawDataset<java.nio.file.Path>
        Returns:
        a plain java object
        Throws:
        java.io.IOException - when IO operation fails in loading a resource

      • getData

        public java.lang.Iterable<ai.djl.training.dataset.Batch> getData​(ai.djl.ndarray.NDManager manager)
        Specified by:
        getData in interface ai.djl.training.dataset.Dataset

      • prepare

        public void prepare​(ai.djl.util.Progress progress)
             throws java.io.IOException
        Specified by:
        prepare in interface ai.djl.training.dataset.Dataset
        Throws:
        java.io.IOException