org.datavec.image.loader

Class NativeImageLoader

java.lang.Object

org.datavec.image.loader.BaseImageLoader

org.datavec.image.loader.NativeImageLoader

All Implemented Interfaces:

Serializable

Direct Known Subclasses:

AndroidNativeImageLoader, CifarLoader, Java2DNativeImageLoader

public class NativeImageLoader
extends BaseImageLoader

Uses JavaCV to load images. Allowed formats: bmp, gif, jpg, jpeg, jp2, pbm, pgm, ppm, pnm, png, tif, tiff, exr, webp

Author:

saudet

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	NativeImageLoader.MultiPageMode

Field Summary

Fields

Modifier and Type	Field and Description
static String[]	ALLOWED_FORMATS
protected org.bytedeco.javacv.OpenCVFrameConverter.ToMat	converter

Fields inherited from class org.datavec.image.loader.BaseImageLoader

BASE_DIR, centerCropIfNeeded, channels, height, imageTransform, log, multiPageMode, rng, width

Constructor Summary

Constructors

Modifier	Constructor and Description
	NativeImageLoader() Loads images with no scaling or conversion.
	NativeImageLoader(int height, int width) Instantiate an image with the given height and width
	NativeImageLoader(int height, int width, int channels) Instantiate an image with the given height and width
	NativeImageLoader(int height, int width, int channels, boolean centerCropIfNeeded) Instantiate an image with the given height and width
	NativeImageLoader(int height, int width, int channels, ImageTransform imageTransform) Instantiate an image with the given height and width
	NativeImageLoader(int height, int width, int channels, NativeImageLoader.MultiPageMode mode) Instantiate an image with the given height and width
protected	NativeImageLoader(NativeImageLoader other)

Method Summary

Modifier and Type	Method and Description
org.bytedeco.javacv.Frame	asFrame(org.nd4j.linalg.api.ndarray.INDArray array) Returns asFrame(array, -1).
org.bytedeco.javacv.Frame	asFrame(org.nd4j.linalg.api.ndarray.INDArray array, int dataType) Converts an INDArray to a JavaCV Frame.
Image	asImageMatrix(File f)
Image	asImageMatrix(InputStream is)
org.bytedeco.javacpp.opencv_core.Mat	asMat(org.nd4j.linalg.api.ndarray.INDArray array) Returns asMat(array, -1).
org.bytedeco.javacpp.opencv_core.Mat	asMat(org.nd4j.linalg.api.ndarray.INDArray array, int dataType) Converts an INDArray to an OpenCV Mat.
org.nd4j.linalg.api.ndarray.INDArray	asMatrix(File f)
org.nd4j.linalg.api.ndarray.INDArray	asMatrix(org.bytedeco.javacv.Frame image)
org.nd4j.linalg.api.ndarray.INDArray	asMatrix(ImageWritable writable) Convert ImageWritable to INDArray
org.nd4j.linalg.api.ndarray.INDArray	asMatrix(InputStream is)
org.nd4j.linalg.api.ndarray.INDArray	asMatrix(Object image) Calls AndroidNativeImageLoader.asMatrix(android.graphics.Bitmap) or Java2DNativeImageLoader.asMatrix(java.awt.image.BufferedImage).
org.nd4j.linalg.api.ndarray.INDArray	asMatrix(org.bytedeco.javacpp.opencv_core.Mat image)
void	asMatrixView(File f, org.nd4j.linalg.api.ndarray.INDArray view)
void	asMatrixView(InputStream is, org.nd4j.linalg.api.ndarray.INDArray view)
void	asMatrixView(org.bytedeco.javacpp.opencv_core.Mat image, org.nd4j.linalg.api.ndarray.INDArray view)
org.nd4j.linalg.api.ndarray.INDArray	asRowVector(File f) Convert a file to a row vector
org.nd4j.linalg.api.ndarray.INDArray	asRowVector(org.bytedeco.javacv.Frame image)
org.nd4j.linalg.api.ndarray.INDArray	asRowVector(InputStream is)
org.nd4j.linalg.api.ndarray.INDArray	asRowVector(Object image) Returns asMatrix(image).ravel().
org.nd4j.linalg.api.ndarray.INDArray	asRowVector(org.bytedeco.javacpp.opencv_core.Mat image)
ImageWritable	asWritable(File f) Convert a file to a INDArray
protected org.bytedeco.javacpp.opencv_core.Mat	centerCropIfNeeded(org.bytedeco.javacpp.opencv_core.Mat img)
protected void	fillNDArray(org.bytedeco.javacpp.opencv_core.Mat image, org.nd4j.linalg.api.ndarray.INDArray ret)
String[]	getAllowedFormats()
protected org.bytedeco.javacpp.opencv_core.Mat	scalingIfNeed(org.bytedeco.javacpp.opencv_core.Mat image)
protected org.bytedeco.javacpp.opencv_core.Mat	scalingIfNeed(org.bytedeco.javacpp.opencv_core.Mat image, int dstHeight, int dstWidth)
protected org.nd4j.linalg.api.ndarray.INDArray	transformImage(org.bytedeco.javacpp.opencv_core.Mat image, org.nd4j.linalg.api.ndarray.INDArray ret)

Methods inherited from class org.datavec.image.loader.BaseImageLoader

downloadAndUntar

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

ALLOWED_FORMATS

public static final String[] ALLOWED_FORMATS

converter

protected org.bytedeco.javacv.OpenCVFrameConverter.ToMat converter

Constructor Detail

NativeImageLoader

public NativeImageLoader()

Loads images with no scaling or conversion.

NativeImageLoader

public NativeImageLoader(int height,
                         int width)

Instantiate an image with the given height and width

Parameters:

height - the height to load

width - the width to load

NativeImageLoader

public NativeImageLoader(int height,
                         int width,
                         int channels)

Instantiate an image with the given height and width

Parameters:

height - the height to load

width - the width to load

channels - the number of channels for the image*

NativeImageLoader

public NativeImageLoader(int height,
                         int width,
                         int channels,
                         boolean centerCropIfNeeded)

Instantiate an image with the given height and width

Parameters:

height - the height to load

width - the width to load

channels - the number of channels for the image*

centerCropIfNeeded - to crop before rescaling and converting

NativeImageLoader

public NativeImageLoader(int height,
                         int width,
                         int channels,
                         ImageTransform imageTransform)

Instantiate an image with the given height and width

Parameters:

height - the height to load

width - the width to load

channels - the number of channels for the image*

imageTransform - to use before rescaling and converting

NativeImageLoader

public NativeImageLoader(int height,
                         int width,
                         int channels,
                         NativeImageLoader.MultiPageMode mode)

Instantiate an image with the given height and width

Parameters:

height - the height to load

width - the width to load

channels - the number of channels for the image*

mode - how to load multipage image

NativeImageLoader

protected NativeImageLoader(NativeImageLoader other)

Method Detail

getAllowedFormats

public String[] getAllowedFormats()

Overrides:

getAllowedFormats in class BaseImageLoader

asRowVector

public org.nd4j.linalg.api.ndarray.INDArray asRowVector(File f)
                                                 throws IOException

Convert a file to a row vector

Specified by:

asRowVector in class BaseImageLoader

Parameters:

f - the image to convert

Returns:

the flattened image

Throws:

IOException

asRowVector

public org.nd4j.linalg.api.ndarray.INDArray asRowVector(InputStream is)
                                                 throws IOException

Specified by:

asRowVector in class BaseImageLoader

Throws:

IOException

asRowVector

public org.nd4j.linalg.api.ndarray.INDArray asRowVector(Object image)
                                                 throws IOException

Returns asMatrix(image).ravel().

Throws:

IOException

See Also:

asMatrix(Object)

asRowVector

public org.nd4j.linalg.api.ndarray.INDArray asRowVector(org.bytedeco.javacv.Frame image)
                                                 throws IOException

Throws:

IOException

asRowVector

public org.nd4j.linalg.api.ndarray.INDArray asRowVector(org.bytedeco.javacpp.opencv_core.Mat image)
                                                 throws IOException

Throws:

IOException

asMatrix

public org.nd4j.linalg.api.ndarray.INDArray asMatrix(File f)
                                              throws IOException

Specified by:

asMatrix in class BaseImageLoader

Throws:

IOException

asMatrix

public org.nd4j.linalg.api.ndarray.INDArray asMatrix(InputStream is)
                                              throws IOException

Specified by:

asMatrix in class BaseImageLoader

Throws:

IOException

asImageMatrix

public Image asImageMatrix(File f)
                    throws IOException

Specified by:

asImageMatrix in class BaseImageLoader

Throws:

IOException

asImageMatrix

public Image asImageMatrix(InputStream is)
                    throws IOException

Specified by:

asImageMatrix in class BaseImageLoader

Throws:

IOException

asMatrix

public org.nd4j.linalg.api.ndarray.INDArray asMatrix(Object image)
                                              throws IOException

Calls AndroidNativeImageLoader.asMatrix(android.graphics.Bitmap) or Java2DNativeImageLoader.asMatrix(java.awt.image.BufferedImage).

Parameters:

image - as a Bitmap or BufferedImage

Returns:

the matrix or null for unsupported object classes

Throws:

IOException

fillNDArray

protected void fillNDArray(org.bytedeco.javacpp.opencv_core.Mat image,
                           org.nd4j.linalg.api.ndarray.INDArray ret)

asMatrixView

public void asMatrixView(InputStream is,
                         org.nd4j.linalg.api.ndarray.INDArray view)
                  throws IOException

Throws:

IOException

asMatrixView

public void asMatrixView(File f,
                         org.nd4j.linalg.api.ndarray.INDArray view)
                  throws IOException

Throws:

IOException

asMatrixView

public void asMatrixView(org.bytedeco.javacpp.opencv_core.Mat image,
                         org.nd4j.linalg.api.ndarray.INDArray view)
                  throws IOException

Throws:

IOException

asMatrix

public org.nd4j.linalg.api.ndarray.INDArray asMatrix(org.bytedeco.javacv.Frame image)
                                              throws IOException

Throws:

IOException

asMatrix

public org.nd4j.linalg.api.ndarray.INDArray asMatrix(org.bytedeco.javacpp.opencv_core.Mat image)
                                              throws IOException

Throws:

IOException

transformImage

protected org.nd4j.linalg.api.ndarray.INDArray transformImage(org.bytedeco.javacpp.opencv_core.Mat image,
                                                              org.nd4j.linalg.api.ndarray.INDArray ret)
                                                       throws IOException

Throws:

IOException

centerCropIfNeeded

protected org.bytedeco.javacpp.opencv_core.Mat centerCropIfNeeded(org.bytedeco.javacpp.opencv_core.Mat img)

scalingIfNeed

protected org.bytedeco.javacpp.opencv_core.Mat scalingIfNeed(org.bytedeco.javacpp.opencv_core.Mat image)

scalingIfNeed

protected org.bytedeco.javacpp.opencv_core.Mat scalingIfNeed(org.bytedeco.javacpp.opencv_core.Mat image,
                                                             int dstHeight,
                                                             int dstWidth)

asWritable

public ImageWritable asWritable(File f)
                         throws IOException

Convert a file to a INDArray

Parameters:

f - the image to convert

Returns:

INDArray

Throws:

IOException

asMatrix

public org.nd4j.linalg.api.ndarray.INDArray asMatrix(ImageWritable writable)
                                              throws IOException

Convert ImageWritable to INDArray

Parameters:

writable - ImageWritable to convert

Returns:

INDArray

Throws:

IOException

asFrame

public org.bytedeco.javacv.Frame asFrame(org.nd4j.linalg.api.ndarray.INDArray array)

Returns asFrame(array, -1).

asFrame

public org.bytedeco.javacv.Frame asFrame(org.nd4j.linalg.api.ndarray.INDArray array,
                                         int dataType)

Converts an INDArray to a JavaCV Frame. Only intended for images with rank 3.

Parameters:

array - to convert

dataType - from JavaCV (DEPTH_FLOAT, DEPTH_UBYTE, etc), or -1 to use same type as the INDArray

Returns:

data copied to a Frame

asMat

public org.bytedeco.javacpp.opencv_core.Mat asMat(org.nd4j.linalg.api.ndarray.INDArray array)

Returns asMat(array, -1).

asMat

public org.bytedeco.javacpp.opencv_core.Mat asMat(org.nd4j.linalg.api.ndarray.INDArray array,
                                                  int dataType)

Converts an INDArray to an OpenCV Mat. Only intended for images with rank 3.

Parameters:

array - to convert

dataType - from OpenCV (CV_32F, CV_8U, etc), or -1 to use same type as the INDArray

Returns:

data copied to a Mat