de.l3s.boilerpipe.sax

Class MediaExtractor

java.lang.Object

de.l3s.boilerpipe.sax.MediaExtractor

public final class MediaExtractor
extends Object

Extracts youtube and vimeo videos that are enclosed by extracted content.

Author:

Christian Kohlschütter, manuel.codiga@gmail.com

Field Summary

Fields

Modifier and Type	Field and Description
static MediaExtractor	INSTANCE

Constructor Summary

Constructors

Constructor and Description
MediaExtractor()

Method Summary

Methods

Modifier and Type	Method and Description
static MediaExtractor	getInstance()
List<Media>	process(String doc, BoilerpipeExtractor extractor) parses the media (picture, video) out of doc
List<Media>	process(TextDocument doc, InputSource is) Processes the given TextDocument and the original HTML text (as an InputSource).
List<Media>	process(TextDocument doc, String origHTML) Processes the given TextDocument and the original HTML text (as a String).
List<Media>	process(URL url, BoilerpipeExtractor extractor) Fetches the given URL using HTMLFetcher and processes the retrieved HTML using the specified BoilerpipeExtractor.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

INSTANCE

public static final MediaExtractor INSTANCE

Constructor Detail

MediaExtractor

public MediaExtractor()

Method Detail

getInstance

public static MediaExtractor getInstance()

Returns:

the singleton instance of MediaExtractor.

process

public List<Media> process(TextDocument doc,
                  String origHTML)
                    throws BoilerpipeProcessingException

Processes the given TextDocument and the original HTML text (as a String).

Parameters:

doc - The processed TextDocument.

origHTML - The original HTML document.

Returns:

A List of enclosed Images

Throws:

BoilerpipeProcessingException - if an error during extraction occure

process

public List<Media> process(TextDocument doc,
                  InputSource is)
                    throws BoilerpipeProcessingException

Processes the given TextDocument and the original HTML text (as an InputSource).

Parameters:

doc - The processed TextDocument. The original HTML document.

Returns:

A List of enclosed Images

Throws:

BoilerpipeProcessingException

process

public List<Media> process(URL url,
                  BoilerpipeExtractor extractor)
                    throws IOException,
                           BoilerpipeProcessingException,
                           SAXException

Fetches the given URL using HTMLFetcher and processes the retrieved HTML using the specified BoilerpipeExtractor.

Parameters:

url - the url of the document to fetch

extractor - extractor to use

Returns:

A List of enclosed Images

Throws:

IOException

BoilerpipeProcessingException

SAXException

process

public List<Media> process(String doc,
                  BoilerpipeExtractor extractor)

parses the media (picture, video) out of doc

Parameters:

doc - document to parse the media out

extractor - extractor to use

Returns:

list of extracted media, with size = 0 if no media found