Deprecated API

Contents

• Deprecated Interfaces
• Deprecated Fields
• Deprecated Methods
• Deprecated Constructors

Deprecated Interfaces

Interface and Description
org.apache.gobblin.dataset.DatasetResolver use the more general DescriptorResolver
org.apache.gobblin.dataset.DatasetResolverFactory use DescriptorResolverFactory as DatasetResolver is deprecated with DescriptorResolver

Deprecated Fields

Field and Description
org.apache.gobblin.configuration.ConfigurationKeys.DATA_PUBLISHER_FINAL_DIR_GROUP
org.apache.gobblin.configuration.ConfigurationKeys.DATA_PUBLISHER_TYPE Use ConfigurationKeys.TASK_DATA_PUBLISHER_TYPE and ConfigurationKeys.JOB_DATA_PUBLISHER_TYPE.

Deprecated Methods

Method and Description
org.apache.gobblin.source.workunit.Extract.addDeltaField(String...) It is recommended to add delta fields in WorkUnit instead of Extract.
org.apache.gobblin.source.workunit.Extract.addPrimaryKey(String...) @deprecated It is recommended to add primary keys in WorkUnit instead of Extract.
org.apache.gobblin.dataset.DatasetsFinder.commonDatasetRoot()
org.apache.gobblin.configuration.SourceState.createExtract(Extract.TableType, String, String)
org.apache.gobblin.configuration.SourceState.createWorkUnit(Extract) Properties in SourceState should not added to a WorkUnit. Having each WorkUnit contain a copy of SourceState is a waste of memory. Use WorkUnit.create(Extract).
org.apache.gobblin.dataset.Dataset.datasetURN() use Dataset.getUrn()
org.apache.gobblin.dataset.DatasetDescriptor.fromDataMap(Map<String, String>) use Descriptor#deserialize(String)
org.apache.gobblin.dataset.IterableDatasetFinder.getDatasetsIterator() use IterableDatasetFinder.getDatasetsStream(int, java.util.Comparator<T>) instead.
org.apache.gobblin.source.workunit.Extract.getDeltaFields() It is recommended to obtain delta fields from WorkUnit instead of Extract.
org.apache.gobblin.source.extractor.Extractor.getHighWatermark() there is no longer support for reporting the high watermark via this method, please see Watermarks for more information.
org.apache.gobblin.configuration.WorkUnitState.getHighWaterMark() use WorkUnitState.getActualHighWatermark().
org.apache.gobblin.source.workunit.WorkUnit.getHighWaterMark() use the WorkUnit.getExpectedHighWatermark() method.
org.apache.gobblin.source.workunit.Extract.getIsFull() It is recommend to get this information from WorkUnit instead of Extract.
org.apache.gobblin.source.workunit.WorkUnit.getLowWaterMark() use the WorkUnit.getLowWatermark() method.
org.apache.gobblin.source.workunit.Extract.getOutputFilePath() As this.getIsFull is deprecated.
org.apache.gobblin.source.workunit.Extract.getPrimaryKeys() It is recommended to obtain primary keys from WorkUnit instead of Extract.
org.apache.gobblin.configuration.WorkUnitState.getProperty(String) Use WorkUnitState.getProp(String)
org.apache.gobblin.configuration.State.getProperty(String) Use State.getProp(String)
org.apache.gobblin.configuration.WorkUnitState.getProperty(String, String) Use WorkUnitState.getProp(String, String)
org.apache.gobblin.configuration.State.getProperty(String, String) Use State.getProp(String, String)
org.apache.gobblin.publisher.DataPublisher.initialize() DataPublisher initialization should be done in the constructor.
org.apache.gobblin.source.workunit.Extract.setDeltaFields(String...) It is recommended to set delta fields in WorkUnit instead of Extract.
org.apache.gobblin.source.workunit.Extract.setFullTrue(long) It is recommend to set this information in WorkUnit instead of Extract.
org.apache.gobblin.configuration.ImmutableWorkUnitState.setHighWaterMark(long)
org.apache.gobblin.configuration.WorkUnitState.setHighWaterMark(long) use WorkUnitState.setActualHighWatermark(Watermark).
org.apache.gobblin.source.workunit.ImmutableWorkUnit.setHighWaterMark(long)
org.apache.gobblin.source.workunit.WorkUnit.setHighWaterMark(long) use WorkUnit.setWatermarkInterval(WatermarkInterval).
org.apache.gobblin.source.workunit.ImmutableWorkUnit.setLowWaterMark(long)
org.apache.gobblin.source.workunit.WorkUnit.setLowWaterMark(long) use WorkUnit.setWatermarkInterval(WatermarkInterval).
org.apache.gobblin.source.workunit.Extract.setPrimaryKeys(String...) It is recommended to set primary keys in WorkUnit instead of Extract.
org.apache.gobblin.dataset.DatasetDescriptor.toDataMap() use Descriptor#serialize(Descriptor)
org.apache.gobblin.records.RecordStreamWithMetadata.withRecordStream(Flowable<StreamEntity<DO>>, SO)

Deprecated Constructors

Constructor and Description
org.apache.gobblin.dataset.DatasetDescriptor(DatasetDescriptor) use DatasetDescriptor.copy()
org.apache.gobblin.dataset.DatasetDescriptor(String, String) use DatasetDescriptor.DatasetDescriptor(String, URI, String) to provide storage system url.
org.apache.gobblin.source.workunit.Extract(SourceState, Extract.TableType, String, String) Extract does not use any property in SourceState. Use Extract.Extract(TableType, String, String)
gobblin.source.workunit.Extract(SourceState, Extract.TableType, String, String)
org.apache.gobblin.source.workunit.MultiWorkUnit() Use MultiWorkUnit.createEmpty() instead.
gobblin.source.workunit.MultiWorkUnit()
org.apache.gobblin.source.workunit.WorkUnit() Use WorkUnit.createEmpty()
gobblin.source.workunit.WorkUnit()
org.apache.gobblin.source.workunit.WorkUnit(SourceState, Extract) Properties in SourceState should not be added to a WorkUnit. Having each WorkUnit contain a copy of SourceState is a waste of memory. Use WorkUnit.create(Extract).
gobblin.source.workunit.WorkUnit(SourceState, Extract)
org.apache.gobblin.source.workunit.WorkUnit(SourceState, Extract, WatermarkInterval) Properties in SourceState should not be added to a WorkUnit. Having each WorkUnit contain a copy of SourceState is a waste of memory. Use WorkUnit.create(Extract, WatermarkInterval).
gobblin.source.workunit.WorkUnit(SourceState, Extract, WatermarkInterval)
org.apache.gobblin.source.workunit.WorkUnit(WorkUnit) Use WorkUnit.copyOf(WorkUnit)
gobblin.source.workunit.WorkUnit(WorkUnit)
org.apache.gobblin.configuration.WorkUnitState(WorkUnit) It is recommended to use WorkUnitState.WorkUnitState(WorkUnit, State) rather than combining properties in the job state into the workunit.
gobblin.configuration.WorkUnitState(WorkUnit)