public class HPCCWsDFUClient extends BaseHPCCWsClient
| Modifier and Type | Field and Description |
|---|---|
static String |
DATASET_ELEMENT |
static String |
ROW_ELEMENT |
static String |
WSDFUURI |
DEAFULTECLWATCHPORT, DEFAULTECLWATCHTLSPORT, initErrMessage, stub, targetESPInterfaceVer, targetHPCCBuildVersion, verbose, wsconn| Modifier | Constructor and Description |
|---|---|
protected |
HPCCWsDFUClient(Connection baseConnection)
Instantiates a new HPCC ws DFU client.
|
| Modifier and Type | Method and Description |
|---|---|
AddtoSuperfileResponseWrapper |
addToSuperFile(AddtoSuperfileRequestWrapper request) |
DFUCreateFileWrapper |
createFile(String fileName,
String cluster,
String eclRecordDefinition,
int expirySeconds)
Create a new (unpublished), uncompressed dfu file.
|
DFUCreateFileWrapper |
createFile(String fileName,
String cluster,
String eclRecordDefinition,
int expirySeconds,
Boolean compressed)
Create a new (unpublished) dfu file.
|
DFUCreateFileWrapper |
createFile(String fileName,
String cluster,
String eclRecordDefinition,
int expirySeconds,
Boolean compressed,
DFUFileTypeWrapper filetype,
String requestid)
Create a new (unpublished) dfu file.
|
DFUCreateFileWrapper |
createFile(String fileName,
String cluster,
String eclRecordDefinition,
String[] partitionHostMap,
int expirySeconds)
Create a new (unpublished) dfu file.
|
DFUCreateFileWrapper |
createFileAndAcquireAccess(String fileName,
String cluster,
String eclRecordDefinition,
int expirySeconds,
Boolean compressed,
DFUFileTypeWrapper type,
String requestId)
Create a new (unpublished) dfu file.
|
DFUCreateFileWrapper |
createFileAndAcquireAccess(String fileName,
String cluster,
String eclRecordDefinition,
String[] partitionHostMap,
int expirySeconds,
Boolean returnBinTypeInfo,
Boolean returnJsonTypeInfo,
org.hpccsystems.ws.client.gen.axis2.wsdfu.v1_39.FileAccessRole accessrole,
org.hpccsystems.ws.client.gen.axis2.wsdfu.v1_39.SecAccessType accesstype)
Create a new (unpublished) dfu file.
|
AddtoSuperfileResponseWrapper |
createSuperfile(String superfilename,
String[] subfiles)
Create super file
|
List<DFUResultWrapper> |
deleteFiles(Set<String> files,
String cluster)
Delete files.
|
void |
deleteSuperFileSubfiles(String superfile,
List<String> subfiles)
Delete super file subfiles.
|
static HPCCWsDFUClient |
get(Connection connection)
Gets the.
|
static HPCCWsDFUClient |
get(String protocol,
String targetHost,
String targetPort,
String user,
String pass)
Gets the.
|
static HPCCWsDFUClient |
get(String protocol,
String targetHost,
String targetPort,
String user,
String pass,
int timeout)
Gets the.
|
EclRecordWrapper |
getDatasetFields(String datasetname,
String clusterName,
String fieldSeparator)
This method retrieves a list of columns for a THOR or CSV dataset.
|
org.apache.axis2.client.Stub |
getDefaultStub()
Gets the default stub.
|
DFUSearchDataResponseWrapper |
getDFUData(DFUSearchDataRequestWrapper req)
Return wrapped response from WsDFU DFUSearchData method requests.
|
org.hpccsystems.ws.client.gen.axis2.wsdfu.v1_57.DFUSearchDataResponse |
getDFUData(String openLogicalName,
String cluster,
boolean roxieSelections,
int chooseFile,
int count,
boolean schemaOnly,
long startIndex)
Deprecated.
|
DFUFileAccessInfoWrapper |
getFileAccess(org.hpccsystems.ws.client.gen.axis2.wsdfu.v1_39.SecAccessType accesstype,
String filename,
String clustername,
int expiryseconds,
String jobid,
boolean includejsonTypeInfo,
boolean includebinTypeInfo,
boolean requestfileinfo)
To be used in conjunction with DAFILESRV's rowservice distributed file read stream.
|
DFUFileAccessInfoWrapper |
getFileAccess(String filename,
String clustername,
int expiryseconds,
String jobid)
To be used in conjunction with DAFILESRV's rowservice distributed file read/write stream.
|
String |
getFileAccessBlob(org.hpccsystems.ws.client.gen.axis2.wsdfu.v1_39.SecAccessType accesstype,
String filename,
String clustername,
int expiryseconds,
String jobid)
getFileAccessBlob - HPCC 7.0.x version
The response is to be used in conjunction with DAFILESRV's rowservice distributed file read stream.
|
String |
getFileAccessBlob(String filename,
String clustername,
int expiryseconds,
String jobid)
getFileAccessBlob
The response is to be used in conjunction with DAFILESRV's rowservice distributed file read/write stream.
|
NodeList |
getFileData(String logicalname,
Long beginrow,
Integer numrows,
String clustername)
Gets the file data.
|
List<DFUDataColumnWrapper> |
getFileDataColumns(String logicalname,
String clustername) |
DFUFileDetailWrapper |
getFileDetails(String logicalname,
String clustername)
Gets the file details.
|
DFUFileDetailWrapper |
getFileDetails(String logicalname,
String clustername,
boolean jsonTypeInfo,
boolean binTypeInfo)
Gets the file details.
|
DFUInfoWrapper |
getFileInfo(String logicalname,
String clustername)
Gets the file info.
|
DFUInfoWrapper |
getFileInfo(String logicalname,
String clustername,
boolean jsonTypeInfo,
boolean binTypeInfo)
Gets the file info.
|
List<DFUDataColumnWrapper> |
getFileMetaData(String logicalname,
String clustername)
Use this function to retrieve file metadata such as column information, for superfiles the metadata from the
first subfile will be returned.
|
List<DFULogicalFileWrapper> |
getFiles(String scope)
Gets the files.
|
String |
getFirstRow(String datasetname,
String clustername)
Returns the first row of data for a dataset.
|
List<DFULogicalFileWrapper> |
getLogicalFiles(String filename,
String cluster,
int firstN,
int pageStartFrom,
int pageSize)
Get array of logical files on target HPCC system based on input parameters.
|
String |
getServiceURI()
Gets the service URI.
|
static int |
getServiceWSDLPort()
Gets the service WSDL port.
|
static String |
getServiceWSDLURL()
Gets the service WSDLURL.
|
String[] |
getSuperFileSubfiles(String filename)
Gets the super file subfiles.
|
protected void |
initWsDFUClientStub(Connection conn)
Initializes the service's underlying stub Should only be used by constructors.
|
boolean |
ping()
Ping.
|
void |
publishFile(String fileId,
String eclRecordDefinition,
long totalRecords,
long fileSize)
Publishes file created by WsDFUCreateFile.
|
void |
publishFile(String fileId,
String eclRecordDefinition,
long totalRecords,
long fileSize,
Boolean overwrite)
Publishes file created by WsDFUCreateFile.
|
List<DFULogicalFileWrapper> |
searchFiles(String logicalFilename,
String cluster)
searchFiles.
|
List<DFULogicalFileWrapper> |
searchFiles(String logicalFilename,
String cluster,
Integer pagesize,
Integer pageStartFrom)
searchFiles
|
compatibilityCheck, compatibilityCheck, equals, fastRefresh, fullRefresh, getConnectionURL, getInitError, getServiceVersion, getServiceVersion, getServiceWSDLPort, getServiceWSDLURL, getStubConnectionTO, getTargetESPInterfaceVersion, getVerbose, handleECLExceptions, handleECLExceptions, handleEspExceptions, handleEspExceptions, handleEspSoapFaults, handleEspSoapFaults, hashCode, hasInitError, isComplete, loadESPRuntimeInterfaceVer, setActiveConnectionInfo, setClientAuth, setStubConnectionTO, setStubOptions, setVerbose, verifyStubmonitoraddObserver, clearChanged, countObservers, deleteObserver, deleteObservers, hasChanged, notifyObservers, notifyObservers, setChangedpublic static final String WSDFUURI
public static final String ROW_ELEMENT
public static final String DATASET_ELEMENT
protected HPCCWsDFUClient(Connection baseConnection)
baseConnection - the base connectionpublic String getServiceURI()
getServiceURI in class BaseHPCCWsClientpublic static String getServiceWSDLURL()
public static int getServiceWSDLPort()
public org.apache.axis2.client.Stub getDefaultStub()
throws org.apache.axis2.AxisFault
BaseHPCCWsClientgetDefaultStub in class BaseHPCCWsClientorg.apache.axis2.AxisFault - the axis faultpublic static HPCCWsDFUClient get(Connection connection)
connection - the connectionpublic static HPCCWsDFUClient get(String protocol, String targetHost, String targetPort, String user, String pass)
protocol - the protocoltargetHost - the target hosttargetPort - the target portuser - the userpass - the passpublic static HPCCWsDFUClient get(String protocol, String targetHost, String targetPort, String user, String pass, int timeout)
protocol - the protocoltargetHost - the target hosttargetPort - the target portuser - the userpass - the passtimeout - the timeoutprotected void initWsDFUClientStub(Connection conn)
conn - -- All connection settings includedpublic DFUInfoWrapper getFileInfo(String logicalname, String clustername) throws Exception, ArrayOfEspExceptionWrapper
logicalname - - logical file to get file info for, can start with '~' or notclustername - - Optional. If specified, the cluster on which to search for the fileException - the exceptionArrayOfEspExceptionWrapper - the array of esp exception wrapperpublic DFUInfoWrapper getFileInfo(String logicalname, String clustername, boolean jsonTypeInfo, boolean binTypeInfo) throws Exception, ArrayOfEspExceptionWrapper
logicalname - logical file name, can start with ~clustername - optional, if specified the cluster name used in the searchjsonTypeInfo - want record structure information returned as JSONbinTypeInfo - want record structure information returned in binary formatException - the exceptionArrayOfEspExceptionWrapper - the array of esp exception wrapperpublic NodeList getFileData(String logicalname, Long beginrow, Integer numrows, String clustername) throws Exception, ArrayOfEspExceptionWrapper
logicalname - - logical file to retrieve data forbeginrow - - beginning row to retrieve data fromnumrows - - number of rows of data to retrieveclustername - - Optional. If specified, the cluster on which to find the logical file.Exception - the exceptionArrayOfEspExceptionWrapper - the array of esp exception wrapperpublic List<DFULogicalFileWrapper> getFiles(String scope) throws Exception, ArrayOfEspExceptionWrapper
scope - - file scope/directory to return files forException - the exceptionArrayOfEspExceptionWrapper - the array of esp exception wrapperpublic AddtoSuperfileResponseWrapper createSuperfile(String superfilename, String[] subfiles) throws Exception, ArrayOfEspExceptionWrapper
superfilename - super file namesubfiles - sub filesException - general exceptionArrayOfEspExceptionWrapper - array of esp exception wrapperpublic AddtoSuperfileResponseWrapper addToSuperFile(AddtoSuperfileRequestWrapper request) throws Exception, ArrayOfEspExceptionWrapper
request - - User provided request wrapperException - general exceptionArrayOfEspExceptionWrapper - array of esp exception wrapperpublic String[] getSuperFileSubfiles(String filename) throws Exception, ArrayOfEspExceptionWrapper
filename - the filenameException - the exceptionArrayOfEspExceptionWrapper - the array of esp exception wrapperpublic List<DFUDataColumnWrapper> getFileMetaData(String logicalname, String clustername) throws Exception, ArrayOfEspExceptionWrapper
logicalname - - Logical filename.clustername - - Optional - The cluster the logical filename is associated with.Exception - the exceptionArrayOfEspExceptionWrapper - the array of esp exception wrapperpublic List<DFUDataColumnWrapper> getFileDataColumns(String logicalname, String clustername) throws Exception, ArrayOfEspExceptionWrapper
logicalname - - logical filename to retrieve the dfu data columns for. Currently this method/service call functions
for THOR files but will return nothing for CSV/XML/FLAT data filesclustername - - optional. The cluster the logical filename is associated with.Exception - the exceptionArrayOfEspExceptionWrapper - the array of esp exception wrapperpublic EclRecordWrapper getDatasetFields(String datasetname, String clusterName, String fieldSeparator) throws Exception, ArrayOfEspExceptionWrapper
datasetname - - the name of the dataset to get dataset fields for. Can begin with '~' or not.clusterName - - optional. If given, the name of the cluster associated with the dataset.fieldSeparator - - optional. if given, and if the file being retrieved is a csv file, and if no field definitions exist
for that csv,. this separator will be used rather than the separator defined during spraying when
splitting up the first line of the file to define the number of fieldsException - the exceptionArrayOfEspExceptionWrapper - the array of esp exception wrapperpublic String getFirstRow(String datasetname, String clustername) throws Exception, ArrayOfEspExceptionWrapper
datasetname - - logical filename, with or without '~' at the beginningclustername - - optional. name of the cluster the file's associated withException - the exceptionArrayOfEspExceptionWrapper - the array of esp exception wrapperpublic List<DFULogicalFileWrapper> getLogicalFiles(String filename, String cluster, int firstN, int pageStartFrom, int pageSize) throws Exception, ArrayOfEspExceptionWrapper
filename - the filenamecluster - --- NO LONGER USED ---firstN - the first NpageStartFrom - the page start frompageSize - the page sizeException - the exceptionArrayOfEspExceptionWrapper - the array of esp exception wrapperpublic DFUSearchDataResponseWrapper getDFUData(DFUSearchDataRequestWrapper req) throws Exception, ArrayOfEspExceptionWrapper
DFUSearchDataRequestWrapper - ExceptionArrayOfEspExceptionWrapper@Deprecated public org.hpccsystems.ws.client.gen.axis2.wsdfu.v1_57.DFUSearchDataResponse getDFUData(String openLogicalName, String cluster, boolean roxieSelections, int chooseFile, int count, boolean schemaOnly, long startIndex) throws Exception, ArrayOfEspExceptionWrapper
openLogicalName - the open logical namecluster - the clusterroxieSelections - the roxie selectionschooseFile - the choose filecount - the countschemaOnly - the schema onlystartIndex - the start indexException - the exceptionArrayOfEspExceptionWrapper - the array of esp exception wrapperpublic void deleteSuperFileSubfiles(String superfile, List<String> subfiles) throws Exception, ArrayOfEspExceptionWrapper
superfile - the superfilesubfiles - the subfilesException - the exceptionArrayOfEspExceptionWrapper - the array of esp exception wrapperpublic List<DFUResultWrapper> deleteFiles(Set<String> files, String cluster) throws Exception, ArrayOfEspExceptionWrapper
files - - list of filenames to delete - can use filename@cluster notationcluster - - name of cluster to delete from (will delete from all clusters if null)
If provided, it is post-pended to filesException - the exceptionArrayOfEspExceptionWrapper - the array of esp exception wrapperpublic List<DFULogicalFileWrapper> searchFiles(String logicalFilename, String cluster) throws Exception, ArrayOfEspExceptionWrapper
logicalFilename - - the filename to search forcluster - - the cluster to search onException - the exceptionArrayOfEspExceptionWrapper - the array of esp exception wrapperpublic List<DFULogicalFileWrapper> searchFiles(String logicalFilename, String cluster, Integer pagesize, Integer pageStartFrom) throws Exception, ArrayOfEspExceptionWrapper
logicalFilename - - the filename to search forcluster - - the cluster to search onpagesize - - the size of the pagepageStartFrom - - the location to search fromException - general exceptionArrayOfEspExceptionWrapper - array of esp exception wrapperpublic String getFileAccessBlob(org.hpccsystems.ws.client.gen.axis2.wsdfu.v1_39.SecAccessType accesstype, String filename, String clustername, int expiryseconds, String jobid) throws Exception, ArrayOfEspExceptionWrapper
accesstype - - the file access level to request to requestfilename - - the name of the target file to be accessedclustername - - the name of the target file's HPCC cluster (can be empty)expiryseconds - - the number of seconds file access is grantedjobid - - unique identifier for access tokenException - the exceptionArrayOfEspExceptionWrapper - the array of esp exception wrapperpublic String getFileAccessBlob(String filename, String clustername, int expiryseconds, String jobid) throws Exception, ArrayOfEspExceptionWrapper
filename - - the name of the target file to be accessedclustername - - the name of the target file's HPCC cluster (can be empty)expiryseconds - - the number of seconds file access is grantedjobid - - unique identifier for access tokenException - the exceptionArrayOfEspExceptionWrapper - the array of esp exception wrapperpublic DFUFileAccessInfoWrapper getFileAccess(org.hpccsystems.ws.client.gen.axis2.wsdfu.v1_39.SecAccessType accesstype, String filename, String clustername, int expiryseconds, String jobid, boolean includejsonTypeInfo, boolean includebinTypeInfo, boolean requestfileinfo) throws Exception, ArrayOfEspExceptionWrapper
accesstype - HPCC 7.0.x version
- the file access level to request to requestfilename - - the name of the target file to be accessedclustername - - the name of the target file's HPCC cluster (can be empty)expiryseconds - - the number of seconds file access is grantedjobid - - unique identifier for access tokenincludejsonTypeInfo - - flag to request file info in JSON formatincludebinTypeInfo - - flag to request file info in Binary formatrequestfileinfo - the requestfileinfoException - the exceptionArrayOfEspExceptionWrapper - the array of esp exception wrapperpublic DFUFileAccessInfoWrapper getFileAccess(String filename, String clustername, int expiryseconds, String jobid) throws Exception, ArrayOfEspExceptionWrapper
filename - - the name of the target file to be accessedclustername - - the name of the target file's HPCC cluster (can be empty)expiryseconds - - the number of seconds file access is grantedjobid - - unique identifier for access tokenException - the exceptionArrayOfEspExceptionWrapper - the array of esp exception wrapperpublic DFUCreateFileWrapper createFile(String fileName, String cluster, String eclRecordDefinition, String[] partitionHostMap, int expirySeconds) throws Exception, ArrayOfEspExceptionWrapper
fileName - the file namecluster - the clustereclRecordDefinition - the ecl record definitionpartitionHostMap - Array declaring the Filepart[i] to Node mappingexpirySeconds - the expiry secondsException - the exceptionArrayOfEspExceptionWrapper - the array of esp exception wrapperpublic DFUCreateFileWrapper createFileAndAcquireAccess(String fileName, String cluster, String eclRecordDefinition, String[] partitionHostMap, int expirySeconds, Boolean returnBinTypeInfo, Boolean returnJsonTypeInfo, org.hpccsystems.ws.client.gen.axis2.wsdfu.v1_39.FileAccessRole accessrole, org.hpccsystems.ws.client.gen.axis2.wsdfu.v1_39.SecAccessType accesstype) throws Exception, ArrayOfEspExceptionWrapper
fileName - the file namecluster - the clustereclRecordDefinition - the ecl record definitionpartitionHostMap - Array declaring the Filepart[i] to Node mappingexpirySeconds - the expiry secondsreturnBinTypeInfo - the return bin type inforeturnJsonTypeInfo - the return json type infoaccessrole - the accessroleaccesstype - the accesstypeException - the exceptionArrayOfEspExceptionWrapper - the array of esp exception wrapperpublic DFUCreateFileWrapper createFile(String fileName, String cluster, String eclRecordDefinition, int expirySeconds) throws Exception, ArrayOfEspExceptionWrapper
fileName - the file namecluster - the clustereclRecordDefinition - the ecl record definitionexpirySeconds - the expiry secondsException - the exceptionArrayOfEspExceptionWrapper - the array of esp exception wrapperpublic DFUCreateFileWrapper createFile(String fileName, String cluster, String eclRecordDefinition, int expirySeconds, Boolean compressed) throws Exception, ArrayOfEspExceptionWrapper
fileName - the file namecluster - the clustereclRecordDefinition - the ecl record definitionexpirySeconds - the expiry secondscompressed - the compressedException - the exceptionArrayOfEspExceptionWrapper - the array of esp exception wrapperpublic DFUCreateFileWrapper createFile(String fileName, String cluster, String eclRecordDefinition, int expirySeconds, Boolean compressed, DFUFileTypeWrapper filetype, String requestid) throws Exception, ArrayOfEspExceptionWrapper
fileName - the file namecluster - the clustereclRecordDefinition - the ecl record definitionexpirySeconds - the expiry secondscompressed - the compressedfiletype - - for example DFUFileTypeWrapper.Csvrequestid - the requestidException - the exceptionArrayOfEspExceptionWrapper - the array of esp exception wrapperpublic DFUCreateFileWrapper createFileAndAcquireAccess(String fileName, String cluster, String eclRecordDefinition, int expirySeconds, Boolean compressed, DFUFileTypeWrapper type, String requestId) throws Exception, ArrayOfEspExceptionWrapper
fileName - the file namecluster - the clustereclRecordDefinition - the ecl record definitionexpirySeconds - the expiry secondscompressed - the compressedtype - - for example DFUFileTypeWrapper.CsvrequestId - the request idException - the exceptionArrayOfEspExceptionWrapper - the array of esp exception wrapperpublic void publishFile(String fileId, String eclRecordDefinition, long totalRecords, long fileSize) throws Exception, ArrayOfEspExceptionWrapper
fileId - the file ideclRecordDefinition - the ecl record definitiontotalRecords - the total recordsfileSize - the file sizeException - the exceptionArrayOfEspExceptionWrapper - the array of esp exception wrapperpublic void publishFile(String fileId, String eclRecordDefinition, long totalRecords, long fileSize, Boolean overwrite) throws Exception, ArrayOfEspExceptionWrapper
fileId - the file ideclRecordDefinition - the ecl record definitiontotalRecords - the total recordsfileSize - the file sizeoverwrite - the overwriteException - the exceptionArrayOfEspExceptionWrapper - the array of esp exception wrapperpublic DFUFileDetailWrapper getFileDetails(String logicalname, String clustername) throws Exception, ArrayOfEspExceptionWrapper
logicalname - - logical file to get file info for, can start with '~' or notclustername - - Optional. If specified, the cluster on which to search for the fileException - the exceptionArrayOfEspExceptionWrapper - the array of esp exception wrapperpublic DFUFileDetailWrapper getFileDetails(String logicalname, String clustername, boolean jsonTypeInfo, boolean binTypeInfo) throws Exception, ArrayOfEspExceptionWrapper
logicalname - logical file for request, can start with ~clustername - optionaljsonTypeInfo - true if record structure information in JSON format is to be returnedbinTypeInfo - true if record structure information in binary format is to be returnedException - the exceptionArrayOfEspExceptionWrapper - the array of esp exception wrapperCopyright © 2021. All rights reserved.