All Implemented Interfaces:: java.lang.AutoCloseable


public abstract class ProxyLoader
 implements AutoCloseable

Load proxies from proxy vendors

Nested Class Summary

Nested Classes
Modifier and Type	Class	Description
`public class`	`ProxyLoader.Companion`

Field Summary

Fields
Modifier and Type	Field	Description
`private Duration`	`minimumProxyTTL`
`private Boolean`	`testProxyBeforeUse`
`private String`	`testUrl`
`private final Duration`	`fileWatchInterval`
`private final Map<Path, Instant>`	`lastModifiedTimes`
`private String`	`banStrategy`
`private Duration`	`ipTimeToBan`
`private Duration`	`segmentTimeToBan`
`private final ConcurrentPassiveExpiringSet<String>`	`bannedIps`
`private final ConcurrentPassiveExpiringSet<String>`	`bannedSegments`
`private Double`	`testIpRate`
`private final Boolean`	`isActive`
`public final static ProxyLoader.Companion`	`Companion`

Constructor Summary

Constructors
Constructor	Description
`ProxyLoader(ImmutableConfig conf)`

Enum Constant Summary

Enum Constants
Enum Constant	Description

Method Summary

Modifier and Type	Method	Description
`final Duration`	`getMinimumProxyTTL()`	The minimum time to live for proxy IPs, the implementation might drop short-live proxy IPs.
`final Unit`	`setMinimumProxyTTL(Duration minimumProxyTTL)`	The minimum time to live for proxy IPs, the implementation might drop short-live proxy IPs.
`final Boolean`	`getTestProxyBeforeUse()`
`final Unit`	`setTestProxyBeforeUse(Boolean testProxyBeforeUse)`
`final String`	`getTestUrl()`
`final Unit`	`setTestUrl(String testUrl)`
`final Duration`	`getFileWatchInterval()`
`final Map<Path, Instant>`	`getLastModifiedTimes()`
`final String`	`getBanStrategy()`
`final Unit`	`setBanStrategy(String banStrategy)`
`final Duration`	`getIpTimeToBan()`
`final Unit`	`setIpTimeToBan(Duration ipTimeToBan)`
`final Duration`	`getSegmentTimeToBan()`
`final Unit`	`setSegmentTimeToBan(Duration segmentTimeToBan)`
`final ConcurrentPassiveExpiringSet<String>`	`getBannedIps()`
`final ConcurrentPassiveExpiringSet<String>`	`getBannedSegments()`
`final Double`	`getTestIpRate()`	The probability to choose a test ip if absent
`final Unit`	`setTestIpRate(Double testIpRate)`	The probability to choose a test ip if absent
`final Boolean`	`isActive()`
`final List<ProxyEntry>`	`updateProxies()`
`abstract List<ProxyEntry>`	`updateProxies(Duration reloadInterval)`
`final Unit`	`updateBanStrategy()`
`final ProxyEntry`	`loadTestProxyIfAbsent()`	Get a test ip by a probability if exist in file TEST_PROXY_FILE
`Unit`	`close()`

Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail
- ProxyLoader
```
ProxyLoader(ImmutableConfig conf)
```

Method Detail

getMinimumProxyTTL
```
 final Duration getMinimumProxyTTL()
```
The minimum time to live for proxy IPs, the implementation might drop short-live proxy IPs.

setMinimumProxyTTL
```
 final Unit setMinimumProxyTTL(Duration minimumProxyTTL)
```
The minimum time to live for proxy IPs, the implementation might drop short-live proxy IPs.

getTestProxyBeforeUse
```
 final Boolean getTestProxyBeforeUse()
```

setTestProxyBeforeUse

 final Unit setTestProxyBeforeUse(Boolean testProxyBeforeUse)

getTestUrl
```
 final String getTestUrl()
```

setTestUrl
```
 final Unit setTestUrl(String testUrl)
```

getFileWatchInterval
```
 final Duration getFileWatchInterval()
```

getLastModifiedTimes

 final Map<Path, Instant> getLastModifiedTimes()

getBanStrategy
```
 final String getBanStrategy()
```

setBanStrategy

 final Unit setBanStrategy(String banStrategy)

getIpTimeToBan
```
 final Duration getIpTimeToBan()
```

setIpTimeToBan

 final Unit setIpTimeToBan(Duration ipTimeToBan)

getSegmentTimeToBan
```
 final Duration getSegmentTimeToBan()
```

setSegmentTimeToBan

 final Unit setSegmentTimeToBan(Duration segmentTimeToBan)

getBannedIps

 final ConcurrentPassiveExpiringSet<String> getBannedIps()

getBannedSegments

 final ConcurrentPassiveExpiringSet<String> getBannedSegments()

getTestIpRate
```
 final Double getTestIpRate()
```
The probability to choose a test ip if absent

setTestIpRate
```
 final Unit setTestIpRate(Double testIpRate)
```
The probability to choose a test ip if absent

isActive
```
 final Boolean isActive()
```

updateProxies
```
 final List<ProxyEntry> updateProxies()
```

updateProxies

 abstract List<ProxyEntry> updateProxies(Duration reloadInterval)

updateBanStrategy

@Synchronized() final Unit updateBanStrategy()

loadTestProxyIfAbsent
```
 final ProxyEntry loadTestProxyIfAbsent()
```
Get a test ip by a probability if exist in file TEST_PROXY_FILE

close
```
 Unit close()
```

Class ProxyLoader

Nested Class Summary

Field Summary

Constructor Summary

Enum Constant Summary

Method Summary

Methods inherited from class java.lang.Object

Constructor Detail

ProxyLoader

Method Detail

getMinimumProxyTTL

setMinimumProxyTTL

getTestProxyBeforeUse

setTestProxyBeforeUse

getTestUrl

setTestUrl

getFileWatchInterval

getLastModifiedTimes

getBanStrategy

setBanStrategy

getIpTimeToBan

setIpTimeToBan

getSegmentTimeToBan

setSegmentTimeToBan

getBannedIps

getBannedSegments

getTestIpRate

setTestIpRate

isActive

updateProxies

updateProxies

updateBanStrategy

loadTestProxyIfAbsent

close