Package org.apache.pulsar.broker.service.nonpersistent

Class NonPersistentTopic

java.lang.Object

org.apache.pulsar.broker.service.AbstractTopic

org.apache.pulsar.broker.service.nonpersistent.NonPersistentTopic

All Implemented Interfaces:

Topic, TopicPolicyListener<org.apache.pulsar.common.policies.data.TopicPolicies>

public class NonPersistentTopic
extends AbstractTopic
implements Topic, TopicPolicyListener<org.apache.pulsar.common.policies.data.TopicPolicies>

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.pulsar.broker.service.Topic

Topic.PublishContext

Field Summary

Fields inherited from class org.apache.pulsar.broker.service.AbstractTopic

addEntryLatencyStatsUsec, brokerService, bytesOutFromRemovedSubscriptions, hasBatchMessagePublished, isAllowAutoUpdateSchema, isEncryptionRequired, isFenced, lastActive, lock, msgOutFromRemovedSubscriptions, POLICY_UPDATE_FAILURE_RETRY_TIME_SECONDS, preciseTopicPublishRateLimitingEnable, producers, publishRateLimitedTimes, replicatorPrefix, resourceGroupPublishLimiter, resourceGroupRateLimitingEnabled, schemaValidationEnforced, topic, topicEpoch, topicPolicies, topicPublishRateLimiter

Constructor Summary

Constructors

Constructor	Description
NonPersistentTopic(java.lang.String topic, BrokerService brokerService)

Method Summary

Modifier and Type	Method	Description
protected java.util.concurrent.CompletableFuture<java.lang.Void>	addReplicationCluster(java.lang.String remoteCluster, NonPersistentTopic nonPersistentTopic, java.lang.String localCluster)
java.util.concurrent.CompletableFuture<java.lang.Void>	addSchemaIfIdleOrCheckCompatible(org.apache.pulsar.common.protocol.schema.SchemaData schema)	If the topic is idle (no producers, no entries, no subscribers and no existing schema), add the passed schema to the topic.
java.util.concurrent.CompletableFuture<org.apache.pulsar.common.policies.data.stats.NonPersistentTopicStatsImpl>	asyncGetStats(boolean getPreciseBacklog, boolean subscriptionBacklogSize, boolean getEarliestTimeInBacklog)
void	checkBackloggedCursors()	Activate cursors those caught up backlog-threshold entries and deactivate slow cursors which are creating backlog.
java.util.concurrent.CompletableFuture<java.lang.Void>	checkBacklogQuotaExceeded(java.lang.String producerName, org.apache.pulsar.common.policies.data.BacklogQuota.BacklogQuotaType backlogQuotaType)
void	checkDeduplicationSnapshot()
void	checkGC()
java.util.concurrent.CompletableFuture<java.lang.Void>	checkIfTransactionBufferRecoverCompletely(boolean isTxnEnabled)	Wait TransactionBuffer Recovers completely.
void	checkInactiveSubscriptions()
void	checkMessageDeduplicationInfo()
void	checkMessageExpiry()
java.util.concurrent.CompletableFuture<java.lang.Void>	checkReplication()
java.util.concurrent.CompletableFuture<java.lang.Void>	close(boolean closeWithoutWaitingClientDisconnect)	Close this topic - close all producers and subscriptions associated with this topic.
java.util.concurrent.CompletableFuture<Subscription>	createSubscription(java.lang.String subscriptionName, org.apache.pulsar.common.api.proto.CommandSubscribe.InitialPosition initialPosition, boolean replicateSubscriptionState, java.util.Map<java.lang.String,java.lang.String> properties)
java.util.concurrent.CompletableFuture<java.lang.Void>	delete()
java.util.concurrent.CompletableFuture<java.lang.Void>	deleteForcefully()	Forcefully close all producers/consumers/replicators and deletes the topic.
java.util.concurrent.CompletableFuture<java.lang.Void>	endTxn(org.apache.pulsar.client.api.transaction.TxnID txnID, int txnAction, long lowWaterMark)	End the transaction in this topic.
org.apache.pulsar.common.policies.data.BacklogQuota	getBacklogQuota(org.apache.pulsar.common.policies.data.BacklogQuota.BacklogQuotaType backlogQuotaType)
java.util.concurrent.CompletableFuture<org.apache.pulsar.common.policies.data.PersistentTopicInternalStats>	getInternalStats(boolean includeLedgerMetadata)
java.util.concurrent.CompletableFuture<org.apache.pulsar.client.api.MessageId>	getLastMessageId()
org.apache.bookkeeper.mledger.Position	getLastPosition()
int	getNumberOfConsumers()
int	getNumberOfSameAddressConsumers(java.lang.String clientAddress)
Replicator	getPersistentReplicator(java.lang.String remoteCluster)
org.apache.pulsar.common.util.collections.ConcurrentOpenHashMap<java.lang.String,NonPersistentReplicator>	getReplicators()
org.apache.pulsar.common.policies.data.stats.NonPersistentTopicStatsImpl	getStats(boolean getPreciseBacklog, boolean subscriptionBacklogSize, boolean getEarliestTimeInBacklog)
Subscription	getSubscription(java.lang.String subscription)
org.apache.pulsar.common.util.collections.ConcurrentOpenHashMap<java.lang.String,NonPersistentSubscription>	getSubscriptions()
protected java.util.concurrent.CompletableFuture<java.lang.Long>	incrementTopicEpoch(java.util.Optional<java.lang.Long> currentEpoch)
java.util.concurrent.CompletableFuture<java.lang.Void>	initialize()
boolean	isActive()
boolean	isPersistent()
boolean	isReplicated()
protected boolean	isTerminated()
java.util.concurrent.CompletableFuture<java.lang.Void>	onPoliciesUpdate(org.apache.pulsar.common.policies.data.Policies data)
void	onUpdate(org.apache.pulsar.common.policies.data.TopicPolicies data)
void	publishMessage(io.netty.buffer.ByteBuf data, Topic.PublishContext callback)
void	publishTxnMessage(org.apache.pulsar.client.api.transaction.TxnID txnID, io.netty.buffer.ByteBuf headersAndPayload, Topic.PublishContext publishContext)	Publish Transaction message to this Topic's TransactionBuffer.
void	removeProducer(Producer producer)
protected java.util.concurrent.CompletableFuture<java.lang.Long>	setTopicEpoch(long newEpoch)
java.util.concurrent.CompletableFuture<java.lang.Void>	stopReplProducers()
java.util.concurrent.CompletableFuture<Consumer>	subscribe(SubscriptionOption option)	Subscribe a topic.
java.util.concurrent.CompletableFuture<Consumer>	subscribe(TransportCnx cnx, java.lang.String subscriptionName, long consumerId, org.apache.pulsar.common.api.proto.CommandSubscribe.SubType subType, int priorityLevel, java.lang.String consumerName, boolean isDurable, org.apache.pulsar.client.api.MessageId startMessageId, java.util.Map<java.lang.String,java.lang.String> metadata, boolean readCompacted, org.apache.pulsar.common.api.proto.CommandSubscribe.InitialPosition initialPosition, long resetStartMessageBackInSec, boolean replicateSubscriptionState, org.apache.pulsar.common.api.proto.KeySharedMeta keySharedMeta)
java.util.concurrent.CompletableFuture<java.lang.Void>	truncate()	Truncate a topic.
java.util.concurrent.CompletableFuture<java.lang.Void>	unsubscribe(java.lang.String subscriptionName)
void	updateRates(NamespaceStats nsStats, org.apache.pulsar.policies.data.loadbalancer.NamespaceBundleStats bundleStats, StatsOutputStream topicStatsStream, ClusterReplicationMetrics replStats, java.lang.String namespace, boolean hydratePublishers)

Methods inherited from class org.apache.pulsar.broker.service.AbstractTopic

addConsumerToSubscription, addFilteredEntriesCount, addProducer, addSchema, checkSchemaCompatibleForConsumer, checkTopicFenced, checkTopicPublishThrottlingRate, currentUsageCount, decrementUsageCount, deletePartitionedTopicMetadataWhileInactive, deleteSchema, deleteTopicPolicies, disableCnxAutoRead, disableProducerRead, enableCnxAutoRead, enableProducerReadForPublishBufferLimiting, enableProducerReadForPublishRateLimiting, getActiveConsumer, getBrokerPublishRateLimiter, getBrokerService, getBytesInCounter, getBytesOutCounter, getDispatchRate, getFilteredEntriesCount, getHierarchyTopicPolicies, getInactiveTopicPolicies, getMsgInCounter, getMsgOutCounter, getName, getNumberOfSameAddressConsumers, getNumberOfSameAddressProducers, getProducers, getReplicatorDispatchRate, getReplicatorPrefix, getSchemaCompatibilityStrategy, getSchemaValidationEnforced, getSubscribeRate, getSubscriptionDispatchRate, getTopicPolicies, getTopicPublishRateLimiter, getWaitingProducersCount, handleConsumerAdded, handleProducerRemoved, hasLocalProducers, hasSchema, increasePublishLimitedTimes, incrementPublishCount, incrementTopicEpochIfNeeded, internalAddProducer, isBrokerPublishRateExceeded, isConsumersExceededOnTopic, isDeleteWhileInactive, isEncryptionRequired, isExceedMaximumMessageSize, isProducersExceeded, isPublishRateExceeded, isResourceGroupPublishRateExceeded, isResourceGroupRateLimitingEnabled, isSameAddressConsumersExceededOnTopic, isSameAddressProducersExceeded, isTopicPublishRateExceeded, markBatchMessagePublished, recordAddLatency, registerTopicPolicyListener, resetBrokerPublishCountAndEnableReadIfRequired, resetTopicPublishCountAndEnableReadIfRequired, toString, unregisterTopicPolicyListener, updateBrokerDispatchRate, updateBrokerPublishRate, updateBrokerReplicatorDispatchRate, updateBrokerSubscribeRate, updateBrokerSubscriptionDispatchRate, updateBrokerSubscriptionTypesEnabled, updateDispatchRateLimiter, updatePublishDispatcher, updateResourceGroupLimiter, updateTopicPolicy, updateTopicPolicyByNamespacePolicy

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface org.apache.pulsar.broker.service.Topic

addProducer, addSchema, checkSchemaCompatibleForConsumer, checkTopicPublishThrottlingRate, deleteSchema, disableCnxAutoRead, enableCnxAutoRead, getBrokerDispatchRateLimiter, getBrokerService, getDispatchRateLimiter, getHierarchyTopicPolicies, getName, getProducers, getSchemaValidationEnforced, getSubscribeRateLimiter, hasSchema, increasePublishLimitedTimes, incrementPublishCount, isBrokerPublishRateExceeded, isEncryptionRequired, isPublishRateExceeded, isResourceGroupPublishRateExceeded, isResourceGroupRateLimitingEnabled, isSystemTopic, isTopicPublishRateExceeded, recordAddLatency, resetBrokerPublishCountAndEnableReadIfRequired, resetTopicPublishCountAndEnableReadIfRequired

Constructor Detail

NonPersistentTopic

public NonPersistentTopic(java.lang.String topic,
                          BrokerService brokerService)

Method Detail

initialize

public java.util.concurrent.CompletableFuture<java.lang.Void> initialize()

Specified by:

initialize in interface Topic

publishMessage

public void publishMessage(io.netty.buffer.ByteBuf data,
                           Topic.PublishContext callback)

Specified by:

publishMessage in interface Topic

incrementTopicEpoch

protected java.util.concurrent.CompletableFuture<java.lang.Long> incrementTopicEpoch(java.util.Optional<java.lang.Long> currentEpoch)

Specified by:

incrementTopicEpoch in class AbstractTopic

setTopicEpoch

protected java.util.concurrent.CompletableFuture<java.lang.Long> setTopicEpoch(long newEpoch)

Specified by:

setTopicEpoch in class AbstractTopic

checkMessageDeduplicationInfo

public void checkMessageDeduplicationInfo()

Specified by:

checkMessageDeduplicationInfo in interface Topic

removeProducer

public void removeProducer(Producer producer)

Specified by:

removeProducer in interface Topic

Overrides:

removeProducer in class AbstractTopic

checkIfTransactionBufferRecoverCompletely

public java.util.concurrent.CompletableFuture<java.lang.Void> checkIfTransactionBufferRecoverCompletely(boolean isTxnEnabled)

Description copied from interface: Topic

Wait TransactionBuffer Recovers completely. Take snapshot after TB Recovers completely.

Specified by:

checkIfTransactionBufferRecoverCompletely in interface Topic

Returns:

a future which has completely if isTxn = false. Or a future return by takeSnapshot.

subscribe

public java.util.concurrent.CompletableFuture<Consumer> subscribe(SubscriptionOption option)

Description copied from interface: Topic

Subscribe a topic.

Specified by:

subscribe in interface Topic

Returns:

subscribe

public java.util.concurrent.CompletableFuture<Consumer> subscribe(TransportCnx cnx,
                                                                  java.lang.String subscriptionName,
                                                                  long consumerId,
                                                                  org.apache.pulsar.common.api.proto.CommandSubscribe.SubType subType,
                                                                  int priorityLevel,
                                                                  java.lang.String consumerName,
                                                                  boolean isDurable,
                                                                  org.apache.pulsar.client.api.MessageId startMessageId,
                                                                  java.util.Map<java.lang.String,java.lang.String> metadata,
                                                                  boolean readCompacted,
                                                                  org.apache.pulsar.common.api.proto.CommandSubscribe.InitialPosition initialPosition,
                                                                  long resetStartMessageBackInSec,
                                                                  boolean replicateSubscriptionState,
                                                                  org.apache.pulsar.common.api.proto.KeySharedMeta keySharedMeta)

Specified by:

subscribe in interface Topic

createSubscription

public java.util.concurrent.CompletableFuture<Subscription> createSubscription(java.lang.String subscriptionName,
                                                                               org.apache.pulsar.common.api.proto.CommandSubscribe.InitialPosition initialPosition,
                                                                               boolean replicateSubscriptionState,
                                                                               java.util.Map<java.lang.String,java.lang.String> properties)

Specified by:

createSubscription in interface Topic

delete

public java.util.concurrent.CompletableFuture<java.lang.Void> delete()

Specified by:

delete in interface Topic

deleteForcefully

public java.util.concurrent.CompletableFuture<java.lang.Void> deleteForcefully()

Forcefully close all producers/consumers/replicators and deletes the topic.

Specified by:

deleteForcefully in interface Topic

Returns:

close

public java.util.concurrent.CompletableFuture<java.lang.Void> close(boolean closeWithoutWaitingClientDisconnect)

Close this topic - close all producers and subscriptions associated with this topic.

Specified by:

close in interface Topic

Parameters:

closeWithoutWaitingClientDisconnect - don't wait for client disconnect and forcefully close managed-ledger

Returns:

Completable future indicating completion of close operation

stopReplProducers

public java.util.concurrent.CompletableFuture<java.lang.Void> stopReplProducers()

checkReplication

public java.util.concurrent.CompletableFuture<java.lang.Void> checkReplication()

Specified by:

checkReplication in interface Topic

addReplicationCluster

protected java.util.concurrent.CompletableFuture<java.lang.Void> addReplicationCluster(java.lang.String remoteCluster,
                                                                                       NonPersistentTopic nonPersistentTopic,
                                                                                       java.lang.String localCluster)

checkMessageExpiry

public void checkMessageExpiry()

Specified by:

checkMessageExpiry in interface Topic

getNumberOfConsumers

public int getNumberOfConsumers()

Specified by:

getNumberOfConsumers in class AbstractTopic

getNumberOfSameAddressConsumers

public int getNumberOfSameAddressConsumers(java.lang.String clientAddress)

Specified by:

getNumberOfSameAddressConsumers in class AbstractTopic

getSubscriptions

public org.apache.pulsar.common.util.collections.ConcurrentOpenHashMap<java.lang.String,NonPersistentSubscription> getSubscriptions()

Specified by:

getSubscriptions in interface Topic

getReplicators

public org.apache.pulsar.common.util.collections.ConcurrentOpenHashMap<java.lang.String,NonPersistentReplicator> getReplicators()

Specified by:

getReplicators in interface Topic

getSubscription

public Subscription getSubscription(java.lang.String subscription)

Specified by:

getSubscription in interface Topic

getPersistentReplicator

public Replicator getPersistentReplicator(java.lang.String remoteCluster)

updateRates

public void updateRates(NamespaceStats nsStats,
                        org.apache.pulsar.policies.data.loadbalancer.NamespaceBundleStats bundleStats,
                        StatsOutputStream topicStatsStream,
                        ClusterReplicationMetrics replStats,
                        java.lang.String namespace,
                        boolean hydratePublishers)

Specified by:

updateRates in interface Topic

getStats

public org.apache.pulsar.common.policies.data.stats.NonPersistentTopicStatsImpl getStats(boolean getPreciseBacklog,
                                                                                         boolean subscriptionBacklogSize,
                                                                                         boolean getEarliestTimeInBacklog)

Specified by:

getStats in interface Topic

asyncGetStats

public java.util.concurrent.CompletableFuture<org.apache.pulsar.common.policies.data.stats.NonPersistentTopicStatsImpl> asyncGetStats(boolean getPreciseBacklog,
                                                                                                                                      boolean subscriptionBacklogSize,
                                                                                                                                      boolean getEarliestTimeInBacklog)

Specified by:

asyncGetStats in interface Topic

getInternalStats

public java.util.concurrent.CompletableFuture<org.apache.pulsar.common.policies.data.PersistentTopicInternalStats> getInternalStats(boolean includeLedgerMetadata)

Specified by:

getInternalStats in interface Topic

isActive

public boolean isActive()

checkGC

public void checkGC()

Specified by:

checkGC in interface Topic

checkInactiveSubscriptions

public void checkInactiveSubscriptions()

Specified by:

checkInactiveSubscriptions in interface Topic

checkBackloggedCursors

public void checkBackloggedCursors()

Description copied from interface: Topic

Activate cursors those caught up backlog-threshold entries and deactivate slow cursors which are creating backlog.

Specified by:

checkBackloggedCursors in interface Topic

checkDeduplicationSnapshot

public void checkDeduplicationSnapshot()

Specified by:

checkDeduplicationSnapshot in interface Topic

onPoliciesUpdate

public java.util.concurrent.CompletableFuture<java.lang.Void> onPoliciesUpdate(org.apache.pulsar.common.policies.data.Policies data)

Specified by:

onPoliciesUpdate in interface Topic

onUpdate

public void onUpdate(org.apache.pulsar.common.policies.data.TopicPolicies data)

Specified by:

onUpdate in interface TopicPolicyListener<org.apache.pulsar.common.policies.data.TopicPolicies>

getBacklogQuota

public org.apache.pulsar.common.policies.data.BacklogQuota getBacklogQuota(org.apache.pulsar.common.policies.data.BacklogQuota.BacklogQuotaType backlogQuotaType)

Specified by:

getBacklogQuota in interface Topic

Returns:

Backlog quota for topic

checkBacklogQuotaExceeded

public java.util.concurrent.CompletableFuture<java.lang.Void> checkBacklogQuotaExceeded(java.lang.String producerName,
                                                                                        org.apache.pulsar.common.policies.data.BacklogQuota.BacklogQuotaType backlogQuotaType)

Specified by:

checkBacklogQuotaExceeded in interface Topic

Returns:

quota exceeded status for blocking producer creation

isReplicated

public boolean isReplicated()

Specified by:

isReplicated in interface Topic

unsubscribe

public java.util.concurrent.CompletableFuture<java.lang.Void> unsubscribe(java.lang.String subscriptionName)

Specified by:

unsubscribe in interface Topic

getLastPosition

public org.apache.bookkeeper.mledger.Position getLastPosition()

Specified by:

getLastPosition in interface Topic

getLastMessageId

public java.util.concurrent.CompletableFuture<org.apache.pulsar.client.api.MessageId> getLastMessageId()

Specified by:

getLastMessageId in interface Topic

addSchemaIfIdleOrCheckCompatible

public java.util.concurrent.CompletableFuture<java.lang.Void> addSchemaIfIdleOrCheckCompatible(org.apache.pulsar.common.protocol.schema.SchemaData schema)

Description copied from interface: Topic

If the topic is idle (no producers, no entries, no subscribers and no existing schema), add the passed schema to the topic. Otherwise, check that the passed schema is compatible with what the topic already has.

Specified by:

addSchemaIfIdleOrCheckCompatible in interface Topic

publishTxnMessage

public void publishTxnMessage(org.apache.pulsar.client.api.transaction.TxnID txnID,
                              io.netty.buffer.ByteBuf headersAndPayload,
                              Topic.PublishContext publishContext)

Description copied from interface: Topic

Publish Transaction message to this Topic's TransactionBuffer.

Specified by:

publishTxnMessage in interface Topic

Parameters:

txnID - Transaction Id

headersAndPayload - Message data

publishContext - Publish context

endTxn

public java.util.concurrent.CompletableFuture<java.lang.Void> endTxn(org.apache.pulsar.client.api.transaction.TxnID txnID,
                                                                     int txnAction,
                                                                     long lowWaterMark)

Description copied from interface: Topic

End the transaction in this topic.

Specified by:

endTxn in interface Topic

Parameters:

txnID - Transaction id

txnAction - Transaction action.

lowWaterMark - low water mark of this tc

Returns:

truncate

public java.util.concurrent.CompletableFuture<java.lang.Void> truncate()

Description copied from interface: Topic

Truncate a topic. The truncate operation will move all cursors to the end of the topic and delete all inactive ledgers.

Specified by:

truncate in interface Topic

Returns:

isTerminated

protected boolean isTerminated()

Specified by:

isTerminated in class AbstractTopic

isPersistent

public boolean isPersistent()

Specified by:

isPersistent in interface Topic