TDMQ for Apache Pulsar

TDMQ for Apache Pulsar
Release Notes and Announcements
Product Documentation©2013-2022 Tencent Cloud. All rights reserved.

Page 1 of 15

TDMQ for Apache Pulsar

Copyright Notice©2013-2024 Tencent Cloud. All rights reserved.
Copyright in this document is exclusively owned by Tencent Cloud. You must not reproduce, modify, copy or distributein any way, in whole or in part, the contents of this document without Tencent Cloud's the prior written consent.
Trademark Notice

All trademarks associated with Tencent Cloud and its services are owned by Tencent Cloud Computing (Beijing)
Company Limited and its affiliated companies. Trademarks of third parties referred to in this document are owned bytheir respective proprietors.
Service Statement
This document is intended to provide users with general information about Tencent Cloud's products and services
only and does not form part of Tencent Cloud's terms and conditions. Tencent Cloud's products or services aresubject to change. Specific products and services and the standards applicable to them are exclusively provided for inTencent Cloud's applicable terms and conditions.

©2013-2022 Tencent Cloud. All rights reserved.

Page 2 of 15

TDMQ for Apache Pulsar

Contents
Release Notes and Announcements
Release Notes
Cluster Version Updates
Announcements
Official Launch of TDMQ for Apache Pulsar
TDMQ for Apache Pulsar's Support for CAM Authorization at All Resource Levels
Suspension of Feature Update for Tencent Cloud SDK©2013-2022 Tencent Cloud. All rights reserved.

Page 3 of 15

TDMQ for Apache Pulsar

Release Notes and Announcements
Release Notes：

Last updated 2023-10-30 10:41:44

June 2023
UpdateDescriptionRelease
Date

Documentation

Supported creating
subscriptions
automatically

You can choose whether to enable "Auto-Create
Subscription" when creating a namespace.

2023-0620

Namespace

May 2023
ReleaseUpdateDescription

Supported
importing roles inbatches

You can import roles in batches when managing roles
and grant each of them permissions for different
namespaces.

2023-0529-UpdateDescription

Release
Date

Documentation

Supported creating
non-persistentmessages

You can choose to create non-persistent messages in
the console and select the number of partitions forsuch messages.

2022-06-Topic29

Management

Supported settinglimits on cluster
quotasTo enhance the stability of virtual clusters, limits are
imposed on some cluster quotas. Existing clusters are
not affected.
The range of the TTL for new namespaces is changed

2022-0629

Use Limits

Date

Documentation

June 2022

to 60 seconds–1 day.

©2013-2022 Tencent Cloud. All rights reserved.

Page 4 of 15

TDMQ for Apache Pulsar

For new virtual clusters, the maximum
production/consumption TPS per topic partition is
reduced from 50,000 to 5,000, and the maximum
production/consumption bandwidth per topic partition
is reduced from 50 MB/s to 5 MB/s, so as to avoid themutual impact between users due to excessive traffic.
Supported filtering
topics by Type andCreator in themessage topic list

-2022-0629

Topic
Management

December 2021
UpdateDescription

Release
Date

Documentation

Supported
displaying the list ofYou can view the list of topic producers, which helps

2021-12-

Producer

you locate producer issues more easily.

23

Management

The numbers of producers/consumers and alarms forcaps are displayed to promptly notify you of any

2021-12-

Topic

23

Management

The message trace feature allows you to view thesubscription modes, the number of retries, and theacknowledgment status of multiple consumers.

2021-1223

Message
Query andTrace

TDMQ for Apache Pulsar supports the pay-as-you-go
billing mode and will be billed starting from January2022.

2021-1223

Billing
Overview

topic producers
Supported thedisplay ofproducer/consumer
counts and cap
alarmsexceptions in a topic.

Supported
displaying thenumber of retries
and theacknowledgment
status for themessage trace
featureSupported the payas-you-go billingmode

October 2021

©2013-2022 Tencent Cloud. All rights reserved.

Page 5 of 15

TDMQ for Apache Pulsar

UpdateDescription

Release
Date

Documentation

2021-1027

ClusterManagement

Cluster-level data can be collected, making it easierSupported clusterlevel data collection

Supported tagmanagement

Added topic-levelalarms
Supported blocking
public network
access to clusters.
You can enable ordisable this feature
as needed.

for you to view the usage details of clusters as awhole. This feature is launched to support the pay-asyou-go billing mode.
Resource tagging and tag authentication with CAM
are supported. Resource management is supported
for proprietary cloudified businesses.
Topic-level alarms are added for
production/consumption speed and traffic and online
producer/consumer count.

-2021-1027

Managing
Resource withTag

2021-10-

Alarm

27

Configuration

2021-10-

Cluster

27

Management

Release
Date

Documentation

August 2021
UpdateSupported setting
the message
retention period
policy innamespaces

Supported forcible
deletion of topics
and subscriptions

Description
Deletion after consumption: Messages will be cleared
within a certain period of time after being
acknowledged successfully to save storage space.
Persistent retention: No matter whether messages are
consumed or not, they will be stored persistently
within the maximum retention period and maximum

2021-0819

Namespacestorage space and then deleted chronologically after
the limit is reached.
Topic: A topic with subscriptions can be forcibly
deleted, along with its subscriptions.
Subscription: A subscription can be forcibly deleted

2021-0819

Topic
Management

even if it has active consumer connections.

©2013-2022 Tencent Cloud. All rights reserved.

Page 6 of 15

TDMQ for Apache Pulsar

May 2021
UpdateDescription

Release
DateDocumentation

TDMQ for Apache Pulsar supports clusters on v2.7.1.
The cluster version is updated to open-source Pulsar
2.7.1 to support more features and simplify
Launched clusters
on v2.7.1

connection.
The listenerName dependency is removed for the new

2021-0531

cluster version, so you don't need to declare
listenerName when connecting to a cluster on v2.7.1

Cluster
VersionUpdatesor later from an open-source Pulsar client.

January 2021
UpdateDescription

Launched theYou can create virtual clusters (which share thecluster
management

underlying resources) and dedicated clusters (whichuse the underlying resources exclusively) in thefeatureconsole.

ReleaseDate

2021-0114

Documentation

ClusterManagement

October 2020
ReleaseUpdateDescription

Launched theOn the Message Query page, you can query themessage querydetails and trace of a message, including the message

2020-10-and message trace
featurescontent, parameters, duration of each stage,
execution result, producer IP, and consumer IP.

30

Date

Documentation

Message
Query andTrace

The open beta test for TDMQ for Apache Pulsar
Started the open
beta test for TDMQ

officially starts. No application is required for the trialuse. The open beta test has certain limits on thefor Apache Pulsar

maximum QPS, maximum number of topics, anddelayed message concurrency.

©2013-2022 Tencent Cloud. All rights reserved.

2020-1012-Page 7 of 15

TDMQ for Apache Pulsar

September 2020
UpdateSupportedconnection toTDMQ for Apache
Pulsar from nativePulsar clients
Upgraded TDMQ
for Apache Pulsar
in closed beta test
to support thenative SDK

Description

ReleaseDate

You can connect to TDMQ for Apache Pulsar fromRole andnative Pulsar clients. For security reasons, you needto configure the appropriate role permissions in theconsole and configure the token on the client (which2020-0917

works in the same way as JWT token authentication
used in the community).
TDMQ for Apache Pulsar will be suspended forupgrade between 09:00 AM and 12:00 PM on
September 17, 2020 to support connection from
native Pulsar clients.

Documentation

2020-0911

Authentication
JWT
Authentication
Configuration-August 2020
ReleaseUpdateDescription

Launched TDMQ

TDMQ for Apache Pulsar will be available in theShanghai region starting from August 9, 2020 and in

2020-08-the Beijing and Chengdu regions starting from August18for Apache Pulsar
in multiple regions

Date

Documentation-18, 2020.

June 2020
UpdateDescription

Release
Date

Documentation

Launched TDMQ

TDMQ for Apache Pulsar is a proprietary finance-

2020-06-

Overview

for Apache Pulsar

grade distributed message middleware developed
based on Pulsar, a top open-source project of04

Apache. It features high consistency, reliability, andconcurrency. Currently, it is widely used in Tencent's
billing scenarios, including core transaction as well as©2013-2022 Tencent Cloud. All rights reserved.

Page 8 of 15

TDMQ for Apache Pulsar

real-time reconciliation, monitoring, and big data
analysis.

©2013-2022 Tencent Cloud. All rights reserved.

Page 9 of 15

TDMQ for Apache Pulsar

Cluster Version Updates：

Last updated 2022-02-11 10:24:30
This document describes the updates to TDMQ for Apache Pulsar clusters as well as relevant notes.

Version 2.7.1
Release date: May 17, 2021
Full switch: June 2021
Release notes:
UpdateType

UpdateDescription
A unique domain name is automatically generated
for each network environment of each cluster as theaccess address, so you don't need to manually

Optimization

Unifieddomain namecreate and manage access points.
The dependency that declares listenerName isaccessremoved, so the SDK is more compatible with TCP
clients in the community that are not adapted tomultiple advertised listeners in Pulsar (includingDocumentation

Apache Pulsar
SDK for C++﻿Apache Pulsar
SDK for Python﻿
Apache Pulsar
SDK for Node.js﻿

C++, Python, and Node.js).

Addition

Support for
publicPublic network access is supported, so you canaccess a TDMQ for Apache Pulsar cluster innetwork
accessTencent Cloud from a TCP client in your local systemor self-built IDC.

Update to thenaming
conventions
Optimization

for the retry
letter anddead letter
topicsThe naming conventions for the retry letter and deadletter topics are updated to the same as used by thePulsar community, so that they are more compatible
with open-source SDKs (the new naming
conventions are not applicable to the original

Getting Access
Address

Message Retry andDead Letter
Mechanisms

Tencent Cloud SDK)
Clusters on v2.7.1 are optimized at the system kernel

Optimization

Performance
optimizationlevel to achieve a 20% higher peak
production/consumption performance than clusterson v2.6.x. In addition, they can be scaled-

imperceptibly according to the actual usage.

©2013-2022 Tencent Cloud. All rights reserved.

Page 10 of 15

TDMQ for Apache Pulsar

Addition

Support for

You can install plugins compatible with AMQP,

protocol-RocketMQ, and CMQ in clusters on v2.7.1.

compatible
plugins (inCurrently, this feature is in beta test. After it isofficially launched, you will be able to access TDMQ

closed betatest)

for Apache Pulsar from popular message queueclients with no modifications required, which will-

make it easier for you to migrate existing businesses.

Version 2.6.1
Release date: October 12, 2020
Full switch: October 2020
Release notes:
UpdateTypeOptimization

Optimization

UpdateDescription

Stability

Issues discovered during the beta test are fixed,

enhancement

significantly improving the cluster stability.

Hot/Cold data

The ZooKeeper component of the Pulsar kernel
adopts the deployment architecture of hot/cold dataisolation in
ZooKeeper

isolation, where metadata and cluster broker
configuration data are deployed separately in two

Documentation--ZooKeeper instances to increase the cluster stability.

Addition

Support for
creation of

You can create virtual clusters in the console forvirtualresource isolation.

-clusters

Upgrade notes:
All newly created clusters will be automatically on the latest version in the current region.
To switch to the new cluster version on your own, follow the steps below:
1. Create a cluster (all newly created clusters are on the latest version) and a copy of completely identical metadata(namespaces, role permissions, topics, and subscriptions).
2. Replace the original production/consumption access point in the client code with the access address of the newcluster.
3. Replace the authentication information (token) in the client code with the token of the new cluster.
4. Switch the producer client first (recreate a producer application and deploy it in the production environment).

©2013-2022 Tencent Cloud. All rights reserved.

Page 11 of 15

TDMQ for Apache Pulsar

5. Wait for all retained messages in the original cluster to be consumed and then switch the consumer client (recreatea consumer application and deploy it in the production environment).

©2013-2022 Tencent Cloud. All rights reserved.

Page 12 of 15

TDMQ for Apache Pulsar

Announcements
Official Launch of TDMQ for Apache Pulsar：Last updated 2022-04-02 10:13:20
Since the start of TDMQ for Apache Pulsar beta test on October 12, 2020, two versions have been launched. The freebeta test of TDMQ for Apache Pulsar will end on December 1, 2021, and billing will officially start then.
To reward you for taking part in the beta test, we will offer you a 1-month free trial, and you can use the service free ofcharge between December 1, 2021 and December 31, 2021.
After its commercial launch, TDMQ for Apache Pulsar will be billed by API call, message storage, and partitioned
topic resource usage on a pay-as-you-go basis with certain free tiers provided. For more information, see PurchaseGuide.

©2013-2022 Tencent Cloud. All rights reserved.

Page 13 of 15

TDMQ for Apache Pulsar

TDMQ for Apache Pulsar's Support for CAM
Authorization at All Resource Levels：

Last updated 2022-04-02 10:14:03
The TDMQ for Apache Pulsar console was upgraded to support CAM authorization for all resource levels from cluster
to topic on July 9, 2021. After the upgrade, some sub-accounts will have no permissions to view and manipulate
unauthorized resources.
You can prompt the root account to authorize resources in the CAM console as instructed here.
Be assured that the permissions in the console do not affect business data streams.

©2013-2022 Tencent Cloud. All rights reserved.

Page 14 of 15

TDMQ for Apache Pulsar

Suspension of Feature Update for Tencent
Cloud SDK：

Last updated 2024-01-03 14:08:52
In order to be more consistent with the Pulsar open-source community, we have stopped feature updates for theTencent Cloud SDK since April 30, 2021. We recommend you use the Apache Pulsar SDK.
If you are using the Tencent Cloud SDK, and you are sure that you don't use the features of tag filtering and backoffdelayed message, you can directly replace it with the Apache Pulsar SDK.
For more information, see the SDK documentation.

©2013-2022 Tencent Cloud. All rights reserved.

Page 15 of 15