Topics

Terminology

Dataristix uses the term “Topic” as a term for “Tag Containers”. Connector topics and tags are connected in Tasks to define data flows.

In the context of the Connector for Event Hubs, “Connector Topics” are configured for each Event Hubs namespace either as “Producer” or “Consumer” topics. A tag contained in a Producer or Consumer connector topic represents an individual Event Hub within the Event Hubs namespace. Event hubs (tags) within a connector topic share the same connector topic settings.

Add Topic

To send data to an Event Hub, add a Producer topic by selecting the “Produce” navigation node for an Event Hubs client, then press the “Add” toolbar button. To receive data from an Event Hub, add a consumer connector topic by selecting the “Consume” navigation node instead. This will add a new connector topic with default settings. Rename the topic to suit and adapt settings in the property panel.

../_images/eventhubs-add-client-topic.png

“Consume” Topic Settings

Configure the following topic settings.

  • Name
    Any connector topic name
  • Consumer Group ID
    The consumer group used for message retrieval. Untick “Use default” to specifiy a different ID.
  • Begin message processing with
    Determine how message consumption begins when the topic receives messages for the first time, when there is no commited offset stored for the consumer group. “Earliest message” means, the “Consume” topic will ask the Event Hub to send all available messages. “Latest message” means, that the Event Hub will only send new messages. Note that live values are not displayed for the connector topic as it may interfere with message delivery in tasks.

“Produce” Topic Settings

Configure the following topic settings.

  • Name
    Any connector topic name
  • Partition Key (optional)
    Optionally specify a partition key for messages sent to this producer topic.

Remove Topics

Remove topics by selecting the Event Hubs client in the navigation panel, then select one or more topics to remove in the content panel, and finally click on the “Remove” toolbar button to remove selected topics. You can also right-click on a topic and select “Remove” from the context menu.

Warning

Note that topics are also removed from any task using the topics.