Documentation

Viewing Messages

Accessing Topics and Partitions

Once a connection has been set up, you are able to begin adding topics. Topics are accessed through the Topics folder, which can only be accessed after the server connection has been established.

Once a topic has been created, you will be able to access the different partitions of the topic, through which you can begin to add messages. Once the messages have been added, they can be retrieved by clicking the green play button in the partition toolbar. Messages across all partitions of a topic can be accessed by navigating to the Data tab of a topic, and hitting the green play button in the toolbar. After retrieval, you are able to see the following information about each message:

  • Offset - information about the offset, as well as key and value length
  • Key - key data
  • Value - value data
  • Timestamp - when the message was added
  • Headers - header data

If you are viewing your messages at the topic level, the data panel will also show the partition to which the message belongs. Key, value, and header data can all be viewed in either text or hex format. Additionally, key and value data can be viewed in both JSON and XML format, provided that the string is a valid JSON/XML string. This data can be viewed by retrieving the messages and clicking on one, which will open the message detail panel. The message detail panel can be closed by clicking the table icon in the top toolbar.

You also have the ability to sort messages. By clicking on a column header in the data panel, it will alphabetically sort based on which column you selected. For example, selecting the key column will sort all messages based on alphabetic order. Clicking again will reverse the order.

When dealing with a large number of messages, you can choose whether to show the oldest messages in a topic, or the newest messages. Additionally, if you are viewing messages at a partition level, you are able to show messages from a certain offset. For example, showing messages from offset 100 will show all messages from offset 100 onward. Prioritizing messages in this way is done by accessing the "Messages" drop-down item located next to the filter search bar.

Filtering Messages

You are able to quickly filter messages that are currently shown (either on topic level or partition level), which makes it easy to find a specific message using the following filter options:

  • Offset - by clicking this option, the filter will show all messages that have the filter input in the offset
  • Key - by clicking this option, the filter will show all messages that have the filter input in the key data
  • Value - by clicking this option, the filter will show all messages that have the filter input in the value data
  • Header Key - by clicking this option, the filter will show all messages that have the filter input in the header key data
  • Header Value - by clicking this option, the filter will show all messages that have the filter input in the header value data

You also have the ability to filter data using Regex instead of simply typing in a string. The above options can be checked and unchecked by clicking the green arrow to the right of the filter search bar.

Managing Topics

Topics can be grouped into folders to ease locating a specific topic. A topic folder is created by navigating to the Topics folder and clicking on the "Create Folder" button on the bottom toolbar, or by using the "Create Folder" popup menu item, which is accessed by right-clicking the Topics folder. Once a topic folder has been created, you are able to drag topics into the folder, allowing for easy organization when working with a large number of topics.


Adding Messages

Messages are added by clicking the green plus button in the partition toolbar. You can choose to add either a single message or multiple messages. When adding a single message to a partition, you are able to choose between adding the key and value data from a file or typing them manually.

You also have the ability to add headers when adding a single message. This is done by navigating to the header tab, and clicking the green plus button. From there, you are able to add both a key and a value to each header.

When adding multiple messages, you can choose between adding both a key and value for each message, or only one of key/value. If adding both key and value, you must choose a character to act as a separator (default is comma). You can add one message per line, so in order to add multiple messages, multiple lines of data must be inputted.


Creating Topics

In order to create a topic, you can either navigate to the topics folder and use the “Add New Topic” button on the bottom toolbar, or use the “Create Topic” menu item that can be accessed by right-clicking the Topics folder. In the “Add Topic” dialog, you must provide the following values under the “General” section:

  • Name - the name you want to give to the topic
  • Partition Count - number of partitions you want in the topic
  • Replica Count - number of replicas you want per partition in the topic

You can also add configurations of your liking to the topic.

Once the topic has been created, it will be added to the Topics folder. From there, you can access the different partitions of the topic, through which you can begin to add messages. The default content type for adding messages is in hexadecimal format, but can easily be changed to string or Avro format. This is done by navigating to the topic and clicking on the "Properties" tab.

From there, you can choose the format in which you want your keys and values to be displayed/added.

Exporting Server Connections

You are able to transfer data from a server connection to an XML file, which makes it easy to import server connections on a different computer. This is done by right-clicking the Clusters folder and selecting the "Export Connections..." menu item.

From there, you can choose which connections to export. You are able to manually type the location to where the data will be exported, or, by clicking the file button, you can navigate to a suitable location for the data file. Once the data has been exported, you will be able to see all the information about the server connections you have selected in the XML file.

Importing Server Connections

Importing data is done in the same manner as exporting is. Simply right-click the Clusters folder and select the "Import Connections..." menu item. From there, navigate to the XML file containing the data you want to import. Once the file is opened, select all of the server connections you want to import and select whether you want information about the server groups. The data will then be added to the Clusters folder.

Offset Explorer | UI Tool for Apache Kafka