This page covers how to use an Azure Service Bus as a data source in Rockset. This includes:
- Creating an Azure Service Bus integration using a topic and subscription.
- Creating a SAS policy on a topic to securely connect your Azure Service Bus to Rockset.
- Creating a collection which can source data from an Azure Service Bus topic into Rockset.
For the following steps, you must have access to an Azure Service Bus account and be able to manage an Azure Service Bus namespace. If you do not have access, please invite your Azure account administrator to Rockset.
These instructions explain how to setup an Azure Service Bus integration using the Azure Portal. You can use an integration to create collections from the messages of a Service Bus topic and subscription.
To create a topic, navigate to your Service Bus namespace. When creating a new topic, the following will appear.
Topics should be sized according to the write patterns of the message producer. For low write rates with minimal variance, smaller topic sizes should suffice. If write rates are high and/or highly variable, a larger topic size should be configured.
After creating a topic, a subscription must be created under this topic. Navigate to your new topic and create a new subscription. Sessions must be enabled on a subscription to ensure reliable message processing.
Once the topic and subscription are created, an access policy needs to be generated. The 'Listen' permission is required.
Once the SAS policy is created, associated connection strings will be generated. A connection string is required to create an integration within Rockset.
After the previous steps are completed, a new Service Bus integration can be created. Navigate to the integrations page and add a new Azure Service Bus integration. Enter a name for the new integration and the connection string associated with the newly created SAS policy.
Once you have set up an integration, you can proceed to create an Azure Service Bus sourced collection.
Note that these operations can also be performed using the Rockset API
Updated 1 day ago