Custom Integration

This page covers how you can add documents to your Rockset collections from any data source using the Rockset API both programmatically using the REST API or manually from a file upload using the Rockset Console.

#Using Custom Integrations

If you choose to use a custom integration as your data source, note that you will have to manage data syncing on your own, whereas Rockset would automatically sync your data when using a managed integration such as S3 or DynamoDB.

You should use this option if either Rockset does not support managed integrations with your desired data source, or if you do not want Rockset to automatically sync your data and wish to manage syncing on your own.

#Create an Empty Collection

While you can directly add documents to any existing collection, you will need to first create an empty collection if you intend to use the Rockset API to add documents to a new collection.

You can create an empty collection by navigating to Collections > Create Collection > Write API in the Rockset Console.

You can also use the Collections API to create an empty collection using the Create Collection endpoint.

#Add Documents

Rockset exposes a REST API using the Documents API to add documents to your collection.

For your convenience, Rockset also maintains SDKs for Node.js, Python, Java, and Golang. Each SDK has its own set of methods for using the REST API to add documents which you can find in its documentation.

#Upload a File

To manually create a collection using a file as your data source, you can do so from the Rockset Console by navigating to Collections > Create Collection > File Upload. You can also upload files to any existing collections (or to this one after it has been created). The file formats currently supported include JSON, CSV, XML, Parquet, XLS and PDF.

Join us on Slack!
Building on Rockset? Come chat with us!