• Loading Your Data
  • Collections
  • Monitoring and Errors

Monitoring and Errors

This page covers the metrics tracked by Rockset for performance monitoring and errors with Collections and their respective data sources.

#Collection Metrics

Metrics for each collection can be accessed by requesting it through the Rockset API and reading the stats value found in the API response, or by navigating to the Collections tab of the Rockset Console and then selecting your collection.

Information is available for the following metrics:

  • Document Count denoting the total number of documents currently in the collection
  • Purged Document Count denoting the total number of documents which have been purged from the collection
  • Last Queried Time denoting the timestamp of the last query executed on the collection
  • Last Updated Time denoting the timestamp of the last update to this collection
  • Total Size denoting the total size (in RocksDB bytes) of the collection, including all of collection data and indexes
  • Total Index Size denoting the total size (in RocksDB bytes) of all of the indexes
  • Row Index Size denoting the total size (in RocksDB bytes) of the row index
  • Column Index Size denoting the total size (in RocksDB bytes) of the column index
  • Inverted Index Size denoting the total size (in RocksDB bytes) of the inverted index
  • Range Index Size denoting the total size (in RocksDB bytes) of the range index
  • Purged Document Size denoting the total size (in RocksDB bytes) of all of the documents which have been purged from the collection
  • Bytes Inserted denoting the total number of bytes of data inserted into the collection
  • Bytes Overwritten denoting the total number of bytes of data overwritten in the collection

#Collection Statuses

There are four main statuses indicating collection states:

  • CREATED indicating that the collection is still currently in the process of being created.
  • BULK_INGEST_MODE indicating that the collection is currently bulk ingesting data from your external data source.
  • READY indicating that the collection is active and ready to be queried.
  • DELETED indicating that the collection is marked for deletion. The collection will cease to exist once it is fully deleted.

You can also programmatically monitor the status (and any data processing errors) of collections using the Rockset API or in the Collections tab of the Rockset Console. From there, you can also select an individual collection to view additional monitoring details.

#Data Source Statuses

There are five main status indicating data source states:

  • INITIALIZING indicating that Rockset resources are still spinning up and scanning the collection to determine what type of ingest is needed next.
  • WATCHING indicating that the data source is waiting for new updates, and will stream in new data as soon as it added to the source.
  • PROCESSING indicating that data ingest from this data source is currently in progress.
  • COMPLETED indicating that the data ingest from this source is completed. This status is only relevant for file uploads, as no further streaming ingest will occur once a file upload is completed.
  • ERROR indicating that there has been an unexpected error which occured during data ingest from this source. You may have to recreate the collection.

You can also programmatically monitor the status (and any data ingest errors) of data sources within collections using the Rockset API or in the Collections tab of the Rockset Console. From there, you can also select an individual collection to view additional monitoring details.

Join us on Slack!
Building on Rockset? Come chat with us!