Ingest Related Limits
The following are Ingest related rate limits placed on your Rockset organization. If you are looking to troubleshoot errors with ingest, please reference the Troubleshooting Ingest page.
| Limit | Description | Value |
|---|---|---|
| Max Documents in Write API Request | Max number of documents allowed for add, patch, and delete operations. | 20,000 |
| Max Documents in Write API Request with Dedicated Streaming Ingest | Max number of documents allowed for add, patch, and delete operations when Dedicated Streaming Ingest is enabled. | 1,000,000 |
| Max Documents in Kafka Connect Request | Max number of documents allowed in a request. | 20,000 |
| Max Size of Write API Request Body | Max number of bytes allowable for a particular request body. | 10 MiB |
| Max Size of Kafka Connect Request Body | Max number of bytes allowable for a particular request body. | 10 MiB |
| Max Size of Document | Max document size allowed in collection. | 40 MiB |
| Max Size of File Upload | Max size of file upload allowed. | 300 MiB |
| Max Size of Parquet File | Max file size for ingesting Parquet. | 20 GiB |
| Max Size of Field Name | Max length of a field name allowed in a collection. | 10,240 characters |
Max Size of _id Value | Max length of value in _id field allowed. | 10,240 characters |
| Max Depth of Package Nesting | Max number of times file(s) can be archived or compressed before being rejected. E.g. a .tar.gz file has 2 levels of packaging. | 10 |
| Max Depth of Nested Fields | Max number of nested levels permitted in a single document. | 32 |
| Max File Compression Ratio | Max compression ratio that will be allowed when decompressing a file before potentially being rejected. | 100 |
| Max Number of Fields in a Document | Maximum number of unique fields in a document (or maximum number of columns in a collection) | No limit |
| Max Number of Documents in Collection | Maximum number of unique documents in a collections (or maximum number of rows in a collection) | No limit |
Updated 8 months ago