Ingest Related Limits
The following are Ingest related rate limits placed on your Rockset organization. If you are looking to troubleshoot errors with ingest, please reference the Troubleshooting Ingest page.
Limit | Description | Value |
---|---|---|
Max Documents in Write API Request | Max number of documents allowed for add, patch, and delete operations. | 20,000 |
Max Documents in Write API Request with Dedicated Streaming Ingest | Max number of documents allowed for add, patch, and delete operations when Dedicated Streaming Ingest is enabled. | 1,000,000 |
Max Documents in Kafka Connect Request | Max number of documents allowed in a request. | 20,000 |
Max Size of Write API Request Body | Max number of bytes allowable for a particular request body. | 10 MiB |
Max Size of Kafka Connect Request Body | Max number of bytes allowable for a particular request body. | 10 MiB |
Max Size of Document | Max document size allowed in collection. | 40 MiB |
Max Size of File Upload | Max size of file upload allowed. | 300 MiB |
Max Size of Parquet File | Max file size for ingesting Parquet. | 20 GiB |
Max Size of Field Name | Max length of a field name allowed in a collection. | 10,240 characters |
Max Size of _id Value | Max length of value in _id field allowed. | 10,240 characters |
Max Depth of Package Nesting | Max number of times file(s) can be archived or compressed before being rejected. E.g. a .tar.gz file has 2 levels of packaging. | 10 |
Max Depth of Nested Fields | Max number of nested levels permitted in a single document. | 32 |
Max File Compression Ratio | Max compression ratio that will be allowed when decompressing a file before potentially being rejected. | 100 |
Max Number of Fields in a Document | Maximum number of unique fields in a document (or maximum number of columns in a collection) | No limit |
Max Number of Documents in Collection | Maximum number of unique documents in a collections (or maximum number of rows in a collection) | No limit |
Updated 7 months ago