Ingestion Errors

This page collects all kinds of the ingestion errors a source may hit, classified by source and exception type. If you are looking to troubleshoot errors with ingest, please reference the Troubleshooting Ingest page.

What are the type of exceptions?

You will see exception messages shown on the Collection page when data source ingest errors occur. There are 2 types of exceptions:

Non retryable exception: This is fatal and the source is in an unrecoverable state, for example a source not found exception.
Soft retryable exception: This type of exception will be retried for 2 to 3 hours with a long backoff before entering permanent error state, for example an authentication error.

Below we listed the all the possible exceptions by source type:

Azure Blob Storage

Exception	Type	Message	Error Code
`BlobStorageException`	Non retryable	Azure Blob Storage bucket not found	N/A
`BlobStorageException`	Soft retryable	Azure Blob Storage bucket does not have list object permissions set	N/A
`BlobStorageException`	Soft retryable	Azure Blob Storage bucket does not have list object permissions set	N/A

Amazon DynamoDB

Exception	Type	Message	Error Code
`TrimmedDataAccessException`	Non retryable	Reached trimmed data for DynamoDB shard	N/A
`ResourceNotFoundException`	Non retryable	DynamoDB resource not found	N/A
`AmazonDynamoDBException`	Non retryable	Export failed for DynamoDB table	ExportConflictException
`TableNotFoundException`	Non retryable	DynamoDB resource not found	N/A
`AmazonDynamoDBException`	Soft retryable	Error occurred while accessing DynamoDB table	UnrecognizedClientException
`AmazonDynamoDBException`	Soft retryable	Error occurred while accessing DynamoDB table	AccessDeniedException

Google Cloud Storage

Exception	Type	Message	Error Code
`StorageException`	Non retryable	GCS bucket not found	N/A
`StorageException`	Non retryable	Unable to perform request to GCS	N/A
`StorageException`	Soft retryable	GCS bucket does not have list object permissions set	N/A
`StorageException`	Soft retryable	GCS bucket does not have list object permissions set	N/A

Kafka

Exception	Type	Message	Error Code
`UnsupportedVersionException`	Non retryable	Encountered unsupported version failure when establishing connection to the Kafka cluster	N/A
`UnknownTopicOrPartitionException`	Non retryable	The Kafka topic is not known to the broker	N/A
`AuthenticationException`	Soft retryable	The Kafka connection didn't make it through due to an authentication failure, please check your security settings	N/A
`AuthorizationException`	Soft retryable	The Kafka connection didn't make it through due to an authorization failure, please check your security settings	N/A
`ConfigException`	Soft retryable	Failed to connect to Kafka due to invalid supplied configuration	N/A

Amazon Kinesis

Exception	Type	Message	Error Code
`ResourceNotFoundException`	Non retryable	Amazon Kinesis Stream not found	N/A
`InvalidArgumentException`	Non retryable	Error occurred while accessing Amazon Kinesis Stream	N/A
`KMSAccessDeniedException`	Soft retryable	Error occurred while accessing Amazon Kinesis Stream	N/A
`KMSDisabledException`	Soft retryable	Error occurred while accessing Amazon Kinesis Stream	N/A
`KMSInvalidStateException`	Soft retryable	Error occurred while accessing Amazon Kinesis Stream	N/A
`KMSNotFoundException`	Soft retryable	Error occurred while accessing Amazon Kinesis Stream	N/A
`KMSOptInRequiredException`	Soft retryable	Error occurred while accessing Amazon Kinesis Stream	N/A
`AmazonKinesisException`	Soft retryable	Invalid AWS credentials specified for Amazon Kinesis	UnrecognizedClientException
`AmazonKinesisException`	Soft retryable	Invalid AWS credentials specified for Amazon Kinesis	InvalidSignatureException
`AmazonKinesisException`	Soft retryable	Error occurred while accessing Amazon Kinesis Stream	AccessDeniedException

AWS Key Management Service

Exception	Type	Message	Error Code
`AmazonS3Exception`	Soft retryable	The KMS key does not have sufficient permissions	AccessDenied
`AmazonS3Exception`	Soft retryable	The KMS key does not have sufficient permission	AllAccessDisabled
`AmazonS3Exception`	Soft retryable	The request was rejected because the specified KMS key is not enabled	KMS.DisabledException
`AmazonS3Exception`	Soft retryable	The request was rejected because the KMS key could not be found	KMS.NotFoundException

MongoDB Atlas

Exception	Type	Message	Error Code
`MongoConfigurationException`	Non retryable	Error configuring the MongoDB client	N/A
`MongoQueryException`	Non retryable	Operation failed due to BSON document greater than 16MiB limit.	10334
`MongoSecurityException`	Soft retryable	Authentication failed to MongoDB host	N/A
`MongoTimeoutException`	Soft retryable	Unable to reach MongoDB cluster. Please ensure that you have added Rockset provided IP addresses to IP Access List under Network Access in your cluster	N/A
`MongoCommandException`	Soft retryable	Not authorized to execute command	13

Amazon S3

Exception	Type	Message	Error Code
`AmazonS3Exception`	Non retryable	S3 bucket not found	NoSuchBucket
`AmazonS3Exception`	Soft retryable	S3 bucket does not have get objects permission set	AccessDenied
`AmazonS3Exception`	Soft retryable	S3 bucket does not have get objects permission set	AllAccessDisabled
`AmazonS3Exception`	Soft retryable	Unable to get object in S3 bucket	InvalidAccessKeyId
`AmazonS3Exception`	Soft retryable	Unable to access S3 bucket	403 Forbidden

Amazon Security Token Service

Exception	Type	Message	Error Code
`AWSSecurityTokenServiceException`	Soft retryable	Authentication failed for AWS cross-account role integration	AccessDenied
`AWSSecurityTokenServiceException`	Soft retryable	Authentication failed for AWS cross-account role integration	AccessDeniedException