Virtual Instance Auto-Scaling is currently in Beta.
CPU-based vertical Auto-Scaling is a technique that automatically adjusts Virtual Instance size according to current workload demands. It is the most cost-efficient way to run Rockset while maximizing performance. With this feature enabled, the Virtual Instance size will auto-scale up during heavier workloads to deliver better performance and auto-scale down when idle to avoid over provisioning resources and reduce costs.
Rockset analyzes Virtual Instance CPU utilization to assess whether to auto-scale a Virtual Instance size up or down. CPU utilization is observed for auto-scaling using an iterative decay approach, allowing for historical analysis with amplified emphasis on recent measurements when making auto-scaling decisions.
- Auto-Scale Up occurs when the CPU utilization decay value exceeds 75%.
- Auto-Scale Down occurs when the CPU utilization decay value is below 25%.
- After a Virtual Instance switch has completed or upon enabling auto-scaling, distinct cooldown periods of 3 minutes and 1 hour are observed for subsequent auto-scale up and down actions.
To create an Auto-Scaling policy on a Virtual Instance, go to the Virtual Instance tab of the Rockset Console and navigate to the Edit Virtual Instance menu for the Virtual Instance you want to configure. Define the minimum and maximum sizes you will allow the policy to scale the Virtual Instance.
Virtual Instance Auto-Scaling is currently only available for Default Virtual Instances.
When an Auto-Scaling occurs:
- Rockset logs Auto-Scaling events in the Activity Logs in the Virtual Instance details page.
- Rockset sends an email with details about the Auto-Scaling action.
Monitor how Rockset makes Auto-Scaling decisions based on CPU utilization with Virtual Instance metrics monitoring.
If you have Auto-Scaling enabled but want to manually resize your VI, there are two possible outcomes:
- Auto-Scaling will remain enabled if you resize your VI within your Auto-Scaling range. For example, if your Auto-Scaling has a minimum size of Small and maximum size of Large and you resize your VI from Large to Medium, Auto-Scaling will remain in place.
- Auto-Scaling will be disabled if you resize your VI outside of your Auto-Scaling range. For example, if your Auto-Scaling minimum size is Small and maximum size is Large and you resize from Large to XL, Auto-Scaling will be disabled.
Updated 24 days ago