Using Control Theory to Keep Compactions Under Control

ON-DEMAND WEBINAR

As data is ingested into a database, it must be constantly rewritten for easy querying. Scylla writes incoming data to immutable files that must later be compacted into fewer files in order to maintain good read performance. The question becomes how fast should you compact? The traditional approach is to expose throughput tunables so the user can control the compaction speed. That means finding a good value involves a lot of trial and error. And what if the workload changes?

We take a different approach at ScyllaDB. We use the mathematical foundation of control theory to make automatic decisions about compactions, putting an end to compaction tuning altogether.

In this webinar you will learn:

How we created mathematical models of compaction backlog
How to use that model to feed a control theory framework that can automatically tune compactions.
Other exciting developments that are coming in this area

Speaker bio

Glauber Costa is VP of Field Engineering at ScyllaDB. He splits his time between the engineering department working on upcoming Scylla features and helping customers be successful with Scylla.

Before ScyllaDB, Glauber worked with Virtualization in the Linux Kernel for 10 years, with contributions ranging from the Xen and KVM Hypervisors to all sorts of guest functionality and containers.

ON-DEMAND WEBINAR

Using Control Theory to Keep Compactions Under Control

Section 1 Title Goes Here

ON-DEMAND WEBINAR

Register to View the Webinar

Section 3 Headline

Section 3 Point 1

Section 3 Point 2

Section 3 Point 3

Section 4 - Point 1

Section 4 - Point 2

Section 4 - Point 3

Section 6 Title

Section 7 Video Title

Speaker bio