We are proud to announce that our paper titled "DBSP: Automatic Incremental View Maintenance for Rich Query Languages" co-authored by two of Feldera co-founders, Mihai Budiu (Chief Scientist) and Leonid Ryzhyk (CTO), has won a Best Paper Award at the VLDB 2023 conference.
While it is always nice to see your work recognized, this award holds special significance for our team. This is because the paper it acknowledges describes the mathematical theory that underpins our Feldera Continuous Analytics Platform.
When we started working on the technology that became Feldera, we already knew firsthand that computing on continuously changing data was hard. A robust, efficient, and general-purpose query engine could not be created solely through feats of engineering but required a solid theoretical foundation. We set out to build such a foundation, leading to the creation of DBSP, a new theory of incremental and streaming computation and the not-so-secret sauce enabling Feldera to achieve:
Correctness, by providing provably correct algorithms for evaluating queries over changing data.
Performance, by establishing complexity bounds on various operators and informing optimizations.
Extensibility: DBSP offers a precise recipe for adding new operators while preserving the end-to-end correctness of the system.
As practitioners, one of our favorite aspects of the DBSP theory is that it lends itself naturally to an efficient implementation. Our open-source implementation of DBSP in Rust powers the Feldera query engine. It is also useful on its own as a library for computations over changing datasets. We are constantly working on improving the library and welcome both users and contributors.
What is VLDB?
Very Large Data Bases (VLDB) is a premier annual international forum for data management and database researchers, vendors, practitioners, application developers, and users.
Want to know more?
- Read the paper
- Follow a series of blog posts by Mihai about DBSP
- Study our open-source implementation of DBSP
- Watch presentations about DBSP by Mihai
