DBSP: Automatic Incremental View Maintenance for Rich Query Languages · HackerPapers discussions

DBSP: Automatic Incremental View Maintenance for Rich Query Languages — mentioned by giovannibonetti

Sat, 17 Oct 2026 03:10:06 GMT

> Real progress happens by expanding the area of the envelope, not by coloring in the blanks. Respectfully disagree. What one person may classify as expanding the envelope, another one with broader knowledge may classify as coloring in the blanks. Much knowledge in one field comes from cross-pollination from other fields. Let me give you an example I just learned about. The database community spent decades trying (to some extent) to solve the implementation of materialized views to arbitrary complex SQL queries. Then, a few years ago, someone with experience in digital signal processing…

Paper and discussion history. A mention is not an endorsement.

DBSP: Automatic Incremental View Maintenance for Rich Query Languages — mentioned by cube2222

Sun, 29 Sep 2024 10:02:07 GMT

This looks extremely cool. This is basically incremental view maintenance in databases, a problem that almost everybody (I think) has when using SQL databases and wanting to do some derived views for more performant access patterns. Importantly, they seem to support a wide breath of SQL operators, support spilling computation state to disk, and it's open-source! Interestingly, it compiles queries to Rust, so an approach similar to Redshift (which compiles queries to C++ programs). There's already a bunch of tools in this area: 1. Materialize[0], which afaik is more big-data oriented, and…

Paper and discussion history. A mention is not an endorsement.