A Preview of DuckDB v2.0
duckdb.org172 points by ibotty 2 hours ago
172 points by ibotty 2 hours ago
DuckDB is one of the things I've been most excited about in a long time. Introduced it to projects at 3 companies since 2023, greatly lowering resource requirements and running it in a variety of environments. Just having the ability to do out of core bigger than memory data processing on lower end consumer grade hardware is remarkable.
Thanks to the team for everything!
Curious to learn more about how people are using it?
Are they downloading parquet files and running analyses locally, or are they connecting to Iceberg-like data lake and leveraging DuckDBs query engine capabilities or have you exposed an interface (REST, UI) to query your data?
We use DuckDB WASM with parquet to build dashboards in-browser. It's cool to be able to write SQL directly in a browser and not have to rely on REST/Graphql/etc to access the data layer.
We use WASM DuckDB as the target for an in-browser agentic feature. Generated SQL runs against the user's individual tables that then feed in-browser dashboards.
Excellent performance.
How many accounts do you have besides these two? https://news.ycombinator.com/item?id=49332606
I <3 DuckDB. It has become one of my go to tools for storing, data processing , integrations and now even graph. More importantly it's fun to use because it is so portable. Looking forward to v2.
Ditto! Very happy with the upcoming async support! Now it'll be a nice little db for serving http traffic as well!
The last year of DuckDB enhancements feel like the shift from in-process execution engine (which it is phenomenal at) to an engine that can serve as the foundation of a cloud data warehouse. I know the founders were reticent about not wanting to build that, but I have a feeling it is in the works.
UPDATE: Removed uninformed comment about the relationship between DuckDB and MotherDuck.
Wait, what? I‘ve always assumed MotherDuck is the company by the main developers of DuckDB? They are unrelated?
I was wrong. Apologies.
> They decided to work together, and DuckLabs would become a co-founder of the new endeavor.
Please document the new "extensible PEG-based parser" for extension authors
DuckDB is so cool, game changer when it comes to local data processing.
Same problem, different day
This is cool
What about the runtime size? I care this because I intend to run a stripped WASM version of DuckDB in browser.
What do you plan on stripping and what's your target? The Emscripten based build is ~10Mb. I have a component build so I'd be interesting on how you'd like to break it up.
Was hoping to see procedural functionality like PL/pgSQL... regardless, an astonishing project overall.