DuckDB
@duckdb
Followers
13,098
Following
3
Media
131
Statuses
665
DuckDB is an in-process SQL OLAP database management system. "DuckDB" and the DuckDB logo are registered trademarks of the DuckDB Foundation.
Amsterdam, The Netherlands
Joined May 2019
Don't wanna be here?
Send us removal request.
Explore trending content on Musk Viewer
Mbappe
• 289639 Tweets
GAME ON DONNY
• 182408 Tweets
HERE WE GO
• 163332 Tweets
#光る君へ
• 99198 Tweets
Cardi
• 73388 Tweets
ブレイキングダウン
• 61003 Tweets
Good Sunday
• 49509 Tweets
桐生戦兎
• 26019 Tweets
テイフェス
• 21541 Tweets
#アンチヒーロー
• 17741 Tweets
テイルズ
• 16835 Tweets
भगत सिंह
• 11309 Tweets
アリーナツアー完走
• 11051 Tweets
フラミンゴ
• 10821 Tweets
Erden Timur
• 10677 Tweets
New blog post by
@mraasveldt
: Multi-Database Support in DuckDB
DuckDB can now attach MySQL, Postgres, and SQLite databases in addition to databases stored in its own format. This allows data to be read into DuckDB and moved between these systems in a
10
85
364
DuckDB was recently covered in
@andy_pavlo
's Advanced Database Systems course at CMU. The lecture covers DuckDB's history, internals, and integration with other systems.
Slides:
Recording:
1
70
360
We are proud to release DuckDB v0.10.0:
Some highlights:
– A reworked and much faster CSV reader
– Fixed-length arrays
– Multi-database support
– Secrets manager
– Temporary memory manager
– Adaptive lossless floating-point compression
– New CLI editor
–
1
63
274
DuckDB 0.7.0 "Labradorius" released with
#JSON
support, parallel and partitioned export to CSV and Parquet, UPSERT,
@DataPolars
integration, and much more in our release announcement blog post:
9
52
266
We wrote a performance guide for DuckDB users! This guide covers topics such as the effects of schema (constraints, indexing) and hardware (CPU, memory, disk). We also share best practices for querying Parquet files and tips for tuning your workload.
1
47
229
We just released DuckDB 0.9.0 "Undulata", check out our release announcement blog post:
2
43
213
DuckDB's co-creator, Hannes Mühleisen, recently became a professor of data engineering at Radboud University. The recording of his inaugural lecture, titled "The Ancient Art of Data Management", is now available.
1
29
184
DuckDB 0.6.0 "Oxyura" released with improved storage, higher performance for CSV loading and indexing, new SQL syntax, better memory management, shell tweaks and so many new features
@mraasveldt
wrote a separate blog post to explain it all:
4
41
171
DuckDB supports querying buckets in the AWS S3 Express One Zone. Read the related guide at , which shows that DuckDB can read a Parquet file from an S3 Express One bucket at about 1.2 gigabytes per second!
PS: You may also noticed that we started rolling
1
33
155
DuckDB 0.5.0 "Pulchellus" released with persistent indexes, out-of-core hash join, new join order optimizer, and many other improvements
1
29
149
New blog post by
@pdet
: DuckDB ADBC - Zero-Copy data transfer via Arrow Database Connectivity
0
28
146
The DuckDB repository hit 15,000 stars on GitHub today. Thanks to our contributors and our amazing community!
0
5
145
New blog post by
@__AlexMonahan__
SQL Gymnastics: Bending SQL into flexible new shapes
In this post, Alex presents pure SQL queries to implement dynamic groupings and aggregate functions using DuckDB's friendly SQL extensions. The queries can be used to
2
25
144
We have revamped one of our core operators, aggregation. It has improved scalability for many unique groups and for a large number of cores. Thanks to these, you can expect better performance when running large aggregations on big machines.
1
19
141
The Awesome DuckDB repository, maintained by
@davidgasquez
, has grown to more than 100 entries in less than a year. If you are aware of more cool projects using DuckDB, please consider submitting a PR!
2
28
141
Did you know that you can connect to a DuckDB database file via HTTPS or S3 with just two SQL statements? We have a new guide that explains how to do this.
2
18
137
New blog post by
@hfmuehleisen
duckplyr: dplyr powered by DuckDB
The post describes the new R package duckplyr, which translates the dplyr API to DuckDB’s execution engine.
Read more at
1
38
137
There are now a lot of handy tools and cool projects built around DuckDB. You can find a list of these in the Awesome DuckDB repository maintained by
@davidgasquez
.
See the list and contribute your project at
1
30
130
DuckDB 0.8.0 "Fulvigula" released, check out our release announcement blog post:
4
37
126
New blog post: JupySQL enables SQL cells in Jupyter, supports DuckDB, and also enables plotting larger than memory datasets using DuckDB! JupySQL is an active fork of ipython-sql being enhanced by the folks at
@ploomber
. Let us know what you think!
4
23
123
The new DuckDB landing page, , has several code snippets for SQL features and DuckDB's APIs. You can use the "Live Demo" button to execute the queries on an example dataset in your browser using the DuckDB shell that runs in WebAssembly.
Note: the demo
1
18
120
DuckDB reached 10 000 stars on GitHub:
3
9
120
We have started publishing the recordings of DuckCon
#4
. We are first releasing the “State of the Duck” talk by DuckDB's co-creators, Hannes Mühleisen (
@hfmuehleisen
) and Mark Raasveldt (
@mraasveldt
).
Video:
Slides:
Special thanks
2
21
113
The DuckDB team celebrates yesterday’s release, v0.10.0, with a custom-made yoghurt cake! 🍰
2
4
112
Lambda functions are one of the most popular features in DuckDB. We recently added list_reduce, a new scalar function that supports lambdas, and they got their own documentation page at .
Note that this feature is currently only available in DuckDB's
0
16
109
DuckDB just got a tldr page. If you have
@tldr_pages
installed, you can get examples of the most common command-line arguments with:
$ tldr duckdb
0
21
107
Did you know that DuckDB's documentation is available as a single PDF? It includes all documentation pages and guides, and just surpassed 1,000 pages.
2
15
104
New blog post by
@carlo_piovesan
: Extensions for DuckDB-Wasm
Thanks to recent developments, DuckDB-Wasm users can now load DuckDB extensions, allowing them to run extensions in the browser.
2
31
104
DuckDB was included in
@InfoWorlds
's best open-source software list as a "tiny-but-powerful project" that provides just enough OLAP for most use cases. The award praised the lightweight nature and many features of DuckDB.
The best open source software of 2023 Ready to discover more? Click the image below ⬇️
0
2
9
2
19
101
This blog post is a short summary of the ICDE 2024
(
@icdeconf
) paper authored by
@lnkuiper
,
@peterabcz
, and
@hfmuehleisen
: Robust External Hash Aggregation in the Solid State Age.
The paper is available at
0
20
100
Did you know that you can use DuckDB to query Google Sheets via its CSV export? This blog post at areca data explains how:
2
16
98
New blog post by Richard Wesley: Range Joins in DuckDB
2
20
96
New blog post by
@holanda_pe
– DuckDB's CSV Sniffer: Automatic Detection of Types and Dialects
3
13
96
DuckDB can both export to and import from Numpy arrays. We added two new guides to cover these features:
5
15
95
2
22
91
We rolled out an updated syntax highlighter and a new color scheme in the DuckDB documentation, .
The highlighter now knows all of DuckDB's keywords and functions. The color scheme is based in the Bluloco theme ().
2
11
92
New blog post by Richard Wesley – DuckDB's AsOf Joins: Fuzzy Temporal Lookups
0
16
89
Did you know that DuckDB supports function chaining? This allows function calls to be rewritten in more a readable manner. See the Even Friendlier SQL with DuckDB blog post for details:
0
13
89
0
31
82
DuckDB's co-creator
@mraasveldt
gave a talk about DuckDB Internals at
@andy_pavlo
's Advanced Databases Course at CMU this week:
0
13
80
DuckDB 0.4.0 "Ferruginea" released with query cancellation on CTRL-C and parallelism for most queries
0
22
78
We created a single, easy-to-search PDF file from the DuckDB documentation:
This is a preview version – if you find any issues, please report them at
0
17
78
Team DuckDB is giving a talk and running a booth
@PydataEindhoven
today. Drop by for some swag!
2
5
72
New blog post by
@pdet
“
@DuckDB
quacks
@ApacheArrow
: A zero-copy data integration between Arrow and DuckDB”
0
26
72
We extended our performance guide with a new recommendation: avoid joining on VARCHAR-typed columns (i.e., strings). The accompanying microbenchmark demonstrates a case where performing a large join on BIGINT columns is 2.6× faster than evaluating the same join on VARCHAR
2
9
70
New guest post by
@matsonj
:
#ModernDataStack
in a Box with DuckDB (includes
@meltanodata
,
@dbt_labs
,
@apachesuperset
, with contributions from
@__AlexMonahan__
and
@josh_wills
)
2
14
68
Next release 0.5.0 is planned for 2022-09-05, major changes, now would be a good time to test with the latest master branch and report issues if any.
2
9
63
#DuckCon
lightning talk recordings:
"
@lakeFS
❤️ DuckDB" by
@ozkatz100
"Using DuckDB and ArrowFlight to Power a Feature Store" by
@tdoehmen
from
@hopsworks
"Integrating DuckDB with
@fluvio_io
" by Sehyo Chang
0
18
63
We have released DuckDB v0.10.3, a bugfix release.
The command 'pip install duckdb --upgrade' already delivers the new version. DuckDB clients in other package management systems (CRAN, Maven, Homebrew, etc.) will be updated in the coming days.
For the release notes and binary
1
13
67
DuckDB 0.3.3 "Sansaniensis" released with JSON extension,
@JuliaLanguage
API, S3 enhancements and much more:
2
19
62
DuckCon
#4
will feature a talk by
@polinaeterna
of
@huggingface
titled “Hugging a Duck: democratizing data access and exploration with DuckDB and Hugging Face Hub”.
The talk will explain how they use DuckDB to allow people to easily explore over 250k public dataset on the
0
13
62
A reminder: DuckDB has a tldr page. If you have
@tldr_pages
installed, you can get examples of the most common command-line arguments by running
$ tldr duckdb
0
9
60
We just released DuckDB v0.10.2, a bugfix release.
See the installation page and the release notes for details:
–
–
1
8
59
0
22
59
New blog post: Parallel Grouped Aggregation in DuckDB
0
12
59
We have released DuckDB v0.10.1, a bugfix release. For installation instructions, see:
This release fixes several issues with the CSV parser and tackles scenarios which previously resulted in out-of-memory (OOM) errors (details in 🧵).
1
12
58
DuckDB's DevRel,
@szarnyasg
, gave a talk last November at the
@oredev
conference titled "DuckDB: Harnessing in-process analytics for data science and beyond". The recording is now available:
The slide deck is here:
0
7
57
A new DuckDB article is out on Datanami with quotes from
@hfmuehleisen
:
DuckDB Walks to the Beat of Its Own Analytics Drum
“DuckDB has this different angle,” Mühleisen said. “It’s more like something that you put into a workflow rather than something
0
9
56
Laurens Kuiper will present his paper "Robust External Hash Aggregation in the Solid State Age" tomorrow at ICDE 2024 in Utrecht. This work describes the techniques that make larger-than-memory aggregation possible in DuckDB. The paper is co-authored by Peter Boncz (
@peterabcz
)
0
10
55
3
5
56
We have released DuckDB v0.9.1 today. This is a bug fix release for various issues discovered after we released 0.9.0. There are no new features, just bug fixes. Database files created by DuckDB v0.9.0 can be read by DuckDB v0.9.1.
1
11
56
Mark and Hannes on their way to
@pydataamsterdam
2023. Come to our booth to chat with the
@duckdb
team!
2
5
55
The second talk at DuckCon
#4
was presented by Polina Kazakova (
@polinaeterna
) of Hugging Face (
@huggingface
) with the title “Hugging a Duck: Democratizing Data Access and Exploration with DuckDB and Hugging Face Hub”.
Video:
Slides:
0
9
54
New blog post by
@samansmink
: Dependency Management in DuckDB Extensions
TL;DR: While core DuckDB has zero external dependencies, building extensions with dependencies is now very simple, with built-in support for vcpkg.
0
13
53
DuckDB 0.3.2 "Gibberifrons" released with time zone support, installable extensions and much more
1
15
53
We are excited to invite you all for our second "DuckCon" user group meeting. It will take place the day before
@fosdem
in Brussels on Friday Feb 3rd, 2023. In-person pandemic permitting.
2
13
52
We are launching a user survey to learn more about how the community uses DuckDB! Please visit the form at
The survey takes about 5 minutes and is anonymous. However, you can enter your email address to participate in a raffle where we give away DuckDB
1
14
50
The fourth talk at DuckCon
#4
was presented by Niger Little-Poole of
@prequel_co
, titled “The Duck(DB) Feather in Your Parquet Cap”.
Video:
Slides:
0
12
45
DuckDB 0.3.1 "Spectabilis" released with new push-based execution framework, GROUPING SETS, ROLLUP & CUBE, ENUM types and much more
2
11
46
We have released DuckDB v0.9.2 today. This is a bug fix release. Database files created by both DuckDB v0.9.0 and v0.9.1 can be read by DuckDB v0.9.2, and vice versa.
1
7
45
The DuckDB team is attending the inaugural lecture of DuckDB’s co-founder
@hfmuehleisen
at
@Radboud_Uni
today.
3
1
45
DuckDB's co-creator Hannes Mühleisen (
@hfmuehleisen
) will give an invited talk on Wednesday May 15th at 17:00. The talk, presented at the industry track of ICDE 2024 in Utrecht, is titled "How I Learned to Stop Worrying About Benchmarks".
0
12
46
Join us for "DuckCon", our first virtual DuckDB User Group Meeting on April 14th
1
15
43
DuckDB's release calendar was recently extended with pictogram of the ducks used for the release codenames. Check it out at
PS: The next version of DuckDB, v0.10.3 is expected to be released on May 20.
0
2
42
