Max Gabrielsson
@Maxxen_
Followers
301
Following
221
Media
13
Statuses
221
Software Engineer @ DuckDB Labs Compiler/Database/Web/Distributed/Low-Level/Constraint/Geospatial/Parallel/Game/Systems/All-Around Programming
Joined June 2012
Or ducked in general. You're losing so much of the benefits of vectorized execution if you trash the cache with allocator calls - not to mention the contention caused when allocating from different threads.
1
0
1
And this is after spending all night trying to optimize this - removing recursion from deserialization, caching already constructed geometries, pooling vectors etc etc. This is why I'm so pedantic about trying to minimize allocations in the context of duckdb-spatial.
1
0
2
Here are some interesting profiling results. Having DuckDB executing a large join with the new spatial join operator, it spends about 50% of the time just _deserializing_ and constructing GEOS geometries, 15% just calling GEOS destructors, and just 2% evaluating the predicate ๐ฅฒ
2
1
41
Its happening y'all, DuckDB's spatial joins are about to get good, actually.
github.com
This PR updates the workflow and pinned DuckDB version in the v1.2.2 branch to DuckDB v1.2.2. It also adds a new physical operator, the SPATIAL_JOIN. Spatial Joins Executing spatial joins in DuckDB...
2
15
118
Experimenting with CRS tracking support in DuckDB Spatial ๐บ๏ธ๐
1
5
18
RT @duckdb: ๐๐ฎ๐๐๐ฒ๐ฟ ๐๐ผ๐ฝ ๐ก ๐ณ๐ผ๐ฟ ๐ฎ๐ด๐ด๐ฟ๐ฒ๐ด๐ฎ๐๐ฒ ๐ณ๐๐ป๐ฐ๐๐ถ๐ผ๐ป๐. The end of the week brings us another blog post. @__AlexMonahan__ takes a deep dive intoโฆ.
duckdb.org
Find the top N values or filter to the latest N rows more quickly and easily with the N parameter in the min, max, min_by, and max_by aggregate functions.
0
15
0
RT @duckdb: ๐จ๐ฝ๐ฑ๐ฎ๐๐ฒ๐ ๐ผ๐ป ๐ฉ๐ฆ๐ฆ ๐๐
๐๐ฒ๐ป๐๐ถ๐ผ๐ป. In this weekโs blog post, Max Gabrielsson dives into the details of the new features and improvementsโฆ.
duckdb.org
DuckDB is another step closer to becoming a vector database! In this post, we show the new performance optimizations implemented in the vector search extension.
0
7
0
RT @duckdb: ๐๐ฉ๐๐๐ญ๐๐ ๐๐๐ง๐๐ก๐ฆ๐๐ซ๐ค ๐ฌ๐ฎ๐ข๐ญ๐. In this weekโs blog post, @holanda_pe takes a deep dive into DuckDBโs CSV performance with the well-knโฆ.
duckdb.org
DuckDB's benchmark suite now includes the NYC Taxi Benchmark. We explain how our CSV reader performs on the Taxi Dataset and provide steps to reproduce the benchmark.
0
9
0
RT @duckdb: New blog post by @__AlexMonahan__:.DuckDB in Python in the Browser with Pyodide, PyScript, and JupyterLite. In this post, Alexโฆ.
0
27
0
RT @kylebarron2: New blog post in collaboration with @ncclementi on using Ibis + DuckDB + Lonboard for analyzing and visualizing large geosโฆ.
0
28
0
RT @leichtdev: @duckdb you are such a nice tool, powerful and refreshingly simple. Please don't sell out to @oracle ๐๐๐.
0
1
0