Kyle Barron kylebarron.dev on bsky Profile
Kyle Barron kylebarron.dev on bsky

@kylebarron2

Followers
3K
Following
11K
Media
141
Statuses
2K

Creating the next generation of geospatial data tools for Python & the browser with GeoArrow, GeoParquet & GeoRust @developmentseed | he/him 🌈

New York, USA
Joined March 2010
Don't wanna be here? Send us removal request.
@kylebarron2
Kyle Barron kylebarron.dev on bsky
2 years
Introducing lonboard: the fastest way to visualize large geospatial vector data from Python. Here's 3 million points rendered with a unique color and radius per point, in two seconds. https://t.co/huNmyLpAr5 https://t.co/qqNcujpWrd
13
116
592
@kylebarron2
Kyle Barron kylebarron.dev on bsky
2 months
New blog post! https://t.co/RZW9Sbjyvz This dives into performance pitfalls of Python bindings, why projects like Lonboard are so fast, and why I care about Apache Arrow so much. The post is high level and you don't need to know C/C++/Rust to understand it!
0
0
7
@trevmanz
trevor manz
4 months
learning a new api? `mo.inspect()` your objects in @marimo_io. no more dir() / help()-ing around `<object at 0x...>`...
1
5
33
@kylebarron2
Kyle Barron kylebarron.dev on bsky
5 months
Published v0.4 of the Rust GeoParquet crate: - Read all GeoParquet 1.1 files, including spatial filtering - Easier integration with upstream parquet crate - Support for adding bbox column when writing files - Sync and async for both reading and writing https://t.co/woobrVOPB1
Tweet card summary image
github.com
This is the tag for the v0.4 release of the geoparquet crate, which was delayed compared to the 0.4 release of the other crates. 0.4.0 (geoparquet crate) - 2025-07-08 New standalone geoparquet crat...
0
0
9
@kylebarron2
Kyle Barron kylebarron.dev on bsky
5 months
Obstore v0.7 is out! The simplest Python cloud storage interface, powered by Rust - Anonymous connections to GCS - Obspec compatibility - Improvements to NASA Earthdata credential provider - Fixed creation of AzureStore from URL - Improved documentation https://t.co/y4uluBeaMc
Tweet card summary image
developmentseed.org
The simplest, highest-throughput Python interface to S3, GCS & Azure Storage, powered by Rust.
1
0
3
@kylebarron2
Kyle Barron kylebarron.dev on bsky
5 months
Introducing Obspec: A Python protocol for interfacing with object storage. Obspec is an alternative to fsspec to read, write, and modify data on object storage while acknowledging that object storage is *not* a filesystem. https://t.co/dSfF4bCHw6
Tweet card summary image
developmentseed.org
Object storage interface definitions for Python.
0
0
10
@andrewlamb1111
Andrew Lamb
9 months
Another blog on my favorite topic: Parquet Filter Pushdown.
1
13
110
@kylebarron2
Kyle Barron kylebarron.dev on bsky
9 months
Obstore v0.6 brings simple, painless integration with Microsoft Planetary Computer! - *Automatic token refresh*. No need to manually fetch SAS tokens and never think about token expiration times again. - STAC API integration https://t.co/jqrLnjDh1e
Tweet card summary image
developmentseed.org
The simplest, highest-throughput Python interface to S3, GCS & Azure Storage, powered by Rust.
0
0
11
@kylebarron2
Kyle Barron kylebarron.dev on bsky
9 months
Published v0.1 of async-tiff, a Rust crate and Python library for low-level, async reading of TIFF and GeoTIFF files. There's high potential for improved performance when opening many TIFF files concurrently, esp in Python server environments https://t.co/JH8n1pv0S3
Tweet card summary image
github.com
Async TIFF reader for Rust and Python. Contribute to developmentseed/async-tiff development by creating an account on GitHub.
0
0
10
@kylebarron2
Kyle Barron kylebarron.dev on bsky
9 months
Published obstore 0.5, the fastest Python interface to S3, GCS & Azure. - Benchmarks: **2.8x higher throughput** than aioboto3 for many small, concurrent requests - Custom credential providers, automatic token refresh - Improved docs, fsspec integration https://t.co/9wOVTdlp1s
Tweet card summary image
developmentseed.org
The simplest, highest-throughput Python interface to S3, GCS & Azure Storage, powered by Rust.
0
2
10
@kylebarron2
Kyle Barron kylebarron.dev on bsky
10 months
New release of obstore: the simplest, highest-throughput Python interface to S3, GCS & Azure Storage! - Pickle support, to unblock usage in @dask_dev - Easier one-line store creation - Open remote objects as file-like readers or writers - Improved docs https://t.co/7WrSsEQKsr
Tweet card summary image
developmentseed.org
The simplest, highest-throughput Python interface to S3, GCS & Azure Storage, powered by Rust.
0
3
22
@kylebarron2
Kyle Barron kylebarron.dev on bsky
10 months
Really cool to see @petegadomski 's work integrating Rust-Python for the STAC ecosystem
0
2
2
@kylebarron2
Kyle Barron kylebarron.dev on bsky
11 months
New obstore v0.3 for easy access to S3, GCS, and Azure Storage! - Easy async **streaming** downloads, uploads, and copies across object stores - Streaming list, with no pagination - Easier configuration with improved type hints - Fsspec integration https://t.co/Zz0p4pLvlA
Tweet card summary image
developmentseed.org
The simplest, highest-throughput Python interface to S3, GCS & Azure Storage, powered by Rust.
2
1
17
@kylebarron2
Kyle Barron kylebarron.dev on bsky
11 months
Really happy for myself and @developmentseed to be part of GeoJupyter, an initiative to improve interactive mapping and analysis in @ProjectJupyter notebooks. https://t.co/JE2a9UVYof
1
3
27
@mourner
Volodymyr Agafonkin πŸ‡ΊπŸ‡¦
11 months
Such a fantastic explanation of my code β€” not sure I'd explain it better. Check this out! πŸ™
@kylebarron2
Kyle Barron kylebarron.dev on bsky
11 months
Spatial indexes, and RTrees specifically, are at the core of geospatial software. But ever wondered how an RTree is actually implemented? In this post we’ll dive into the implementation of Flatbush, a blazing-fast, memory-efficient RTree by @mourner https://t.co/ZT1YXNP5xm
1
5
30
@kylebarron2
Kyle Barron kylebarron.dev on bsky
11 months
Spatial indexes, and RTrees specifically, are at the core of geospatial software. But ever wondered how an RTree is actually implemented? In this post we’ll dive into the implementation of Flatbush, a blazing-fast, memory-efficient RTree by @mourner https://t.co/ZT1YXNP5xm
0
18
72
@pyodide
Pyodide
11 months
Pyodide 0.27 has been released πŸŽ‰ Release highlights: πŸ”“ pyodide-build decoupling πŸ”’ @numpy_team 2.0 🏎️ Python ⇔ JavaScript FFI performance improvements πŸ“Š New data science and data engineering packages: @ApacheArrow (PyArrow), @DataPolars, @duckdb https://t.co/hqd3oBEJ7w
blog.pyodide.org
Pyodide v0.27.0 is out. This release was focused on improving the long-term stability of Pyodide. Welcome Agriya Khetarpal to the Pyodide team Agriya Khetarpal has joined as a new maintainer. Agriya...
1
19
53
@kylebarron2
Kyle Barron kylebarron.dev on bsky
11 months
These are ports of @mourner 's awesome Flatbush and Kdbush libraries πŸ™‡β€β™‚οΈ
0
0
7
@kylebarron2
Kyle Barron kylebarron.dev on bsky
11 months
Released geo-index 0.2: Fast, memory-efficient, zero-copy spatial indexes for Python & Rust. - Range, nearest-neighbor queries - Persist indexes as bytes, reuse them later - Supports float32 for 2x less memory - Enables GeoParquet spatial partitioning https://t.co/cZMJYvdYjf
Tweet card summary image
github.com
A Rust crate and Python library for packed, immutable, zero-copy spatial indexes. - georust/geo-index
2
5
42
@andrewlamb1111
Andrew Lamb
11 months
The browser based parquet viewer https://t.co/crTTxwBceA is pretty sweet -- let's you explore the file format, including schema and layout, and data with SQL. Natch it is based on @ApacheDataFusio
4
37
185
@andy_pavlo
Andy Pavlo (@andypavlo.bsky.social)
11 months
Buckle up because we're crashing into the new year with my annual database retrospective: License change blowbacks! @databricks vs. @SnowflakeDB gangwar! @DuckDB shotgun weddings! Buying a college quarterback with database money for your new lover!
Tweet card summary image
cs.cmu.edu
Andy rises from the ashes of his dead startup and discusses what happened in 2024 in the database game.
18
164
735