Ryan Abernathey
@rabernat
Followers
7K
Following
10K
Media
214
Statuses
7K
Scientist and Startup Founder Co-founder and CEO @EarthmoverHQ @pangeo_data steering council member ex-Professor @columbia @lamontEarth
New York, NY
Joined February 2011
It was super fun talking to Max about my journey through geospatial / climate and where I think I this field is heading.
Today's conversation is a deep dive on how we do scientific computing today, and how it could be better Talking to @rabernat about @pangeo_data, @zarr_dev and @EarthmoverHQ Watch: https://t.co/LBRdLrfWhy
3
13
83
🌎 Why do we need a cloud-native data lake for geospatial data? In the latest episode of The Infra Pod, @tnachen & @ianlivingstone chat with the cofounders of @EarthmoverHQ, @rabernat & @_jhamman, about the future of data in climate and earth sciences. 🎧 Link in 🧵
1
2
13
🌤️ #AMS2025 is just around the corner! We are taking AMS by storm with an exhibitor booth (booth 353), two talks from @_jhamman and @rabernat , and hosting a @pangeo_data Community Happy Hour (register here: https://t.co/7CujhX87AC)!
1
6
12
@rabernat is rounding out the week of #AGU24 with his talk, “How can we make cloud computing actually accessible to all scientists?” on Friday at 5:10 PM https://t.co/2yo0ET7F53
0
1
7
Monday through Thursday, I'll be hanging out with @rabernat at the @EarthmoverHQ booth in the exhibit hall. Swing by to say hello or to snag some swag/stickers/etc. We'll also be demoing #icechunk all week.
1
1
5
Checked out the other site. 🟦 Seems much better. Gonna be over there more from now on. 👋
0
1
7
I take it all back. At #SatSummit in Lisbon we finally discovered the holy grail of cloud optimized file formats
@mouthofmorrison @rabernat @betolink @EarthmoverHQ @steadyflux That said, it isn't 100% clear that NASA's best move is to immediately convert 10000+ data sets into cutting edge ARCO formats. Kerchunk and Virtual Zarr offer benefits of ARCO while keeping data in the native formats.
0
3
25
Are you heading to #AGU24 next month? Consider joining us for a bonus day of hacking on @pangeo_data. I'll be there representing @EarthmoverHQ and helping folks work with #icechunk and @zarr_dev. Details and signup here:
discourse.pangeo.io
🎉 Please join us for a Pangeo working meeting / hackathon on December 14 in Washington, DC 🎉 I’m excited to announce a Pangeo working meeting following the 2024 AGU Fall Meeting in Washington, DC....
0
1
14
🚀 New blog post: Nomadic Compute - The Future of Distributed AI Workloads 🌐 In a fast-paced AI world, flexibility & resilience are key. "Nomadic Compute" pattern lets workloads move dynamically across clouds for peak performance, cost, & availability:
tigrisdata.com
This AI stuff is cool, but GPU inference is not needed all of the time. Most of the time your instances stay idle, which means you're just burning investor money without any real benefit. Today we'll...
0
1
3
Come learn about recent @xarray_dev GroupBy improvements at tomorrow's (Wed, Nov 13) Pangeo Showcase! https://t.co/K0Wi0ZQK43
1
7
29
Most developers today wouldn't dream of not using version control for their code... However, the same principles can be applied to data! @EarthmoverHQ's new open source project--Icechunk--includes version control features built specifically for the @zarr_dev data model, brining
1
3
39
Xarray v2024.10.0 has just been released, including support for xarray.DataTree and zarr-python v3 !!! https://t.co/LB2cvjuJKx
@xarray_dev @zarr_dev
github.com
This release brings official support for xarray.DataTree, and compatibility with zarr-python v3! Aside from these two huge features, it also improves support for vectorised interpolation and fixes ...
2
26
99
It’s a real honor to be part of this amazing collection of experts. Looking forward to helping spread the word about Cloud Native Geospatial!
Introducing the Founding CNG Editorial Board for the Cloud-Native Geospatial Forum (CNG)! This group of leaders from our community have graciously volunteered to guide our work. https://t.co/86miHteByg
1
1
31
"Large GeoSpatial Benchmarks: First Pass" Last month we asked for TiB scale geo workloads to form a benchmark suite. We got strong response. Since then we've built out these into a public suite. This post goes over what's implemented and early results https://t.co/ZxQhqw4fwQ
docs.coiled.io
Summary: We implement several large-scale geo benchmarks. Most break. Fun! This article describes those benchmarks, what they attempt, how they break, and the technical work necessary to make them ...
1
4
26
Join us tomorrow Oct 23 at 4 PM EDT for a Pangeo showcase on Icechunk: An Open-Source Transactional Storage Engine for Zarr by @rabernat!
discourse.pangeo.io
Title: “Icechunk: An Open-Source Transactional Storage Engine for Zarr” Invited Speaker: Ryan Abernathy (ORCID: 0000-0001-5999-4917) When: Wednesday, October 23, 2024 at 4 PM EDT Where: Launch...
0
7
15
It's been a blast learning rust and working with the @EarthmoverHQ team on Icechunk! Come see what it's all about. Absolutely worth it, I promise.
⚡️ Icechunk is fast! What does this mean for users? Reduced cost for all data-intensive compute jobs and enhanced productivity for the data scientists who work with data all day long. Icechunk, @EarthmoverHQ's new transactional cloud-native storage engine for array / tensor
0
4
27
⚡️ Icechunk is fast! What does this mean for users? Reduced cost for all data-intensive compute jobs and enhanced productivity for the data scientists who work with data all day long. Icechunk, @EarthmoverHQ's new transactional cloud-native storage engine for array / tensor
0
9
35
We’re hosting a webinar on Tuesday, October 22 from 12- 1 PM EST to discuss what Icechunk means for the scientific data community and answer questions from attendees. Register here: https://t.co/mGrYyqOvEU
🚀 We are thrilled to announce the release of the Icechunk storage engine, a new open-source library and specification for the storage of multidimensional array (a.k.a. tensor) data in cloud object storage. Read our blog post about Icechunk here:
0
8
11
There has been so much interest and investment in launching new EO satellites in the past 3-5 years. But, there has been relatively limited interest and investment into solving the boring problems of standardization, interoperability and analysis-ready data* in EO.
4
10
78