Spiral
@SpiralDB
Followers
313
Following
76
Media
4
Statuses
27
Multimodal warehousing that works with the tools you love. “Storage Packed In Recursive Arrays & Layers”
NYC & London
Joined March 2023
RT @mbakovic__: "Can every system perform an effective push-down? How do we leverage ephemeral caches to accelerate workloads? How can we m….
0
3
0
Our CTO @ngates_ wrote a blog post on donating Vortex (@vortexdotdev) to the Linux Foundation, and what's next for the project.
1
3
20
RT @SpiralDB: It's official: Vortex has been accepted as an Incubation-stage @linuxfoundation project 🍾. The core of the Composable Data St….
0
13
0
Many thanks to our existing community of contributors and supporters, including @andy_pavlo from CMUDB, @carlo_curino and the Microsoft @GraySystemsLab, @wesmckinn, @Snowflake and @PalantirTech. We're always looking for contributors, come find us over on Github!.
0
0
6
As part of the transition to community governance, we are putting together an utterly cracked Technical Steering Committee to guide the project, details to be announced soon 😉. You can read the full announcement post from LF AI&Data.
linuxfoundation.org
Vortex Project Joins LF AI & Data Foundation
1
1
6
It's official: Vortex has been accepted as an Incubation-stage @linuxfoundation project 🍾. The core of the Composable Data Stack is, and always will be, open source. We believe @vortexdotdev can serve as a new extensible storage layer for the next era of builders. The Linux
1
13
41
Checkout our latest post by @andreweduffy about bridging our Rust code to Java to accelerate Apache Iceberg queries 🏎️.
spiraldb.com
Using Vortex to accelerate Apache Iceberg queries up to 4x
0
3
15
Checkout our latest post, by @adamm_gs .
spiraldb.com
Tips and lessons learned from building systems directly against object stores
I've spent the past ~2 years thinking about building on top of object storage, especially about trying to build high throughput low latency OLAP-like systems. So I wrote down some of my thoughts and lessons >>>.
0
1
7
⏰ Happening in 1 hour⏰. Come check out our talk on implementing Vortex as a new Iceberg file format for fun + profit.
If you're at #IcebergSummit, be sure to come see our CEO and Founder @_willmanning talk about Turbocharging Apache Iceberg scans with Vortex!
0
1
6
If you're at #IcebergSummit, be sure to come see our CEO and Founder @_willmanning talk about Turbocharging Apache Iceberg scans with Vortex!
0
1
9
We are hosting our inaugural London Systems event on March 26th, inspired by the analogous events in NYC & SF. We will feature talks from Mistral and Spiral, with plenty of time for mingling over drinks and pizza. RSVP here:
lu.ma
We are hosting an inaugural London Systems event, inspired by the analogous events in NYC & SF. It will focus on systems-oriented software engineering topics.…
1
5
12
And in case you missed it, @andreweduffy has written up a primer on how exactly FSST works
spiraldb.com
Deep dives and design decisions
0
1
1
Our FSST string decompression just got 30% faster 🚀.
github.com
NOTE: we may want to fall back to a 4-byte unrolling for WASM / 4-byte architectures, but it may not matter.
1
1
6
Vortex turns push-down compute into an extreme sport
spiraldb.com
Deep dives and design decisions
0
1
12
Is your data where it needs to be? We explore the critical design decisions surrounding data layouts when creating file formats.
spiraldb.com
Deep dives and design decisions
0
1
8
We built the file explorer for Vortex that we always wish we had when working with other file formats. You can check it out if you have a Rust toolchain installed:. cargo install --git vortex-tui.
github.com
An extensible, state of the art columnar file format. Formerly at @spiraldb, now a Linux Foundation project. - vortex-data/vortex
I bet there aren't any other file formats that come with a slick terminal explorer 😎
0
3
12
For database-pilled Londoners, our very own @adamm_gs is putting together a meetup. Come for talks, conversations with fellow systems enthusiasts, and of course food 🍕. Sign up at First meeting in February 🚀.
lu.ma
View and subscribe to events from London Systems on Luma. March 26 | 6pm | Shoreditch Treehouse Hosted by Spiral Meetup focus on systems-oriented software engineering topics, from experts to anyone....
1/ We (@SpiralDB) are putting together a London systems meetup, to give a chance for (software) engineers to share and discuss their work on the underlying systems and tools that power most of our work - databases, compilers, VMs etc. and we're looking for speakers! >>.
0
4
15
