Voltron Data
@VoltronData
Followers
3,669
Following
26
Media
103
Statuses
508
We offer a new way to design and build composable data systems based on open source standards.
Worldwide
Joined February 2021
Don't wanna be here?
Send us removal request.
Explore trending content on Musk Viewer
安田記念
• 168639 Tweets
#BINIMikha_LadySetters
• 141223 Tweets
ML IN HONGKONG
• 135519 Tweets
MIKHA OUR BEST PLAYER
• 128859 Tweets
ロマンチックウォリアー
• 78290 Tweets
BUILD BD 3GETHER
• 76062 Tweets
GAME ON DONNY
• 45581 Tweets
ナミュール
• 44474 Tweets
#ユーフォ3期
• 30264 Tweets
ソウルラッシュ
• 29084 Tweets
土砂降り
• 28778 Tweets
OFIFI LIVE ON IG
• 26381 Tweets
ガイアフォース
• 25559 Tweets
Küçükçekmece
• 17912 Tweets
#鉄腕DASH
• 16933 Tweets
クランクアップ
• 16588 Tweets
ゲリラ豪雨
• 16304 Tweets
宝塚記念
• 14651 Tweets
どらほー
• 11313 Tweets
才木くん
• 11191 Tweets
Pinned Tweet
🔥 Already excited about Theseus? It gets better. 🔥
Dive deeper into what makes Theseus the ultimate choice for petabyte-scale data challenges with our bar-raising benchmarking report. See the proof of unparalleled performance & efficiency. 🚀
📊 Full report here:
3
21
42
One major strength of
@ApacheArrow
is that it supports a wide variety of programming languages including R, Python, and C++. This can enable faster and smoother
#data
processing. Learn more at
#TheDataThread
.
3
21
120
For the next edition of Pulling the Thread on 8/24,
@zeroshade
discusses how to get even more mileage out of
@GraphQL
with the help of Arrow Flight RPC. Join the live event w/ Q&A at a new time - *3pm* EDT
#JSON
2
9
104
If you’re a data scientist working with large data in
#Rstats
, you won’t want to miss the next Pulling the Thread event on 8/10 @ 12:30 pm EDT!
@djnavarro
will discuss the advantages of using the Arrow package in R and break down how it all works w/ Q&A.
2
28
97
If you’re an
#RStats
developer working with large datasets, it’s time to explore what
#ApacheArrow
- the multi-language toolbox for working with larger-than-memory data - can do for you. Get access to a tutorial and resources in our latest blog:
0
28
86
🚀 Introducing: The Composable Codex! This is a 5-part dive into
#ComposableDataSystems
. Starting from zero: A New Frontier. It’s a look at the history, technology, trends, and opportunities that are all critical to our arrival at the Composable era.
1
21
68
We’re celebrating the latest
@ApacheArrow
10.0.0 release by sharing 5 things we’re excited about 🏹
1
14
65
Our co-founder
@wesmckinn
shares the origin story of
@ApacheArrow
and how the project has evolved. Learn about the project’s capabilities and use cases as well as future goals that could benefit the community on our blog.
#BigData
1
28
62
The
@ApacheArrow
12.0.0 release is out and full of feature improvements and optimizations. Big shoutout to the 97 contributors for all the hard work over the last 3 months. Get our highlights in the 🧵
2
14
62
#ApacheArrow
11.0.0 is out! This release strengthens its position as the backbone for
#developers
who need to interop between different libraries, tools, and languages. Over the last few months, the team resolved 423 issues across 95 contributors. See the 🧵for highlights:
1
11
60
Have you met our fabulous developer advocates
@marlene_zw
and
@djnavarro
? Get to know them on today's blog!
#opensource
0
17
60
Building on the strengths of
@ApacheArrow
Flight, Arrow Flight SQL offers a smoother method for connectivity between different databases. When combined with
@DuckDB
, the opportunities for data pipelines can expand even further. Learn how they can be used:
1
17
58
Data transfer is a major bottleneck for many data workloads. Apache Doris recently adapted Arrow Flight SQL, which allows it to leverage the Python ADBC Driver for fast data reading.
This tutorial shows how to do data transmission at scale with Python, JDBC, Java, and Spark. In
2
5
44
If you're using DuckDB, come join our discussion today on how you can leverage Ibis to give your
@duckdb
pipelines even more power.
You can run your local experiments using DuckDB, and deploy to production using Ibis with a single line of code change!
Ibis supports 20+
1
6
41
To kick off the new year, we’re highlighting 12
#OpenSource
projects to watch in 2023. These technologies are modernizing the way
#DataAnalytics
and
#MachineLearning
get done. Read the report now!
2
19
39
Simplify database connectivity for both clients and vendors with our new blog post on the benefits of
@ApacheArrow
ADBC and Flight SQL. Learn how -
0
10
39
On the fourth day of
@ApacheArrow
🏹 its contributors gave to me: not one but *all* of
#rstats
{dplyr} join capabilities
#twelvedaysofarrow
#opensource
#thankyoucommunity
🙌 🙏
0
20
39
We’re releasing a report spotlighting 12
#OpenSource
projects to watch in 2023. Let’s see if you can guess all 12 before we drop it… (check the thread!)
#data
#analytics
#machinelearning
2
12
40
On the seventh day of
@ApacheArrow
🏹 its contributors gave to me: the
#rstats
{dplyr} ability to filter & aggregate without the “Error: cannot allocate vector of size 2 GB”
#twelvedaysofarrow
#opensource
#thankyoucommunity
🙌 🙏
0
15
38
On the sixth day of
@ApacheArrow
🏹 its contributors gave to me: the
#rstats
capability to create a (virtual) table in
@DuckDB
#twelvedaysofarrow
#opensource
#thankyoucommunity
🙌 🙏
0
17
37
On the second day of
@ApacheArrow
🏹 its contributors gave to me: C, C++, C#, Go, Java, JavaScript, Julia, MATLAB, Python, R, Ruby, and Rust Arrow libraries
#twelvedaysofarrow
#opensource
#thankyoucommunity
🙌 🙏
0
20
37
Got Geospatial data? Today,
@paleolimbot
is introducing GeoArrow at
@ApacheCon
. It plugs straight into existing
@ApacheArrow
-based systems to make
#GeospatialData
shine in data pipelines.
#ComposableDataSystems
#COC2023
Learn more:
1
14
34
@ApacheArrow
7.0.0 is Coming Soon! Get a sneak peak 👀 at some new capabilities & improved documentation
#opensource
#dataanalytics
#Python
#rstats
#cpp
0
25
34
Preview release of the nanoarrow-based
@SnowflakeDB
Connector for
#Python
is available! This connector is ~10x smaller in size and removes a hard dependency on a specific version of
#PyArrow
. Learn how the nanoarrow integration makes it possible.
1
11
33
At the next Pulling the Thread event, improve your
#geospatial
workflows by leveraging Arrow-based formats and tools.
@paleolimbot
&
@jorisvdbossche
show you how with
@GeoParquet
and
#GeoArrow
on 10/5 at 3:00 pm EDT.
#RStats
#RSpatial
1
9
33
Now available:
@SnowflakeDB
driver for
@ApacheArrow
#ADBC
! This makes it quicker and easier to connect to Snowflake using languages that don't already have connectors.
1
8
32
Arrow Database Connectivity (ADBC) is being adopted more and more by organizations seeking to improve data portability and performance. In this blog post, get resources to learn why
@SnowflakeDB
@dbt_labs
@duckdb
integrated it!
1
7
33
Meet Theseus - the petabyte-scale query engine redefining the
#DataAnalytics
SPACE - scale, performance and cost efficiency. 🚀 Process hundreds of TBs in seconds & unleash GPUs for real-time insights. 👉 Unveiled at
#NVIDIAGTC
:
1
16
33
Arrow Database Connectivity (ADBC) gives users a single way to get Arrow data in and out of databases - whether columnar or not. It’s a new API in the
@ApacheArrow
ecosystem and one we think you should know about:
1
9
32
Ready to take your
@ApacheArrow
experience to the next level? We're pleased to offer a new enterprise subscription that will help simplify issue reporting, provide faster fixes in between releases, and much more.
0
7
32
Tomorrow @ 12:30 pm EDT, join
@djnavarro
for the follow up to her popular session Doing More with
#Data
: An Introduction to Arrow for R Users. Subscribe to the YouTube channel for alerts on this and other exciting community events!
#RStats
0
9
32
Dataframe Interoperability in action! We explain the dataframe interchange protocol and how it’s pushing composability forward in the
#Python
ecosystem. We demo it using
@ApacheArrow
to visualize a
#PyArrow
table with
@vega_vis
Altair without conversion.
0
11
32
We recently released a proof of concept SQLAlchemy driver for Arrow Flight SQL. This supports deploying Arrow-native data storage and analytics stacks leveraging Flight and
@apachesuperset
as the interface. See an example of this in action on the blog!
1
6
30
Use
@huggingface
@IbisData
&
@LangChainAI
to create a custom search engine for your data. This
#opensource
trifecta helps you save money and gain flexibility by switching out data sources and
#LLMs
without changing much code.
@marlene_zw
shows you how!
0
7
30
The latest
@ApacheArrow
8.0.0 release introduces new capabilities that make it an even more powerful toolkit for data analytics and established a foundation for future work that will improve performance and interoperability. Read about it.
0
12
30
Inside the
#OpenSource
Report: It’s fast, lightweight, embraced by many already.
@DuckDB
is pulling users from traditional relational databases and we see why. Get our take on why it’s a top project to watch this year:
0
7
30
Registration is now open for
#TheDataThread
! On June 23, join us as we host experts from the across the
#data
community, such as
@ApacheArrow
co-creators
@wesmckinn
&
@intjesus
, who will provide insights on the next wave of
#OpenSource
technology.
0
21
28
Follow
@VoltronData
to catch the
#twelvedaysofarrow
celebrating the
@ApacheArrow
🏹 developer community for just a few of the amazing capabilities contributed to the Arrow project 🎁
#opensource
#thankyoucommunity
🙌 🙏
0
16
29
The latest
@ApacheArrow
9.0.0 release is available. It includes built-in support for
@GoogleCloud
storage, performance enhancements for Acero, and much more. See the highlights:
0
8
29
On today's blog, learn more about how Arrow Flight works and why it's useful.
0
10
28
ICYMI, the latest release to
@ApacheArrow
was shared earlier this month. Learn more about some of the newest features from the 7.0.0 release including the addition of Flight SQL and changes to
#PyArrow
.
0
5
27
It was exciting to see the composable data systems vision become a reality at VeloxCon!
As data use cases become more diverse, companies need shared open standards and modular components that teams can leverage to quickly build data systems that fit
0
6
26
On the first day of
@ApacheArrow
🏹 its contributors gave to me: A cross-language development platform for
#data
analytics in-memory
#twelvedaysofarrow
#opensource
#thankyoucommunity
🙌 🙏
Follow
@VoltronData
to catch the
#twelvedaysofarrow
celebrating the
@ApacheArrow
🏹 developer community for just a few of the amazing capabilities contributed to the Arrow project 🎁
#opensource
#thankyoucommunity
🙌 🙏
0
16
29
0
16
25
Over the past few months,
@marlene_zw
traveled to
#PyCon
events around the world. A talk on
@DataPolars
inspired her to write how the project written in
@rustlang
works with
@ApacheArrow
&
@IbisData
to build faster data pipelines.
0
7
26
The vibrant
@ApacheArrow
ecosystem now has a conference called the
#TheDataThread
. See what led
@VoltronData
to develop the event, and why you should attend.
0
11
26
Inside the
#OpenSource
Report: It’s official… people love
@DataPolars
. This
#dataframe
built on
#ApacheArrow
and written in
#rustlang
is one to watch. Shoutout to
@RitchieVink
for all the hard work on this project. Learn more:
1
6
25
If you're curious about how to get involved with the
@ApacheArrow
community, our quick intro to the Arrow New Contributor's Guide has you covered:
0
8
23
🔥Shoutout to the 12 projects on our list🔥
@PyTorch
@IbisData
#Velox
by
@Meta
@FB_Engineering
@DuckDB
@RAPIDSai
@substrait_io
@ApacheArrow
@DataPolars
@redpandadata
@huggingface
#Malloy
by
@GoogleAI
@lloydtabb
@numba_jit
1
5
24
The recent ADBC release lets users connect to databases through Arrow Flight SQL while remaining in
#Python
. This cuts down on complexity and enhances performance. We benchmarked this new capability against the Arrow JDBC driver. See the results:
0
10
24
Today on the blog: we dig into the Census PUMS dataset to show why an up-front investment in
#Parquet
(over CSV) provides an opportunity to use your data…rather than reading it.
0
9
24
LLMs unlock capabilities for organizations to chat with data. But what if you want to chat with or ask questions of your own data, stored in different sources? Today we show how to use
@LangChainAI
and
@IbisData
.
1
5
23
The
@IbisData
4.1 release brings a new pair of functions for reading CSV and Parquet to any supported backend, with the same line of code.
@kae_suarez
walks through what that looks like on
#ApacheArrow
DataFusion,
@duckdb
, and
@DataPolars
. Check it out!
1
9
23
Love to see
@IbisData
powering
#opensource
tools!
@Google
uses Ibis in its Data Validation Tool, which helps users ensure their data stays intact after moving it between different backends, including
#BigQuery
, Teradata, Cloud SQL, and more.
0
10
22
Find yourself wondering what new is in the works for
@ApacheArrow
7.0.0? Here is a sneak peak 👀
#opensource
#dataanalytics
#Python
#rstats
#cpp
0
14
22
For the last decade, our team has championed
#OpenSource
Standards and software development on
#GPUs
.
Today, our CEO
@datametrician
takes it to the next level at
#HPEdiscover
.
Introducing Theseus: the accelerator-native data processing engine.
Now inside
@HPE_Ezmeral
.
2
9
22
New release alert:
@ApacheArrow
nanoarrow 0.2 is out! nanoarrow is a lightweight C library that helps apps implement Arrow C Data & Stream interfaces. The release offers an IPC reader and a Getting Started tutorial, among other improvements. Learn more:
0
4
22
On the third day of
@ApacheArrow
🏹 its contributors gave to me: fast, flexible reading & writing of
@ApacheParquet
files in
#Python
#rstats
&
#cpp
#twelvedaysofarrow
#opensource
#thankyoucommunity
🙌 🙏
0
11
21
In our latest post,
@marlene_zw
uses
@IbisData
to analyze a massive Hacker News dataset pulled from Google
#BigQuery
. If you use
#python
for data analysis and feel the pain of using
#SQL
for large queries…this is a must-read:
1
10
21
Thank you
@VLDBconf
for the incredible opportunity to share and learn about composable data systems! Lots of momentum in the space to celebrate with
@MetaOpenSource
@motherduck
@sundeck_io
@starburstdata
@FireboltHQ
, our team
@VoltronData
& more.
0
3
22
We're working with
@MetaOpenSource
's
#Velox
project to improve the developer experience. Together, we'll enable modular, composable accelerated query processing that integrates with the rest of the open source
#ApacheArrow
ecosystem. Read more:
1
6
21
Looking for a primer on how
@ApacheArrow
can work to streamline your applications? Check out "In-Memory Analytics with Apache Arrow" - an essential resource from
@zeroshade
:
0
5
21
Find out what happened when
@mim_djo
and
@MurrayData
teamed up to see how fast a 60 million row
#Parquet
file could be processed, benchmarking numerous data engines. The results might surprise you… Then try it yourself!
1
4
21
Want to use LLMs to chat to or query your own data? Using
@IbisData
with
@LangChainAI
you can. Ibis gives users the flexibility needed to connect LLMs to multiple data sources & systems — with a few lines of code. Learn how:
0
8
21
We took a dataset that was 3.1 GB compressed, 14 GB uncompressed, and 50GB in memory, almost a hundred files, and 200+ columns… and transformed it into a
#Parquet
. The results? A compact, fast-to-use, and portable dataset. Check it out:
0
3
21
We worked with
@fb_engineering
to improve accessibility & UX for
#Velox
, the
#opensource
unified execution engine that accelerates DBMS. Now users have more troubleshooting benefits & contribution is easier. Great work
@assignUser
@raulcumplido
!
1
9
16
On the tenth day of
@ApacheArrow
🏹 its contributors gave to me: {reticulate} methods for passing
#data
between
#rstats
and
#Python
for seamless interoperability
#twelvedaysofarrow
#opensource
#thankyoucommunity
🙌 🙏
0
8
20
Have you thought about using
#golang
for your
#DataScience
workflows? When paired with
#ApacheArrow
and
#Parquet
you can experience advantages for common use cases.
@zeroshade
wrote a series of posts covering this topic. First up: how to get started.
1
5
20
Our CEO, Josh Patterson (
@datametrician
) talks using
#OpenStandards
to augment data systems on the latest episode of
@implydata
's podcast. Get his take on
@ApacheArrow
@IbisData
@duckdb
and the importance of connectivity in the
#DataAnalytics
ecosystem.
1
11
20
Over the past few years
@IbisData
downloads and adoption have spiked. We caught up with maintainers and contributors to get their perspective – and got a preview of the 4.0 release coming soon.
1
8
18
Formalized database access for Apache Arrow! The community accepted the Arrow Database Connectivity (aka ADBC) specification. Now applications have a simple API abstraction for moving Arrow data in and out of databases. Learn more here:
0
5
19
It's a great day to learn about
@IbisData
! Listen to
@cpcloudy
, Principal Engineer at
@VoltronData
and lead maintainer of the Ibis Project, speak with
@digiglean
on the
@realpython
's recent podcast episode "Decoupling Systems to Get Closer to the Data" >
2
9
18
On today's blog we’re spotlighting a specific change in the
#ApacheArrow
9.0.0 release. Learn how the Arrow C++ execution engine, Acero, drives significant performance gains in Arrow workflows.
0
7
18
We want to extend our sincere gratitude to everyone who gave a talk and attended
#TheDataThread
(the first event of many!). If you had trouble accessing the platform or couldn't attend, all live and pre-recorded sessions are available here:
0
5
18
Is Apache Arrow Flight SQL on your radar yet? It’s a new columnar database protocol in the
@ApacheArrow
project. Today on the blog, we cover some of the questions we’ve heard about its capabilities. Check it out!
0
11
18
Want to experiment with Arrow Flight SQL? Our latest blog shows you how to run Flight SQL using a
#DuckDB
backend — and we give you the code + a pre-built Docker container to get started.
0
4
18
That’s a wrap (pun intended 🎁) on our
#twelvedaysofarrow
celebration of the
@ApacheArrow
developer community! The
@voltrondata
team would like to wish everyone a happy and safe holiday season
#opensource
#thankyoucommunity
🙌 🙏
0
8
18
We've added new sessions to
#TheDataThread
agenda!
@DynamicWebPaige
,
@murraydata
,
@randyzwitch
,
@paleolimbot
,
@marlene_zw
and others have joined the lineup. Check out who else is speaking and register today at
0
9
18
This is impressive. A user request came in for an
@IbisData
#ApacheDruid
backend connection. A few hours later,
@cpcloudy
shipped it. Learn how he did it:
0
6
18
Revving up our engine for full-stack acceleration 🚀💪We’re thrilled to welcome
@chipro
@ZhenzhongXu
& the
@ClaypotAI
team to
@VoltronData
! Read the article by
@mr_bumss
in
@VentureBeat
to learn more!
0
6
18
If you need to balance performance and memory limitations, use
@IbisData
and
@duckdb
to convert CSV files to
@ApacheParquet
for increased flexibility and in-memory columnar capabilities. We show you how with the UK Census Data!
0
5
18
PSA: Tomorrow you can learn about
@IbisData
from
@fishnets88
on the
@probabl_ai
live coding stream! Click the link to see what time it is streaming in your area.
Per suggestion from the crowd, I will be exploring Ibis in the next live coding stream on behalf of
@probabl_ai
. I'll also do my best to find a fun dataset for this one 🙂
1
5
23
0
6
17
The Wall is coming……and it’s 😱
Fortunately, Chapter 04 of the
#ComposableCodex
is HERE.
Read The Wall & The Machine to understand the macro trends (and threats) impacting data system performance in the face of
#AI
.
Available now:
1
11
17
If we didn’t meet at
@nvidia
#GTC24
, watch our session, "Breaking Down The Wall: Accelerator-Native Now" [S63422]. Our cofounder
@rodaramburu
presents our new benchmark data and shares our vision for accelerating the full data system.
0
3
17
Voltron Data supports each member of our community in the quest to embrace their true colors. Happy Pride Month! 🌈
#LGBTQIA
+
#PrideMonth
#Pride2022
0
1
17
On the eighth day of
@ApacheArrow
🏹 its contributors gave to me: a cookbook filled with
#Python
#rstats
and
#cpp
Arrow recipes 📋
#twelvedaysofarrow
#opensource
#thankyoucommunity
🙌 🙏
0
10
16
In the NEW
#ComposableCodex
chapter we make one thing clear: Don't move your data. No really, don’t do it. Learn how composable connectivity standards for data format, access & transport help systems rise above the data sprawl.
#ComposableDataSystems
0
13
17
We're proud to be collaborating on this project!
Introducing
#Velox
, an open source execution engine for data management systems that both unifies & accelerates common data computation engines, like Spark & Presto. Learn how Velox improves computation-intensive data workloads & how you can participate:
3
23
75
0
6
17
Yesterday we showed how to scale down the Census PUMS dataset by transforming it into
#Parquet
. Today
@marlene_zw
is back to show the top Python tools to analyze this data
@ApacheArrow
@IbisData
@RAPIDSai
CuDF. Check it out!
0
8
16
We’re counting down to the start of
#TheDataThread
, an
@ApacheArrow
community event🎉. Don’t miss
@WesMckinn
&
@IntJesus
as they kick off the live talks with their keynote TODAY at 12pm ET. Registrants should have a link to the event from Zoom in their inbox.
8
6
16
One week away: See a live demo of our
#GPU
query engine, Theseus, and learn what Voltron Data is up to. Register now for this 45-min live virtual event hosted by our co-founders,
@rodaramburu
@keithjkraus
with
@philbewankenobi
running the demo 🔥
0
5
16
Reading CSVs just got a whole lot faster. Learn how
#ApacheArrow
can speed up ETL processing in R with minimal effort in 3 simple steps:
#rstats
0
11
16