DeltaLakeOSS Profile Banner
Delta Lake Profile
Delta Lake

@DeltaLakeOSS

Followers
10K
Following
1K
Media
1K
Statuses
2K

Delta Lake is an open-source storage framework that enables building a Lakehouse architecture for Spark, Flink, Trino, Hive, Scala, Java, Rust, Python, & more!

San Francisco, CA
Joined April 2019
Don't wanna be here? Send us removal request.
@DeltaLakeOSS
Delta Lake
3 days
Delta Lake 4.0 now supports Variant data type designed for working with semi-structured data like JSON with evolving schemas!. Key capabilities include:.🔹 𝗦𝗰𝗵𝗲𝗺𝗮-𝗼𝗻-𝗿𝗲𝗮𝗱: No need to define a fixed schema in advance. Structured data can be extracted at query time. 🔹
Tweet media one
0
1
4
@DeltaLakeOSS
Delta Lake
5 days
Missed today's “Delta Live! Live Rust hacking and AMA” 🦀 with R. Tyler Croy and Robert Pack?. Catch the full recording on our YouTube channel ➡️ 🎥 Next stream is on Tuesday, August 26 at 7AM PT!. #opensource #oss #rustlang #deltalake
Tweet media one
1
1
6
@DeltaLakeOSS
Delta Lake
5 days
Amsterdam! 🇳🇱 The Open Lakehouse Meetup is happening on Aug 27. Hear from Chang She (@changhiskhan) — Co‑founder & CEO of @lancedb and co‑author of pandas — on how to scale #multimodal AI pipelines across text, video, audio, images, and sensor data at petabyte scale. 📅
Tweet media one
0
0
5
@DeltaLakeOSS
Delta Lake
5 days
NOW LIVE! 🚨. Tune in to Delta Lake Live! with Tyler Croy & Robert Pack to do some kernel hacking together. 🦀🙌. 📽️ #opensource #oss #rustlang #kernel.
Tweet card summary image
twitch.tv
Free and open source software developer, mostly Rust nowadays for data appliocations
0
0
1
@DeltaLakeOSS
Delta Lake
6 days
Join R. Tyler Croy, Delta Lake maintainer and founder of Buoyant Data, for “Delta Live! Live Rust hacking and AMA” 🦀 on Twitch. 📅 Tuesday, August 19.⏰ 7:00AM PT / 10:00AM ET.🎥 Whether you’re curious about delta-rs, want to see open source development
Tweet media one
2
0
4
@DeltaLakeOSS
Delta Lake
6 days
⚡️ Faster, More Reliable Table Reads with Version Checksums in #DeltaLake!. The Delta Lake Java Kernel now supports version checksums—think of them as mini-checkpoints for your Delta logs that supercharge your data operations. Here’s what you gain:.🔹 𝗔𝗰𝗰𝗲𝗹𝗲𝗿𝗮𝘁𝗲𝗱
Tweet media one
0
1
3
@DeltaLakeOSS
Delta Lake
9 days
🇳🇱 Join us in Amsterdam on August 27 for the Open Lakehouse Meetup!. Discover how your lakehouse is ready for production-scale multimodal ML pipelines in "Your Lakehouse Has Everything You Need" with @Sammy_Sidhu, CEO & Co-Founder of Eventual!. See how to process millions of
Tweet media one
0
4
8
@DeltaLakeOSS
Delta Lake
10 days
Exciting update in Delta Kernel Java! 🎉. Kernel now allows engines to write file statistics to the Delta log whenever available. This enhancement allows for more effective data skipping during queries by leveraging filters at read time. The result? Faster queries, optimized
Tweet media one
0
3
5
@DeltaLakeOSS
Delta Lake
10 days
RT @lancedb: Open Lakehouse Meetup in Amsterdam on Aug 27th with @lancedb and @databricks. Hear from @changhiskhan @lancedb CEO & Cofounder….
0
1
0
@DeltaLakeOSS
Delta Lake
12 days
Delta Lake 4.0 brings big improvements to the internal table features framework in Delta Kernel. Now, engines using Delta Kernel can append to tables with powerful features like deletionVectors, v2Checkpoint, and timestampNtz—all enhancing reliability and performance. 👉 Explore
Tweet media one
0
3
14
@DeltaLakeOSS
Delta Lake
13 days
📢 Join us in Amsterdam for the 𝗢𝗽𝗲𝗻 𝗟𝗮𝗸𝗲𝗵𝗼𝘂𝘀𝗲 𝗠𝗲𝗲𝘁𝘂𝗽!. 🔗 Register here: Session Spotlight 🌟.𝘊𝘰𝘮𝘱𝘰𝘴𝘢𝘣𝘭𝘦 𝘖𝘱𝘦𝘯 𝘛𝘢𝘣𝘭𝘦 𝘍𝘰𝘳𝘮𝘢𝘵𝘴 – 𝘐𝘯𝘵𝘦𝘨𝘳𝘢𝘵𝘪𝘯𝘨 𝘖𝘱𝘦𝘯 𝘛𝘢𝘣𝘭𝘦 𝘍𝘰𝘳𝘮𝘢𝘵𝘴 𝘸𝘪𝘵𝘩 𝘵𝘩𝘦
Tweet media one
0
1
4
@DeltaLakeOSS
Delta Lake
18 days
Hannes Mühleisen, Co-Creator of @duckdb, will be talking about the DuckLake project at the Open Lakehouse Meetup in Amsterdam on August 27th! Don't miss it. 🦆🦀. Sign up here ➡️ #duckdb #opensource #oss #deltalake #openlakehouse
Tweet media one
0
5
20
@DeltaLakeOSS
Delta Lake
19 days
Looking to go deep on the best data engineering has to offer on open lakehouse systems — with others who build and contribute to them? The Open Lakehouse Meetup is for you! 🚀. 📅 Wednesday, August 27.🕒 5:00 – 9:00PM.🇳🇱 Amsterdam, Netherlands. Register now to save your spot ➡️
Tweet media one
1
4
13
@DeltaLakeOSS
Delta Lake
20 days
Missed @YoussefMrini's talk on the latest Delta Lake latest and most impactful features at Data+AI Summit? The full session is now live on YouTube! 😎. Find out how Deletion Vectors, Liquid Clustering, and more can take your analytics to the next level. 🎥 Watch now:
Tweet media one
1
3
5
@DeltaLakeOSS
Delta Lake
26 days
“We picked Rust because it makes it easier for new contributors to get involved with high-performance development. It’s straightforward for people to start working with, and it integrates really well with Python.”. In this clip, @JayChia5 explains how @daftengine's choice of
0
1
4
@DeltaLakeOSS
Delta Lake
1 month
Curious about how Delta Lake structures its tables and achieves both scalability and reliability?. In our recent webinar, Scott Haines breaks down the building blocks of a #DeltaLake table:.🔹 Partitioned storage — boosts performance and query efficiency.🔹 Parquet files —
0
3
3
@DeltaLakeOSS
Delta Lake
1 month
🎥 Now Available: Delta-Kernel-RS — Unparalleled Interoperability Across Query Engines. At #DataAISummit, Robert Pack and Zach Schuermann (@Databricks) introduced Delta-Kernel-RS — a new #Rust implementation of the Delta Lake protocol designed for unparalleled interoperability
Tweet media one
0
0
5
@DeltaLakeOSS
Delta Lake
1 month
In this walkthrough, ChanChan Mao with @daftengine shows how #Daft and #DeltaLake can work together by merging complex datasets (image metadata, annotations, categories) and writing them natively to Delta Lake, complete with partitioning and Delta log tracking—no #JVM, no #Spark
0
2
5
@DeltaLakeOSS
Delta Lake
1 month
In this clip, Ion Koutsouris (Rustacean & Delta Maintainer) explains how @lakeFS garbage collection policy integrates with #DeltaLake to manage unreferenced files and automate cleanups. By leveraging Spark jobs, lakeFS ensures your Delta Lake storage remains lean and organized.
0
0
1
@DeltaLakeOSS
Delta Lake
1 month
“We cut our streaming ingestion costs over 90% by adopting kafka-delta-ingest, which means we can invest those savings in really interesting large language model products or innovative data processes.” — R. Tyler Croy, Principal Engineer at @Scribd & Maintainer of delta-rs 💬
0
1
10