Delta Lake
@DeltaLakeOSS
Followers
10K
Following
1K
Media
1K
Statuses
2K
Delta Lake is an open-source storage framework that enables building a Lakehouse architecture for Spark, Flink, Trino, Hive, Scala, Java, Rust, Python, & more!
San Francisco, CA
Joined April 2019
โก๏ธ From vector DB to multimodal lakehouse at petabyte scale. Join us in Mountain View on Nov 13 for โScaling Multimodal AI Lakehouse with Lance & LanceDBโ with Chang She (@lancedb) at the Open Lakehouse + AI Mini Summit! Learn: ๐น Lowโlatency random access + search APIs
0
2
6
Welcome to today's Delta webinar! Let us know where you are tuning in from. ๐
0
0
2
Flight SQL + Delta: Building the Future of High-Speed Data Exchange
1
3
8
Parquet sparked a revolution in columnar storage. Now AI workloads are driving a new wave of change. At ๐ข๐ฝ๐ฒ๐ป ๐๐ฎ๐ธ๐ฒ๐ต๐ผ๐๐๐ฒ + ๐๐ ๐ ๐ถ๐ป๐ถ ๐ฆ๐๐บ๐บ๐ถ๐, Julien Le Dem (@datadoghq) will cover: ๐น Whatโs changed since Parquet was introduced ๐น Why new columnar formats are
1
3
23
Thu, Nov 11 @ 9 AM PT โ๏ธ Flight SQL + Delta: Building the Future of High-Speed Data Exchange Learn how @ApacheArrow Flight, DataFusion, and Delta Lake enable fast SQL over Arrow Flight, plus how Delta VACUUM/OPTIMIZE integrate into a Flight SQL server backed by DataFusion for
0
3
5
Weโre heading to the Open Lakehouse + AI Mini Summit (Nov 13, Mountain View)! Join Chang She @changhiskhan for Scaling Multimodal AI Lakehouse with Lance & LanceDB โ how the LanceDB Multimodal Lakehouse powers petabyte-scale multimodal apps with low-latency search, schema
2
2
15
Join us at Open Lakehouse + AI Paris on November 24, 6:30โ10PM โ co-located with the Forward Data Conference! ๐ซ๐ท Secure your spot now โฌ๏ธ https://t.co/X6JwIDj4QA Weโre bringing together data innovators and open source contributors for an evening packed with insight and
0
5
9
๐ฃ Join us for the nextย Open Lakehouse + AIย webinar: ๐๐ฃ๐จ-๐๐ฐ๐ฐ๐ฒ๐น๐ฒ๐ฟ๐ฎ๐๐ฒ๐ฑ ๐๐ฝ๐ฎ๐ฐ๐ต๐ฒ ๐ฆ๐ฝ๐ฎ๐ฟ๐ธโข ๐๐ฎ๐๐ฎ ๐ฃ๐ฟ๐ผ๐ฐ๐ฒ๐๐๐ถ๐ป๐ด ๐ฎ๐ป๐ฑ ๐ ๐ฒ๐๐ฎ๐ฑ๐ฎ๐๐ฎ ๐ ๐ฎ๐ป๐ฎ๐ด๐ฒ๐บ๐ฒ๐ป๐ ๐ณ๐ผ๐ฟ ๐๐ฒ๐ป๐๐ ๐ช๐ผ๐ฟ๐ธ๐น๐ผ๐ฎ๐ฑ๐. ๐ REGISTER: https://t.co/1PQ4tUrlk5 Discover how
0
2
2
๐๐ฒ๐น๐๐ฎ ๐๐ฒ๐ฟ๐ป๐ฒ๐น ๐ฃ๐ผ๐๐ฒ๐ฟ๐ ๐๐ผ๐ป๐ณ๐น๐๐ฒ๐ป๐ ๐ง๐ฎ๐ฏ๐น๐ฒ๐ณ๐น๐ผ๐ ๐ @confluentinc Tableflowโs Delta Lake support is built on Delta Kernel, the open source library developed by Databricks to make Delta Lake universally accessible across any processing engine. Delta
0
1
10
Discover how deletion vectors can take Delta Lake performance to the next level. ๐ In this 5-minute video, @YoussefMrini breaks down how deletion vectors speed up delete, update, and merge operations by marking rows logicallyโno need to rewrite entire files. ๐ฅ Watch:
0
3
6
๐ Massive data, missionโcritical pipelines, zero excuses. โScaling @ApacheSpark at @OpenAIโ with Chao Sun shows how to make Apache Sparkโข reliable at scale. ๐น Cluster management, job submission, access control ๐น Dynamic scaling for spiky, multiโtenant loads ๐น How Apache
0
2
9
In this hands-on walkthrough, @YoussefMrini (@databricks) shows you how to handle special characters, rename columns, and safely modify schemas in Delta Lake! ๐ค ๐ฅย Get started: https://t.co/3Owg1NegAp By leveraging column mapping, youโll learn how to make Delta tables easier
0
1
3
๐จ THIS WEEK! ๐The data world doesnโt need more lineage graphs โ it needs more understanding. Join us on Thursday, Oct 30 at 9AM PT for our next Open Lakehouse + AI webinar, where weโll explore why โtotal visibilityโ often creates noise, not clarity. Discover how oleander is
0
0
2
Where does the feature platform fit in a world increasingly dominated by AI? At Open Lakehouse + AI Mini Summit, Hao Xu (Apple) shares how Feast is evolving beyond a feature store into a full feature platform for AIโbridging data, models, and applications through innovations
0
2
3
Weโre diving deep intoย Flight SQL + Deltaย to show how open technologies likeย Apache Arrow Flight,ย #DataFusion, andย Delta Lakeย are reshaping high-performance analytics! ๐ ๐๏ธ November 11 ๐ 9:00 AM PT ๐ Register: https://t.co/sIZCvxPdde See how: ๐น Flight SQLย provides a
0
1
4
๐ From data to AIโwithout the governance headaches. Donโt miss โFrom Data to AI: Leveraging Unity Catalog to Train at Scaleโ with Aniruth Narayanan (@Databricks) at Open Lakehouse + AI Mini Summit in Mountain View on Nov 13! ๐๏ธ Learn how a unified governance plane streamlines
0
1
5
Hard deletes break incremental loads. Delta Lakeโs Change Data Feed captures inserts, updates, and deletes โ including those produced by MERGE โ so downstream streams can maintain consistency. In this clip, @waitingforcode shows how CDF simplifies merge/update logic when rows
0
0
3
The open source and data community is coming together in Mountain View, CA! ๐ฅ Join us Nov 13 (12โ4:30PM PT) for the ๐ข๐ฝ๐ฒ๐ป ๐๐ฎ๐ธ๐ฒ๐ต๐ผ๐๐๐ฒ + ๐๐ ๐ ๐ถ๐ป๐ถ ๐ฆ๐๐บ๐บ๐ถ๐, featuring two tracks packed with insights on AI infrastructure, context engineering, and the future of
0
3
8
Join us for Open Lakehouse + AI in Paris, co-located with the Forward Data Conference! ๐ซ๐ท Weโre bringing together the open source and data engineering community for a fun and inspiring evening diving into the latest in open lakehouse and AI architectures. ๐ The lineup
0
0
0
Did you know you can easily enable Variant Type in existing Delta tables? ๐ก Just run an ALTER TABLE command to activate the Delta feature: `variantType`. โ ๏ธ Keep in mind: only clients that support Variant Type can read the updated table, and individual Variant entries are
0
1
6