Delta Lake
@DeltaLakeOSS
Followers
10K
Following
1K
Media
1K
Statuses
2K
Delta Lake is an open-source storage framework that enables building a Lakehouse architecture for Spark, Flink, Trino, Hive, Scala, Java, Rust, Python, & more!
San Francisco, CA
Joined April 2019
Discover how deletion vectors can take Delta Lake performance to the next level. š In this 5-minute video, @YoussefMrini breaks down how deletion vectors speed up delete, update, and merge operations by marking rows logicallyāno need to rewrite entire files. š„ Watch:
0
2
6
š Massive data, missionācritical pipelines, zero excuses. āScaling @ApacheSpark at @OpenAIā with Chao Sun shows how to make Apache Spark⢠reliable at scale. š¹ Cluster management, job submission, access control š¹ Dynamic scaling for spiky, multiātenant loads š¹ How Apache
0
2
9
Something that stuck with me watching endless hours of Bill O'Neil speaking about charts, he often said something to the effect "When a stock is up 5 or more weeks in a row, It is telling you it wants to go a lot higher". $GEV up 9 weeks in a row before its flat base. Chart via
45
52
389
In this hands-on walkthrough, @YoussefMrini (@databricks) shows you how to handle special characters, rename columns, and safely modify schemas in Delta Lake! š¤ š„Ā Get started: https://t.co/3Owg1NegAp By leveraging column mapping, youāll learn how to make Delta tables easier
0
1
3
šØ THIS WEEK! šThe data world doesnāt need more lineage graphs ā it needs more understanding. Join us on Thursday, Oct 30 at 9AM PT for our next Open Lakehouse + AI webinar, where weāll explore why ātotal visibilityā often creates noise, not clarity. Discover how oleander is
0
0
2
Where does the feature platform fit in a world increasingly dominated by AI? At Open Lakehouse + AI Mini Summit, Hao Xu (Apple) shares how Feast is evolving beyond a feature store into a full feature platform for AIābridging data, models, and applications through innovations
0
2
3
Solana will trade like oil & gas until Wall Street values blockchains using fundamentals Solana can become VERY profitable networks as finance moves onchain -- tokenization is projected to grow from $600B to $9T in 2030. Here's a model I built out for Solana with key drivers: -
68
76
509
Weāre diving deep intoĀ Flight SQL + DeltaĀ to show how open technologies likeĀ Apache Arrow Flight,Ā #DataFusion, andĀ Delta LakeĀ are reshaping high-performance analytics! š šļø November 11 š 9:00 AM PT š Register: https://t.co/sIZCvxPdde See how: š¹ Flight SQLĀ provides a
0
1
4
š From data to AIāwithout the governance headaches. Donāt miss āFrom Data to AI: Leveraging Unity Catalog to Train at Scaleā with Aniruth Narayanan (@Databricks) at Open Lakehouse + AI Mini Summit in Mountain View on Nov 13! šļø Learn how a unified governance plane streamlines
0
1
5
Hard deletes break incremental loads. Delta Lakeās Change Data Feed captures inserts, updates, and deletes ā including those produced by MERGE ā so downstream streams can maintain consistency. In this clip, @waitingforcode shows how CDF simplifies merge/update logic when rows
0
0
3
The open source and data community is coming together in Mountain View, CA! š„ Join us Nov 13 (12ā4:30PM PT) for the š¢š½š²š» šš®šøš²šµš¼ššš² + šš š š¶š»š¶ š¦ššŗšŗš¶š, featuring two tracks packed with insights on AI infrastructure, context engineering, and the future of
0
3
8
This November 29, one guest will experience the ultimate travel reward! Play all month and let your next adventure begin at FireKeepers.
0
5
25
Join us for Open Lakehouse + AI in Paris, co-located with the Forward Data Conference! š«š· Weāre bringing together the open source and data engineering community for a fun and inspiring evening diving into the latest in open lakehouse and AI architectures. š The lineup
0
0
0
Did you know you can easily enable Variant Type in existing Delta tables? š” Just run an ALTER TABLE command to activate the Delta feature: `variantType`. ā ļø Keep in mind: only clients that support Variant Type can read the updated table, and individual Variant entries are
0
1
6
Open Lakehouse + AI spotlight: Hannes Mühlheisen shares how anyone can contribute to @duckdb and DuckLakeāboth MIT-licensed, open source, and welcoming PRs and community engagement on GitHub. Check out this clip to hear how easy it is to get involved and start contributing
0
1
4
Open Lakehouse + AI brings builders and practitioners together to share how open lakehouse and AI meet in the real worldāthrough adoption stories, handsāon patterns, and collaborative learning. š Join a global community shaping the future of data and AI! Whatās next? š¹
0
1
1
Design's best trendspotter is @ridd_design. - He drives industry dialog with @joindiveclub - He changes the way designers work with @getinflight - He spotlights designers, tools and trends early I spent two days with him to learn how he does it. One of the most important
50
43
297
Hi everyone! We will get started shortly. Let us know where you are tuning in from! š
1
0
0
30 minutes to go! šØ Join us at 9AM PT for Diving into Streaming Data Design Patterns for Delta Lake with @newfront and @waitingforcode. šļø Oct 14 š„ Streaming LIVE to X, YouTube & LinkedIn #opensource #oss #deltalake #linuxfoundation #streaming
ā°Ā Final Reminder ā Delta Lake Webinar Tomorrow! Wondering ifĀ data engineering design patternsĀ can unlock new insights intoĀ Delta Lake? Or how Delta Lake can become a key part of yourĀ streaming data architecture? JoinĀ @newfront (@bufbuild)Ā andĀ @waitingforcodeĀ as they tackle
0
1
4
$SFM Too much inflation, and coming competition for the boss. Same store sales 6% ---> 1% . Our promotional ensemble caught the ramp up in significant discounts. Don't miss the next airball!
2
3
21
ā
Scott, drawing on streaming expertise from Yahoo, Twilio, and Nike, will shareĀ best practicesĀ for using Delta Lake in streaming architectures. ā
Bartosz, author ofĀ Data Engineering Design Patterns, will reverse-engineer several patterns to show how Delta Lakeās features power
1
0
1
ā°Ā Final Reminder ā Delta Lake Webinar Tomorrow! Wondering ifĀ data engineering design patternsĀ can unlock new insights intoĀ Delta Lake? Or how Delta Lake can become a key part of yourĀ streaming data architecture? JoinĀ @newfront (@bufbuild)Ā andĀ @waitingforcodeĀ as they tackle
1
2
5