dunithd Profile Banner
Dunith Danushka ๐Ÿฅ‘๐Ÿ‡ฌ๐Ÿ‡ง๐Ÿ‡ฑ๐Ÿ‡ฐ Profile
Dunith Danushka ๐Ÿฅ‘๐Ÿ‡ฌ๐Ÿ‡ง๐Ÿ‡ฑ๐Ÿ‡ฐ

@dunithd

Followers
2K
Following
2K
Media
302
Statuses
2K

Technical Product Marketing @ EDB. Technologist, writer, and conference speaker on data and AI.

Manchester, UK
Joined June 2009
Don't wanna be here? Send us removal request.
@dunithd
Dunith Danushka ๐Ÿฅ‘๐Ÿ‡ฌ๐Ÿ‡ง๐Ÿ‡ฑ๐Ÿ‡ฐ
7 months
Check out the latest article in my newsletter: Data and AI in 2025: Looking Beyond the Hype via @LinkedIn
Tweet media one
0
1
7
@dunithd
Dunith Danushka ๐Ÿฅ‘๐Ÿ‡ฌ๐Ÿ‡ง๐Ÿ‡ฑ๐Ÿ‡ฐ
7 months
Just blogged: Apache Iceberg Quickstart with PyIceberg
Tweet media one
0
0
3
@dunithd
Dunith Danushka ๐Ÿฅ‘๐Ÿ‡ฌ๐Ÿ‡ง๐Ÿ‡ฑ๐Ÿ‡ฐ
8 months
Iceberg is everywhere, putting pressure on data professionals to catch up. I created a 7-week study guide to get started with Apache Iceberg essentials. Let me know how you liked it or anything that I missed.
0
1
6
@dunithd
Dunith Danushka ๐Ÿฅ‘๐Ÿ‡ฌ๐Ÿ‡ง๐Ÿ‡ฑ๐Ÿ‡ฐ
9 months
Just blogged: The Great Shift Left: Embracing the Shift Left Data Architecture.
Tweet media one
0
1
4
@dunithd
Dunith Danushka ๐Ÿฅ‘๐Ÿ‡ฌ๐Ÿ‡ง๐Ÿ‡ฑ๐Ÿ‡ฐ
11 months
RT @DevoxxUK: What do a billion rows of code, music, cake and smart homes all have in common? They were all topics on the Mind the Geek traโ€ฆ.
0
4
0
@dunithd
Dunith Danushka ๐Ÿฅ‘๐Ÿ‡ฌ๐Ÿ‡ง๐Ÿ‡ฑ๐Ÿ‡ฐ
1 year
The fastest data hustlers in town. Join us tonight.
@redpandadata
Redpanda Data
1 year
๐Ÿ“ฃ LAST CALL: @ClickHouseDB meetup in #London. Join @dunithd and the savviest of #streamingdata experts from ClickHouse and @Cloudflare! From inspiring talks and networking to coffee and nibbles, it's the perfect way to liven up your Wednesday evening โ˜• . Meet us at: . ๐Ÿ—“
Tweet media one
0
0
2
@dunithd
Dunith Danushka ๐Ÿฅ‘๐Ÿ‡ฌ๐Ÿ‡ง๐Ÿ‡ฑ๐Ÿ‡ฐ
1 year
RT @redpandadata: ๐Ÿ“ฃ LONDON CALLING ALL #STREAMINGDATA FANS. Come join the @ClickHouseDB meetup where you'll hear from our very own @dunithdโ€ฆ.
0
1
0
@dunithd
Dunith Danushka ๐Ÿฅ‘๐Ÿ‡ฌ๐Ÿ‡ง๐Ÿ‡ฑ๐Ÿ‡ฐ
1 year
RT @TheDanicaFine: I knew it was gonna be good, but last night's #apacheKafka meetup in #frankfurt was actually incredible. An engaged commโ€ฆ.
0
2
0
@dunithd
Dunith Danushka ๐Ÿฅ‘๐Ÿ‡ฌ๐Ÿ‡ง๐Ÿ‡ฑ๐Ÿ‡ฐ
1 year
I'm in Frankfurt today, speaking at the Frankfurt Kafka Meetup with amazing @TheDanicaFine about stream processing with Apache Flink. Join us if you are around.
www.meetup.com
Join us for an Apache Kafkaยฎ x Apache Flinkยฎ meetup on Tuesday, June 11th from 6:00pm in Frankfurt hosted by Thinkport! ๐Ÿ“ **Venue:** Thinkport GmbH Arnsburger Str. 74 603
0
0
3
@dunithd
Dunith Danushka ๐Ÿฅ‘๐Ÿ‡ฌ๐Ÿ‡ง๐Ÿ‡ฑ๐Ÿ‡ฐ
1 year
The docs team at @redpandadata did a fabulous job of adding the "Ask AI" feature to docs. It allows you to ask specific questions about the product and get the most relevant answers tailored to your context. Give it a try today
Tweet media one
1
3
11
@dunithd
Dunith Danushka ๐Ÿฅ‘๐Ÿ‡ฌ๐Ÿ‡ง๐Ÿ‡ฑ๐Ÿ‡ฐ
1 year
RT @Christina_wm: Here's the slide I presented yesterday! Let's speed up the data transforms! . Harnessing WebAssembly for Real-time Statelโ€ฆ.
www.slideshare.net
The document discusses an upcoming event in Bratislava on harnessing WebAssembly for real-time stateless streaming pipelines. It covers topics such as data transformation in streaming pipelines, the...
0
3
0
@dunithd
Dunith Danushka ๐Ÿฅ‘๐Ÿ‡ฌ๐Ÿ‡ง๐Ÿ‡ฑ๐Ÿ‡ฐ
1 year
RT @Christina_wm: Interested in how #WebAssembly will change the way to do you thing about processing streaming pipelines? .Don't forget toโ€ฆ.
Tweet media one
eu.communityovercode.org
Traditionally, dealing with real-time data pipelines has involved significant overhead, even for straightforward tasks like data transformation or masking. However, in this talk, weโ€™ll venture into...
0
4
0
@dunithd
Dunith Danushka ๐Ÿฅ‘๐Ÿ‡ฌ๐Ÿ‡ง๐Ÿ‡ฑ๐Ÿ‡ฐ
1 year
RT @Christina_wm: ๐ŸŽ‰ ๐ŸŽ‰ ๐ŸŽ‰ Announcing Redpanda Connect ๐ŸŽ‰ ๐ŸŽ‰ ๐ŸŽ‰ - A Better Way to Build Connectors! Written in Go, it's super lightweight and incโ€ฆ.
0
10
0
@dunithd
Dunith Danushka ๐Ÿฅ‘๐Ÿ‡ฌ๐Ÿ‡ง๐Ÿ‡ฑ๐Ÿ‡ฐ
1 year
With its acquisition of Benthos, Redpanda rolls out Redpanda Connect, an intuitive environment to compose and run streaming data pipelines.
Tweet media one
techcrunch.com
Redpanda has already integrated Benthos into its own service and has made it the core technology of its new Redpanda Connect service.
0
6
19
@dunithd
Dunith Danushka ๐Ÿฅ‘๐Ÿ‡ฌ๐Ÿ‡ง๐Ÿ‡ฑ๐Ÿ‡ฐ
1 year
RT @DevoxxUK: Watch this session by @tmgstevens from @redpandadata where he teaches us how WebAssembly can be used to write stateless dataโ€ฆ.
0
4
0
@dunithd
Dunith Danushka ๐Ÿฅ‘๐Ÿ‡ฌ๐Ÿ‡ง๐Ÿ‡ฑ๐Ÿ‡ฐ
1 year
In this blog, I present a reference architecture for real-time API call volume tracking with Apache APISIX, Redpanda, and Apache Pinot.
@TDataScience
Towards Data Science
1 year
In this article, @dunithd shows how to design a real-time analytics pipeline for tracking API invocation usage with Apache APISIX, Redpanda, and Apache Pinot
0
3
13
@dunithd
Dunith Danushka ๐Ÿฅ‘๐Ÿ‡ฌ๐Ÿ‡ง๐Ÿ‡ฑ๐Ÿ‡ฐ
1 year
To wrap up, let's discuss potential use cases and the benefits of using tiered storage with Kafka.
Tweet media one
0
0
0
@dunithd
Dunith Danushka ๐Ÿฅ‘๐Ÿ‡ฌ๐Ÿ‡ง๐Ÿ‡ฑ๐Ÿ‡ฐ
1 year
What if we could archive older, closed log segments into secondary storage? That's the idea behind Kafka's Tiered Storage feature.
Tweet media one
Tweet media two
Tweet media three
1
0
0
@dunithd
Dunith Danushka ๐Ÿฅ‘๐Ÿ‡ฌ๐Ÿ‡ง๐Ÿ‡ฑ๐Ÿ‡ฐ
1 year
Kafka's storage engine uses a hierarchy of storage objects. Understanding this hierarchy can help us better comprehend how tiered storage works.
Tweet media one
Tweet media two
Tweet media three
1
0
0
@dunithd
Dunith Danushka ๐Ÿฅ‘๐Ÿ‡ฌ๐Ÿ‡ง๐Ÿ‡ฑ๐Ÿ‡ฐ
1 year
As data ages and becomes less frequently accessed, Kafka automatically moves it from the primary storage tier to the secondary storage tier. This process is transparent to users and applications accessing the data.
Tweet media one
1
0
0