Mark Payne
@dataflowmark
Followers
548
Following
877
Media
15
Statuses
472
Principal Software Engineer, Cloudera. Apache NiFi PMC. Christian, father, husband, geek.
Maryland, USA
Joined January 2015
An expensive Kafka cluster sells for $1M. Cheap Kafka sells for … $220M The story of how Confluent acquired WarpStream after just 13 months of operations 👇
4
55
352
I'm excited to welcome @joewitt26, @LukeRoquet and the whole team at @datavolo to the GC family! 🙌 We're thrilled to partner on this journey with you 😊 Read more about what got us excited below 👇 https://t.co/2TDV6VXBJq cc: @generalcatalyst , @quentinclark
lnkd.in
This link will take you to a page that’s not on LinkedIn
2
3
19
We're pleased to announce our joint investment in @Datavolo along with @GeneralCatalyst and others to help revolutionize data pipelines with #AI. Read more at @SiliconANGLE:
siliconangle.com
Startup Datavolo raises over $21M to transform how generative AI models access unstructured data - SiliconANGLE
0
5
11
Gone are the days of simply managing data—AI has ushered in the era of intelligently leveraging data. We're thrilled to support @joewitt26 & @LukeRoquet as they embark on the next phase of the @datavolo journey. By @quentinclark & @max_rimpel ↓ https://t.co/LlXBKOo4vi
generalcatalyst.com
2
28
14
NiFi-LangChain, designed for constructing Large Language Model (LLM) pipelines within @apachenifi using the composable @LangChainAI Expression Language (LCEL), is now available on GitHub: https://t.co/AYsxEzHYir
1
11
25
This is the future of data pipelines. Auto generate NiFi flows from natural language https://t.co/w4WvqBJJZN
#ApacheNiFi #dataflows #data
0
4
9
Ever dreamed of building data pipelines by just describing the flow? Well, now you can! 🤯 Datavolo's new Generative AI features allow you to describe a dataflow and we'll will build it for you! Check it out:
2
3
12
The response from long time @apachenifi users already as well as new ones tells us we are on the right track @datavolo to help a lot of organizations get their unstructured data to and through these powerful LLMs as well as help orchestrate other aspects of Gen AI data patterns
At the enterprise level today every company is a data company and the only constant is change itself. Generative AI is our latest compelling reminder. NiFi was built for this very opportunity. https://t.co/OfdEIUADUY
1
3
9
At the enterprise level today every company is a data company and the only constant is change itself. Generative AI is our latest compelling reminder. NiFi was built for this very opportunity. https://t.co/OfdEIUADUY
datavolo.io
Apache NiFi was built for GenAI. At the enterprise level today every company is a data company and the only constant is change itself.
0
3
8
New year, new website design! Thanks to a collaborative effort from several designers and developers, the Apache NiFi project website has a new look, with more prominent links to downloads, documentation, and source code! https://t.co/aNqNWf1vb6
nifi.apache.org
Apache NiFi is an easy to use, powerful, and reliable system to process and distribute data
4
5
38
A fitting new look for the NiFi website as the NiFi 2.0 M1 release gains traction. The new python integration and alignment to Generative AI use cases is huge for our community!
New year, new website design! Thanks to a collaborative effort from several designers and developers, the Apache NiFi project website has a new look, with more prominent links to downloads, documentation, and source code! https://t.co/aNqNWf1vb6
0
3
13
Modernizing Streaming Encryption with age in @apachenifi
https://t.co/2NbMFbjRTH
exceptionfactory.com
Apache NiFi 2.0.0-M1 and 1.24.0 introduced new Processors supporting the age-encryption.org/v1 specification. Built on the Jagged framework implementation, the EncryptContentAge and DecryptContentAge...
0
4
11
A Python API is coming to NiFi! Want a sneak peek? I put together a video that demos how it will work, and how to build a Processor in Python. Oh, and I provide a build that you can use to try it out today! https://t.co/uJ7FlwfZJi
#python #nifi #dataflow #dataengineering
3
8
23
Apache NiFi 1.21.0 released! Mostly focused on stability, security and preparing for the NiFi 2.0 line including more than 120 resolved JIRAs. Download
nifi.apache.org
Apache NiFi is an easy to use, powerful, and reliable system to process and distribute data
3
10
49
NiFi's ReplaceText processor can be a powerhouse for data transformation Learn some tips & tricks for using effectively and efficiently in my latest blog post: https://t.co/kClqGEOUIc
medium.com
The ReplaceText Processor is fairly well known. It provides the ability to perform a “search and replace” action against text as it flows…
0
4
11
Why You Should Learn Apache NiFi 🚀 Hey, you gotta check out Apache NiFi - an open-source data integration tool that makes it easy to automate data flow between different systems! This is a must-have tool for all data engineers and scientists working with data. 💻💡
1
6
21
Apache NiFi is the perfect tool for AI/ML product managers looking to manage and automate data flows in real time! It cuts down the pipeline build time for AI products!
3
2
20
The next post in the "Building an Effective NiFi Flow" series is up This time it will focus on PartitionRecord and the power and easy of use that it brings #nifi #apachenifi #dataflow #dataengineering #partitionrecord
https://t.co/CfYlnjGsCH
link.medium.com
Recently, I made the case for why QueryRecord is one of my favorite in the vast and growing arsenal of NiFi Processors. Part of the power…
1
5
11
Fun with Apache NiFi: Using UpdateDatabaseRecord for Schema Migration and Database Replication
0
10
11
The first step in building highly effective NiFi dataflows: learn about the QueryRecord Processor. #nifi #dataflow #apachenifi #dataengineering
link.medium.com
Of the 400+ Processors that are now available in Apache NiFi, QueryRecord is perhaps my favorite. In most cases, it is quite simple to use…
0
5
11