🚀 𝟐𝟎𝟐𝟒 𝐌𝐢𝐥𝐞𝐬𝐭𝐨𝐧𝐞 𝐟𝐨𝐫 @DatabendLabs:.• GA of MPP on shared S3 storage.• Tasks, Streams, Transactions & Stored Procedures.• Serving 50+ customers with 100M queries/day.• Lightning-fast insights on 800+ PB of data!. Looking forward to 2025: More value with LLM,.

🚀 @DatabendLabs just launched 𝐄𝐗𝐏𝐋𝐀𝐈𝐍 𝐏𝐄𝐑𝐅 – bringing 𝐯𝐢𝐬𝐮𝐚𝐥 𝐪𝐮𝐞𝐫𝐲-𝐥𝐞𝐯𝐞𝐥 𝐂𝐏𝐔 𝐩𝐫𝐨𝐟𝐢𝐥𝐢𝐧𝐠 to a whole new production-ready level in your cloud data warehouse!🔥.𝐇𝐨𝐰 𝐢𝐭 𝐰𝐨𝐫𝐤𝐬:.✨ Activated by EXPLAIN PERF.✨ Distributed semaphore

Full deep-dive (with all the ugly details and best practices):.

Stop hitting SQL limits! Teams use Databend UDFs to:.-> Clean e-commerce addresses w/ Python.-> Redact PII & enrich logs w/ JavaScript.-> Run LLMs for support tickets.-> Power gaming matchmaking at 1000+ QPS .-> Crunch numbers blazing fast w/ #WASM.Real code examples inside 🚀.

RT @ASFSeaTunnel: 🚀 Unlock seamless data sync with #SeaTunnel MySQL-CDC & @DatabendLabs! Dive into full format analysis, practical solution….

In Databend, If it 𝐜𝐚𝐧 𝐛𝐞 𝐯𝐢𝐬𝐮𝐚𝐥𝐢𝐳𝐞𝐝, 𝐰𝐞 𝐯𝐢𝐬𝐮𝐚𝐥𝐢𝐳𝐞 𝐢𝐭! 💡. #Databend's optimizer trace provides complete visibility into query optimization. Track every optimizer step, every optimizer rule, understand exactly how they work - zero black boxes in our

Curious how Fuse Engine makes cloud analytics simpler yet powerful? Dive deeper here:.

Meet Fuse Engine—our powerful storage engine built from scratch in 2021, inspired by Apache Iceberg. Purely S3-based, no disk or caching needed, yet excels at:.✅ Petabyte-scale analytics with 10,000+ QPS.✅ Sub-second real-time transactions (single & multi-table).✅ Zero-copy.

@AnthropicAI @deepseek_ai Currently, this approach is still in the experimental phase. The complete process for a single query takes approximately 10-20 seconds [about ~10s for optimization and 10s for verification]. We hope to implement this in #Databend soon. We welcome professors or students interested.

In our experiments, we utilized @AnthropicAI Claude Sonnet 3.7 for logical plan optimization, then employed @deepseek_ai DeepSeek V2 Prover for formal verification to confirm that the optimized plans remain semantically equivalent to the original ones. [2/3].

How about using #AI for Query Optimization? Our experiments have shown promising results. AI actually excels at optimizer tasks, such as rule-based optimization, join order optimization, and filter pushdown operations. [1/3]

The practical benefits: .• Reduced data scanning through intelligent pruning .• Efficient memory usage with optimized join strategies .• Parallel execution of complex aggregations .• Automatic selection of appropriate physical operators. Learn more:

Our optimizer's 4-stage process:. 1️⃣ Statistics Collection: Gathers table & column metrics for informed decisions .2️⃣ Logical Optimization: Pushes filters down, simplifies expressions, optimizes aggregations .3️⃣ Join Optimization: Uses dynamic programming to determine efficient.

𝙃𝙤𝙬 𝘿𝙖𝙩𝙖𝙗𝙚𝙣𝙙'𝙨 𝙌𝙪𝙚𝙧𝙮 𝙊𝙥𝙩𝙞𝙢𝙞𝙯𝙚𝙧 𝙈𝙖𝙠𝙚𝙨 𝘼𝙣𝙖𝙡𝙮𝙩𝙞𝙘𝙨 𝙁𝙖𝙨𝙩. Curious how #Databend delivers efficient query performance? Our optimizer transforms SQL into smart execution plans through a sophisticated pipeline. Let's explore the technology.

Want the full story on how this gaming giant ditched Snowflake for Databend Cloud and revolutionized their real-time data game? 🚀 From pain to insane gains—check it out here:

Imagine serving millions of gamers with real-time data. But your warehouse lags. Costs explode. 😓.A top gaming platform struggled with Snowflake—high cost and no sub-second speed hurt engagement. They switched to Databend Cloud and crushed it:.- 70% cost cut.- 100B rows/month.-.

⚡️ Time Travel + Speed on Petabytes?. @DatabendLabs' Fuse Engine delivers both using Git-inspired versioning on cloud storage. See how:

🚀 #Databend v1.2.725 is now available! .✨ 63 exciting new features 🔧 59 thoughtful bug fixes. Highlights:.✨ Hybrid cache for improved performance .✨ Enhanced query-level memory management .✨ Bendsave for backup and restore .✨ Auto vacuum capability. Full changelog:.

🚀 Oops-proof your data operations with #Databend.Inspired by Git's version control, #Databend lets you: .• 𝗥𝗲𝗰𝗼𝘃𝗲𝗿 𝗱𝗿𝗼𝗽𝗽𝗲𝗱 𝗱𝗮𝘁𝗮𝗯𝗮𝘀𝗲𝘀 & 𝘁𝗮𝗯𝗹𝗲𝘀 .• 𝗥𝗲𝘃𝗲𝗿𝘁 𝗯𝗮𝗱 𝗱𝗮𝘁𝗮 𝗰𝗵𝗮𝗻𝗴𝗲𝘀 .• 𝗥𝗼𝗹𝗹 𝗯𝗮𝗰𝗸 𝘀𝗰𝗵𝗲𝗺𝗮.

𝐃𝐢𝐯𝐢𝐧𝐠 𝐢𝐧𝐭𝐨 𝐃𝐚𝐭𝐚𝐛𝐞𝐧𝐝'𝐬 𝐪𝐮𝐞𝐫𝐲 𝐨𝐩𝐭𝐢𝐦𝐢𝐳𝐞𝐫 𝐩𝐢𝐩𝐞𝐥𝐢𝐧𝐞! 🚀.The optimizer applies transformations to make your queries lightning fast:.1️⃣ Subquery decorrelation.2️⃣ Statistics aggregation.3️⃣ Cost estimation collection.4️⃣ Aggregate normalization.5️⃣