So excited about my ETL Pipeline on #Github Actions started working without errors. I'll share more details in a blog post in a few weeks about my #Python ETL code, #Datavisualization & #PostgreSQL cloud DB.

Your Dockerfile: - FROM ubuntu:latest - Installs 47 packages - Runs as root - 2.3GB image size - Rebuild takes 15 minutes - Security scan shows 89 vulnerabilities Your app: - A Python script - 3 dependencies - Could run on Alpine in a 50MB image You're not using containers.

This week we wrapped up our @databricks series! We covered: 1. Importing Data from flat files and connecting to Data Sources 2. Analyzing data using SQL Editor and Notebooks 3. Visualizing and Creating Dashboards 4. Using AI to code and talk with our Databases You can learn all

People focus too much on their career and not enough on their personal lives. We weren't meant to work 9-5, go home to watch tv all night, and repeat for 40+years! We were made for connection and people. I want you to have a great career and be very successful, but that doesn't

You only need to read four books to truly get what’s going on in ML and data engineering: - Fundamentals of Data Engineering by Joe Reis - Designing Data Intensive Applications by Martin Kleppmann - AI engineering by Chip Huyen - Designing Machine Learning Systems by Chip

If you want to get started with system design, learn these 12 concepts... 🧵

The best engineers I know delete more code than they write Junior engineers add features. Senior engineers remove complexity Every line of code you write is a liability. It needs to be maintained. It can break. It adds cognitive load to anyone who reads it later The best pull

My favourite stack for data projects (at the moment): Airflow - scheduling/orchestration of pipelines dbt - SQL-based transformations with testing + lineage Postgres - database Docker - containerisation Apache Superset - BI/visualisation. The best bit? All open source.

us-east-1 is down Here is why:

Having a great time in my country #Honduras #vacationmode

A common mistake I see: People treat message queues and streams as if they’re interchangeable. They’re not. Here’s the difference 👇 Message Queue (MQ) - Designed for delivery guarantees (at-least-once, exactly-once). - Great for sporadic workloads and asynchronous tasks. -

One of the often overlooked parts of being an EM is project management. You may not always have a dedicated project manager on your team, which means you have the ✨distinct pleasure✨ of filling that role. 🐞 New episode: Project Management as an EM https://t.co/wGZ4zaLojC

Format your SQL code in SQL Server Management Studio 22 with the free SQL Formatter from @madskristensen - I just got a PR approved to enable this (for SSMS) - download from VSIX Gallery #sqlserver #ssms https://t.co/YG3u8DdIxP

Did you know you can open a Fabric Warehouse in Visual Studio Code by simply clicking on the "Open in Visual Studio Code" button in the Warehouse Explorer? This is a game-changer for pro-developers! 🎉 #FabricWarehouse #MicrosoftFabric

It's pretty!

It's hard to believe when developers say they are firing many questions at LLMs to review and analyze their code and using the agent mode in their Visual Studio IDEs, but then claim in the same sentence that their code is free of AI assistance.

In my experience, Data Cleaning vs Data Transformation Initially, I viewed data cleaning and transformation as similar tasks since both prepare data. However, I soon discovered that each serves an unique purpose, enriching my understanding and appreciation for the intricacies

Today, I interviewed a candidate for a Junior Machine Learning Engineer position. I began with basic questions, but the candidate used buzzwords to explain concepts. When I probed deeper into those terms, she couldn’t provide clear explanations. I asked her to write code for

I have just ported the SQL Formatter by @madskristensen to SSMS 21! Format your SQL code based on the SQL ScriptDom formatting engine (and yes, raise your voice to fix it's shortcommings) - download and install from here: https://t.co/HvIS4PDFyk

📢 New in Visual Studio: Bring Your Own Model to Chat We’re expanding flexibility in Copilot for Visual Studio. You can now connect API keys from providers like OpenAI, Anthropic, and Google to run Chat on the model of your choice. This update gives you: ✅ Choice – Access the