Sean Lopp
@lopp_sean
Followers
627
Following
238
Media
36
Statuses
302
Open Source Data | https://t.co/TFYgbz5UXa
Denver, CO
Joined December 2013
RT @atroyn: yesterday evening i gave a presentation to founders, investors, and the ai community at @aixventureshq on how to think about ai….
0
104
0
RT @_odsc: Join us at the AI Solution Showcase Expo for Sean Lopp’s @lopp_sean talk, The Unreasonable Effectiveness of an Asset Graph. Get….
0
2
0
RT @winston_chang: I just dropped this hot new track at #positconf2023.Snoop vs Biggie battle on the subject of R vs Python.(With a little….
0
40
0
RT @vboykis: Here's an incomplete list of things we never talk about when we talk about LLMs and AI
vickiboykis.com
Deep learning and LLMs are messy
0
25
0
Another really useful post that I'm late to the party on. As a startup employee you sometimes get to see PnL, but its usually very mysterious. This article unpacks these statements well:
lethain.com
Some years ago, I was explaining to my manager that I was feeling a bit bored, and they told me to learn how to read a Profit & Loss (P&L) statement. At the time, that sounded suspiciously like,...
0
1
1
Late to discover this post but k8s+batch mashup is a common theme in my computing career. One reason I'm excited about @dagster is because it actually does make orchestration w/ k8s better:
medium.com
And what it would look like if it had been
0
1
4
RT @dagster: Level up from running basic ELT/ETL jobs to managing a data platform for your analytics workloads!. With Dagster, you can deve….
0
5
0
RT @dagster: The latest edition of the Data Unplugged podcast features data engineer Vinnie Dalpiccol, who shares his experience adopting a….
linkedin.com
The orchestration of the modern Data platform - Focus on Dagster Episode 4️⃣ of Data unplugged is out! In this episode, I am joined by Vinnie Dalpiccol. We will discuss different topics such as 💡...
0
3
0
RT @s_ryz: Partitions are a big deal in data engineering and don't get talked about enough. More than half of Dagster users partition thei….
0
13
0
The @dagster 1.2.0 release is 🔥.- an orchestrator that deeply knows and models your data partitions 📅.- new resource configuration that is ooh so 🐍.
dagster.io
Dagster 1.2 introduces Pythonic config, stronger partitioned asset support, and updated integrations.
0
1
1
RT @dagster: Join us live today as we demo the new dagster-airflow tooling that makes migrating off @ApacheAirflow and onto Dagster a breez….
0
2
0
"Teams are excited to build workflows in Dagster, and they're tired of doing it in Airflow". Join @dagster Wednesday to learn more! . 📆
0
0
4
The story:.- orchestrators are hard to test locally so you push straight to prod.- testing in prod breaks prod.- breaking prod pages on-call, interrupting new work.- interruptions cause slowdowns, teams are criticized for being behind.- so they skip technical debt aka local tests.
1
0
0
One of my favorite books with our young family is "If you give a mouse a cookie". Unfortunately, I think there is a data engineering version of the story: "If you test in production" 😢.
1
0
6
🎇➡️😱 Getting paged on-call is the worst, especially during the holidays. @dagster decreases errors and alerts:. 1⃣ one-line retry polices reattempt function calls.2⃣ entire runs can be reattempted from the point of failure.3⃣ stakeholder alerts on SLAs.
1
0
11
😁 I’m very excited for this release. @getdbt meets SLA-driven schedules!. 1. Create a new model 🧑💻.2. Assign a freshness SLA to the result based on your stakeholders ⏱.3. The end. No worrying about jobs, cron strings, or dags. 🎉.
dbt is central to many Dagster projects, so it’s no surprise that we have focused on making @getdbt models easy to integrate into Dagster pipelines to centralize observability and run metadata. And now we are adding Declarative Scheduling for dbt!
0
1
4