dataengwithaws Profile Banner
DATA ENGINEERING Profile
DATA ENGINEERING

@dataengwithaws

Followers
3K
Following
4K
Media
20
Statuses
10K

upgrade your knowledge in DATA ENGINEERING with A W S

Joined August 2023
Don't wanna be here? Send us removal request.
@dataengwithaws
DATA ENGINEERING
9 months
πŸ“· What we learned this week at @dataengwithaws πŸ“· Where to start as a beginner πŸ“· AWS tools for smarter pipelines πŸ“· Personal stories from the trenches πŸ“· How to build a modern lakehouse stack
0
0
3
@dataengwithaws
DATA ENGINEERING
9 months
"Fun Friday / Weekly Wrap" Light content, summarize week, build community feel. data eng tip before the weekend: take time to document your pipeline. yes even if it’s ugly. especially if it’s ugly. future you will thank you πŸ“·
4
0
6
@dataengwithaws
DATA ENGINEERING
9 months
(Summary thread): πŸ“· What we learned this week at @dataengwithaws πŸ“· Where to start as a beginner πŸ“· AWS tools for smarter pipelines πŸ“· Personal stories from the trenches πŸ“· How to build a modern lakehouse stack Follow for more next week πŸ“· and don’t forget to touch grass
1
0
1
@dataengwithaws
DATA ENGINEERING
9 months
"Fun Friday / Weekly Wrap" Light content, summarize week, build community feel. data eng tip before the weekend: take time to document your pipeline. yes even if it’s ugly. especially if it’s ugly. future you will thank you πŸ“·
0
0
1
@dataengwithaws
DATA ENGINEERING
9 months
Want a Notion board with step-by-step AWS projects? thinking of putting one together for free. Like this tweet if that sounds helpful πŸ“· might just drop it soon πŸ“·
0
1
2
@dataengwithaws
DATA ENGINEERING
9 months
"Deep Dive Thread Day" Showcase expertise, provide value, attract retweets. πŸ“· Building a Data Lake on AWS (2025 Edition) Tired of theory? Here’s a real-world stack that works πŸ“· Ingest β†’ Kafka / Kinesis Buffer β†’ S3 (raw zone) Process β†’ Glue / Lambda / EMR Store β†’ S3
0
1
1
@dataengwithaws
DATA ENGINEERING
9 months
(Engagement tweet): Data engineers, what’s one AWS service you wish you learned earlier? I’ll start: πŸ“· Step Functions. Saved me from messy spaghetti code flows. reply and share yours πŸ“·
0
0
3
@dataengwithaws
DATA ENGINEERING
9 months
"Real Talk Wednesday" Show vulnerability, personal story, engagement driver. I failed my first data pipeline project. like BAD. no retries broke on nulls cost $700 overnight but I learned more in those 3 days than any course ever taught me
0
0
2
@dataengwithaws
DATA ENGINEERING
9 months
One underrated AWS combo for beginners: πŸ“· CloudWatch + SNS Monitor logs or ETL job failures Automatically send alerts to email/Slack It's like having a robot yell at you when stuff breaks πŸ“· and honestly.. we all need that
0
0
2
@dataengwithaws
DATA ENGINEERING
9 months
"Tips & Tools Tuesday" Share actionable tips and resources for current & aspiring data engineers. If you’re still writing batch jobs for everything, try this instead: πŸ“· Lambda + EventBridge for real-time triggers πŸ“· Glue streaming jobs for incremental ETL πŸ“· Kinesis for
0
0
0
@dataengwithaws
DATA ENGINEERING
9 months
(Visual + Short Thread): πŸ“· 5 AWS services every beginner data engineer should mess with: (a tiny thread) S3 – your data lake starts here Glue – managed ETL + crawlers Lambda – serverless magic Athena – SQL on files πŸ“· CloudWatch – logs or it didn’t happen Just play with them.
0
0
3
@dataengwithaws
DATA ENGINEERING
9 months
"Foundations & Vibes" Attract beginners, build emotional connection, start light. data engineering seems complex when you're just starting out. pipelines, spark, cloud, kafka.. it’s a lot but here's the truth β€” you don't need to learn everything at once. start small. pick a tool.
0
0
0
@dataengwithaws
DATA ENGINEERING
10 months
πŸ’¬ Did you get both answers right? Let me know in the replies! πŸ§΅πŸ‘‡ #AWS #Serverless #EventDriven (5/5) Let me know if you need any tweaks before posting! πŸš€
0
0
0
@dataengwithaws
DATA ENGINEERING
10 months
🎯 Key Takeaway: Lambda + SQS = Event-driven powerhouse πŸ’ͺ πŸ”Ή Decouples producers & consumers πŸ”Ή Handles spikes in workload πŸ”Ή Scales automatically This duo is the backbone of many serverless architectures! (4/5)
1
0
1
@dataengwithaws
DATA ENGINEERING
10 months
πŸ” Why not the others? ❌ SNS – Good for pub/sub but not core to event-driven workflows. ❌ DynamoDB – Useful for data storage, but not essential for event processing. ❌ EC2 – Provides compute, but not serverless like Lambda. ❌ EBS – Block storage, not related to event-driven
1
0
0
@dataengwithaws
DATA ENGINEERING
10 months
πŸ’‘ Correct Answers: A) Lambda & E) SQS Why? πŸ€” βœ… Lambda – Runs code in response to events, no servers to manage. βœ… SQS – Message queue that helps decouple producers & consumers. Together, they enable scalable & fault-tolerant event-driven architectures. (2/5)
1
0
0
@dataengwithaws
DATA ENGINEERING
10 months
⚑ Question: Which TWO AWS services are essential for building an event-driven architecture? A) Lambda B) SNS C) DynamoDB D) EC2 E) SQS F) EBS Drop your two answers below! πŸ‘‡ (1/5)
1
0
0
@dataengwithaws
DATA ENGINEERING
10 months
πŸ’¬ Did you get it right? Drop a βœ… in the comments if you did! If not, let me know what confused you. Let's learn together! πŸš€ #AWS #Cloud #DataEngineering (4/4)
1
0
0
@dataengwithaws
DATA ENGINEERING
10 months
πŸ” Why not the others? ❌ DynamoDB – NoSQL key-value & document DB, but not optimized for graph queries. ❌ RDS – Relational database, not ideal for graph-based relationships. ❌ EC2 – Just provides compute capacity, not a DB service. Neptune specializes in graph relationships!
1
0
0
@dataengwithaws
DATA ENGINEERING
10 months
πŸ’‘ Answer: B) Amazon Neptune Amazon Neptune is a fully managed graph database service designed for applications that need to analyze highly connected data. Use cases: πŸ”Ή Social networking πŸ”Ή Recommendation engines πŸ”Ή Fraud detection πŸ”Ή Knowledge graphs (2/4)
1
0
0