Atlassian's internal data lake is leveraged by a number of teams where they find and fetch relevant data in the lake, apply transformation logic to it and move it to the destination. To pull this off, they have to provision a data pipeline, which involves setting up and

RT @eatonphil: Almost everything I read on LLMs is either 1) vendor-driven that doesn't help me build a mental model for tradeoffs, or 2) t….

RT @duckdb: We are proud to release the first major version of DuckDB, v1.0.0, codenamed "Snow Duck". This version is a culmination of alm….

The thought process behind picking the right database with a reference checklist:

Here is a checklist to refer to when researching a fitting database for your use case:. Throughput .Latency .Scalability .Availability .Durability .Disaster recovery .Data volume .Data model .Consistency requirements .Operational complexity .Documentation and support .Ecosystem.

If you've used if else blocks in your code, you can go ahead and say it's an AI-powered app with intelligent decision-making capabilities. #ai #applicationdevelopment #appsthesedays.

RT @hovgaardgames: JOB OPENING: We're looking for a Project Manager to help us manage the development of Big Ambitions. Full-time, immedia….

I've recently started a newsletter on backend engineering. So far it has hit 109 subs with double the followers. I am open to cross-promotions if anyone is willing to do that. Here is my newsletter in case you wanna check it out: Cheers!. #newsletter

RT @chazhutton: Today’s Comic: Then and Now…

In the illustration below, three applications share the resources of a bare metal server, each running on their respective virtual machines. The VMs (Virtual Machines) are hosted on a hypervisor over the host bare metal OS. App B proves to be a noisy neighbor hogging most of

Stay in the loop on the latest in the backend engineering realm, in addition to discovering related concepts, augmenting your knowledge and becoming a more informed backend engineer. Check out my new newsletter: #backend #backendengineering

Here is an interesting research paper that discusses a runtime called DTHREADS that guarantees deterministic execution of multithreaded programs even in the presence of data races. Given the same sequence of inputs or OS events, a program using DTHREADS always produces the same.

Operating systems have two fundamental types of threads: User threads and Kernel threads. User threads are created by the code and the code runtime environment. In contrast, the kernel threads are the threads managed by the operating system's kernel. When our program needs to

There is quite a significant difference between being able to ship code in a certain language and being proficient in it. Java, Python, Kotlin, Go, etc., are not just programming languages. They are ecosystems. Being proficient in any of them entails learning frameworks,.

A few days back, I posted about kickstarting the journey to implementing a complex distributed system from the bare bones. About that I've posted two detailed newsletter posts. The first is an introductory post into the realm of distributed programming, covering the concepts or.

Working with Threads is tricky since their output in a multithreaded environment is mostly non-deterministic. We, as programmers, do not have absolute control over when threads run since their execution order is determined by the OS's thread scheduler. Threads may not.

Do you feel excited when your programming language adds new features and updated syntax back and forth, or are you apprehensive about it?. Well, with the continual updates, it requires time & energy to unlearn what we've been already using and replace it with a new syntax or a.

When implementing a server capable of handling concurrent requests, we can leverage multithreading to assign a thread to every client request, allowing the server to handle multiple requests simultaneously. In addition, we can leverage a thread pool to assign idle threads from.