Retries deal with transient errors in distributed systems by transparently retrying failed operations. Problem context Cloud environments and the services that operate in them may be subject to temporary glitches. Therefore, these systems need to be sensitive to them and be able to react accordingly. Faults can be of various types, such…

It is actually controlling the usage of resources by an application instance, a particular tenant, or a whole service over time. Problem context Cloud applications are exposed to varying loads depending on the service model. …

Today’s Good Morning Data will focus on web scrapers, their architectures at scale, and other tips for creating them. As I have recently started a new project involving the processing of many websites at the same time, I believe that the topic of how to scale it is extremely important…

Today’s Good Morning Data will focus on distributed systems issues, consistency models, and optimizing DWH storage by Netflix. Grab a cup of coffee or any other favourite beverage and start the day with some noteworthy material from the world of data. Enjoy reading 📚 Data in MAANG [Netflix] Optimizing data warehouse storage In Netflix, due…

Today’s Good Morning Data will focus on Apache Airflow, its use cases, use at scale and growing popularity. Grab a cup of coffee or any other favourite beverage and start the day with some noteworthy material from the world of data. Enjoy reading 📚 [Benji Lampel, Tal Gluck] Advanced Data Quality Use Cases with Airflow and Great Expectations What I really like about Airflow…

Today’s Good Morning Data will focus on Test Data Management and Container-managed ETL Applications. Grab a cup of coffee or any other favourite beverage and start the day with some noteworthy material from the world of data. Enjoy reading 📚 [XenonStack] Test Data Management Tools and Working Architecture — Complete Guide Test data management is a process through which an organisation…

Today’s Good Morning Data will focus on DataOps. Several aspects need to be clarified in this field, and this collection of articles should resolve any doubts at the initial stage of delving into this approach. Grab a cup of coffee or any other favourite beverage and start the day with…

Today’s Good Morning Data will focus on Data Mesh and the various aspects associated with it. This is a collection of articles that, when read, will give a good understanding of its concepts, applications and good practices. Grab a cup of coffee or any other favourite beverage and start the…

Today’s Good Morning Data will focus on ETL testing, LinkedIn’s approach for near real-time personalization and GitHub’s Arctic Code Vault. Grab a cup of coffee or any other favourite beverage and start the day with some noteworthy material from the world of data. Enjoy reading 📚 [Slawomir Chodnicki] Testing strategies for data integration Recently, I have been…