![]() ![]() From application downtime to data downtime Now, as data systems reach similar levels of complexity and higher levels of importance in an organization, we can apply these same concepts to our field as data reliability - an organization’s ability to deliver high data availability and health throughout the entire data life cycle. On top of these duties, SREs are known as the “firefighters” of the engineering world, working to address hidden bugs, laggy applications, and system outages. In a previous article, I discussed why data reliability is must-have for data teams, and here, I share how we can apply this concept in to data pipelines.Ĭoined by Google SVP Benjamin Treynor Sloss in the early 2000s, Site Reliability Engineering, a subset of DevOps, refers to “what happens when you ask a software engineer to design an operations function.” In other words, site reliability engineers (SREs for short) build automated software to optimize application uptime while minimizing toil and reducing downtime. ![]() As data professionals, we can learn a lot from software engineering when it comes to building robust, highly available systems. ![]()
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |