TD:LR We no longer need to manually track the state of a table, when it was created, when it was...
Blog Articles
Three Agile Testing Methods – TDD, ATDD and BDD
In the word of agile, there are three common testing techniques that can be used to improve our...
Catalog & Cocktails Podcast – agile in the data domain
TD:LR Early in 2022 I was lucky enough to talk to the awesome Catalog and Cocktails podcast crew...
Using a manifest concept to run data pipelines
TD:LR … you don’t always need to use DAGs to orchestrate Previously we talked about how we use an ephemeral Serverless architecture based on Google Cloud Functions and Google PubSub Messaging to run our customer data...
“Serverless” Data Processing
TD:LR When we dreamed up agiledata.io and started white-boarding ideas around architecture, one of the patterns we were adamant that we would leverage, would be Serverless. This posts explains why we were adamant and...
A Data Engineer an Agile Coach and a Fish walk into a bar…
TD:LR This is the first of a series of articles detailing how we built a platform to make data fun and remove complexity for our users Stop me if you’ve heard this one before ! A Coach and an Engineer I’m a Data...
Data Mesh Podcast – Finding useful and repeatable patterns for data
TD:LR I talk to Scott Hirleman on the Data Mesh Radio podcast on my thoughts on Data Mesh and the need for resuable patterns in the data & analytics domain. My opinion on Data Mesh I am not a fan of the current...
What is Data Lineage?
TD:LR AgileData mission is to reduce the complexity of managing data. In the modern data world there are many capability categories, each with their own specialised terms, technologies and three letter acronyms. We...
Data Mesh 4.0.4
TD:LR Data Mesh 4.0.4 is only available for a very short time. please ensure you scroll to the bottom of the article to understand the temporal nature of the Data Mesh 4.0.4 approach.This article was published on 1st...
What is a Data Catalog?
TD:LR AgileData mission is to reduce the complexity of managing data. In the modern data world there are many capability categories, each with their own specialised terms, technologies and three letter acronyms. We...
Whats the hottest new data thing in 2022 — Data Mesh or Metric Store
There is a lot of vendor washing going on A lot of data vendors are vendor washing their technologies to pretend they enable "Data Mesh" as they are punting on Data Mesh being the new thing for 2022. I think they are...
AgileData >>> Modern Data Stack
TD:LR AgileData's mission is to reduce the complexity of managing data. A large part of modern data complexity is selecting, implementing and maintaining a raft of different technologies to provide your "Modern Data...