Because sharing is caring
TD:LR Cloud Data Platforms promise you the magic of storing your data and unlimited elastic compute for cents. Is it too good to be true? Yes AND No. You can run a cloud platform for a low low cost, but its will take engineering effort to get there. Myth: using the...
Pick a few things that really matter, not thousands of “requirements” We when first started developing the core of the AgileData backend for the MVP, we knew we would need a cloud database to store...
As part of our journey to exploring the use of the Google Cloud Platform (GCP) as the core of our infrastructure for AgileData.io we have had to start unlearning a lot of our AWS and Microsoft Azure knowledge and...
Blogs about the AgileData Product
Blogs about running a data consultancy
Blogs about DataOps
Blogs about Data and Analytics
Blogs about Google Cloud
Blogs about the AgileData Journey
Blogs about Product Management
Links to Resources that are useful
Blogs that describe Data Things
As Data Consultants your customers are buying and outcome based on one of these patterns – effort, expertise, e...
Defining a Data Architecture is a key pattern when working in the data domain.
Its always tempting to boil the...
TD:LR Data Architecture as a Service (DAaaS), is it Buzzwashing or not? As is often the case, it depends on your poin...
TD:LR Cloud Data Platforms promise you the magic of storing your data and unlimited elastic compute for cents. Is it...
TD:LR Data observability is not something new, its a set of features every data platform should have to get the data...
TD:LR The dream is we can just point the machine at our data, ask our question and get a useful answer. With ChatGPT...
TD:LR Late in 2022 I was lucky enough to talk to Tobias Macey on the Data Engineering podcast about our AgileData SaaS...
TD:LR Late in 2022 I was lucky enough to talk to Tobias Macey on the Data Engineering podcast about combining agile...
We wanted to be able to dynamically notify Data Magicians when a task had completed, without them having to refresh t...
TD:LR To get data tasks done involves a lot more than just bashing out a few lines of code to get the data into a...
Early in 2022 Shane Gibson was lucky enough to talk to the Focus podcast crew about agile governance in the data doma...
We no longer need to manually track the state of a table, when it was created, when it was updated, which data pipeli...
In the word of agile, there are three common testing techniques that can be used to improve our testing practices and...
TD:LR … you don’t always need to use DAGs to orchestrate Previously we talked about how we use an ephemeral...
TD:LR When we dreamed up agiledata.io and started white-boarding ideas around architecture, one of the patterns we...
This is the first of a series of articles detailing how we built a platform to make data fun and remove complexity fo...
In 2022 Shane Gibson was lucky enough to present “Analysts can model democratising data modeling” at the ...
TD:LR I talk to Scott Hirleman on the Data Mesh Radio podcast on my thoughts on Data Mesh and the need for resuable...
TD:LR AgileData mission is to reduce the complexity of managing data. In the modern data world there are many...
TD:LR Data Mesh 4.0.4 is only available for a very short time. please ensure you scroll to the bottom of the article...
TD:LR AgileData mission is to reduce the complexity of managing data. In the modern data world there are many...
Early in 2022 Shane Gibson was lucky enought to talk to the Catalog and Cocktails podcast crew about agile in the dat...
There is a lot of vendor washing going on A lot of data vendors are vendor washing their technologies to pretend they...
Data observability is the practice of monitoring and measuring the behaviour of data. It is the ability to understand...
TD:LR AgileData's mission is to reduce the complexity of managing data. A large part of modern data complexity is...
In 2021 Shane Gibson was lucky enough to present “A selection of practical agile patterns when using Data Vault...
TD:LR Agile DataOps is where we combine the processes and technologies from DataOps with a new agile way of working,...
One feature to rule them all As product managers we are always looking for the next “killer feature” for our product....
Our UX/UI journey is accelerating We are currently full steam into the development of the initial User Interface for...
Some tasks seem really small and only take minutes, but multiply that effort by completing that task a hundred times...
When we first sketched out our plans for AgileData we were pretty clear what AgileData would do and what it wouldn’t...
We are currently doing some work on creating rule patterns that enable us to automagically find duplicate Concept...
One of the (many) things we needed to decide when we started to build out the AgileData Minimal Magical Product (MMP),...
This should be an easy one for me to answer right? Understand the customers problem first We get told in startup land...
Pick a few things that really matter, not thousands of “requirements” We when first started developing...
My co-founder Nigel and I have been working in the data and analytics domain for over 30 years (well I have, he is...
As part of our journey to exploring the use of the Google Cloud Platform (GCP) as the core of our infrastructure for...
With the advent of self-service data discovery tools and big data platforms, the bold announcements of "the data...
We will email you whenever we share new content, no spam, pinky promise