Because sharing is caring
Defining a Data Architecture is a key pattern when working in the data domain.
Its always tempting to boil the ocean when defining yours, don’t!
And once you have defined your data architecture, find a way to articulate and share it with simplicity.
Here is how we articulate the AgileData Data Agile-tecture.
In 2022 Shane Gibson was lucky enough to present “Analysts can model democratising data modeling” at the Knowledge Gap Conference
Watch the presentation.
TD:LR I talk to Scott Hirleman on the Data Mesh Radio podcast on my thoughts on Data Mesh and the need for resuable patterns in the data & analytics domain. My opinion on Data Mesh I am not a fan of the current...
TD:LR AgileData mission is to reduce the complexity of managing data. In the modern data world there are many capability categories, each with their own specialised terms, technologies and three letter acronyms. We...
TD:LR Data Mesh 4.0.4 is only available for a very short time. please ensure you scroll to the bottom of the article to understand the temporal nature of the Data Mesh 4.0.4 approach.This article was published on 1st...
TD:LR AgileData mission is to reduce the complexity of managing data. In the modern data world there are many capability categories, each with their own specialised terms, technologies and three letter acronyms. We...
Early in 2022 Shane Gibson was lucky enought to talk to the Catalog and Cocktails podcast crew about agile in the data domain. Watch or listen to the episode.
There is a lot of vendor washing going on A lot of data vendors are vendor washing their technologies to pretend they enable "Data Mesh" as they are punting on Data Mesh being the new thing for 2022. I think they are...
Data observability is the practice of monitoring and measuring the behaviour of data. It is the ability to understand how data is flowing through your systems, identify any anomalies or issues that arise, and take action to address them. It requires a holistic view of the entire data factory, from data ingestion to data processing and analysis.
In other words, data observability is about making sure that the data you are using is accurate, complete and reliable. It is about ensuring that your data is trustworthy and that you can rely on it to make informed decisions.
TD:LR AgileData's mission is to reduce the complexity of managing data. A large part of modern data complexity is selecting, implementing and maintaining a raft of different technologies to provide your "Modern Data...
In 2021 Shane Gibson was lucky enough to present “A selection of practical agile patterns when using Data Vault” at the Knowledge Gap Conference
TD:LR Agile DataOps is where we combine the processes and technologies from DataOps with a new agile way of working, to reduce the time taken and increase the value of the data we provide to our customers What's in a...
One feature to rule them all As product managers we are always looking for the next “killer feature” for our product. You know the one, that feature that will become the magical thing that will have customers flooding...
Blogs about the AgileData Product
Blogs about running a data consultancy
Blogs about DataOps
Blogs about Data and Analytics
Blogs about Google Cloud
Blogs about the AgileData Journey
Blogs about Product Management
Links to Resources that are useful
Blogs that describe Data Things
As Data Consultants your customers are buying and outcome based on one of these patterns – effort, expertise, e...
Defining a Data Architecture is a key pattern when working in the data domain.
Its always tempting to boil the...
TD:LR Data Architecture as a Service (DAaaS), is it Buzzwashing or not? As is often the case, it depends on your poin...
TD:LR Cloud Data Platforms promise you the magic of storing your data and unlimited elastic compute for cents. Is it...
TD:LR Data observability is not something new, its a set of features every data platform should have to get the data...
TD:LR The dream is we can just point the machine at our data, ask our question and get a useful answer. With ChatGPT...
TD:LR Late in 2022 I was lucky enough to talk to Tobias Macey on the Data Engineering podcast about our AgileData SaaS...
TD:LR Late in 2022 I was lucky enough to talk to Tobias Macey on the Data Engineering podcast about combining agile...
We wanted to be able to dynamically notify Data Magicians when a task had completed, without them having to refresh t...
TD:LR To get data tasks done involves a lot more than just bashing out a few lines of code to get the data into a...
Early in 2022 Shane Gibson was lucky enough to talk to the Focus podcast crew about agile governance in the data doma...
We no longer need to manually track the state of a table, when it was created, when it was updated, which data pipeli...
In the word of agile, there are three common testing techniques that can be used to improve our testing practices and...
TD:LR … you don’t always need to use DAGs to orchestrate Previously we talked about how we use an ephemeral...
TD:LR When we dreamed up agiledata.io and started white-boarding ideas around architecture, one of the patterns we...
This is the first of a series of articles detailing how we built a platform to make data fun and remove complexity fo...
In 2022 Shane Gibson was lucky enough to present “Analysts can model democratising data modeling” at the ...
TD:LR I talk to Scott Hirleman on the Data Mesh Radio podcast on my thoughts on Data Mesh and the need for resuable...
TD:LR AgileData mission is to reduce the complexity of managing data. In the modern data world there are many...
TD:LR Data Mesh 4.0.4 is only available for a very short time. please ensure you scroll to the bottom of the article...
TD:LR AgileData mission is to reduce the complexity of managing data. In the modern data world there are many...
Early in 2022 Shane Gibson was lucky enought to talk to the Catalog and Cocktails podcast crew about agile in the dat...
There is a lot of vendor washing going on A lot of data vendors are vendor washing their technologies to pretend they...
Data observability is the practice of monitoring and measuring the behaviour of data. It is the ability to understand...
TD:LR AgileData's mission is to reduce the complexity of managing data. A large part of modern data complexity is...
In 2021 Shane Gibson was lucky enough to present “A selection of practical agile patterns when using Data Vault...
TD:LR Agile DataOps is where we combine the processes and technologies from DataOps with a new agile way of working,...
One feature to rule them all As product managers we are always looking for the next “killer feature” for our product....
Our UX/UI journey is accelerating We are currently full steam into the development of the initial User Interface for...
Some tasks seem really small and only take minutes, but multiply that effort by completing that task a hundred times...
When we first sketched out our plans for AgileData we were pretty clear what AgileData would do and what it wouldn’t...
We are currently doing some work on creating rule patterns that enable us to automagically find duplicate Concept...
One of the (many) things we needed to decide when we started to build out the AgileData Minimal Magical Product (MMP),...
This should be an easy one for me to answer right? Understand the customers problem first We get told in startup land...
Pick a few things that really matter, not thousands of “requirements” We when first started developing...
My co-founder Nigel and I have been working in the data and analytics domain for over 30 years (well I have, he is...
As part of our journey to exploring the use of the Google Cloud Platform (GCP) as the core of our infrastructure for...
With the advent of self-service data discovery tools and big data platforms, the bold announcements of "the data...
We will email you whenever we share new content, no spam, pinky promise