TD:LR Data Architecture as a Service (DAaaS), is it Buzzwashing or not? As is often the case, it depends on your point of view. Our point of view? Nope its a real thing.
Blog
Because sharing is caring
3 types of product features
Our UX/UI journey is accelerating We are currently full steam into the development of the initial User Interface for AgileData.io. The team have done some awesome work on the UX designs for a bunch of the core screens,...
Reducing Manual Effort, Everywhere, Every-time
Some tasks seem really small and only take minutes, but multiply that effort by completing that task a hundred times and you have found a task that should be automated. Collect your data In AgileData we automate the...
Why assumptions are just that
When we first sketched out our plans for AgileData we were pretty clear what AgileData would do and what it wouldn’t do. Those assumptions didn’t last long. Combine with magic We knew we wanted to focus on what we call...
Micro Actions, ensuring a little bit of Magic Happens Here everytime
We are currently doing some work on creating rule patterns that enable us to automagically find duplicate Concept values and create a master view of them. For example creating a master view of Customers, or a master...
Buy, Build or Lease
One of the (many) things we needed to decide when we started to build out the AgileData Minimal Magical Product (MMP), was which capabilities we would build vs which capabilities we would lease or buy. As part of our...
What problem(s) does AgileData solve?
This should be an easy one for me to answer right? Understand the customers problem first We get told in startup land that you need to understand the customers problem in-depth, before you start building your product....
Why we chose Google Cloud as the infrastructure platform for AgileData
Pick a few things that really matter, not thousands of “requirements” We when first started developing the core of the AgileData backend for the MVP, we knew we would need a cloud database to store...
Why we founded AgileData
My co-founder Nigel and I have been working in the data and analytics domain for over 30 years (well I have, he is slightly younger). We have both held multiple roles through these years, Nigel primarily in the...
Google BigQuery – Online Training resources
As part of our journey to exploring the use of the Google Cloud Platform (GCP) as the core of our infrastructure for AgileData.io we have had to start unlearning a lot of our AWS and Microsoft Azure knowledge and...
Its 2019 – Isn’t the Data Warehouse dead?
With the advent of self-service data discovery tools and big data platforms, the bold announcements of "the data warehouse is dead" started to ring out around the world. So why, you would ask, are we building a new...
AgileData Product
Blogs about the AgileData Product
Consulting
Blogs about running a data consultancy
DataOps
Blogs about DataOps
Data and Analytics
Blogs about Data and Analytics
Google Cloud
Blogs about Google Cloud
Journey
Blogs about the AgileData Journey
Product Management
Blogs about Product Management
Resources
Links to Resources that are useful
What Is
Blogs that describe Data Things
All Blogs
5E’s
As Data Consultants your customers are buying and outcome based on one of these patterns – effort, expertise, e...
Agile-tecture Data Factory
Defining a Data Architecture is a key pattern when working in the data domain.
Its always tempting to boil the...
Data Architecture as a Service (DAaaS)
TD:LR Data Architecture as a Service (DAaaS), is it Buzzwashing or not? As is often the case, it depends on your poin...
Myth: using the cloud for your data warehouse is expensive
TD:LR Cloud Data Platforms promise you the magic of storing your data and unlimited elastic compute for cents. Is it...
Observability, Tick
TD:LR Data observability is not something new, its a set of features every data platform should have to get the data...
The language of data is not so natural
TD:LR The dream is we can just point the machine at our data, ask our question and get a useful answer. With ChatGPT...
Build Data Products Without A Data Team Using AgileData
TD:LR Late in 2022 I was lucky enough to talk to Tobias Macey on the Data Engineering podcast about our AgileData SaaS...
How To Bring Agile Practices To Your Data Projects
TD:LR Late in 2022 I was lucky enough to talk to Tobias Macey on the Data Engineering podcast about combining agile...
App Engine and Socket.IO
We wanted to be able to dynamically notify Data Magicians when a task had completed, without them having to refresh t...
I can write a bit of code faster
TD:LR To get data tasks done involves a lot more than just bashing out a few lines of code to get the data into a...
The Focus Podcast – Agile Data Governance Patterns
Early in 2022 Shane Gibson was lucky enough to talk to the Focus podcast crew about agile governance in the data doma...
ELT without persisted watermarks ? not a problem
We no longer need to manually track the state of a table, when it was created, when it was updated, which data pipeli...
Three Agile Testing Methods – TDD, ATDD and BDD
In the word of agile, there are three common testing techniques that can be used to improve our testing practices and...
Using a manifest concept to run data pipelines
TD:LR … you don’t always need to use DAGs to orchestrate Previously we talked about how we use an ephemeral...
“Serverless” Data Processing
TD:LR When we dreamed up agiledata.io and started white-boarding ideas around architecture, one of the patterns we...
A Data Engineer an Agile Coach and a Fish walk into a bar…
This is the first of a series of articles detailing how we built a platform to make data fun and remove complexity fo...
Analysts can model democratising data modeling
In 2022 Shane Gibson was lucky enough to present “Analysts can model democratising data modeling” at the ...
Data Mesh Podcast – Finding useful and repeatable patterns for data
TD:LR I talk to Scott Hirleman on the Data Mesh Radio podcast on my thoughts on Data Mesh and the need for resuable...
What is Data Lineage?
TD:LR AgileData mission is to reduce the complexity of managing data. In the modern data world there are many...
Data Mesh 4.0.4
TD:LR Data Mesh 4.0.4 is only available for a very short time. please ensure you scroll to the bottom of the article...
What is a Data Catalog?
TD:LR AgileData mission is to reduce the complexity of managing data. In the modern data world there are many...
Catalog & Cocktails Podcast – agile in the data domain
Early in 2022 Shane Gibson was lucky enought to talk to the Catalog and Cocktails podcast crew about agile in the dat...
Whats the hottest new data thing in 2022 — Data Mesh or Metric Store
There is a lot of vendor washing going on A lot of data vendors are vendor washing their technologies to pretend they...
What is Data Observability?
Data observability is the practice of monitoring and measuring the behaviour of data. It is the ability to understand...
AgileData >>> Modern Data Stack
TD:LR AgileData's mission is to reduce the complexity of managing data. A large part of modern data complexity is...
A selection of practical agile patterns when using Data Vault
In 2021 Shane Gibson was lucky enough to present “A selection of practical agile patterns when using Data Vault...
Agile DataOps
TD:LR Agile DataOps is where we combine the processes and technologies from DataOps with a new agile way of working,...
The “Killer” Feature
One feature to rule them all As product managers we are always looking for the next “killer feature” for our product....
3 types of product features
Our UX/UI journey is accelerating We are currently full steam into the development of the initial User Interface for...
Reducing Manual Effort, Everywhere, Every-time
Some tasks seem really small and only take minutes, but multiply that effort by completing that task a hundred times...
Why assumptions are just that
When we first sketched out our plans for AgileData we were pretty clear what AgileData would do and what it wouldn’t...
Micro Actions, ensuring a little bit of Magic Happens Here everytime
We are currently doing some work on creating rule patterns that enable us to automagically find duplicate Concept...
Buy, Build or Lease
One of the (many) things we needed to decide when we started to build out the AgileData Minimal Magical Product (MMP),...
What problem(s) does AgileData solve?
This should be an easy one for me to answer right? Understand the customers problem first We get told in startup land...
Why we chose Google Cloud as the infrastructure platform for AgileData
Pick a few things that really matter, not thousands of “requirements” We when first started developing...
Why we founded AgileData
My co-founder Nigel and I have been working in the data and analytics domain for over 30 years (well I have, he is...
Google BigQuery – Online Training resources
As part of our journey to exploring the use of the Google Cloud Platform (GCP) as the core of our infrastructure for...
Its 2019 – Isn’t the Data Warehouse dead?
With the advent of self-service data discovery tools and big data platforms, the bold announcements of "the data...
Subscribe to our newsletter
We will email you whenever we share new content, no spam, pinky promise