Join Shane Gibson as he chats with Tomas Kratky on his experience in defining data lineage and DataOps patterns.Guests Tomas Kratky Shane GibsonResourcesSubscribe | Apple Podcast | Spotify | Google Podcast | Amazon Audible | TuneIn | iHeartRadio | PlayerFM | Listen...
AgileData Podcast
Because sharing is caring
AgileData WoW Q&A – Hamish Gray and May-Lyn Hu
Join Shane Gibson, Hamish Gray and May-Lyn Hu as they talk through some of the experiences they have had in their organisation applying agile and data together in a new way of working.Guests Hamish Gray May-Lyn Hu...
Information Product Canvas
Join Shane and Tammy Leahy as they discuss the Information Product Canvas, what each area of the canvas holds and why you would want to collect this information.
This is the second in a series of podcast episodes that deep dives into the Information Product pattern.
Analytical team topologies – Ashwin Kamath
Join Shane and guest Ashwin Kamath as they discuss his experience working with analytical teams and analytical team topologies.
Information Products – What and Why
Join Shane GIbson and Tammy Leahy as they discuss what the Information Product pattern is and Why you would use it.
Scaling data teams – Tammy Leahy
Shane Gibson chats to Tammy Leahy about how she helped scale the data teams she leads.
Data Products
Join Shane and guest Eric Broda as they discuss data products.
Agile Security
Join Shane and guest Laura Bell as they discuss how you can eat the security elephant in an agile way.
Analyst vs Analytics Engineer – Benn Stancil
Join Shane and guest Benn Stancil as they discuss the difference between the age old analyst role and the new emerging role of analytics engineer (amongst a few other interesting things)
3 agile architecture things
Join Shane and guest Brian McMillian as they discuss the art of architecture in an agile data world. We discuss 3 things: 1. the 4x approach2. data vault3. everything is code
AgileBI – Raphael Branger
Join Shane and guest Raphael Branger as they discuss combining agile ways of working with the world of data and business intelligence (BI).
Agile and Analytics – Shaun McGirr
Join Shane and special guest Shaun McGirr as they discuss the combining of agile ways of working with analytics teams.
The magic of Agile Data teams vs Agile Software teams – Lynn Winterboer
Join Shane and special guest Lynn Winterboer as they discuss the core differences between teams that leverage an agile way of working while managing data versus creating software.
AgileData Product
Blogs about the AgileData Product
Consulting
Blogs about running a data consultancy
DataOps
Blogs about DataOps
Data and Analytics
Blogs about Data and Analytics
Google Cloud
Blogs about Google Cloud
Journey
Blogs about the AgileData Journey
Product Management
Blogs about Product Management
Resources
Links to Resources that are useful
What Is
Blogs that describe Data Things
All Blogs
Unveiling the Magic of Data Clean Rooms: Your Data Privacy Magicians
Data clean rooms are secure environments that enable organisations to process, analyse, and share sensitive data whil...
Free Google Analytics 4 (GA4) online courses
TD:LR There is some great free course content to help you upskill in Google Analytics 4 (GA4) Here are the ones we...
5E’s
As Data Consultants your customers are buying and outcome based on one of these patterns – effort, expertise, e...
Agile-tecture Data Factory
Defining a Data Architecture is a key pattern when working in the data domain.
Its always tempting to boil the...
Data Architecture as a Service (DAaaS)
TD:LR Data Architecture as a Service (DAaaS), is it Buzzwashing or not? As is often the case, it depends on your poin...
Myth: using the cloud for your data warehouse is expensive
TD:LR Cloud Data Platforms promise you the magic of storing your data and unlimited elastic compute for cents. Is it...
Observability, Tick
TD:LR Data observability is not something new, its a set of features every data platform should have to get the data...
The language of data is not so natural
TD:LR The dream is we can just point the machine at our data, ask our question and get a useful answer. With ChatGPT...
Build Data Products Without A Data Team Using AgileData
TD:LR Late in 2022 I was lucky enough to talk to Tobias Macey on the Data Engineering podcast about our AgileData SaaS...
How To Bring Agile Practices To Your Data Projects
TD:LR Late in 2022 I was lucky enough to talk to Tobias Macey on the Data Engineering podcast about combining agile...
App Engine and Socket.IO
We wanted to be able to dynamically notify Data Magicians when a task had completed, without them having to refresh t...
I can write a bit of code faster
TD:LR To get data tasks done involves a lot more than just bashing out a few lines of code to get the data into a...
The Focus Podcast – Agile Data Governance Patterns
Early in 2022 Shane Gibson was lucky enough to talk to the Focus podcast crew about agile governance in the data doma...
ELT without persisted watermarks ? not a problem
We no longer need to manually track the state of a table, when it was created, when it was updated, which data pipeli...
Three Agile Testing Methods – TDD, ATDD and BDD
In the word of agile, there are three common testing techniques that can be used to improve our testing practices and...
Using a manifest concept to run data pipelines
TD:LR … you don’t always need to use DAGs to orchestrate Previously we talked about how we use an ephemeral...
“Serverless” Data Processing
TD:LR When we dreamed up agiledata.io and started white-boarding ideas around architecture, one of the patterns we...
A Data Engineer an Agile Coach and a Fish walk into a bar…
This is the first of a series of articles detailing how we built a platform to make data fun and remove complexity fo...
Analysts can model democratising data modeling
In 2022 Shane Gibson was lucky enough to present “Analysts can model democratising data modeling” at the ...
Data Mesh Podcast – Finding useful and repeatable patterns for data
TD:LR I talk to Scott Hirleman on the Data Mesh Radio podcast on my thoughts on Data Mesh and the need for resuable...
What is Data Lineage?
TD:LR AgileData mission is to reduce the complexity of managing data. In the modern data world there are many...
Data Mesh 4.0.4
TD:LR Data Mesh 4.0.4 is only available for a very short time. please ensure you scroll to the bottom of the article...
Abracadabra! Unravel the Mysteries of Data Catalog
Data catalogs are comprehensive inventories of an organisations data assets, helping data analysts and information co...
Catalog & Cocktails Podcast – agile in the data domain
Early in 2022 Shane Gibson was lucky enought to talk to the Catalog and Cocktails podcast crew about agile in the dat...
Whats the hottest new data thing in 2022 — Data Mesh or Metric Store
There is a lot of vendor washing going on A lot of data vendors are vendor washing their technologies to pretend they...
Data Observability Uncovered: A Magical Lens for Data Magicians
Data observability provides comprehensive visibility into the health, quality, and reliability of your data ecosyste...
AgileData >>> Modern Data Stack
TD:LR AgileData's mission is to reduce the complexity of managing data. A large part of modern data complexity is...
A selection of practical agile patterns when using Data Vault
In 2021 Shane Gibson was lucky enough to present “A selection of practical agile patterns when using Data Vault...
Agile DataOps
TD:LR Agile DataOps is where we combine the processes and technologies from DataOps with a new agile way of working,...
The “Killer” Feature
One feature to rule them all As product managers we are always looking for the next “killer feature” for our product....
3 types of product features
Our UX/UI journey is accelerating We are currently full steam into the development of the initial User Interface for...
Reducing Manual Effort, Everywhere, Every-time
Some tasks seem really small and only take minutes, but multiply that effort by completing that task a hundred times...
Why assumptions are just that
When we first sketched out our plans for AgileData we were pretty clear what AgileData would do and what it wouldn’t...
Micro Actions, ensuring a little bit of Magic Happens Here everytime
We are currently doing some work on creating rule patterns that enable us to automagically find duplicate Concept...
Buy, Build or Lease
One of the (many) things we needed to decide when we started to build out the AgileData Minimal Magical Product (MMP),...
What problem(s) does AgileData solve?
This should be an easy one for me to answer right? Understand the customers problem first We get told in startup land...
Why we chose Google Cloud as the infrastructure platform for AgileData
Pick a few things that really matter, not thousands of “requirements” We when first started developing...
Why we founded AgileData
My co-founder Nigel and I have been working in the data and analytics domain for over 30 years (well I have, he is...
Google BigQuery – Online Training resources
As part of our journey to exploring the use of the Google Cloud Platform (GCP) as the core of our infrastructure for...
Its 2019 – Isn’t the Data Warehouse dead?
With the advent of self-service data discovery tools and big data platforms, the bold announcements of "the data...
Subscribe to our newsletter
We will email you whenever we share new content, no spam, pinky promise