Blogs
Because sharing is caring
Patterns for being a successful internal data consultancy with Dylan Jones
Join Shane Gibson as he chats with Dylan Jones on how to adopt patterns used by successful data consultancies and apply them in your organisation as an internal data team.
Defining self-service data
Everybody wants self service data, but what do they really mean when they say that.
If we gave them access to a set of highly nested JSON data, and say “help your self”, would that be what they expect?
Or do they expect self service to be able to get information without asking a person to get it for them.
Or are they expecting something in between.
I ask them which of the five simple self service patterns they want to find, which form of self service they are after.
OKR’s with Adrian Howard
Join Murray Robinson and Shane Gibson as they discuss objectives and key results with Adrian Howard.
Adrian explains how OKR’s can be used as a strategic instrument for aligning goals within your organisation. We walk through common pitfalls and misconceptions emphasizing the importance of using OKR’s focused on outcomes rather than outputs. We discuss the potential for using OKR’s with vendors. The idea of paired metrics. And how OKR’s can serve as indicators of underlying problems within your organisations culture and structure.
Combining agile and data five years on with Blair Tempero
Guests Blair TemperoShane GibsonResources Join Shane Gibson as he chats with Blair Tempero on that last five years since they started the AgileData Podcast together.Listen on your favourite Podcast Platform | Apple Podcast | Spotify | Google Podcast | Amazon...
The Heart of Agile with Mike Leber
Join Murray Robinson and Shane Gibson as discuss business agility and the heart of agile with Mike Leber.
We talk about how the heart of agile liberates you from rigid process frameworks by focusing on collaboration, delivery reflection and improvement. We talk about how the agile industrial complex has turned agile into a heavyweight waterfall process. And how innovation is happening outside the traditional agile bubble. And lastly, we talk about agile leadership. If you’re interested in getting to the heart of agile and exploring business agility.
The state of product management with Jason Knight
Join Murray Robinson and Shane Gibson as they chat with Jason Knight on the state of product management.
Jason shares his insights and experiences on the responsibilities of a product manager, the evolving nature of the role. Differentiating buyer and user features the importance of testing and validating ideas. Supporting cross-functional teams and fostering a mindset of continuous improvement. Jason shares insights from his experiences and discussions with thought leaders and provides advice for those navigating the product management field.
There are 3 strategic / macro data use cases
I often ask which of these three macro data use cases the Organisations believed were its priorities to achieve their business strategy:
Providing data to Customers
Supporting Internal Processes
Providing data to External Organisations
Each of these three strategic / macro data use cases come with specific data architectures, data work and also impact the context of how you would design your agile data ways of working.
Eventually the data maintenance Tortoise will catch the new data work Hare
When you work in a data team you have to split your time between building and delivering new Information Products and maintaining the ones you have already delivered.
DataOps patterns can help reduce the time you spend on the maintenance work.
Building the Data Plane while flying it
In the data domain you typically have to balance between building the right thing and building the thing right.
The days of being able to spend 6 months or a year on “Sprint Zero” creating your data platform have gone.
One team I worked with called it “building the airplane as you fly it”
Here are 5 patterns I have seen data teams adopt to help them do this.
AgileData App
Explore AgileData features, updates, and tips
Network
Learn about consulting practises and good patterns for data focused consultancies
DataOps
Learn from our DataOps expertise, covering essential concepts, patterns, and tools
Data and Analytics
Unlock the power of data and analytics with expert guidance
Google Cloud
Imparting knowledge on Google Cloud's capabilities and its role in data-driven workflows
Journey
Explore real-life stories of our challenges, and lessons learned
Product Management
Enrich your product management skills with practical patterns
What Is
Describing data and analytics concepts, terms, and technologies to enable better understanding
Resources
Valuable resources to support your growth in the agile, and data and analytics domains
AgileData Podcast
Discussing combining agile, product and data patterns.
No Nonsense Agile Podcast
Discussing agile and product ways of working.
App Videos
Explore videos to better understand the AgileData App's features and capabilities.
Data Mesh 4.0.4
TD:LR Data Mesh 4.0.4 is only available for a very short time. please ensure you scroll to the bottom of the article to understand the temporal nature of the Data Mesh 4.0.4 approach.This article was published on 1st...
Abracadabra! Unravel the Mysteries of Data Catalog
Data catalogs are comprehensive inventories of an organisations data assets, helping data analysts and information consumers to quickly find, understand, and utilise relevant information. They foster collaboration, maintain data governance, and ensure compliance.
Catalog & Cocktails Podcast – agile in the data domain
Early in 2022 Shane Gibson was lucky enought to talk to the Catalog and Cocktails podcast crew about agile in the data domain. Watch or listen to the episode.
Whats the hottest new data thing in 2022 — Data Mesh or Metric Store
There is a lot of vendor washing going on A lot of data vendors are vendor washing their technologies to pretend they enable "Data Mesh" as they are punting on Data Mesh being the new thing for 2022. I think they are...
Data Observability Uncovered: A Magical Lens for Data Magicians
Data observability provides comprehensive visibility into the health, quality, and reliability of your data ecosystem. It dives deeper than traditional monitoring, examining the actual data flowing through your pipelines. With tools like data lineage tracking, data quality metrics, and anomaly detection, data observability helps data magicians quickly detect and diagnose issues, ensuring accurate, reliable data-driven decisions.
Analyst vs Analytics Engineer – Benn Stancil
Join Shane and guest Benn Stancil as they discuss the difference between the age old analyst role and the new emerging role of analytics engineer (amongst a few other interesting things)
3 agile architecture things
Join Shane and guest Brian McMillian as they discuss the art of architecture in an agile data world. We discuss 3 things: 1. the 4x approach2. data vault3. everything is code
AgileBI – Raphael Branger
Join Shane and guest Raphael Branger as they discuss combining agile ways of working with the world of data and business intelligence (BI).
Agile and Analytics – Shaun McGirr
Join Shane and special guest Shaun McGirr as they discuss the combining of agile ways of working with analytics teams.
AgileData >>> Modern Data Stack
TD:LR AgileData's mission is to reduce the complexity of managing data. A large part of modern data complexity is selecting, implementing and maintaining a raft of different technologies to provide your "Modern Data...
A selection of practical agile patterns when using Data Vault
In 2021 Shane Gibson was lucky enough to present “A selection of practical agile patterns when using Data Vault” at the Knowledge Gap Conference
Agile DataOps
TD:LR Agile DataOps is where we combine the processes and technologies from DataOps with a new agile way of working, to reduce the time taken and increase the value of the data we provide to our customers What's in a...
The magic of Agile Data teams vs Agile Software teams – Lynn Winterboer
Join Shane and special guest Lynn Winterboer as they discuss the core differences between teams that leverage an agile way of working while managing data versus creating software.
Agile Data Testing Techniques, a magical list of testing TLA’s
Join Shane and Nigel as they discuss the many notions you should understand to start your journey on the DataOps and automated data testing path.
Data Lineage, mapping your way to magic
Join Shane and Nigel as they discuss data lineage, what it is, why people want it and what it can actually be used for.
The Magic of Serverless
Join Shane and Nigel as they discuss what serverless actually means, and the value of leveraging serverless components within your data platform.
The “Killer” Feature
One feature to rule them all As product managers we are always looking for the next “killer feature” for our product. You know the one, that feature that will become the magical thing that will have customers flooding...
Data Layers, the magic of the right data in the right place
Join Shane and Nigel as they discuss what data layers and how we apply data layers as a core part of the AgileData.io Agile-Tecture.
AgileData refactoring
Join Shane and Nigel as they discuss what refactoring is and why you should always plan to refactor your data, code and platform from day one.
3 types of product features
Our UX/UI journey is accelerating We are currently full steam into the development of the initial User Interface for AgileData.io. The team have done some awesome work on the UX designs for a bunch of the core screens,...
AgileData Patterns
Join Shane and Nigel as they discuss what agile data patterns are and how you can apply them to speed up the delivery of data to your stakeholders.