Organisation Intent Enable the organisation to gain a clear, trusted understanding of the organisation’s legacy data platform, what data exists, where it lives, and what it means, to confidently inform modernisation,...
agiledata Blogs
Because sharing is caring
The pattern of writing a data book with Shane Gibson and Ramona C Truta
Join Ramona C Truta as she interviews Shane Gibson about the patterns of writing a data book (and they discuss a whole lot of other data things)
The Hook data modeling pattern with Andrew Foad
Join Shane Gibson as he chats with Andrew Foad on his data modeling pattern “Hook”
Increasing the perceived value of your data team with Aaron Wilkerson
Join Shane Gibson as he chats with Aaron Wilkerson on ways data teams can increase the perception of the value they add to their organisation.
ELM Patterns Templates with Remco Broekmans
Join Shane Gibson as he chats with Remco Broekmans about the pattern templates that are part of the Ensemble Logical Modeling (ELM) patterns.
Data Operating Models patterns with Dylan Anderson
Join Shane Gibson as he chats with Dylan Anderson about the patterns required to define a Data Operating Model.
Can we use an Information Product Canvas image to start the data design process?
Can completed Information Product Canvas image help with the initial design of the data environment to deliver that Information Product?
Overall the Disco outputs were not good enough to be used as a data design (not sure it ever will be perfect), so some more iteration to be done.
But the output it did generate was an encouraging start.
DataOps Patterns with Chris Bergh
Join Shane Gibson as he chats with Chris Bergh on improving your teams way of working by using DataOps patterns.
What is a Fractional role and why should you care?
A fractional team or a fractional role is one where an organisation gets access to experienced professionals who are hired on a part time or as needed basis.
Fractional professionals typically work across multiple organisations at the same time, providing their expertise where and when it is needed most.
This fractional pattern allows organisations to get access to skills and capabilities that they cannot find, or afford to hire as permanent members of their team.
Merging Data Vault and Medallion Architecture Patterns with Patrick Cuba
Join Shane Gibson as he chats with Patrick Cuba on combining the Data Vault data modeling pattern with the Medallion Architecture pattern.
Agentic Mesh Ecosystem Patterns with Eric Broda
Join Shane Gibson as he chats with Eric Broda on the patterns required to create an ecosystem to support the use of Agents in enterprise organisations.
AgileData Feature #03 – Catalog Browse and Search
Data Persona’s can use the Catalog to quickly search, find and access the Data Assets (Tiles) they need to complete a data task, such as supporting the development of Information Products or using the data for analysis.
Topic Tags and Dynamic Filtering allows Data Assets to be easily found using the Organisations business terminology.
With the Menu Anywhere capability they can drill out to any other screen in the AgileData App, retaining the context of the Tile, removing the need to go to the screen and manually searching for that Data Asset again.
Any time a data user performs a data task in the AgileData App, or an automated data task is executed on the AgileData Platform, the Catalog is automagically updated. The Catalog data is treated as a first class citizen, not as data exhaust.
The Catalog is part of a wider ensemble of features that let them search or browse to locate essential Data Assets quickly, view comprehensive details for each set of data, and track the flow of data similarly to parcel tracking.
Reliability Engineering of AI Agents with Petr Pascenko
Join Shane Gibson as he chats with Petr Pascenko on the pattern of Reliability Engineering of AI Agents
One suggestion on starting your journey into becoming a data consultant
At #AgileData we are focussed on helping people become data entrepreneurs.
Whether they want to start their journey by side hustling, or becoming a one person data band or grow their small data consulting companies revenue and margin, but not their team, we are keen to be part of their journey.
AgileData Feature #02 – Single Sign-in
With Single Sign-On (SSO), users gain streamlined access to the AgileData App, eliminating the need for repeatedly logging in and reducing friction in their data day.
This feature leverages Google Identity and Access Management (IAM) to provide seamless and secure authentication, ensuring that users can easily connect to the platform using their existing credentials.
AgileData’s SSO is not only secure but also scalable, designed to meet the needs of growing teams while maintaining the highest standards of data protection and access control.
5 core Data Collection Patterns
At AgileData, delivering our Fractional Data Service has revealed the diverse challenges of integrating data from varied organisations, industries, and systems. To scale effectively, we’ve adopted five core data collection patterns based on our “Define it Once, Reuse it Often” (DORO) principle:
1. Push
2. Pull
3. Stream
4. Share
5. File Drop
These patterns are supported by a toolkit of tested technologies like Dataddo, Meltano, and Google services, allowing us to solve new data challenges quickly. Our approach ensures flexibility and scalability, always starting with the question: Push, Pull, Stream, Share, or File Drop?
An Experiment – Top Data Trends for 2025 with Coalesce and Google NotebookLM
Join two LLM generated guests as they discuss the Top Data Trends of 2025 Whitepaper published by Coalesce.
This is a different episode. Instead of a human guest, we have two robot guests.
I decided to try and experiment. My experiment was, can I upload a white paper to LLM, have it generate a podcast listen to that podcast in my daily walk and see whether that summary removes the need for me to actually read the white paper.
So in this case, I have grabbed a white paper called Top Data Trends for 2025 from Coalesce, uploaded it to the Google Notebook LLM and got it to generate a podcast with two hosts chatting about the white paper.
Have a listen, let me know what you think.
AgileData Feature #01 – Marketplace
Information Consumers can quickly search, find and access the Information Products they need to answer their business questions.
This feature enables Information Consumers to search and find all the available dashboards, reports and analytical models in the AgileData App, regardless of what third party Last Mile tool they are created in.
It also enables the Information Consumer to quickly open that report or dashboard directly from the Marketplace, when those reports are accessible by a web URL
Agile Project Management with Johanna Rothman
Join Murray Robinson and Shane Gibson as they chat with Jurgen Appelo about the crisis in the agile community.
We explore how the agile job market has changed with diminishing roles for agile coaches and scrum masters. And we discuss what people can do now that the agile consulting and training gold rush is over. We talk about the poor quality of agile practices in organizations claiming to have done agile. And the need to improve further, to get the benefits available. And we talk about the evolution and rebranding of agile practices and the impact of AI on the industry.
Gain valuable insights into the future of agile, the importance of adapting to change and strategies for sustaining relevance in a shifting market.
DataOps
DataOps Leveraging automation and continuous monitoring, DataOps optimises the flow of data from collection to consumption, reducing manual intervention and ensuring that updates and changes are seamless.Scalable and...
The crisis in agile with Jurgen Appelo
Join Murray Robinson and Shane Gibson as they chat with Jurgen Appelo about the crisis in the agile community.
We explore how the agile job market has changed with diminishing roles for agile coaches and scrum masters. And we discuss what people can do now that the agile consulting and training gold rush is over. We talk about the poor quality of agile practices in organizations claiming to have done agile. And the need to improve further, to get the benefits available. And we talk about the evolution and rebranding of agile practices and the impact of AI on the industry.
Gain valuable insights into the future of agile, the importance of adapting to change and strategies for sustaining relevance in a shifting market.