Blogs
Because sharing is caring
Unveiling the Secrets of Data Quality Metrics for Data Magicians: Ensuring Data Warehouse Excellence
Data quality metrics are crucial indicators in a data warehouse that measure the accuracy, completeness, consistency, timeliness, and uniqueness of data. These metrics help organisations ensure their data is reliable and fit for use, thus driving effective decision-making and analytics
Amplifying Your Data’s Value with Business Context
The AgileData Context feature enhances data understanding, facilitates effective decision-making, and preserves corporate knowledge by adding essential business context to data. This feature streamlines communication, improves data governance, and ultimately, maximises the value of your data, making it a powerful asset for your business.
New Google Cloud feature to Optimise BigQuery Costs
This blog explores AgileData’s use of Google Cloud, specifically its BigQuery service, for cost-effective data handling. As a bootstrapped startup, AgileData incorporates data storage and compute costs into its SaaS subscription, protecting customers from unexpected bills. We constantly seek ways to minimise costs, utilising new Google tools for cost-saving recommendations. We argue that the efficiency and value of Google Cloud make it a preferable choice over other cloud analytic database options.
Data as a First-Class Citizen: Empowering Data Magicians
Data as a first-class citizen recognizes the value and importance of data in decision-making. It empowers data magicians by integrating data into the decision-making process, ensuring accessibility and availability, prioritising data quality and governance, and fostering a data-centric mindset.
The patterns of Data Vault with Hans Hultgren
In a compelling episode of the Agile Data Podcast, Shane Gibson invites Hans Hultgren to explore the intricacies of Data Vault modeling. Hans, with a substantial background in IT and data warehousing, brings his expertise to the table, discussing the evolution and benefits of Data Vault modeling in today’s complex data landscapes. Shane and Hans navigate through the foundations of Data Vault, including its core components like hubs, satellites, and links, and delve into more advanced concepts like Same-As Links (SALs) and Hierarchical Links (Hals). They highlight how Data Vault enables flexibility, agility, and incremental development in data modeling, ensuring scalability and adaptability to change.
To whitelabel or not to whitelabel
Are you wrestling with the concept of whitelabelling your product? We at AgileData have been there. We discuss our journey through the decision-making process, where we grappled with the thought of our painstakingly crafted product being rebranded by another company.
Metadata-Driven Data Pipelines: The Secret Behind Data Magicians’ Greatest Tricks
Metadata-driven data pipelines are the secret behind seamless data flows, empowering data magicians to create adaptable, scalable, and evolving data management systems. Leveraging metadata, these pipelines are dynamic, flexible, and automated, allowing for easy handling of changing data sources, formats, and requirements without manual intervention.
Data Consulting Patterns with Joe Reis
Dive into the world of data consulting with Shane Gibson and Joe Reis on the Agile Data Podcast. Explore their journey from traditional employment to successful data consulting, covering client acquisition, business models, financial management, reputation, sales strategies, employee management, and work-life balance.
The Enchanting World of Data Modeling: Conceptual, Logical, and Physical Spells Unraveled
Data modeling is a crucial process that involves creating shared understanding of data and its relationships. The three primary data model patterns are conceptual, logical, and physical. The conceptual data model provides a high-level overview of the data landscape, the logical data model delves deeper into data structures and relationships, and the physical data model translates the logical model into a database-specific schema. Understanding and effectively using these data models is essential for business analysts and data analysts, create efficient, well-organised data ecosystems.
AgileData App
Explore AgileData features, updates, and tips
Network
Learn about consulting practises and good patterns for data focused consultancies
DataOps
Learn from our DataOps expertise, covering essential concepts, patterns, and tools
Data and Analytics
Unlock the power of data and analytics with expert guidance
Google Cloud
Imparting knowledge on Google Cloud's capabilities and its role in data-driven workflows
Journey
Explore real-life stories of our challenges, and lessons learned
Product Management
Enrich your product management skills with practical patterns
What Is
Describing data and analytics concepts, terms, and technologies to enable better understanding
Resources
Valuable resources to support your growth in the agile, and data and analytics domains
AgileData Podcast
Discussing combining agile, product and data patterns.
No Nonsense Agile Podcast
Discussing agile and product ways of working.
App Videos
Explore videos to better understand the AgileData App's features and capabilities.
AgileBI – Raphael Branger
Join Shane and guest Raphael Branger as they discuss combining agile ways of working with the world of data and business intelligence (BI).
Agile and Analytics – Shaun McGirr
Join Shane and special guest Shaun McGirr as they discuss the combining of agile ways of working with analytics teams.
AgileData >>> Modern Data Stack
TD:LR AgileData's mission is to reduce the complexity of managing data. A large part of modern data complexity is selecting, implementing and maintaining a raft of different technologies to provide your "Modern Data...
A selection of practical agile patterns when using Data Vault
In 2021 Shane Gibson was lucky enough to present “A selection of practical agile patterns when using Data Vault” at the Knowledge Gap Conference
Agile DataOps
TD:LR Agile DataOps is where we combine the processes and technologies from DataOps with a new agile way of working, to reduce the time taken and increase the value of the data we provide to our customers What's in a...
The magic of Agile Data teams vs Agile Software teams – Lynn Winterboer
Join Shane and special guest Lynn Winterboer as they discuss the core differences between teams that leverage an agile way of working while managing data versus creating software.
Agile Data Testing Techniques, a magical list of testing TLA’s
Join Shane and Nigel as they discuss the many notions you should understand to start your journey on the DataOps and automated data testing path.
Data Lineage, mapping your way to magic
Join Shane and Nigel as they discuss data lineage, what it is, why people want it and what it can actually be used for.
The Magic of Serverless
Join Shane and Nigel as they discuss what serverless actually means, and the value of leveraging serverless components within your data platform.
The “Killer” Feature
One feature to rule them all As product managers we are always looking for the next “killer feature” for our product. You know the one, that feature that will become the magical thing that will have customers flooding...
Data Layers, the magic of the right data in the right place
Join Shane and Nigel as they discuss what data layers and how we apply data layers as a core part of the AgileData.io Agile-Tecture.
AgileData refactoring
Join Shane and Nigel as they discuss what refactoring is and why you should always plan to refactor your data, code and platform from day one.
3 types of product features
Our UX/UI journey is accelerating We are currently full steam into the development of the initial User Interface for AgileData.io. The team have done some awesome work on the UX designs for a bunch of the core screens,...
AgileData Patterns
Join Shane and Nigel as they discuss what agile data patterns are and how you can apply them to speed up the delivery of data to your stakeholders.
Reducing Manual Effort, Everywhere, Every-time
Some tasks seem really small and only take minutes, but multiply that effort by completing that task a hundred times and you have found a task that should be automated. Collect your data In AgileData we automate the...
Why assumptions are just that
When we first sketched out our plans for AgileData we were pretty clear what AgileData would do and what it wouldn’t do. Those assumptions didn’t last long. Combine with magic We knew we wanted to focus on what we call...
Micro Actions, ensuring a little bit of Magic Happens Here everytime
We are currently doing some work on creating rule patterns that enable us to automagically find duplicate Concept values and create a master view of them. For example creating a master view of Customers, or a master...
Buy, Build or Lease
One of the (many) things we needed to decide when we started to build out the AgileData Minimal Magical Product (MMP), was which capabilities we would build vs which capabilities we would lease or buy. As part of our...
What problem(s) does AgileData solve?
This should be an easy one for me to answer right? Understand the customers problem first We get told in startup land that you need to understand the customers problem in-depth, before you start building your product....
Flying the airplane while building it – Jan Sheppard
Join Shane and Blair as they chat with Jan Sheppard about the experience of building a new agile way of working while still ensuring you are delivering data and analytical value to your stakeholders.
Why we chose Google Cloud as the infrastructure platform for AgileData
Pick a few things that really matter, not thousands of “requirements” We when first started developing the core of the AgileData backend for the MVP, we knew we would need a cloud database to store...