Blogs
Because sharing is caring
NZ Scaleup AgileData achieves Google Cloud Ready – BigQuery Designation
AgileData has achieved Google Cloud Ready – BigQuery designation, streamlining data management for customers and partners. This certification confirms the integration’s functionality and reliability, reducing complexity through a low-code interface. By leveraging Google Cloud’s infrastructure and BigQuery, AgileData empowers business leaders to rapidly gain insights and make informed decisions efficiently.
We are working on something new at AgileData, follow us as we build it in public
The AgileData team is dedicating 30 days to exploring a novel data use case, which might lead to a new product, feature set, or module. They’ll document their daily progress publicly to share learnings and insights. Follow their journey on their blog for updates as they build and experiment in real-time.
Product Management with John Cutler
Join Murray Robinson and Shane Gibson as they discuss product management with John Cutler, famous for his newsletter The Beautiful Mess.
We dive into the purpose of product management as a driver of profitable growth. And we discuss how to use the north star framework to align your organisation around common goals. We examine how to use product roadmaps to communicate and prioritize plans and discuss how critical it is to be an open, honest, and effective leader. And finally we look at whether agile is critical or useless in product management. Join us as we uncover the insights and best practices product managers need to be more effective.
UX Research with Nick Fine
Join Murray Robinson and Shane Gibson as they discuss UX research with Dr. Nick Fine. Nick explains what to expect from a UX researcher, how to do user research well, and the challenges that researchers have to overcome to obtain valid results. Whether you’re a product manager, designer, or developer this episode is packed with actionable insights, real world examples and expert tips to enhance your understanding of UX research and its role in creating high value, digital products and services.
The Vanguard Method with Ibrar Hussain
Join Murray Robinson and Shane Gibson as they discuss the Vanguard method with Ibbi Hussain, one of the founding architects of this revolutionary approach to organisation change. Ibi describes how the Vanguard method uses systems thinking, service design, and occupational psychology to make profound improvements to call center performance. Join us as we navigate through the philosophy of change, the importance of leadership. And practical insights into implementing sustainable improvement within organisations.
Episode 100 – A retrospective
Welcome to our 100th episode.
In this episode, we talk about what we’ve learnt from our guests about agile, product development and leadership. We discuss what the podcast is about and why we started it. We unpack our critical take on fake agile and discuss agile leadership and product development. Join us as we take a deep dive into the insights, experiences and conversations that have shaped our podcast ovr the last 99 episodes. And here’s to another hundred episodes of cutting through the nonsense and bringing you the advice you need to succeed.
Business Agility with Evan Leybourn
Join Murray Robinson and Shane Gibson as they chat with Evan Leybourn from the Business Agility Institute about business agility. We discuss how to define and measure business agility, examples of agile organisations, and the struggle with traditional bureaucratic models. We delve into the different types of leadership, the nature of internal cultural and political changes, and the challenges faced by organisations in adopting and implementing agility.
Bridging Data and Product Management Practises and Patterns with Juha Korpela
Join Shane Gibson as he chats with Juha Korpela on how to adopt patterns and practises from Product Management and apply them to the data domain.
Innovation and disaster with Ron Westrum
Join Murray Robinson and Shane Gibson as they chat with Ron Westrum about how organisational culture drives innovation and disaster. We discuss generative, bureaucratic and pathological cultures, using real-world examples from NASA, Boeing and others. This episode highlights the importance of leadership integrity, openness, honesty, the free flow of information, and a mission-focused approach to achieving organisational goals. Listen for insights on identifying and promoting a generative culture, dealing with bad news, the role of technical maestros, and much more.
Introducing Hai, AgileData 2024 Data Intern
I’m Hai, a name that intriguingly means “hi” in English. Originally from Vietnam, I now find myself in Australia, studying Data Science and embracing an internship at AgileData.io. This journey is not just about academic growth but also about applying my knowledge in practical, impactful ways. Join me as I explore the blend of technology and community, aiming to make a difference through data.
NZ Scaleup AgileData achieves Google Cloud Ready – BigQuery Designation
AgileData has achieved Google Cloud Ready – BigQuery designation, streamlining data management for customers and partners. This certification confirms the integration’s functionality and reliability, reducing complexity through a low-code interface. By leveraging Google Cloud’s infrastructure and BigQuery, AgileData empowers business leaders to rapidly gain insights and make informed decisions efficiently.
DataOps: The Magic Wand for Data Magicians
DataOps is a magical approach to data management, combining Agile, DevOps, and Lean Manufacturing principles. It fosters collaboration, agility, automation, continuous integration and delivery, and quality control. This empowers data magicians like you to work more efficiently, adapt to changing business requirements, and deliver high-quality, data-driven insights with confidence.
The language of data is not so natural
TD:LR Shane Gibson - AgileData.io The dream is we can just point the machine at our data, ask our question and get a useful answer. With ChatGPT we are closer than we have ever been, but we are not there yet, When...
Build Data Products Without A Data Team Using AgileData
TD:LR Shane Gibson - AgileData.io Late in 2022 I was lucky enough to talk to Tobias Macey on the Data Engineering podcast about our AgileData SaaS product and our focus on enabling analysts to do the data work without...
How To Bring Agile Practices To Your Data Projects
TD:LR Shane Gibson - AgileData.io Late in 2022 I was lucky enough to talk to Tobias Macey on the Data Engineering podcast about combining agile patterns and practises with those from the data domain. Listen to the...
Using the Information Product Canvas with Tammy Leahy
Join Shane and Tammy Leahy as they discuss the Information Product Canvas, what each area of the canvas holds and why you would want to collect this information.
This is the second in a series of podcast episodes that deep dives into the Information Product pattern.
Analytical team topologies – Ashwin Kamath
Join Shane and guest Ashwin Kamath as they discuss his experience working with analytical teams and analytical team topologies.
Information Products – What and Why with Tammy Leahy
Join Shane GIbson and Tammy Leahy as they discuss what the Information Product pattern is and Why you would use it.
App Engine and Socket.IO
We wanted to be able to dynamically notify Data Magicians when a task had completed, without them having to refresh their browser screen constantly. Implementing websockets allowed us to achieve this.
I can write a bit of code faster
TD:LR Shane Gibson - AgileData.io To get data tasks done involves a lot more than just bashing out a few lines of code to get the data into a format that you can give it to your stakeholder/customer. Unless of course...
The Focus Podcast – Agile Data Governance Patterns
Early in 2022 Shane Gibson was lucky enough to talk to the Focus podcast crew about agile governance in the data domain. Watch or listen to the episode.
ELT without persisted watermarks ? not a problem
We no longer need to manually track the state of a table, when it was created, when it was updated, which data pipeline last touched it …. all these data points are available by doing a simple call to the logging and bigquery api. Under the covers the google cloud platform is already tracking everything we need … every insert, update, delete, create, load, drop, alter is being captured
Three Agile Testing Methods – TDD, ATDD and BDD
In the word of agile, there are three common testing techniques that can be used to improve our testing practices and to assist with enabling automated testing.
Scaling data teams – Tammy Leahy
Shane Gibson chats to Tammy Leahy about how she helped scale the data teams she leads.
Data Products
Join Shane and guest Eric Broda as they discuss data products.
Using a manifest concept to run data pipelines
TD:LR Nigel Vining - AgileData.io … you don’t always need to use DAGs to orchestrate Previously we talked about how we use an ephemeral Serverless architecture based on Google Cloud Functions and Google PubSub...
“Serverless” Data Processing
TD:LR Nigel Vining - AgileData.io When we dreamed up AgileData and started white-boarding ideas around architecture, one of the patterns we were adamant that we would leverage, would be Serverless. This posts explains...
A Data Engineer an Agile Coach and a Fish walk into a bar…
This is the first of a series of articles detailing how we built a platform to make data fun and remove complexity for our users
Analysts can model democratising data modeling
In 2022 Shane Gibson was lucky enough to present “Analysts can model democratising data modeling” at the Knowledge Gap Conference
Watch the presentation.
Data Mesh Podcast – Finding useful and repeatable patterns for data
TD:LR Shane Gibson - AgileData.io I talk to Scott Hirleman on the Data Mesh Radio podcast on my thoughts on Data Mesh and the need for resuable patterns in the data & analytics domain. My opinion on Data Mesh I am not...
The Enchanting World of Data Magicians: Marketing Analytics vs. Product Analytics
Marketing Analytics involves analysing data from various channels, such as social media, email, and websites, to assess the performance of marketing efforts.
Product Analytics focuses on understanding and improving user experience and satisfaction with digital products or services.
What is Data Lineage?
TD:LR ADI - AgileData.io AgileData mission is to reduce the complexity of managing data. In the modern data world there are many capability categories, each with their own specialised terms, technologies and three...