Google Cloud

Because sharing is caring

Myth: using the cloud for your data warehouse is expensive

Myth: using the cloud for your data warehouse is expensive

TD:LR Cloud Data Platforms promise you the magic of storing your data and unlimited elastic compute for cents.  Is it too good to be true?  Yes AND No. You can run a cloud platform for a low low cost, but its will take engineering effort  to get there. Myth: using the...

Myth: using the cloud for your data warehouse is expensive

TD:LR Cloud Data Platforms promise you the magic of storing your data and unlimited elastic compute for cents.  Is it too good to be true?  Yes AND No. You can run a cloud platform for a low low cost, but its will take engineering effort  to get there. Myth: using the...

App Engine and Socket.IO

We wanted to be able to dynamically notify Data Magicians when a task had completed, without them having to refresh their browser screen constantly. Implementing websockets allowed us to achieve this.

Using a manifest concept to run data pipelines

TD:LR … you don’t always need to use DAGs to orchestrate Previously  we talked about how we use an ephemeral Serverless architecture based on Google Cloud Functions and Google PubSub Messaging to run our customer data pipelines at agiledata.io This post I’m going to...

“Serverless” Data Processing

TD:LR When we dreamed up agiledata.io and started white-boarding ideas around architecture, one of the patterns we were adamant that we would leverage, would be Serverless. This posts explains why we were adamant and what that has to do with Apples. Is serverless even...

Why we chose Google Cloud as the infrastructure platform for AgileData

  Pick a few things that really matter, not thousands of “requirements”   We when first started developing the core of the AgileData backend for the MVP, we knew we would need a cloud database to store customers data. We had a lot of experience writing in...

Google BigQuery – Online Training resources

As part of our journey to exploring the use of the Google Cloud Platform (GCP) as the core of our infrastructure for AgileData.io we have had to start unlearning a lot of our AWS and Microsoft Azure knowledge and experience and relearn the GCP way. Google BigQuery is...

App Engine and Socket.IO

We wanted to be able to dynamically notify Data Magicians when a task had completed, without them having to refresh their browser screen constantly. Implementing websockets allowed us to achieve this.

Using a manifest concept to run data pipelines

TD:LR … you don’t always need to use DAGs to orchestrate Previously  we talked about how we use an ephemeral Serverless architecture based on Google Cloud Functions and Google PubSub Messaging to run our customer data pipelines at agiledata.io This post I’m going to...

“Serverless” Data Processing

TD:LR When we dreamed up agiledata.io and started white-boarding ideas around architecture, one of the patterns we were adamant that we would leverage, would be Serverless. This posts explains why we were adamant and what that has to do with Apples. Is serverless even...

AgileData Product

Blogs about the AgileData Product

Consulting

Blogs about running a data consultancy

DataOps

Blogs about DataOps

Data and Analytics

Blogs about Data and Analytics

Google Cloud

Blogs about Google Cloud

Journey

Blogs about the AgileData Journey

Product Management

Blogs about Product Management

Resources

Links to Resources that are useful

What Is

Blogs that describe Data Things

All Blogs

Subscribe to our newsletter

We will email you whenever we share new content, no spam, pinky promise

Let me read it first.