Google Cloud Articles

Using a manifest concept to run data pipelines

TD:LR … you don’t always need to use DAGs to orchestrate Previously  we talked about how we use an ephemeral Serverless architecture based on Google Cloud Functions and Google PubSub Messaging to run our customer data pipelines at agiledata.io This post I’m going to...

“Serverless” Data Processing

TD:LR When we dreamed up agiledata.io and started white-boarding ideas around architecture, one of the patterns we were adamant that we would leverage, would be Serverless. This posts explains why we were adamant and what that has to do with Apples. Is serverless even...

Why we chose Google Cloud as the infrastructure platform for AgileData

  Pick a few things that really matter, not thousands of “requirements”   We when first started developing the core of the AgileData backend for the MVP, we knew we would need a cloud database to store customers data. We had a lot of experience writing in...

Google BigQuery – Online Training resources

As part of our journey to exploring the use of the Google Cloud Platform (GCP) as the core of our infrastructure for AgileData.io we have had to start unlearning a lot of our AWS and Microsoft Azure knowledge and experience and relearn the GCP way. Google BigQuery is...
No Results Found

The page you requested could not be found. Try refining your search, or use the navigation above to locate the post.