Google Cloud Articles

App Engine and Socket.IO

We wanted to be able to dynamically notify Data Magicians when a task had completed, without them having to refresh their browser screen constantly. Implementing websockets allowed us to achieve this.

Using a manifest concept to run data pipelines

TD:LR … you don’t always need to use DAGs to orchestrate Previously  we talked about how we use an ephemeral Serverless architecture based on Google Cloud Functions and Google PubSub Messaging to run our customer data pipelines at agiledata.io This post I’m going to...

“Serverless” Data Processing

TD:LR When we dreamed up agiledata.io and started white-boarding ideas around architecture, one of the patterns we were adamant that we would leverage, would be Serverless. This posts explains why we were adamant and what that has to do with Apples. Is serverless even...

Why we chose Google Cloud as the infrastructure platform for AgileData

  Pick a few things that really matter, not thousands of “requirements”   We when first started developing the core of the AgileData backend for the MVP, we knew we would need a cloud database to store customers data. We had a lot of experience writing in...