Opinion Analysis of News, Threaded Conversations, and User Generated Content

Tool to define Apache Beam pipeline in YAML or JSON

Asgarde allows simplifying error handling with Apache Beam Java, with less code, more concise and expressive code.

Cloud-native Telco BSS hosted in GCP K8s with standalone Diameter to gRPC gateway. Rule Engine using Neo4j graphs. Analytics Events sent to GCP BigData (Dataflow+BigQuery) via PubSub. It's awesome!

Asgarde allows simplifying error handling with Apache Beam Python, with less code, more concise and expressive code.

Cloud Dataflow Tutorial for Beginners

Public source code for the Batch Processing with Apache Beam (Python) online course

Midgard is a wrapper on Beam Kotlin, allowing more concise and expressive code. It removes Beam boilerplate code and proposes more Functional Programming style

I got Google Cloud Certified. I have what it takes to leverage Google Cloud technology. Here my certification: https://www.credential.net/ee1bd2d6-fdb0-4037-8a8d-9afae3d79c86.

build streaming apps on spring cloud dataflow platform

Project showing a CI CD pipeline for Dataflow Java with Flex Template and Cloud Build

Building a next-generation hybrid data pipeline architecture that combines the power of Microsoft Fabric, Azure Cloud, and Power BI. This pipeline is engineered to tackle the challenges of real-time data ingestion, multi-layered processing, and analytics, delivering business-critical insights.

Cloud Dataflow pipeline that reads the file from Cloud Storage and processes and outputs in the memory store.

IIM-DEVOPS - (demo) Real-time Twitter's hashtags analytics... fully managed by Google Cloud

Cloud dataflow pipeline code that processes data from a cloud storage bucket, transforms it and stores in Google's highly scalable, reduced latency in-memory database, memorystore which is an implementation of Redis.

Realtime Meetup "Répondez, s'il vous plaît" (RSVPs) analytics built upon Apache-Beam - Streaming Processing

Experiment in using windowing and trigger for more accurate streaming analytics with Apache Beam

Efficient Python data pipeline leveraging Apache Beam and Google Cloud Dataflow to update a Bucket with data concerning daily prices of instruments extracted from BMF website, serving as input for other data pipelines. The code generates a dataflow template, which is then scheduled to run periodically using Cloud Scheduler + Cloud Functions.