Streaming Data Analytics

Module 1 Foundations Lectures 1 – 6

LECTURE 01Past

Introduction to Streaming Data

What streaming is, why it matters, batch vs stream

⏱ 90 min

LECTURE 02Past

Data Sources & Personalisation

Identifying sources, real-time personalisation patterns

⏱ 90 min

LECTURE 03Past

Kafka Architecture

Topics, partitions, brokers — how Kafka works

⏱ 90 min

LECTURE 04Past

Setup: Docker & Kafka

Installing Docker, Kafka, Zookeeper environment

⏱ 90 min

LECTURE 05Past

Setup: Docker & Kafka II

Configuration, troubleshooting, verifying the stack

⏱ 90 min

LECTURE 06Available

Your First Producer

Python venv, stock CSV, yFinance, BTC live, multi-producer

⏱ 90 min View Slides →

Module 2 Making Kafka Work Lectures 7 – 10

LECTURE 07Available

Reading from Kafka

Console consumer, Python consumer, analytics & decision framework

⏱ 90 min View Slides →

LECTURE 08Available

Saving to MongoDB

MongoDB Atlas setup, consumer_mongodb.py, persistent storage

⏱ 90 min View Slides →

LECTURE 09Available

Analytics & Alerts

Decision framework, offset strategy, analytics consumer, alert triggers

⏱ 90 min View Slides →

LECTURE 10Available

Fraud Detection Capstone

End-to-end: multi-producer → Kafka → MongoDB enrichment → 3 fraud rules

⏱ 90 min View Slides →

Module 3 Stream Processing Lectures 11 – 13

LECTURE 11Available

Windowing & Aggregations

Tumbling, sliding & session windows in practice

⏱ 90 min View Slides →

LECTURE 12Notes

Apache Spark Streaming

Micro-batch model, decision framework & case studies

⏱ 90 min View Notes →

LECTURE 13Notes

Apache Flink & True Streaming

Flink vs Spark, exactly-once semantics & UPI case study

⏱ 90 min View Notes →

Module 4 Grafana Dashboards & Alerts Lectures 14 – 16

LECTURE 14Notes

Grafana Fundamentals

Install Grafana, connect MySQL, and build a transaction-risk dashboard

⏱ 90 min View Notes →

LECTURE 15Notes

Building Live Dashboards

Fraud operations dashboard, variables, and live ingestion mode

⏱ 90 min View Notes →

LECTURE 16Notes

Alerts in Grafana

Alert rules, contact points, Slack routing & design strategy

⏱ 90 min View Notes →

LECTURE 16 EXTENSIONLab

Live Fraud Dashboard

Run producer and MySQL consumers, then watch transactions and alerts update in Grafana

⏱ 90 min Open Lab →

Module 5 Streaming Decision Systems Lectures 17 – 18

LECTURE 17Project

Multi-Source Surge Pricing

Join demand, driver supply, weather, traffic, and events into an explainable live pricing decision

⏱ 90 minOpen Project →

LECTURE 18Soon

Pricing Explainability & Scenarios

Compare policies, test guardrails, audit fairness, and present a management recommendation

⏱ 90 min

Module 6 Capstone Presentations Lectures 19 – 20

LECTURE 19Soon

Capstone — Part 1

Teams present streaming pipelines — data sources, architecture, live demo

⏱ 90 min

LECTURE 20Soon

Capstone — Part 2

Remaining team presentations, peer review, course wrap-up

⏱ 90 min