Personalized Recommendation System Architecture

Personalized Recommendation System Architecture An architecture diagram generated by Archify. Client App · Mobile / Web Feed Request · Architecture component Client App Mobile / Web Feed Request Recs Orchestrator · Multi-Stage Controller · Online Recommendation Serving Enclave · Stateless Recs Orchestrator Multi-Stage Controller Stateless Session Cache · Recent Clicks (Redis) · Online Recommendation Serving Enclave Session Cache Recent Clicks (Redis) Candidate Retrieval · Two-Tower ANN Search · Online Recommendation Serving Enclave · 1B to 1,000 Candidate Retrieval Two-Tower ANN Search 1B to 1,000 Vector Database · HNSW / ScaNN Embeddings · Online Recommendation Serving Enclave Vector Database HNSW / ScaNN Embeddings Heavy Ranker · Deep Multi-Task (MMoE) · Online Recommendation Serving Enclave · P(Click), P(Watch) Heavy Ranker Deep Multi-Task (MMoE) P(Click), P(Watch) Online Feature Store · Feast / Redis Low Latency · Online Recommendation Serving Enclave Online Feature Store Feast / Redis Low Latency Re-Ranking & Diversity · MMR & Bandits (Top 20) · Online Recommendation Serving Enclave · Deduplicate Re-Ranking & Diversity MMR & Bandits (Top 20) Deduplicate Event Stream · Kafka Interaction Log · Real-Time Feature & Model Training Enclave Event Stream Kafka Interaction Log Flink Real-Time ETL · 10-min Feature Windows · Real-Time Feature & Model Training Enclave · Stream Stats Flink Real-Time ETL 10-min Feature Windows Stream Stats Offline Training Fleet · Daily PyTorch / Spark · Real-Time Feature & Model Training Enclave Offline Training Fleet Daily PyTorch / Spark Model Registry · S3 / ONNX Model Weights · Real-Time Feature & Model Training Enclave Model Registry S3 / ONNX Model Weights GET /feed Fetch Session Retrieve Candidates Vector HNSW Query Pass Candidates Hydrate Features Pass Top Scored Return Feed Emit Interactions Stream Logs Aggregated Features Publish Weights Online Recommendation Serving Enclave Real-Time Feature & Model Training Enclave Legend Backend Database Message bus External