System Design

BigCat's Architecture Lab

> Distributed · Scalability · Real-world Case Studies
Day 01Scalability FoundationsVertical/Horizontal · L4/L7 LB · Stateless · Capacity Planning Day 02CachingCache Layers · LRU/LFU/ARC · Cache-aside · Invalidation Day 03Database SelectionSQL/NoSQL · OLTP/OLAP · ACID/BASE · Decision Tree Day 04Database ShardingHash/Range · Consistent Hashing · Hot Spots · Resharding Day 05ReplicationLeader/Multi/Leaderless · Sync/Async · Replication Lag · Failover Day 06ConsistencyLinearizable/Causal/Eventual · CAP/PACELC · HLC · Per-domain Choice Day 07Distributed Transactions2PC/3PC · Saga · Outbox · Idempotency Day 08Message QueuesKafka/RabbitMQ/SQS · Delivery Semantics · Backpressure · DLQ Day 09API DesignREST/GraphQL/gRPC · Pagination · Versioning · Rate-Limit Contract Day 10Rate LimitingToken/Leaky/Sliding/GCRA · Distributed Counters · Multi-dim · 429 Contract Day 11Unique ID GenerationUUIDv4/v7 · Snowflake · ULID/KSUID · Clock Skew Day 12Search SystemsInverted Index · Lucene Segments · Scatter-Gather · Vector HNSW Day 13Recommendation SystemsTwo-Tower Retrieval · Multi-stage Funnel · Cold Start · Generative Rec TIGER Day 14Feed SystemPush/Pull/Hybrid · Fanout Amplification · Timeline Storage · Ranking Pipeline Day 15Chat SystemWebSocket Connections · Bucketed Storage · Delivery Guarantees · E2E Encryption Day 16Video StreamingTranscode Pipeline · Per-Title/Per-Shot · ABR · CDN/Open Connect Day 17Payment SystemsIdempotency Recovery Points · Double-Entry Ledger · Saga/Outbox · 3-Way Reconciliation Day 18Subscription & BillingLifecycle State Machine · By-Second Proration · Usage Metering · Multi-currency & Tax Day 19Geospatial SystemsGeohash/S2/H3 · Grid vs R-Tree · haversine/ETA · Uber DISCO Geo-Sharding Day 20Data Processing (Batch vs Stream)Batch/Stream Unify · Lambda/Kappa · Event-time/Watermark · Exactly-once Day 21Monitoring & ObservabilityMetrics/Logs/Traces · OpenTelemetry Sampling · SLO/Error Budget · Percentile Aggregation Day 22Deployment & ReleaseRolling/Blue-Green/Canary · Canary Analysis · Feature Flags · Expand-Contract Migration Day 23ReliabilityCircuit Breaker FSM · Backoff+Jitter Retry · Bulkhead Isolation · Graceful Degradation & Load Shedding Day 24SecurityAuthN/AuthZ Boundary · OAuth2/OIDC + PKCE · JWT vs Session Revocation · Secret Dynamic Creds Day 25System Design InterviewScoping · 4-Step Framework + Time-boxing · Think Out Loud & Deep Dive · Articulating Trade-offs Day 26Capacity EstimationPowers of 2 + Latency Numbers · DAU→QPS Peak · Storage/Bandwidth/Memory · Assumption Discipline Day 27Cost & Capacity EngineeringQueueing Headroom · Reactive/Predictive Autoscaling · FinOps Attribution · Rightsizing/Spot Tiers Day 28CDN & EdgeAnycast/BGP · Tiered Cache Funnel · Purge/SWR Invalidation · Edge Compute V8 Isolate Day 29File & Object StorageObject vs Block vs File flat keyspace · Replication vs Erasure Coding 11 nines · Multipart + presigned direct upload · Strong metadata consistency & hot partitions Day 30Authorization & Account SystemsRBAC/ABAC/ReBAC relation tuples · Hierarchical inheritance & Zookie revocation · Multi-tenant RLS isolation · Hash-chained tamper-evident audit Day 31Hybrid Search & RerankingBM25 vs dense vectors complementary · Recall/rerank multi-stage funnel · RRF fusion & cross-encoder reranking · Query-biased snippet highlighting Day 32LLM ServingTwo-phase inference & continuous batching · KV Cache/PagedAttention memory bottleneck · Prompt caching & prefix-aware routing · Cost/Latency/Quality triangle Day 33AI Product BackendRAG recall quality contextual+hybrid+rerank · Durable resumable agent loops · Embedding service model/index version locking · Human-in-the-loop approval gate Day 34Real-time SystemsTCP head-of-line blocking & UDP/WebRTC/QUIC channels · Client prediction + server reconciliation + interpolation · Authoritative server tick/delta/AOI state sync · Collab editing OT/CRDT/LWW (Figma) Day 35IoT & EdgeMQTT pub/sub & tiered QoS · Edge reduction + offline buffering · Kafka peak-shaving/decouple/backpressure · TSDB Gorilla compression & cardinality explosion Day 36Blockchain & Distributed LedgerPoW/PoS/BFT consensus & Sybil resistance · Smart-contract determinism + gas + reentrancy · Hash chain/Merkle/off-chain storage availability · Trilemma & L2 Rollups (Optimistic vs ZK) Day 37Multi-tenant SaaSSilo/Pool/Bridge isolation spectrum · Shard by tenant_id + RLS for leak/skew control · Noisy-neighbor per-tenant limiting + fair queues · Idempotent recomputable usage metering Day 38Data Lake & LakehouseLake/warehouse/lakehouse selection & open columnar · ACID on S3 with Iceberg/Delta/Hudi (immutable files + atomic snapshot swap + OCC) · Layered-metadata pruning + time travel + small-file ops · Unified batch/stream COW vs MoR & incremental ETL Day 39Workflow EngineDurable execution: event-sourcing + deterministic replay · Orchestration vs choreography · Saga compensation (semantic undo) + backward/forward recovery · Activity at-least-once + idempotency key + heartbeat/timeout