01. System Design

systemdesign distributedsystem books systemdesign/concepts

Introduction to System Design

What Is System Design

System design is the process of defining the elements of a system, as well as their interactions and relationships, in order to satisfy a set of specified requirements.

In software engineering, system design is a phase in the software development process that focuses on the high-level design of a software system, including the architecture and components.

System Design Roadmap
System Design Primer

Index

Acing the System Design Interview Book

1. System Requirements
   1. 02 - Scalability
      • Proxy, Reverse Proxy and Load Balancer
      • Session Store
   2. 03 - Availability
   3. 04 - Fault-Tolerance
      • Circuit Breaker
   4. 05 - Latency and Throughput
      • Latency Metrics, From First Principles
      • Latency, Tail Latency and Response time in DS
      • Tail Latency
   5. 06 - Consistency
      • Eventual Consistency
      • Linearizability
      • Gossip Protocol
      • zookeeper
   6. 07 - Accuracy
   7. 08 - Complexity and Maintainability
   8. 09 - Cost
   9. 10 - Security and Privacy
2. Databases
   1. ACID Principles
      • ACID - Isolation
   2. CAP Theorem
      • PACELC Theorem
   3. Row-Based and Column-based Database
   4. Redis
   5. DynamoDB
      • DynamoDB Deep Dive for System Design Interviews
      • Dynamo - Amazon’s Highly Available Key-value Store
      • DynamoDB Streams
   6. Cassandra
3. Netwoking Essentials
   1. HTTP
   2. QUIC Protocol
   3. Server Sent Events

---

Arpit System Design Course Note

• Database Scaling, Sharding and Replication

  • Database Scaling - Supplementary

• AF06.1 - NoSQL Databases

  • Picking the right database

• Caching

  • Redis
  • Hazelcast

• Message Queues, Message Streams

  • Message Broker
  • Publisher-Subscriber Architecture

• 02 - Scalability > Load balancer

  • Client SIde Load Balancing

• Circuit Breaker

• Data Redundancy and Recovery

• DS02.4 - Client Server

  • 1009-TCP
  • 1202-UDP
  • Websocket

• Blob Storage and S3

  • Azure Blob Storage
  • How S3 Works
  • 09 - S3
  • S3 Tables

• Bloom Filters

  • Cuckoo Filters

• Consistent Hashing

• Big Data Processing

  • Batch Processing and Stream Processing
  • Event Streaming
  • Apache Kafka
  • Apache Flink

• Designing e-commerce product listing

• Designing Rate Limiter

• Designing a Notification Service

• Designing real-time abuse masker

• Designing Tinder Feed

• Designing Twitter Trends

• Designing URL Shortners

• Designing PasteBin

• Designing Fraud Detection

• Designing a Recommendation engine

• Designing a Web Crawler

• Designing Facebook News Feed

• Designing Ad Click Aggregator

• Designing Whatsapp

• Designing Top-K Youtube videos

• Designing TicketMaster

• Designing Dropbox

• Designing Uber

Extras

• Robustness Principle (Postel’s Law)
• HyperLogLog
• C4 Model
• Searching Techniques
• N+1 Problem in ORM
• Erasure Coding

System Design Interview Book

Volume 01

• Introduction - First Three Chapters
• Design a Rate Limiter
• DESIGN CONSISTENT HASHING
• Design a Key-Value Store
• DESIGN A UNIQUE ID GENERATOR IN DISTRIBUTED SYSTEMS
• DESIGN A URL SHORTENER
• DESIGN A WEB CRAWLER
• DESIGN A NOTIFICATION SYSTEM
• DESIGN A NEWSFEED SYSTEM
• DESIGN A CHAT SYSTEM
• DESIGN A SEARCH AUTOCOMPLETE SYSTEM
• DESIGN YouTube
• DESIGN Google Drive

Volume 02

• Proximity Service
• Nearby Friends
• Google Maps
• Distributed Message Queue
• Metrics Monitoring and Alerting System
• Aggregate Ad Click Events
• Hotel Reservation System
• Distributed Email Service
• S3-like Object Storage
• Real-time Gaming Leaderboard
• Payment System
• Digital Wallet
• Stock Exchange

System Design Domain Knowledge

System Design Course - Domain Knowledge | Learn from Ex-Google Engineers

Fundamentals of Transactions & Distributed Systems

• Database Transactions (ACID, Practical Applications)
• Database Isolation Levels + Optimistic Locking
• Distributed System Theory
• CAP Theorem & PACELC
• Consensus Algorithms (e.g., Paxos, Raft)
• Distributed Transactions

Geospatial Search

• Introduction to Geospatial Search
• Geohash
• QuadTrees
• Space-Filling Curves (incl. Hilbert Curve)
• Google’s S2 Geometry Library
• Designing a Map Rendering Service
• Review + Mini project (design a local POI finder)

Search Engine Mechanics + File Systems

• Inverted Index basics
• Building a Simple Inverted Index
• ElasticSearch: Core Components
• Advanced Search Applications using ElasticSearch
• File Chunking
• Build a mini search engine + chunking simulation

Media Systems, Security & Probabilistic Data Structures

• Video Transcoding and Playback
• Unique ID Generators
• Security Practices in Software Development
• Bloom Filters (Intro + Advanced Techniques)
• Count-Min Sketch (1 & 2)
• HyperLogLog
• Review + Final Project (Design a system using a probabilistic structure)

---

Transclude of system-design.base