Kafka for Administrators Training

Module 1: Introduction to Apache Kafka

• Event Streaming, the motivations ?
• What is Apache Kafka
• The Apache Kafka project
• The key benefits of Kafka
• What is it used for ?
• The alternative solutions
• The Confluent Streaming Platform

Module 2: Kafka Fundamentals

• Broker, Message, Topic & Partitions
• Producers Basics
• Consumers & Consumer Groups
• Replication & Fault-tolerance
• Data retention and compression
• Understanding Zookeeper’s roles
• Understanding Kafka’s performance

Module 3: Replication, Fault Tolerance and Data Reliability

• Understanding Data Replication
• Understanding Replica Placement
• Managing Rack-Awareness
• Broker Controller
• Broker Recovery Process
• Producer’s Delivery Acknowledgment
• Idempotent Producer & Transaction (Exactly Once Semantics)

Module 4: Kafka’s Storage Layer

• Partitions and Segments Log Files
• Managing Page Cache
• Log Retention and Cleanup Policies
• Zookeeper

Module 5: Managing Kafka Consumers

• Consumer Groups
• Managing Offset
• Understanding the Consumer Rebalancing
• Monitoring Consumer Lag

Module 6 : Installing & Administrating a Kafka Cluster

• Installing and Running Kafka
• Managing Cluster Configurations
• Managing Topic Configurations
• Upgrading a Kafka Cluster
• Kafka Cluster Elasticity
• Capacity Planning
• Hardware & Deployment Considerations

Module 7: Deploying Kafka on multiple Data Centers

• Multiple Data Centers Deployment Strategies
• Managing Cross Data Center Replication (MirrorMaker 2)

Module 8: Optimizing a Kafka Cluster for performances

• Tuning Kafka Producers and Consumers
• Tuning Kafka Brokers Write Path
• Tuning Kafka Brokers Read Path
• Managing Kafka Shutdown and Restart
• Testing a Kafka Cluster.

Module 9: Security

• Consumer Groups
• Managing Offset
• Understanding the Consumer Rebalancing
• Monitoring Consumer Lag