The following is the representation of the Kafka Connect cluster distributed architecture details:
In the preceding diagram, we can see the following details:
- We have source Connector 1, with three tasks: Task 1, Task 2, and Task 3. These three tasks are spread out among four workers: Worker 1, Worker 3, and Worker 4.
- We also have source Connector 2, with two tasks: Task 1 and Task 2. These two tasks are spread out between two workers: Worker 2 and Worker 3.
- We also have sink Connector 3 with four tasks: Task 1, Task 2, Task 3, and Task 4. These four tasks are spread out among four workers: ...
