Responsibilities

• Set up and administer Kafka clusters, including installation, licensing, and configuration for UAT and PROD environments
• Monitor cluster health using Confluent Control Center, Cloudera Manager, Prometheus, Grafana, and Splunk
• Deploy and manage monitoring tools and troubleshoot stream‑based application issues
• Orchestrate services with Kubernetes and containerise workloads using Docker
• Implement infrastructure as code with Terraform, Concourse, and Veracode for security scanning
• Maintain cluster across all environments: add/remove nodes, rebalance, and perform regular failover drills
• Set up DevOps pipelines with CI/CD for Kafka deployments using Ansible
• Integrate Azure Databricks, on‑premises Hadoop, Spark, and other data pipelines
• Prepare and execute load and performance tests to validate cluster stability and best practices
• Configure security and protocol set...