About
Senior Kafka Administrator and Hadoop Platform Engineer with 7+ years of hands-on experience supporting large-scale, mission-critical data platforms in 24x7 production environments. Strong expertise in Confluent Kafka, Apache Kafka, Hadoop (CDH/HDP/CDP), AWS, and Linux-based infrastructure. Proven track record in high availability, disaster recovery, capacity planning, performance optimization, incident response, and SLA-driven operations. Adept at implementing enterprise security (Kerberos, Ranger, ACLs) and ensuring platform reliability and scalability.
Skills & Expertise (41)
Work Experience
Kafka Administrator
CBTS Technology Solutions India
Jun 2023 - Present
Administer and support enterprise Confluent Kafka clusters across Development, Staging, Production, and Disaster Recovery environments. Manage Kafka topics, partitions, replication factors, Schema Registry schemas, ACLs, and Kafka Connect source/sink connectors. Implement and maintain Kafka security using Kerberos, service accounts, and role-based access control. Monitor platform health, throughput, and latency using DataDog, ensuring 99.9% availability. Perform incident response and root cause analysis for production issues and outages. Install, configure, and upgrade Confluent Kafka on RHEL 8 and RHEL 9 systems. Support DR readiness, failover validation, and SLA compliance for business-critical applications.
Senior Engineer – Platform & Big Data Infrastructure
Margo Networks Pvt. Ltd.
Feb 2022 - Jun 2023
Managed HDP-based Hadoop clusters, Apache Kafka, Ceph storage, and Proxmox VE virtualization platforms. Installed, configured, and optimized Kafka, Hadoop, NiFi, Ceph, Nginx, HAProxy, and Filebeat in production. Led platform upgrades and patching activities, reducing downtime and operational risk. Implemented HA for NameNode and ResourceManager, improving system resilience. Conducted performance tuning, capacity planning, and system optimization to support growing workloads. Administered VMware and Proxmox clusters, including HA configuration and VM lifecycle management. Created operational runbooks and maintained Confluence documentation for support teams.
Project Lead – Big Data Platform (Designation: Principal)
Brahmdevdada Mane Polytechnic
Dec 2018 - Dec 2021
Led a banking data platform project, managing a cross-functional team including shift planning, recruitment, payroll coordination, and team operations. Acted as primary point of contact for platform, infrastructure, and production issues. Administered Hadoop ecosystem (HDFS, YARN) and Apache Kafka stack. Designed and implemented highly available Hadoop and Kafka architectures. Managed cluster lifecycle including capacity planning, scaling, and node management. Performed RCA for failed jobs and optimized platform stability. Managed on-prem infrastructure, including team setup and operational readiness.
Education
Master of Technology (M.Tech) – Computer Science & Engineering - D.Y. Patil College of Engineering & Technology
- · Afghanistan
Bachelor of Engineering (B.E.) – Computer Science & Engineering - SVERI’s College of Engineering
- · Afghanistan
Certifications
No certifications added yet
Interested in this developer?
Profile Score Breakdown
Profile Overview
Availability Details
Visa Status
Need Sponsorship
Relocation
Depends on Offer
Skills (41)
Click a skill to find developers with the same skill
