Senior Data Engineer (Flink)

Builds and runs real time streaming pipelines, keeping latency low and jobs recoverable at high volume.

Strong hands on Apache Flink across DataStream API and Flink SQL. Event time processing, checkpointing, savepoints, and state management in production. High volume Kafka streaming. Data modelling for analytics and streaming into a lakehouse. Monitors pipeline health and handles recovery when jobs fail.

Requirements

Requirements

pache Flink (DataStream, Flink SQL), Kafka, Java, Scala, Python, SQL, Docker, Kubernetes

Strong hands-on experience with Apache Flink, including DataStream API and Flink SQL. Experience with high-volume Kafka streaming and real-time data processing. Strong knowledge of event time processing, checkpointing, savepoints, and state management. Experience with data modelling for analytics and streaming into a lakehouse. Experience monitoring pipeline health and handling job recovery and failures. Apache Iceberg or other open table formats. Airflow. On premises or self managed cluster experience.