Data Platform Engineer Apache Iceberg

Apache Iceberg and Spark define this Data Platform Engineer opportunity at Hyve Solutions. Build cloud-native data infrastructure at PB scale.

This experienced Data Warehouse SE will evolve Hyve’s enterprise platform from Hadoop and Hive toward a Lakehouse architecture. The work emphasizes platform engineering, distributed data systems, Kubernetes, object storage, and large-scale processing. You will support batch, streaming, and incremental workloads while developing core platform capabilities.

Key Responsibilities:

• Design and operate an Apache Iceberg Lakehouse platform
• Migrate Hadoop and HDFS to cloud-native object storage
• Develop metadata, catalog, governance, and multi-engine access services
• Optimize Spark performance, scalability, reliability, and cost efficiency
• Operate Kubernetes data platforms and integrate Azure, Databricks, and Snowflake

Requirements:

• Expert knowledge of Apache Spark execution and optimization
• Strong Apache Iceberg, Hudi, or Delta Lake experience
• Hands-on Kubernetes and Spark on Kubernetes experience
• Cloud object storage knowledge and distributed systems expertise
• At least three years in large-scale data platform engineering

Apply your Spark, Iceberg, Kubernetes, and cloud-native platform expertise to Hyve Solutions’ enterprise data evolution.