Azure Data Engineer

Strong hands-on experience with Azure Data Factory (ADF), Azure Databricks, Python, PySpark, SQL, and Azure cloud services. Expertise in developing scalable data ingestion, transformation, and orchestration pipelines using Databricks and Apache Airflow. Experience implementing Medallion Architecture (Bronze, Silver, Gold), Delta Lake, and reusable data engineering frameworks. Develop reusable Databricks notebooks, data transformation components, orchestration workflows, and automated data quality checks. Strong experience with Azure DevOps, Git, CI/CD pipelines, and automated deployment processes. Experience with Spark performance tuning, pipeline troubleshooting, data reconciliation, and workload optimization. Knowledge of data governance, metadata management, Unity Catalog, and enterprise data engineering best practices.

#J-18808-Ljbffr