Databricks Data Engineer

About This Role

We are seeking a Databricks Data Engineer to join our growing data practice. In this role, you will design and maintain pipelines, implement Delta Lake best practices, and collaborate with data scientists and analysts to deliver enterprise-grade data solutions.

Key Responsibilities

• Develop and optimize ETL/ELT pipelines using Databricks and Spark

• Implement Delta Lake for ACID transactions and performance improvements

• Collaborate with data scientists on ML-ready datasets

• Ensure data governance and compliance using Unity Catalog

• Monitor and troubleshoot data pipelines in production

Requirements

• 5+ years of experience in data engineering

• Strong proficiency in Apache Spark, PySpark, and SQL

• Hands-on experience with Databricks Lakehouse

• Solid knowledge of cloud data storage (S3, ADLS, GCS)

• Bachelor’s degree in Computer Science, Data Engineering, or related field

Preferred Qualifications

• Databricks certifications (Data Engineer Professional, Lakehouse Fundamentals)

• Experience with MLOps and MLflow

• Knowledge of streaming data pipelines (Kafka, Kinesis)

• Background in financial services or healthcare data pipelines

What We Offer