Senior Data Engineer

Job Summary: Lead Data Engineer

Insight Global is seeking an experienced Data Engineer to help build the next generation of its Retail and Omnichannel Analytics platform. This role combines hands-on data engineering, technical leadership, and architecture across the full analytics lifecycle, including data ingestion, transformation, governance, semantic modeling, reporting, self-service analytics, and AI-enabled data products.

Day-to-Day Responsibilities

• Design and build scalable ingestion, transformation, and data-product frameworks using Databricks and Azure technologies.
• Establish Databricks best practices across Medallion Architecture, governance, performance, data quality, and operational excellence.
• Build batch, near real-time, and streaming pipelines using Databricks, Spark/PySpark, Delta Lake, and Azure Data Factory.

Required Skills & Experience

• 7+ years of Data Engineering experience.
• Strong hands-on Databricks experience in enterprise production environments.
• Advanced experience with Python, SQL, Scala, Spark/PySpark, and Delta Lake.
• Strong experience with Azure Data Factory, Azure DevOps, Git, CI/CD pipelines, and release management.

Nice to Have

• Experience with Unity Catalog, LakeFlow, Delta Live Tables, Databricks SQL, Databricks Genie, and Databricks Workflows.

Duration: 12+ month contract

Compensation: $28-35/hour USD (dependent on years of experience)

"Benefit packages for this role may include healthcare insurance offerings and paid leave as provided by applicable law."