Overview: Tek Ninjas is a global software consulting and digital services company built for speed, scale, and innovation, headquartered in Carrollton, Texas. Our client operates in the Finance industry.
Job Title: Lead Azure Data Engineer – Data Factory & Databricks
Location: Houston, Texas 77079
Duration: 6 Months
Job Type: Contract
Work Type: Onsite
Job Description:
THE ROLE:
The Lead Azure Data Engineer will design, develop, test, and optimize scalable data integration and processing solutions. The role includes building Azure Data Factory pipelines and data flows, developing Azure Databricks notebooks and workflows, tuning SQL queries, managing Delta Lake and ADLS Gen2 data, and supporting CI/CD-based environment promotion. The engineer will collaborate with stakeholders and contribute to reliable, maintainable data platforms.
Key Responsibilities
-
Develop Azure Data Factory pipelines, data flows, triggers, integration runtimes, and parameterized workflows.
-
Build and optimize Azure Databricks notebooks, jobs, workflows, and Delta Lake solutions.
-
Develop modular data engineering code using Python or Scala with unit testing practices.
-
Write and tune advanced SQL queries using CTEs, window functions, and large datasets.
-
Manage data storage and optimization using ADLS Gen2, Parquet, partitioning, Z-Ordering, OPTIMIZE, and VACUUM.
-
Support Git-based CI/CD and promotion across Azure Data Factory and Databricks environments.
-
Collaborate with stakeholders and participate in testing and delivery activities.
Required Skills & Experience
-
8-10 years of data engineering experience
-
At least 3 years of Azure experience
-
Azure Data Factory
-
Azure Databricks
-
Advanced SQL
-
Python or Scala
-
Experience with large datasets and data pipeline optimization
Preferred Skills
-
Agile
-
Infrastructure as Code
-
Terraform
-
CI/CD automation
Tek Ninjas Group is an equal opportunity employer supporting workforce diversity.