Senior Data Engineer

About the role

The Senior Data Engineer will design, build, and maintain scalable data pipelines and platforms using Microsoft Fabric and Azure SQL. You will be responsible for the end‑to‑end medallion architecture (Bronze, Silver, Gold) that powers analytics, AI, and business decision‑making.

Key responsibilities

• Design, build, and optimise the medallion architecture (Bronze, Silver, Gold) in Microsoft Fabric, including Lakehouse, Warehouse and Dataflows Gen2.
• Enforce engineering best practices such as versioning, CI/CD, and Git‑based recovery workflows.
• Create a reusable, API‑led integration layer for source systems like Premier, Salesforce, Oracle Primavera Cloud and Azure SQL.
• Develop ingestion frameworks for structured and semi‑structured data via REST APIs.
• Curate, validate and optimise datasets for machine‑learning model training, feature engineering, AI pricing intelligence and forecasting.
• Implement data quality gates, automated monitoring, alerting and lineage across all layers.
• Maintain data residency, in‑tenant security and role‑based access control.
• Collaborate with analysts and business stakeholders to translate requirements into scalable data solutions and provide runbooks, documentation and quality scorecards.

Required profile

• Bachelor’s degree in Computer Science, Data Engineering or related field (Master’s preferred).
• 10+ years of data engineering experience with hands‑on work in Microsoft Fabric and AI data preparation.
• Domain experience in construction, contracting, fit‑out or engineering design is highly desirable.

Required skills

• SQL
• Python
• Apache Spark
• Power Query
• REST APIs
• Git
• Microsoft Fabric (Lakehouse, Warehouse, Dataflows Gen2)
• Azure services: Functions, Service Bus, Key Vault, Blob Storage
• Infrastructure as Code
• CI/CD pipelines