Principal Data Software Engineer

About the role

The Principal Data Software Engineer will design, develop, and maintain data‑driven systems that power ETL pipelines, backend services, and machine‑learning workflows. This senior position ensures reliable data processing, high quality, scalability, and performance across multiple environments.

Key responsibilities

• Design and implement Python‑based backend services using FastAPI, Django, and Prefect.
• Build, orchestrate, and optimise scalable ETL pipelines and data workflows.
• Transform, clean, and validate data to guarantee accuracy and consistency.
• Design relational database schemas and manage migrations in PostgreSQL.
• Develop and manage machine‑learning pipelines, integrating models into production.
• Containerise applications and oversee deployments with Kubernetes and Helm.
• Create and maintain CI/CD pipelines for automated testing and delivery.
• Implement observability, monitoring pipeline health, performance, and logs.
• Apply data governance, security, and compliance standards.
• Provide production support, incident investigation, and root‑cause analysis.
• Collaborate with data scientists, backend engineers, and DevOps teams.

Required profile

• Bachelor’s degree in Computer Science, Software Engineering, Data Engineering or a related field.
• 6–10 years of professional experience in data engineering.
• Proven experience with Python backend frameworks (FastAPI, Django).
• Hands‑on experience building ETL pipelines using Airflow or Prefect.
• Strong background with relational databases, especially PostgreSQL.

Required skills

• Python
• FastAPI
• Django
• Prefect
• Airflow
• pandas
• PostgreSQL
• SQL
• Docker
• Kubernetes
• Helm
• CI/CD
• Pytest
• Observability tooling
• ML experiment tracking tools