Senior Data Engineer

About the role

Devsinc is looking for a Senior Data Engineer with 4-6 years of professional experience to design, build and maintain scalable data pipelines and processing systems that support analytics, data products and AI/ML capabilities. The engineer works with Product, Business Intelligence, Data Science and Engineering teams to deliver production-ready datasets and high-performance data solutions.

Key responsibilities

• Design, develop and maintain scalable ETL/ELT pipelines for data ingestion, transformation, validation and delivery.
• Build, schedule and orchestrate production-grade workflows with Apache Airflow; write distributed jobs with Apache Spark.
• Write efficient, reusable Python code for data processing, automation and pipeline development.
• Develop and optimize complex SQL queries, and design pipelines for structured, semi-structured and unstructured data.
• Implement Redis for caching and high-performance data access, and integrate data from APIs, databases, files and third-party sources.
• Set up data validation, monitoring, logging, error handling, alerting and pipeline observability.
• Optimize performance, storage, processing time and infrastructure costs, and build reusable frameworks instead of one-off scripts.
• Troubleshoot failures, bottlenecks and data-quality issues, and establish engineering standards and documentation.

Required profile

• Bachelor's degree in Computer Science, Software Engineering, Data Science or a related field.
• 4-6 years of professional experience in Data Engineering or a closely related role.
• Strong hands-on experience with production-grade ETL/ELT pipelines and large datasets.
• Preferred: cloud platforms (AWS, Azure, GCP), PostgreSQL or data warehouses, geospatial data, CI/CD and infrastructure-as-code, and experience supporting data products or AI/ML pipelines.

Required skills

• Python and advanced SQL
• Apache Airflow and Apache Spark
• Redis, caching strategies and data modelling
• Familiarity with Linux, Git and Docker/containers