Software Engineer – Data Infrastructure & Acquisition

About the role

We are looking for a Software Engineer who will own the design and operation of large‑scale data ingestion and acquisition systems that feed next‑generation AI models. Working fully remotely, you will collaborate with engineers, researchers and product leaders to build robust pipelines for high‑volume audio and text datasets.

Key responsibilities

• Design, build and maintain scalable data ingestion and processing pipelines.
• Extend and manage cloud infrastructure on GCP using Infrastructure‑as‑Code (Terraform).
• Identify, integrate and operationalize new external data sources, including audio and web‑crawled datasets.
• Collaborate with AI scientists and engineering teams to improve data quality, reduce cost and increase throughput.
• Optimize systems for cost efficiency, reliability and high‑throughput at scale.
• Contribute to architectural decisions and roadmap for long‑term data infrastructure scalability.

Required profile

• Strong software engineering background with experience in distributed systems or backend production environments.
• Hands‑on experience with Python development on Linux.
• Proficiency with Google Cloud Platform and IaC tools such as Terraform.
• Familiarity with Docker and large‑scale data pipeline or web‑crawling implementations.
• Ability to thrive in fast‑paced, ambiguous environments and manage multiple priorities.
• Excellent communication and collaboration skills across technical teams.

Required skills

• Python
• Linux
• Google Cloud Platform (GCP)
• Terraform
• Docker
• Large‑scale data pipelines
• Web crawling (optional)