Sr Data Engineer (ML Platform)

Job Roles & Responsibilities

As a Sr Data Engineer – ML Platform at Lyric, you will design and maintain scalable data solutions that power our AI platform for supply chains. You will work closely with data science and engineering teams to integrate machine learning models, automate data workflows, and enhance the reliability, performance, and scalability of our data pipelines. Your contributions will directly impact the efficiency and intelligence of enterprise operations.

About the role

We are seeking a highly skilled Sr Data Engineer to join our ML Platform team. You will build and optimize data pipelines, collaborate with data science teams, and ensure seamless deployment of machine learning solutions. This role requires strong expertise in workflow orchestration tools, scalable architecture design, and a passion for continuous improvement in data engineering practices.

Key responsibilities

• Design, implement, and maintain scalable and robust data solutions using Apache Airflow and Prefect.

• Optimize data pipelines to enhance performance, reliability, and scalability of the ML platform.

• Collaborate with data science teams to integrate machine learning models into production pipelines.

• Automate and streamline data workflows in line with best practices.

• Monitor, troubleshoot, and maintain end-to-end data pipelines.

• Document processes, standards, and workflows for data engineering and ML platform operations.

• Enhance system architecture to support evolving enterprise AI supply chain solutions.

• Ensure data quality, consistency, and governance across the platform.

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Engineering, Data Science, or a related field.

• Strong experience with Apache Airflow, Prefect, and workflow orchestration for production pipelines.

• Proficient in Python, SQL, and modern data engineering frameworks.

• Hands-on experience with building and optimizing data pipelines for machine learning platforms.

• Familiarity with cloud platforms (AWS, GCP, or Azure) and scalable architecture design.

• Strong problem-solving skills and ability to communicate complex technical insights clearly.

• Experience with data modeling, ETL design, and automated workflow systems.

• Ability to adapt quickly in a dynamic product and enterprise AI environment.

What we offer

• Opportunity to work with cutting-edge AI solutions transforming global supply chains.

• Collaborative, innovative, and fast-paced work environment.

• Competitive salary and benefits package.

• Career growth and learning opportunities in AI and data engineering.

• Be part of a mission-driven company delivering intelligence and efficiency at scale.