Technical Lead, Data Infrastructure Primary Duties:
- Work closely with internal teams, including those in Simulation and Machine Learning (ML) such as Perception, Prediction, and Planning, to thoroughly understand their requirements and use cases.
- Evaluate, integrate, and enhance both open-source tools (like Apache Spark, Ray, Apache Beam, and Argo) and internal proprietary solutions.
- Create, develop, and refine scalable computing solutions by programming and validating them in practical settings.
- Lead and manage infrastructure engineering teams.
- Clearly communicate the technical vision, while providing mentorship and producing documentation to support the adoption of the platform.
- Proficiency in Python is essential; C++ experience is strongly preferred.
- Hands-on experience with distributed computing frameworks, including Apache Spark, Ray, Apache Beam, Apache Airflow, Argo Workflows, and Kubernetes.
- Proven leadership in the design, architecture, and development of data processing infrastructures.
- Outstanding communication and collaboration skills.
