Design and implement scalable pipelines to collect and process production ML and LLM traffic from multiple sources;
Define data storage strategies, retention policies, and privacy controls aligned with business and regulatory requirements;
Develop observability, debugging, and monitoring capabilities to support production issue investigation and operational excellence;
Build and maintain evaluation frameworks, automated rating systems, and alerting mechanisms to detect model and prompt performance regressions;
Implement data protection measures, including PII redaction, content safety controls, and end-to-end platform operations.
Requirements
Proven experience building and operating production-grade data or ML platforms, including ingestion, storage, governance, monitoring, and operational support;