Founding Engineer
Design and build test environments, evaluation harnesses and labeled datasets that measure how AI systems behave across multi-step tasks.
- San Francisco, California, United States
- Full-time
- On-site
- $150K–$300K per year
- Posted Nov 10, 2026
INDUSTRYSoftware & InternetAI & Machine Learning
Responsibilities
- Construct simulated software environments that mimic the tools and workflows automated systems use.
- Build grading logic and evaluation systems that hold up when systems look for shortcuts.
- Create benchmarks whose scores track real-world results.
- Review interaction logs to find and measure previously unrecorded failure patterns.
- Turn findings into reusable datasets and test suites for internal improvement and external partners.
- Support data and training agreements alongside the founders while refining the evaluation tooling.
Requirements
- Experience in a AI
- Experience in a machine learning
Nice to have: startup founding experience, selective fellowship, mathematics, programming, debate, games
Skills
training databenchmarksevaluation systemsdatasetsenvironment buildinggrader designevaluation pitfallsautomation interactionbusiness software replication
Benefits
- Health, dental and vision coverage
- Retirement plan
- Flexible time off
More jobs nearby
Full description
Company details are for members
Sign up for a free job alert to see Raydar's profile, website and LinkedIn, and the same for every employer on Referso Jobs.