Job description
Software Engineer (Model Evaluation & Benchmarking)
San Francisco, California (Hybrid)
$140,000 - $170,000 + Equity + Healthcare + 401(k) + PTO
Are you a Software Engineer interested in working on the systems that measure and validate cutting-edge AI models before they reach production, while joining a high-growth AI start-up at an exciting stage of expansion?
This is an opportunity to join a high-growth AI company building advanced computer vision and generative AI systems used by global brands. The engineering team is focused on developing reliable multimodal AI platforms where model performance, consistency, and reliability are critical for real-world deployment.
In this role, you will build evaluation and benchmarking systems that test generative and vision models across image, video, and multimodal pipelines. You will work closely with researchers and ML engineers to ensure new models meet production-quality standards and that regressions are quickly detected as systems evolve.
This role would suit a software engineer who enjoys building infrastructure, testing frameworks, and evaluation tooling for complex machine learning systems.
The Role:
*Build automated evaluation pipelines for AI and vision models
*Develop benchmarking systems for generative and multimodal models
*Detect regressions across model checkpoints and versions
*Design metrics for model realism, consistency, and performance
*Integrate evaluation tooling into CI/CD and deployment workflows
The Person:
*Strong programming skills in Python
*Experience building testing frameworks or benchmarking tools
*Understanding of machine learning experimentation workflows
*Experience working with data analysis tools such as NumPy or Pandas
*Interest in computer vision, generative AI, or multimodal systems
Reference Number: BBBH270868
To apply for this role or to be considered for further roles, please click "Apply Now" or contact Ben Herridge at Rise Technical Recruitment.
Rise Technical Recruitment Inc of 1011 Centre Rd, Suite 322, Wilmington, DE 19805 act as an employer-paid private personnel agency.
The salary advertised is the bracket available for this position. The actual salary paid will be dependent on your level of experience, qualifications and skill set and will be decided by our client, the employer. Rise are not responsible or liable for any hiring decisions made by the end client.
We are an equal opportunities company and welcome applications from all suitable candidates.
