# Robotics Researcher, Evaluations

Canonical page: https://efference.ai/careers/senior-rse-model-inference-evaluation/

Robotics Researcher, Evaluations at Efference. San Francisco · Full time · On-site. You'll determine how changes in Efference's perception and compute infrastructure affect what robots can actually do.

You'll determine how changes in Efference's perception and compute infrastructure affect what robots can actually do. You'll design experiments that connect camera quality, compression, timing, network behavior, and inference performance to reliable task completion on physical robots.

## What you’ll do

- Build a suite of manipulation and mobile-robot tasks with clear success criteria, repeatable starting conditions, and representative failure cases.
- Integrate and evaluate learned policies, including vision-language-action and imitation-learning models, across local and remote inference configurations.
- Run controlled studies of bitrate, image processing, observation age, synchronization error, latency, and jitter, separating their effects from changes in the policy.
- Measure task success, intervention rate, completion time, and recovery behavior with enough repeated trials to distinguish improvements from noise.
- Maintain versioned datasets, checkpoints, environments, and run metadata; use held-out tasks or scenes to test whether results generalize.
- Investigate failures with imaging, wireless, controls, and ML engineers, then turn the findings into product requirements and reproducible regression cases.

## What we are looking for

- Hands-on experience deploying and evaluating learned policies on physical robots.
- Strong Python skills and familiarity with a modern ML framework, robot middleware, and the practical debugging of perception-to-action systems.
- Understanding of experimental design, statistical uncertainty, dataset leakage, and the limits of aggregate benchmark scores.
- Ability to isolate failures across sensor input, model behavior, control, and hardware instead of attributing every failure to the model.
- A record of turning research questions into experiments that others can reproduce and use to make engineering decisions.

## Nice to Have

- Experience with VLA, diffusion, or flow-based policies and robot learning datasets or evaluation frameworks.
- Work on robustness, distribution shift, sim-to-real transfer, or policy performance under sensor and network impairments.
- Experience building automated robot test stations, ground-truth instrumentation, or large-scale evaluation pipelines.