Staff Software Engineer, Perception (R5421)
Opens Lever in a new tab
About this role
What You'll Do:
Model Development – Design, train, fine-tune, and maintain state-of-the-art vision, vision-language, and vision-language-action models that improve perception and decision-making for autonomous systems.
Data Pipelines & Model Training – Build scalable data pipelines, supervised fine-tuning (SFT) workflows, and evaluation loops that continuously improve model performance on mission-relevant tasks.
Model Deployment & Optimization – Deploy and optimize machine learning models for embedded hardware using technologies such as ONNX, TensorRT, and hardware-accelerated inference frameworks.
Perception & Autonomy Applications – Apply modern machine learning techniques to solve challenging perception and autonomy problems across aerial and other autonomous systems operating in complex, real-world environments.
Research-to-Production – Translate cutting-edge machine learning research into production-ready capabilities by balancing model performance, robustness, computational efficiency, and operational reliability.
Cross-functional Collaboration – Partner closely with perception, autonomy, platform, and software engineering teams to integrate machine learning capabilities into mission-ready autonomous systems.
Model Evaluation & Validation – Develop benchmarks, testing methodologies, and evaluation frameworks to measure model performance, identify failure modes, and guide future improvements.
Continuous Improvement – Improve training infrastructure, developer tooling, deployment workflows, and model lifecycle management to accelerate experimentation and production delivery.
Required Qualifications:
Typically requires a minimum of 7 years of related experience with a Bachelor’s degree; or 6 years and a Master’s degree; or 4 years with a PhD; or equivalent work experience.
Expertise of machine learning fundamentals.
Experience training an deploying ML models for computer vision in a production setting.
Strong understanding of 3D vision problems/algorithms.
Experience with machine learning frameworks such as PyTorch and TensorFlow.
Demonstrated expertise in deploying models using TensorRT and ONNX.
Proficiency in C++ and Python.
Strong analytical and problem-solving skills, with the ability to translate research into practical applications.
- Ability to obtain a SECRET clearance
Preferred Qualifications:
Experience with developing autonomous systems for defense customers.
Experience with training/finetuning vision-language models, vision-language-action models, and/or world models.
Contributions to open-source projects in machine learning or computer vision.
Track record of publications in leading computer vision and robotics conferences and journals (e.g., CVPR, ICCV/ECCV, RAL, ICRA).
Additional Information
Compensation
$195,200 - $292,800 a year
Skills & Technologies
Opens Lever in a new tab
Job Details
- Company
- Shield AI
- Location
- Washington / DC / USA
- Work Type
- Onsite
- Posted
- July 28, 2026
- Source freshness
- Seen on employer source 23h ago
About Shield AI
Shield AI is building the world's best AI pilot. Their Hivemind AI powers autonomous aircraft for defense applications, enabling drones to fly missions in GPS-denied environments without communications.
View company profileSimilar Physical AI roles
More open roles matched by shared skills, category, or company.
Staff Deep Learning Engineer (R5677)
Shield AI
Senior Staff Deep Learning Engineer (R5675)
Shield AI
Senior Software Engineer, Perception (R5420)
Shield AI