Het Patel

Teaching robots to see, learn, and find their way.

Portrait of Het Patel

About me

I’m a robotics engineer, and most of my work sits where state estimation, semantic mapping, and autonomous navigation meet real hardware. I like the problems that only show up once a robot leaves the lab: clocks that drift apart, sensors that get knocked out of alignment, and maps that go stale the moment someone moves a pallet.

Right now I’m a Founding Robotics Engineer at Operation Autopilot, where I own the C++/ROS 2 autonomy stack for a mixed fleet of custom AMRs, Unitree Go2 quadrupeds, and a Unitree G1 humanoid. A lot of my time goes into estimation: a GTSAM/iSAM2 factor graph that fuses IMU preintegration, visual tracking, leg kinematics, and wheel odometry, with PTP keeping every sensor on the same clock. On top of that I built AUTO-MAP, a shared 3D metric-semantic map where CLIP, DINOv2, and VLM features live in a scene graph that remembers when things changed, so a robot can answer a plain-language question about a building on its own Jetson Thor. I also set up the unglamorous half that keeps a fleet alive: CI on every PR, rosbag replay regressions, Docker images, and over-the-air deploys with rollback.

Before that I spent about a year at Vinayak Technology on a team building construction AMRs that had to work without GPS. I wrote C++ ROS 2 drivers, calibration, and custom Nav2 planner and controller plugins, and extended LIO-SAM and FAST-LIO2 with NDT prior-map alignment, loop closure, and online extrinsic recalibration for the days a sensor mount took a hit. An Isaac Sim twin with tuned inertia, contact, and actuator models let us debug the robot before driving out to site.

Earlier, at ISRO, I worked on software for a SAR payload data recorder and on Gaganyaan crew-cabin display software in C++ and OpenGL ES. At Samsung R&D I benchmarked detectors and deployed a TensorRT-optimized YOLOv4 on smart-refrigerator edge hardware, which earned an Excellence Award.

During my master’s I kept coming back to two things. One was pedestrian-aware driving on a real Polaris GEM e4: first AutoShield, a TTC-gated yield and stop supervisor, then Adapt, where an 8.18M-parameter diffusion model forecasts pedestrians five seconds out and GPU-accelerated MPPI plans around them. The other was contact-rich manipulation, like a contact-gated residual SAC policy that seats a USB-A plug on a UR5e. These days that curiosity looks like training manipulation policies, trying VLA models on everyday tasks, tinkering with human-robot interaction, and deploying world models on whatever robots I can get running.

I have a master’s in Autonomy and Robotics from the University of Illinois Urbana-Champaign and a B.Tech in Electronics and Communication Engineering from VIT. The full write-ups, films, and code are in projects.

Projects

Adapt: Multi-Agent Diffusion Forecasting and MPPI-Based Autonomous Driving preview

Adapt: Multi-Agent Diffusion Forecasting and MPPI-Based Autonomous Driving

[Navigation] ROS 2, Diffusion, MPPI

Architected a multimodal perception-to-control autonomy stack for the Polaris GEM e4, integrating LiDAR–RGB-D pedestrian fusion, GNSS/INS state estimation, open-vocabulary 3D goal localization, and diffusion-based motion prediction with TTC-driven safety supervision to support pedestrian-aware navigation while maintaining independent yielding and stopping safeguards.

Team predictor · 0.302 m minADE-20 · offline AV2

Contact-Gated Residual Reinforcement Learning for Submillimeter Robotic USB Insertion preview

Contact-Gated Residual Reinforcement Learning for Submillimeter Robotic USB Insertion

[Manipulation] SAC, MuJoCo, ROS 2

Addressed the precision gap between vision-language manipulation and contact-constrained assembly through hierarchical control that separates coarse approach planning from learned insertion corrections, enabling submillimeter USB-A seating in a real-robot demonstration using a scripted approach policy, with OpenVLA integration evaluated separately in simulation.

UR5e demo · scripted approach, learned insertion

AutoShield: Multimodal Pedestrian Motion Prediction and TTC-Gated Autonomous Control preview

AutoShield: Multimodal Pedestrian Motion Prediction and TTC-Gated Autonomous Control

[Navigation] ROS 2, Sensor fusion, Control

Developed an integrated perception-to-actuation autonomy stack on the UIUC GEM vehicle, addressing the fundamental limitations of reactive pedestrian avoidance through short-horizon motion prediction and anticipatory collision-risk assessment, enabling context-aware speed adaptation, conservative handling of uncertain observations, and supervised vehicle operation.

53/58 supervised mixed team trials · safety driver

Open-Vocabulary Zero-Shot 6D Object Pose Estimation and Tracking preview

Open-Vocabulary Zero-Shot 6D Object Pose Estimation and Tracking

[Perception] FoundationPose, VLM, SAM-3

Bridged natural-language object selection with manipulation-oriented spatial reasoning, transforming semantic descriptions into object-specific segmentation masks and geometrically grounded 6-DoF poses without requiring instance-specific model training. Evaluated on YCB-Video, achieving 76.5–100% ADD-S AUC across two objects, demonstrating the potential for language-directed robotic perception in cluttered environments.

88.31% mean ADD-S AUC / 44-evaluation subset

C.A.R.E.: ROS 2 Humanoid Teleoperation Through AR Spectacles preview

C.A.R.E.: ROS 2 Humanoid Teleoperation Through AR Spectacles

[Manipulation] ROS 2, AR, Human–robot interaction

Assistive robotics prototype combining Snap Spectacles, live camera feedback, and humanoid control to explore assistance for people with limited mobility; contributed Gemini VLM experiments while collaborating with teammates responsible for SLAM/navigation and the AR communication interface.

CLIP-Grounded Vision–Language–Action Learning for Humanoid Loco-Manipulation preview

CLIP-Grounded Vision–Language–Action Learning for Humanoid Loco-Manipulation

[Manipulation] HumanVLA, CLIP, Isaac Gym

Addressed long-horizon, language-conditioned humanoid object rearrangement under partial observability, connecting semantic scene understanding with coordinated locomotion, grasping, and object placement without privileged environment states; structured evaluation across 615 HITR task configurations spanning four simulated indoor environments.

Solar panel cleaning robot preview

Solar panel cleaning robot

[Systems] ESP32, Qt, Embedded

A tracked cleaning prototype with integrated actuation, wireless control, and a Qt dashboard.

SAE INDIA / Aircraft design preview

SAE INDIA / Regular class aircraft

[Systems] CAD, Aerodynamics, Fabrication

A parasol-wing aircraft developed with Aviators International for the SAE INDIA Aero Design competition.

Wildlife conservation drone preview

A drone for wildlife conservation

[Systems] Pixhawk, System design, Raspberry Pi

A conservation hexacopter design exploring surveillance, a perching mechanism, and medication-support missions.

Experience

Operation Autopilot

Company tenure: May 2026 – Present

Founding Robotics Engineer

Building semantic SLAM for changing facilities: fast geometric SLAM on the robot, asynchronous open-vocabulary perception, and a scene graph a VLM can query.

More about the work
  • Developing autonomous navigation using semantic SLAM for AutoMap, connecting local visual maps with facility graphs and cloud VLM environmental reasoning.
  • Deploying local navigation on Jetson Orin Nano and integrating cloud-assisted lost-localization recovery. Sub-10-second recovery is an engineering target, not a reported benchmark.
  • Contributing to team VLM fine-tuning for physical agents and environmental reasoning.

Vinayak Technology

Jul 2024 – Aug 2025

Robotics Engineer

ROS 2 navigation for material transport on GPS-denied construction sites. Sensor integration, localization, and simulation-to-field work.

More about the work
  • Developed and deployed ROS 2 navigation for construction-site material transport over GPS-denied routes longer than 200 m, connecting perception, localization, planning, and control.
  • Integrated LiDAR, IMU, wheel encoders, and RGB-D cameras through custom ROS 2 drivers; co-defined sensor placement and implemented online extrinsic calibration for realignment after on-site impacts.
  • Developed LiDAR–inertial localization and NDT alignment workflows with LIO-SAM and FAST-LIO2 for repetitive geometry in approximately 2,000 m² mapped environments.
  • Built an Isaac Sim digital twin with tuned inertia, contact, and actuator models to compare simulated trajectories with field behavior during commissioning.

ISRO

May 2023 – Jan 2024

Embedded Software Research Intern

C++/Qt recorder interfaces, hardware diagnostics, and cabin-display software for space systems.

More about the work
  • Replaced a legacy recorder interface with a C++/Qt operator application for an indigenous SAR Solid State Recorder, using UART/RS-232 commands and USB 2.0 downloads.
  • Implemented recording controls, file management, recorder-status diagnostics, and bad-block controls for hardware checkout.
  • Contributed to Gaganyaan cabin-display software using C++, OpenGL ES, and PetaLinux on a Xilinx platform.

Samsung Research

Dec 2022 – Jun 2023

Research & Development Intern · Hybrid

Computer vision for food recognition, with YOLOv4 and TensorRT in an on-device inference pipeline.

More about the work
  • Benchmarked YOLOv4, R-CNN, and BiT for smart-refrigerator food recognition; selected and deployed YOLOv4 with TensorRT in the device inference pipeline.
  • Built a pipeline synchronizing on-device detections with cloud inventory records; received a Samsung PRISM Excellence Award.

Education

University of Illinois Urbana-Champaign

Master’s in Autonomy and Robotics

Completed

Vellore Institute of Technology

B.Tech in Electronics and Communication Engineering

Sep 2020 – May 2024

Print-friendly résumé ↗