Article 10 min read 2,222 words

Eye-Controlled Robots: What Stretch Shows

Eye-controlled home robots sound like a future feature: look at an object, blink, and the robot helps. The more useful version is less cinematic and much more practical. A person with limited hand movement might use an eye-tracking tablet on a power chair to drive a robot, command an arm, confirm a grasp, or ask for help without waiting for a care partner to stand next to them.

ui44 Team All articles

That is why Hello Robot Stretch 3 is such a useful case study. Stretch is not a mass-market appliance. ui44 lists it as a $24,950 open-source mobile manipulator with a compact 33 x 34 cm footprint, 24.5 kg body, 2 kg payload, 2-5 hour runtime, ROS 2, Python SDK support, depth cameras, navigation LiDAR, and web/gamepad/dexterous teleoperation. But because it is built around real homes, assistive research, and configurable teleoperation, it exposes the interface questions that every future assistive home robot will have to answer.

Eye-controlled assistive home robot interface stack from user intent to fallback
Scroll sideways to inspect the full chart.

The buyer lesson is simple: eye control is not the product. Eye control is one input layer in a larger assistive robot system. The robot still needs enough reach, runtime, feedback, autonomy, and safe fallback to make the command worth issuing.

What Eye Control Actually Solves

Eye tracking can solve a very specific problem: it gives a user a way to express intent when a touchscreen, joystick, keyboard, or phone app is not practical. That intent might be "drive forward," "turn toward the counter," "raise the arm," "open the gripper," or "bring me the item." For some users, gaze plus dwell selection can be faster and less fatiguing than repeated switch scanning. For others, voice may be easier until privacy, speech fatigue, noise, or inconsistent recognition gets in the way.

The hard part is everything after the command. If the user has to select dozens of small motions to retrieve a bottle, scratch an itch, carry a printed page, or move through a crowded room, the interface becomes a burden. A useful robot must compress low-level motions into higher-level actions. The user should not have to micromanage every centimeter of the arm unless they choose to.

Hello Robot Stretch 3 mobile manipulator as a practical baseline for eye-controlled assistive home robots

Stretch shows the shape of that stack. The official Stretch 3 materials describe web teleoperation, gamepad teleoperation, dexterous teleoperation, and open ROS 2/Python autonomy demos. Hello Robot's assistive materials also describe collaborative pilot work with users and care partners, including remote testing and in-home co-design. The important point for buyers is not that one vendor has solved every daily activity. It is that assistive control is a loop: user intent, accessible input, robot execution, feedback, error recovery, and caregiver or remote fallback.

Stretch Is a Better Baseline Than a Humanoid Demo

A humanoid video can look more natural than a wheeled manipulator, but the interface may be less clear. Does the robot understand spoken commands? Does a remote operator step in? Can the user see what the robot sees? Can it be stopped without standing nearby? Can it reach a shelf, table, floor, and cabinet from a seated user's real home layout?

Stretch is visually modest, which is part of its value. The ui44 database records a 141 cm height for Stretch 3, floor-to-cabinet reach, a compliant gripper, gripper and head RGBD cameras, a wide-angle RGB camera, LiDAR, microphone array, Wi-Fi 6E, Bluetooth, Ethernet, and USB. The platform is not pretending to be a general household employee. It is a mobile arm with explicit controls and published limitations.

That matters for accessible control because every hidden assumption becomes a support burden. If a future home humanoid accepts eye commands but cannot reliably align with the counter, detect the target, or recover from a failed grasp, the user still waits for a human. If a wheeled arm is slower but gives a clear camera view, an accessible web interface, and a safe way to stop, it may be more useful for a narrow set of daily tasks.

Robot

Hello Robot Stretch 3

ui44 status
Active, $24,950
Interface lesson
Transparent teleoperation and open software make it easier to adapt inputs such as eye tracking, switches, or caregiver control.

Robot

Hello Robot Stretch 4

ui44 status
Available, $29,950
Interface lesson
Longer runtime, self-charging, stronger payload, and omnidirectional mobility show where assistive pilots are heading.

Robot

Weave Isaac 1

ui44 status
Pre-order, $7,999 or subscription
Interface lesson
A task-specific home robot can hide much of the interface burden if the task is narrow enough.

Robot

1X NEO

ui44 status
Pre-order, $20,000 early-adopter price
Interface lesson
A soft humanoid form may be appealing, but buyers still need clear disclosure about app control, autonomy, and recovery.

Robot

NEURA 4NE-1 Mini

ui44 status
Pre-order, EUR19,999 standard / EUR29,999 Pro
Interface lesson
Teleoperation and dexterous hands may require the higher tier, so interface claims need SKU-level reading.

The table is not saying these robots compete directly. They do not. It is showing the buyer frame: form factor matters less than the control contract. A laundry robot, a mobile manipulator, and a humanoid all need to answer who is in control, how the user gives intent, what the robot does autonomously, and how failures are handled.

Stretch 3 vs Stretch 4: Why Hardware Still Matters

Interface discussions can become software-only very quickly. That is a mistake. Accessible control lives inside physical constraints.

Stretch 3 is light and compact. Hello Robot's official Stretch 3 page lists a 2 kg payload, 24.5 kg weight, 33 x 34 x 141 cm size, 2-5 hour runtime, ROS 2/Python SDK support, web manipulation from a browser, and teleoperation choices. For a home user, those specs translate into a robot that can fit through tight passages, be rolled out of the way, and work near tables, counters, and cabinets. The trade-off is that the payload and runtime define the task envelope.

Stretch 4 moves the platform toward pilot deployment. ui44 records a $29,950 list price, 160 cm height, 45 cm diameter footprint, 46 kg weight, self-charging, 8 hour light-load runtime, 2.5 kg payload with the arm extended, and 4 kg with the arm retracted. Hello Robot's current page emphasizes inclusive design, robust perception of people, contact sensitivity, a simple mobile UI, mapping/navigation, 3D SLAM, data collection, and VLM grasping demos.

Stretch 3 and Stretch 4 specifications that shape eye-controlled assistive robot use
Scroll sideways to inspect the full chart.

For eye control, these details are not trivia. A longer runtime means the robot can stay useful across a larger part of the day. Self-charging reduces the care partner burden. A stronger arm expands the set of objects that can be moved. Omnidirectional mobility can make positioning easier in tight rooms. But the heavier body and larger footprint may also change where the robot can go. The right question is not "which robot has the better spec sheet?" It is "which spec removes a real dependency in this home?"

The Case Study Buyers Should Notice

Hello Robot's official people-story material describes Stretch being used with an eye-tracking system on a power-chair tablet, including a quick tutorial and later co-design to make the interface more intuitive. It also describes use beyond a single room: participation at events, outdoor access around a home, museum exploration, and small daily activities.

That story is powerful, but buyers should read it carefully. A case study is evidence of possibility, not proof of plug-and-play reliability. It involved a motivated user, Hello Robot staff, an occupational-therapy context, and active co-design. That is exactly the point. For assistive robotics in 2026, the most honest deployments look like partnerships, not shrink-wrapped appliances.

The user-facing question is therefore more specific:

  • Can the robot be operated through the user's existing eye-tracking setup, not just a vendor demo tablet?
  • Can the interface be reconfigured without a custom engineering project every time the user's needs change?
  • Does the robot support high-level actions, or does the user have to drive every movement manually?
  • What happens if the robot drops an object, loses network access, or blocks a path?
  • Who can take over, what can they see, and what data is stored?

For a wheelchair user, care partner, occupational therapist, or assistive-technology buyer, those questions matter more than whether the robot looks humanoid.

Shared Autonomy Is the Real Goal

Pure manual eye control is valuable, but it can become tiring. Pure autonomy is attractive, but it is rarely reliable enough for open-ended home assistance. The practical middle ground is shared autonomy.

In shared autonomy, the user gives intent and permission while the robot handles parts of the task: aligning to an object, maintaining a safe distance, grasping with a compliant gripper, navigating to a known location, or stopping when contact is unexpected. The user remains in charge of goals. The robot reduces the amount of repetitive control needed to reach those goals.

This is why Stretch's open stack matters. ROS 2, Python SDK access, calibrated cameras, web teleoperation, and published autonomy demos give researchers and assistive developers surfaces to adapt. That does not make Stretch simple. It makes the difference between a closed appliance that either works or does not, and a platform that can be tuned for a user, room, and task.

Task-specific robots can take the opposite route. Weave Isaac 1, for example, is not an assistive eye-control robot, but its ui44 record is useful because it frames autonomy around named jobs: laundry flow, room reset, bed making, pillow and blanket fixing, and returning clutter. If those jobs work, the interface can be simpler because the action space is narrow. A user might only need to schedule, approve, pause, or correct.

That distinction is the core buyer trade-off. A general mobile manipulator gives flexibility but demands setup and control literacy. A narrow home robot may be easier to command but less adaptable. Eye control helps most when the product is honest about where it sits on that spectrum.

A Buyer Checklist for Accessible Robot Interfaces

Do not evaluate an assistive home robot by asking only whether it supports eye tracking. Ask how the whole control chain behaves in the actual home.

Assistive home robot buyer checklist for eye control and accessible interfaces
Scroll sideways to inspect the full chart.

Start with the input device. If the user already has an eye-gaze tablet, switch system, wheelchair controller, or communication device, ask whether the robot can integrate with that setup. A separate tablet mounted in the wrong place is not accessibility. It is another device to maintain.

Then test the feedback path. The user needs to know where the robot is, what it sees, what mode it is in, and whether the last command succeeded. Multiple camera feeds may help a remote operator, but they can overload a user if the interface is not simplified. For eye control, screen layout matters because target size, dwell time, error correction, and fatigue all affect daily usability.

Next, demand a recovery plan. A robot arm can miss. A mobile base can wedge itself against furniture. Wi-Fi can drop. A gripper can hold the wrong object. The robot needs a safe stop, caregiver takeover, and a way to resume without turning a small error into a full reset.

Finally, read the support model. Hello Robot's assistive pilot language is explicit that some work involves remote testing, in-home collaboration, care partners, engineering staff, and occupational-therapy-informed co-design. That is reasonable for an early assistive mobile manipulator. It would be unreasonable if a mass-market product hid the same support burden behind vague AI language.

What Would Make Eye-Controlled Robots Ready for More Homes?

The next useful milestone is not a robot that obeys gaze like magic. It is a robot that can accept accessible intent, reduce low-level control burden, and make errors recoverable.

For Stretch-like platforms, that means better task templates: "bring this from the counter," "open this drawer if safe," "follow me to the doorway," "move the cup closer," "scratch here with this tool," or "go dock now." Each template needs clear permissions and a visible state machine. The user should know whether the robot is navigating, aligning, grasping, waiting, or asking for help.

For humanoids, it means disclosure. A humanoid intended for home assistance should state which interfaces exist on day one: voice, app, joystick, eye-gaze integration, caregiver dashboard, remote operator, or autonomous routine library. It should also state which tasks are independent, which are supervised, and which require company support.

For buyers, the practical near-term strategy is to match the interface to a small number of high-value tasks. The best first task is not always the flashiest. It may be getting to a backyard door, reaching a counter item, moving a light object, participating in a family activity, or reducing the number of times a care partner is interrupted for a minor action.

Bottom Line

Eye-controlled home robots are plausible because the pieces already exist: eye-gaze computers, web interfaces, mobile manipulators, depth cameras, compliant grippers, remote support, and shared autonomy research. Stretch shows how those pieces can meet in a real assistive context.

But Stretch also shows why buyers should be skeptical of simple claims. The interface is not a checkbox. It is the full path from a user's intent to a robot action and back to a recoverable state. If a company can explain that path clearly, show the hardware limits, disclose the support model, and adapt the controls to the user's actual setup, eye control becomes more than a demo. It becomes a way to turn a robot arm into a little more independence.

Sources & References
  • Hello Robot Stretch 3 product page: https://hello-stretch3.com/stretch-3-product
  • Hello Robot Stretch 4 product page: https://hello-robot.com/stretch-4/
  • Hello Robot Stretch Assist page: https://hello-robot.com/assist/
  • Hello Robot people story on Stretch and eye-tracking control: https://hello-robot.com/people-stories-georgena-and-sharon/
  • ui44 robot database records for Stretch 3, Stretch 4, Weave Isaac 1, 1X NEO, and NEURA 4NE-1 Mini
UT

Written by

ui44 Team

Published July 8, 2026

Share this article

Open a plain share link on X or Bluesky. No embeds, no widgets, no cookie baggage.

Explore the database

Go beyond the headlines

Compare specs, features, and prices across 100+ robots from leading manufacturers worldwide.