Atharv Belsare, Zohre Karimi, Connor Mattson, Rushiil Nakka, and Daniel S. Brown
IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2026
Assistive robots operating under shared autonomy must balance user control with autonomous assistance. Because robot actions depend on internal intent inference that is not directly observable, mismatches between inferred and intended goals can undermine coordination and trust.
In many shared autonomy systems, transparency is assumed to emerge implicitly through observable robot behavior, such as motion trajectories or goal-directed actions. However, when assistance depends on online intent inference, motion alone may not reveal the robot's internal inference state.
The robot infers a goal from the human's joystick input but does not communicate this inference. This can lead to misaligned goals and requires the human to guess whether the robot needs a correction. With a visual feedback interface, the robot displays its inferred intent, allowing the human to see what the robot believes the target is and adjust their input accordingly. With auditory feedback, the robot verbally communicates its inferred intent, similarly supporting intent alignment.
We study transparency as an interface design variable, defined by feedback modality (visual vs. auditory) and information richness (sparse vs. rich). We implement our interfaces on VOSA, a vision-based shared autonomy framework that performs real-time intent inference from egocentric visual observations without task-specific training.
Visual Sparse highlights the single object that the robot currently infers as the user's intended target.
Visual Rich displays bounding boxes, labels, and confidence scores for all candidate objects, with color encoding confidence from red (low) to green (high).
Visual Sparse
Visual Rich
Auditory Sparse verbalizes only the currently inferred object label when the robot's prediction changes.
Auditory Rich verbalizes label and confidence information for all candidate objects that meet the confidence threshold.
Auditory Sparse
Auditory Rich
We evaluate these interfaces across two assistive manipulation tasks differing in complexity.
Shelving: placing bottles and condiments onto a two-level shelf.
Sorting (Recycling): sorting cluttered objects into the correct recycling bins, a more complex scenario due to increased clutter and a larger candidate set.
We conducted a user study (N = 25) across both tasks, with participants teleoperating a Kinova Gen3 manipulator via an Xbox controller.
Shelving
Sorting (Recycling)
Providing feedback significantly improves intent alignment and reduces the need for corrective interventions, indicating that making the inferred goal legible accelerates convergence in shared control. This holds regardless of feedback modality or richness.
Revealing the full belief distribution did not consistently improve alignment or trust. Users did not require full access to the robot's internal belief distribution to realize these coordination benefits; exposing the inferred goal alone was sufficient.
Participants preferred visual feedback over auditory feedback, reporting greater understanding of the robot's plan and higher trust when intent information was presented visually.
Preferences for sparse versus rich information depended on task complexity. In the shelving task, participants preferred Visual Rich (52%). In the more cluttered and ambiguous sorting task, participants preferred Visual Sparse (48%), reflecting a trade-off between completeness and cognitive load.
Auditory feedback was most tolerable in its sparse form. Rich auditory feedback was the least preferred condition overall, with participants describing it as distracting rather than informative.
Based on these results, we outline the following guidelines for designing transparent shared autonomy systems.
Transparency design should emphasize goal legibility over belief disclosure. Exposing the inferred goal is sufficient to support coordination; transparency need not be exhaustive to be effective.
Favor visual feedback for continuous spatial interaction. Visual feedback aligns with the spatial, continuous nature of assistive manipulation tasks and can be referenced without interrupting ongoing control.
Match feedback richness to task complexity and environmental ambiguity. Richer feedback supports understanding in simpler environments but becomes counterproductive in cluttered, ambiguous ones.
Use auditory feedback selectively and sparingly. Auditory transparency is most effective when limited to brief cues indicating salient intent changes rather than sustained verbal explanation.