TATIC: Task-Aware Temporal Learning for Human Intent Inference from Physical Corrections in Human-Robot Collaboration

TL;DR

TATIC uses torque estimation and TCN to achieve a 0.904 Macro-F1 score in intent recognition.

cs.RO 🔴 Advanced 2026-03-11 7 views
Jiurun Song Xiao Liang Minghui Zheng
human-robot collaboration physical interaction intent inference temporal learning robot adaptability

Key Findings

Methodology

TATIC combines torque-based contact force estimation with a task-aware Temporal Convolutional Network (TCN) to infer discrete task-level intent and estimate continuous motion-level parameters from brief physical corrections. Task-aligned feature canonicalization ensures robust generalization across diverse layouts, while an intent-driven adaptation scheme translates inferred human intent into robot motion adaptations.

Key Results

  • Experiments show TATIC achieves a 0.904 Macro-F1 score in intent recognition, demonstrating its efficiency in multi-task environments.
  • Hardware validation successfully applied TATIC in collaborative disassembly tasks, showcasing its applicability in real-world scenarios.
  • Feature ablation studies indicate that using the full feature set significantly improves model performance, particularly in target selection and direction regression tasks.

Significance

TATIC holds significant implications for both academia and industry, especially in dynamic environments requiring rapid human intent response. It addresses existing methods' shortcomings in handling physical feedback, offering a more direct and low-latency interaction channel.

Technical Contribution

TATIC introduces a novel approach by combining torque estimation with TCN to decode semantic intent and motion corrections from physical interactions. This method enhances intent recognition accuracy and reduces reliance on external force sensors, decreasing operator fatigue.

Novelty

TATIC is the first to integrate torque estimation with temporal convolutional networks for extracting task-level intent and motion corrections from brief physical interactions, offering unique advantages in handling physical feedback.

Limitations

  • In complex multi-contact scenarios, TATIC may struggle with recognition due to the model's assumption of a single contact point.
  • Prolonged physical interactions may lead to operator fatigue during long-duration tasks.
  • The model's performance under extreme environmental conditions remains unverified.

Future Work

Future research directions include extending TATIC to handle multi-contact scenarios, optimizing the model to reduce operator fatigue, and validating its performance under different environmental conditions.

AI Executive Summary

In modern human-robot collaboration, robots must swiftly adapt to dynamic task constraints and evolving human intent. However, existing methods fall short in handling physical feedback. The TATIC framework combines torque estimation with a task-aware Temporal Convolutional Network to decode semantic intent and motion corrections from physical interactions.

TATIC has achieved remarkable results in experiments, particularly attaining a 0.904 Macro-F1 score in intent recognition, indicating its efficiency in multi-task environments. Hardware validation further demonstrates TATIC's applicability in real-world scenarios, especially in collaborative disassembly tasks.

While TATIC excels in many areas, challenges remain in complex multi-contact scenarios. Future research will focus on expanding its application scope, optimizing the model to reduce operator fatigue, and validating its performance under different environmental conditions.

Deep Analysis

Background

With the rise of human-robot collaboration, robots need to quickly adapt to dynamic task constraints and evolving human intent in shared workspaces. Traditional physical human-robot interaction methods primarily rely on physical corrections for trajectory guidance but struggle to infer task-level semantic intent. Recent advances in semantic planning and robot control have been driven by large language models and vision-language models, but these methods mainly rely on vision and language inputs, lacking mechanisms to interpret physical feedback.

Core Problem

In dynamic human-robot collaboration environments, robots must quickly adapt to changing task constraints and human intent. Existing methods fall short in handling physical feedback, unable to effectively decode semantic intent and motion corrections from physical interactions.

Innovation

The TATIC framework combines torque-based contact force estimation with a task-aware Temporal Convolutional Network to infer discrete task-level intent and estimate continuous motion-level parameters from brief physical corrections. Task-aligned feature canonicalization ensures robust generalization across diverse layouts, while an intent-driven adaptation scheme translates inferred human intent into robot motion adaptations.

Methodology

  • �� Utilize torque estimation for contact force estimation, supporting brief physical corrections. • Employ a task-aware Temporal Convolutional Network (TCN) to infer discrete task-level intent and continuous motion-level parameters. • Ensure robust generalization across diverse layouts through task-aligned feature canonicalization. • Translate inferred human intent into robot motion adaptations through an intent-driven adaptation scheme.

Experiments

Experiments were conducted on a 7-DoF manipulator, collecting 500 in-distribution and 250 out-of-distribution episodes. The experimental design included intent recognition tasks and hardware validation, using Macro-F1 score as the primary evaluation metric. Feature ablation studies evaluated the impact of different feature sets on model performance.

Results

Experimental results show TATIC achieves a 0.904 Macro-F1 score in intent recognition, demonstrating its efficiency in multi-task environments. Hardware validation successfully applied TATIC in collaborative disassembly tasks, showcasing its applicability in real-world scenarios. Feature ablation studies indicate that using the full feature set significantly improves model performance, particularly in target selection and direction regression tasks.

Applications

TATIC can be applied in dynamic environments requiring rapid human intent response, such as manufacturing, disassembly, and healthcare assistance. Its low-latency interaction and efficient intent recognition capabilities make it highly applicable in these fields.

Limitations & Outlook

Despite TATIC's strong performance, challenges remain in complex multi-contact scenarios. The model assumes a single contact point, which may struggle in multi-contact scenarios. Additionally, prolonged physical interactions may lead to operator fatigue, and the model's performance under extreme environmental conditions remains unverified.

Plain Language Accessible to non-experts

Imagine you're in a kitchen cooking, with a robot assistant helping you. When you need to adjust the pot's position, you give the robot a gentle push, and it immediately understands your intent and adjusts the pot. That's how TATIC works. It senses your slight push, infers the task you want, and quickly responds. Just like in the kitchen, you don't need to verbally instruct the robot every step; it understands your needs through your actions.

ELI14 Explained like you're 14

Imagine you're playing a game where the robot assistant understands every move you make. When you want it to fetch something, you just give it a gentle nudge, and it gets what you mean. That's how TATIC works. It can infer your intent from slight movements and respond accordingly. Just like in the game, you don't need to verbally instruct the robot every step; it understands your needs through your actions.

Glossary

Temporal Convolutional Network

A neural network architecture for processing time-series data, capable of capturing temporal dependencies in data.

Used to infer discrete task-level intent and continuous motion-level parameters.

Torque Estimation

A method for estimating external contact forces by measuring joint torques.

Supports brief physical corrections, reducing reliance on external force sensors.

Task-Aligned Feature Canonicalization

A feature processing method ensuring robust generalization across diverse layouts.

Used to eliminate global spatial dependencies in features.

Intent-Driven Adaptation Scheme

A mechanism that translates inferred human intent into robot motion adaptations.

Used for efficient intent recognition and motion adjustments.

Macro-F1 Score

A metric for evaluating classification model performance, considering the average F1 score of each class.

Used to evaluate TATIC's performance in intent recognition tasks.

Open Questions Unanswered questions from this research

  • 1 How to improve TATIC's recognition capabilities in complex multi-contact scenarios? The current model assumes a single contact point, which may struggle in multi-contact scenarios.
  • 2 How to reduce operator fatigue during long-duration tasks? Prolonged physical interactions may lead to operator fatigue, requiring model optimization to mitigate this effect.

Applications

Immediate Applications

Manufacturing

TATIC can be used in manufacturing for human-robot collaboration, helping robots quickly adapt to dynamic task demands and improve production efficiency.

Healthcare Assistance

In healthcare assistance, TATIC can help robot assistants quickly respond to healthcare professionals' needs, improving the efficiency and safety of medical services.

Long-term Vision

Smart Homes

TATIC can be used in smart home environments, helping home robots better understand and respond to user needs, achieving more natural human-robot interactions.

Abstract

In human-robot collaboration (HRC), robots must adapt online to dynamic task constraints and evolving human intent. While physical corrections provide a natural, low-latency channel for operators to convey motion-level adjustments, extracting task-level semantic intent from such brief interactions remains challenging. Existing foundation-model-based approaches primarily rely on vision and language inputs and lack mechanisms to interpret physical feedback. Meanwhile, traditional physical human-robot interaction (pHRI) methods leverage physical corrections for trajectory guidance but struggle to infer task-level semantics. To bridge this gap, we propose TATIC, a unified framework that utilizes torque-based contact force estimation and a task-aware Temporal Convolutional Network (TCN) to jointly infer discrete task-level intent and estimate continuous motion-level parameters from brief physical corrections. Task-aligned feature canonicalization ensures robust generalization across diverse layouts, while an intent-driven adaptation scheme translates inferred human intent into robot motion adaptations. Experiments achieve a 0.904 Macro-F1 score in intent recognition and demonstrate successful hardware validation in collaborative disassembly (see experimental video at https://youtu.be/xF8A52qwEc8).

cs.RO eess.SY