@arxiv.org.list.cs.ro.recent@rss-parrot.net
I'm an automated parrot! I relay a website's RSS feed to the Fediverse. Every time a new post appears in the feed, I toot about it. Follow me to get all new posts in your Mastodon timeline! Brought to you by the RSS Parrot.
---
Site URL: arxiv.org/list/cs.RO/recent
Feed URL: arxiv.org/rss/cs.RO
Posts: 558
Followers: 1
A Data-driven Contact Estimation Method for Wheeled-Biped Robots
https://arxiv.org/abs/2410.12345
Published: October 18, 2024 04:00
arXiv:2410.12345v2 Announce Type: replace Abstract: Contact estimation is a key ability for limbed robots, where making and breaking contacts has a direct impact on state estimation and balance control. Existing approaches typically rely on gate-cycle…
BestMan: A Modular Mobile Manipulator Platform for Embodied AI with Unified Simulation-Hardware APIs
https://arxiv.org/abs/2410.13407
Published: October 18, 2024 04:00
arXiv:2410.13407v1 Announce Type: new Abstract: Embodied Artificial Intelligence (Embodied AI) emphasizes agents' ability to perceive, understand, and act in physical environments. Simulation platforms play a crucial role in advancing this field by…
Just Add Force for Contact-Rich Robot Policies
https://arxiv.org/abs/2410.13124
Published: October 18, 2024 04:00
arXiv:2410.13124v1 Announce Type: new Abstract: Robot trajectories used for learning end-to-end robot policies typically contain end-effector and gripper position, workspace images, and language. Policies learned from such trajectories are unsuitable for…
ORSO: Accelerating Reward Design via Online Reward Selection and Policy Optimization
https://arxiv.org/abs/2410.13837
Published: October 18, 2024 04:00
arXiv:2410.13837v1 Announce Type: cross Abstract: Reward shaping is a critical component in reinforcement learning (RL), particularly for complex tasks where sparse rewards can hinder learning. While shaping rewards have been introduced to provide…
Configurable Embodied Data Generation for Class-Agnostic RGB-D Video Segmentation
https://arxiv.org/abs/2410.12995
Published: October 18, 2024 04:00
arXiv:2410.12995v1 Announce Type: new Abstract: This paper presents a method for generating large-scale datasets to improve class-agnostic video segmentation across robots with different form factors. Specifically, we consider the question of whether…
A transformer-based deep reinforcement learning approach to spatial navigation in a partially observable Morris Water Maze
https://arxiv.org/abs/2410.12820
Published: October 18, 2024 04:00
arXiv:2410.12820v1 Announce Type: new Abstract: Navigation is a fundamental cognitive skill extensively studied in neuroscientific experiments and has lately gained substantial interest in artificial intelligence research. Recreating the task solved by…
Interactive Navigation with Adaptive Non-prehensile Mobile Manipulation
https://arxiv.org/abs/2410.13418
Published: October 18, 2024 04:00
arXiv:2410.13418v1 Announce Type: new Abstract: This paper introduces a framework for interactive navigation through adaptive non-prehensile mobile manipulation. A key challenge in this process is handling objects with unknown dynamics, which are…
Dynamic Open-Vocabulary 3D Scene Graphs for Long-term Language-Guided Mobile Manipulation
https://arxiv.org/abs/2410.11989
Published: October 18, 2024 04:00
arXiv:2410.11989v2 Announce Type: replace Abstract: Enabling mobile robots to perform long-term tasks in dynamic real-world environments is a formidable challenge, especially when the environment changes frequently due to human-robot interactions or the…
Differentiable Robot Rendering
https://arxiv.org/abs/2410.13851
Published: October 18, 2024 04:00
arXiv:2410.13851v1 Announce Type: new Abstract: Vision foundation models trained on massive amounts of visual data have shown unprecedented reasoning and planning skills in open-world settings. A key challenge in applying them to robotic tasks is the…
3D Guidance Law for Flexible Target Enclosing with Inherent Safety
https://arxiv.org/abs/2404.16312
Published: October 18, 2024 04:00
arXiv:2404.16312v3 Announce Type: replace-cross Abstract: In this paper, we address the problem of enclosing an arbitrarily moving target in three dimensions by a single pursuer while ensuring the pursuer's safety by preventing collisions with the target.…
MASQ: Multi-Agent Reinforcement Learning for Single Quadruped Robot Locomotion
https://arxiv.org/abs/2408.13759
Published: October 18, 2024 04:00
arXiv:2408.13759v2 Announce Type: replace Abstract: This paper proposes a novel method to improve locomotion learning for a single quadruped robot using multi-agent deep reinforcement learning (MARL). Many existing methods use single-agent reinforcement…
CooHOI: Learning Cooperative Human-Object Interaction with Manipulated Object Dynamics
https://arxiv.org/abs/2406.14558
Published: October 18, 2024 04:00
arXiv:2406.14558v2 Announce Type: replace Abstract: Recent years have seen significant advancements in humanoid control, largely due to the availability of large-scale motion capture data and the application of reinforcement learning methodologies.…
Automatic Navigation and Voice Cloning Technology Deployment on a Humanoid Robot
https://arxiv.org/abs/2410.13612
Published: October 18, 2024 04:00
arXiv:2410.13612v1 Announce Type: new Abstract: Mobile robots have shown immense potential and are expected to be widely used in the service industry. The importance of automatic navigation and voice cloning cannot be overstated as they enable functional…
Gaussian Splatting to Real World Flight Navigation Transfer with Liquid Networks
https://arxiv.org/abs/2406.15149
Published: October 18, 2024 04:00
arXiv:2406.15149v2 Announce Type: replace Abstract: Simulators are powerful tools for autonomous robot learning as they offer scalable data generation, flexible design, and optimization of trajectories. However, transferring behavior learned from…
DualQuat-LOAM: LiDAR Odometry and Mapping parametrized on Dual Quaternions
https://arxiv.org/abs/2410.13541
Published: October 18, 2024 04:00
arXiv:2410.13541v1 Announce Type: new Abstract: This paper reports on a novel method for LiDAR odometry estimation, which completely parameterizes the system with dual quaternions. To accomplish this, the features derived from the point cloud, including…
Adaptive Subsampling and Learned Model Improve Spatiotemporal Resolution of Tactile Skin
https://arxiv.org/abs/2410.13847
Published: October 18, 2024 04:00
arXiv:2410.13847v1 Announce Type: new Abstract: High-speed tactile arrays are essential for real-time robotic control in unstructured environments, but high pixel counts limit readout rates of most large tactile arrays to below 100Hz. We introduce ACTS -…
SPF-EMPC Planner: A real-time multi-robot trajectory planner for complex environments with uncertainties
https://arxiv.org/abs/2410.13573
Published: October 18, 2024 04:00
arXiv:2410.13573v1 Announce Type: new Abstract: In practical applications, the unpredictable movement of obstacles and the imprecise state observation of robots introduce significant uncertainties for the swarm of robots, especially in cluster…
Music to Dance as Language Translation using Sequence Models
https://arxiv.org/abs/2403.15569
Published: October 18, 2024 04:00
arXiv:2403.15569v2 Announce Type: replace-cross Abstract: Synthesising appropriate choreographies from music remains an open problem. We introduce MDLT, a novel approach that frames the choreography generation problem as a translation task. Our method…
RPCBF: Constructing Safety Filters Robust to Model Error and Disturbances via Policy Control Barrier Functions
https://arxiv.org/abs/2410.11157
Published: October 18, 2024 04:00
arXiv:2410.11157v2 Announce Type: replace-cross Abstract: Control Barrier Functions (CBFs) have proven to be an effective tool for performing safe control synthesis for nonlinear systems. However, guaranteeing safety in the presence of disturbances and…
State Estimation Transformers for Agile Legged Locomotion
https://arxiv.org/abs/2410.13496
Published: October 18, 2024 04:00
arXiv:2410.13496v1 Announce Type: new Abstract: We propose a state estimation method that can accurately predict the robot's privileged states to push the limits of quadruped robots in executing advanced skills such as jumping in the wild. In particular,…
Novelty-based Sample Reuse for Continuous Robotics Control
https://arxiv.org/abs/2410.13490
Published: October 18, 2024 04:00
arXiv:2410.13490v1 Announce Type: new Abstract: In reinforcement learning, agents collect state information and rewards through environmental interactions, essential for policy refinement. This process is notably time-consuming, especially in complex…
BlabberSeg: Real-Time Embedded Open-Vocabulary Aerial Segmentation
https://arxiv.org/abs/2410.12979
Published: October 18, 2024 04:00
arXiv:2410.12979v1 Announce Type: new Abstract: Real-time aerial image segmentation plays an important role in the environmental perception of Uncrewed Aerial Vehicles (UAVs). We introduce BlabberSeg, an optimized Vision-Language Model built on CLIPSeg…
Steering Your Generalists: Improving Robotic Foundation Models via Value Guidance
https://arxiv.org/abs/2410.13816
Published: October 18, 2024 04:00
arXiv:2410.13816v1 Announce Type: new Abstract: Large, general-purpose robotic policies trained on diverse demonstration datasets have been shown to be remarkably effective both for controlling a variety of robots in a range of different scenes, and for…
Motion Accuracy and Computational Effort in QP-based Robot Control
https://arxiv.org/abs/2407.16617
Published: October 18, 2024 04:00
arXiv:2407.16617v2 Announce Type: replace Abstract: Quadratic Programs (QPs) have become a mature technology for the control of robots of all kinds, including humanoid robots. One aspect has been largely overlooked, however, which is the accuracy with…
KOI: Accelerating Online Imitation Learning via Hybrid Key-state Guidance
https://arxiv.org/abs/2408.02912
Published: October 18, 2024 04:00
arXiv:2408.02912v3 Announce Type: replace Abstract: Online Imitation Learning struggles with the gap between extensive online exploration space and limited expert trajectories, hindering efficient exploration due to inaccurate reward estimation. Inspired…
t-READi: Transformer-Powered Robust and Efficient Multimodal Inference for Autonomous Driving
https://arxiv.org/abs/2410.09747
Published: October 18, 2024 04:00
arXiv:2410.09747v2 Announce Type: replace-cross Abstract: Given the wide adoption of multimodal sensors (e.g., camera, lidar, radar) by autonomous vehicles (AVs), deep analytics to fuse their outputs for a robust perception become imperative. However,…
CLIMB: Language-Guided Continual Learning for Task Planning with Iterative Model Building
https://arxiv.org/abs/2410.13756
Published: October 18, 2024 04:00
arXiv:2410.13756v1 Announce Type: new Abstract: Intelligent and reliable task planning is a core capability for generalized robotics, requiring a descriptive domain representation that sufficiently models all object and state information for the scene. We…
PC-Planner: Physics-Constrained Self-Supervised Learning for Robust Neural Motion Planning with Shape-Aware Distance Function
https://arxiv.org/abs/2410.12805
Published: October 18, 2024 04:00
arXiv:2410.12805v1 Announce Type: new Abstract: Motion Planning (MP) is a critical challenge in robotics, especially pertinent with the burgeoning interest in embodied artificial intelligence. Traditional MP methods often struggle with high-dimensional…
Comprehensive Robotic Cholecystectomy Dataset (CRCD): Integrating Kinematics, Pedal Signals, and Endoscopic Videos
https://arxiv.org/abs/2312.01183
Published: October 18, 2024 04:00
arXiv:2312.01183v3 Announce Type: replace Abstract: In recent years, the potential applications of machine learning to Minimally Invasive Surgery (MIS) have spurred interest in data sets that can be used to develop data-driven tools. This paper introduces…
D$^3$Fields: Dynamic 3D Descriptor Fields for Zero-Shot Generalizable Rearrangement
https://arxiv.org/abs/2309.16118
Published: October 18, 2024 04:00
arXiv:2309.16118v3 Announce Type: replace Abstract: Scene representation is a crucial design choice in robotic manipulation systems. An ideal representation is expected to be 3D, dynamic, and semantic to meet the demands of diverse manipulation tasks.…
Flex: End-to-End Text-Instructed Visual Navigation with Foundation Models
https://arxiv.org/abs/2410.13002
Published: October 18, 2024 04:00
arXiv:2410.13002v1 Announce Type: new Abstract: End-to-end learning directly maps sensory inputs to actions, creating highly integrated and efficient policies for complex robotics tasks. However, such models are tricky to efficiently train and often…
VLM-Grounder: A VLM Agent for Zero-Shot 3D Visual Grounding
https://arxiv.org/abs/2410.13860
Published: October 18, 2024 04:00
arXiv:2410.13860v1 Announce Type: cross Abstract: 3D visual grounding is crucial for robots, requiring integration of natural language and 3D scene understanding. Traditional methods depending on supervised learning with 3D point clouds are limited by…
Risk Assessment for Autonomous Landing in Urban Environments using Semantic Segmentation
https://arxiv.org/abs/2410.12988
Published: October 18, 2024 04:00
arXiv:2410.12988v1 Announce Type: new Abstract: In this paper, we address the vision-based autonomous landing problem in complex urban environments using deep neural networks for semantic segmentation and risk assessment. We propose employing the…
Jailbreaking LLM-Controlled Robots
https://arxiv.org/abs/2410.13691
Published: October 18, 2024 04:00
arXiv:2410.13691v1 Announce Type: new Abstract: The recent introduction of large language models (LLMs) has revolutionized the field of robotics by enabling contextual reasoning and intuitive human-robot interaction in domains as varied as manipulation,…
Anisotropic Stiffness and Programmable Actuation for Soft Robots Enabled by an Inflated Rotational Joint
https://arxiv.org/abs/2410.13003
Published: October 18, 2024 04:00
arXiv:2410.13003v1 Announce Type: new Abstract: Soft robots are known for their ability to perform tasks with great adaptability, enabled by their distributed, non-uniform stiffness and actuation. Bending is the most fundamental motion for soft robot…
Guided Reinforcement Learning for Robust Multi-Contact Loco-Manipulation
https://arxiv.org/abs/2410.13817
Published: October 18, 2024 04:00
arXiv:2410.13817v1 Announce Type: new Abstract: Reinforcement learning (RL) often necessitates a meticulous Markov Decision Process (MDP) design tailored to each task. This work aims to address this challenge by proposing a systematic approach to behavior…
Resolving Positional Ambiguity in Dialogues by Vision-Language Models for Robot Navigation
https://arxiv.org/abs/2410.12802
Published: October 18, 2024 04:00
arXiv:2410.12802v1 Announce Type: new Abstract: We consider an autonomous navigation robot that can accept human commands through natural language to provide services in an indoor environment. These natural language commands may include time, position,…
Towards a Factor Graph-Based Method using Angular Rates for Full Magnetometer Calibration and Gyroscope Bias Estimation
https://arxiv.org/abs/2410.13827
Published: October 18, 2024 04:00
arXiv:2410.13827v1 Announce Type: new Abstract: MEMS Attitude Heading Reference Systems are widely employed to determine a system's attitude, but sensor measurement biases limit their accuracy. This paper introduces a novel factor graph-based method…
GyroCopter: Differential Bearing Measuring Trajectory Planner for Tracking and Localizing Radio Frequency Sources
https://arxiv.org/abs/2410.13081
Published: October 18, 2024 04:00
arXiv:2410.13081v1 Announce Type: new Abstract: Autonomous aerial vehicles can provide efficient and effective solutions for radio frequency (RF) source tracking and localizing problems with applications ranging from wildlife conservation to search and…
Embodied AI with Two Arms: Zero-shot Learning, Safety and Modularity
https://arxiv.org/abs/2404.03570
Published: October 18, 2024 04:00
arXiv:2404.03570v2 Announce Type: replace Abstract: We present an embodied AI system which receives open-ended natural language instructions from a human, and controls two arms to collaboratively accomplish potentially long-horizon tasks over a large…
Self-Supervised Learning For Robust Robotic Grasping In Dynamic Environment
https://arxiv.org/abs/2410.11229
Published: October 18, 2024 04:00
arXiv:2410.11229v2 Announce Type: replace Abstract: Some of the threats in the dynamic environment include the unpredictability of the motion of objects and interferences to the robotic grasp. In such conditions the traditional supervised and…
Interacting humans and robots can improve sensory prediction by adapting their viscoelasticity
https://arxiv.org/abs/2410.13755
Published: October 18, 2024 04:00
arXiv:2410.13755v1 Announce Type: new Abstract: To manipulate objects or dance together, humans and robots exchange energy and haptic information. While the exchange of energy in human-robot interaction has been extensively investigated, the underlying…
Preference Aligned Diffusion Planner for Quadrupedal Locomotion Control
https://arxiv.org/abs/2410.13586
Published: October 18, 2024 04:00
arXiv:2410.13586v1 Announce Type: new Abstract: Diffusion models demonstrate superior performance in capturing complex distributions from large-scale datasets, providing a promising solution for quadrupedal locomotion control. However, offline policy is…
CERES: Critical-Event Reconstruction via Temporal Scene Graph Completion
https://arxiv.org/abs/2410.13514
Published: October 18, 2024 04:00
arXiv:2410.13514v1 Announce Type: new Abstract: This paper proposes a method for on-demand scenario generation in simulation, grounded on real-world data. Evaluating the behaviour of Autonomous Vehicles (AVs) in both safety-critical and regular scenarios…
RAMPA: Robotic Augmented Reality for Machine Programming and Automation
https://arxiv.org/abs/2410.13412
Published: October 18, 2024 04:00
arXiv:2410.13412v1 Announce Type: new Abstract: As robotics continue to enter various sectors beyond traditional industrial applications, the need for intuitive robot training and interaction systems becomes increasingly more important. This paper…
ALOHA Unleashed: A Simple Recipe for Robot Dexterity
https://arxiv.org/abs/2410.13126
Published: October 18, 2024 04:00
arXiv:2410.13126v1 Announce Type: new Abstract: Recent work has shown promising results for learning end-to-end robot policies using imitation learning. In this work we address the question of how far can we push imitation learning for challenging…
TRLO: An Efficient LiDAR Odometry with 3D Dynamic Object Tracking and Removal
https://arxiv.org/abs/2410.13240
Published: October 18, 2024 04:00
arXiv:2410.13240v1 Announce Type: new Abstract: Simultaneous state estimation and mapping is an essential capability for mobile robots working in dynamic urban environment. The majority of existing SLAM solutions heavily rely on a primarily static…
Arc-Length-Based Warping for Robot Skill Synthesis from Multiple Demonstrations
https://arxiv.org/abs/2410.13322
Published: October 18, 2024 04:00
arXiv:2410.13322v1 Announce Type: new Abstract: In robotics, Learning from Demonstration (LfD) aims to transfer skills to robots by using multiple demonstrations of the same task. These demonstrations are recorded and processed to extract a consistent…
Power in Numbers: Primitive Algorithm for Swarm Robot Navigation in Unknown Environments
https://arxiv.org/abs/2410.13149
Published: October 18, 2024 04:00
arXiv:2410.13149v1 Announce Type: new Abstract: Recently, the navigation of mobile robots in unknown environments has become a particularly significant research topic. Previous studies have primarily employed real-time environmental mapping using cameras…
An efficient strategy for path planning with a tethered marsupial robotics system
https://arxiv.org/abs/2408.02141
Published: October 17, 2024 04:00
arXiv:2408.02141v2 Announce Type: replace Abstract: A tethered marsupial robotics system comprises three components: an Unmanned Ground Vehicle (UGV), an Unmanned Aerial Vehicle (UAV), and a tether connecting both robots. Marsupial systems are highly…
Learning Smooth Humanoid Locomotion through Lipschitz-Constrained Policies
https://arxiv.org/abs/2410.11825
Published: October 17, 2024 04:00
arXiv:2410.11825v2 Announce Type: replace Abstract: Reinforcement learning combined with sim-to-real transfer offers a general framework for developing locomotion controllers for legged robots. To facilitate successful deployment in the real world,…
Dual Action Policy for Robust Sim-to-Real Reinforcement Learning
https://arxiv.org/abs/2410.12250
Published: October 17, 2024 04:00
arXiv:2410.12250v1 Announce Type: cross Abstract: This paper presents Dual Action Policy (DAP), a novel approach to address the dynamics mismatch inherent in the sim-to-real gap of reinforcement learning. DAP uses a single policy to predict two sets of…
PIVOT-R: Primitive-Driven Waypoint-Aware World Model for Robotic Manipulation
https://arxiv.org/abs/2410.10394
Published: October 17, 2024 04:00
arXiv:2410.10394v2 Announce Type: replace Abstract: Language-guided robotic manipulation is a challenging task that requires an embodied agent to follow abstract user instructions to accomplish various complex manipulation tasks. Previous work trivially…
Improving the Generalization of Unseen Crowd Behaviors for Reinforcement Learning based Local Motion Planners
https://arxiv.org/abs/2410.12232
Published: October 17, 2024 04:00
arXiv:2410.12232v1 Announce Type: new Abstract: Deploying a safe mobile robot policy in scenarios with human pedestrians is challenging due to their unpredictable movements. Current Reinforcement Learning-based motion planners rely on a single policy to…
Towards Autonomous Indoor Parking: A Globally Consistent Semantic SLAM System and A Semantic Localization Subsystem
https://arxiv.org/abs/2410.12169
Published: October 17, 2024 04:00
arXiv:2410.12169v1 Announce Type: new Abstract: We propose a globally consistent semantic SLAM system (GCSLAM) and a semantic-fusion localization subsystem (SF-Loc), which achieves accurate semantic mapping and robust localization in complex parking lots.…
"Set It Up!": Functional Object Arrangement with Compositional Generative Models
https://arxiv.org/abs/2405.11928
Published: October 17, 2024 04:00
arXiv:2405.11928v2 Announce Type: replace Abstract: This paper studies the challenge of developing robots capable of understanding under-specified instructions for creating functional object arrangements, such as "set up a dining table for two"; previous…
Design Space Exploration of Embedded SoC Architectures for Real-Time Optimal Control
https://arxiv.org/abs/2410.12142
Published: October 17, 2024 04:00
arXiv:2410.12142v1 Announce Type: new Abstract: Empowering resource-limited robots to execute computationally intensive tasks like model/learning-based algorithms is challenging. Due to the complexity of the workload characteristic, the bottlenecks in…
LLM2Swarm: Robot Swarms that Responsively Reason, Plan, and Collaborate through LLMs
https://arxiv.org/abs/2410.11387
Published: October 17, 2024 04:00
arXiv:2410.11387v2 Announce Type: replace Abstract: Robot swarms are composed of many simple robots that communicate and collaborate to fulfill complex tasks. Robot controllers usually need to be specified by experts on a case-by-case basis via…
Hybrid Decision Making for Scalable Multi-Agent Navigation: Integrating Semantic Maps, Discrete Coordination, and Model Predictive Control
https://arxiv.org/abs/2410.12651
Published: October 17, 2024 04:00
arXiv:2410.12651v1 Announce Type: new Abstract: This paper presents a framework for multi-agent navigation in structured but dynamic environments, integrating three key components: a shared semantic map encoding metric and semantic environmental…
The State of Robot Motion Generation
https://arxiv.org/abs/2410.12172
Published: October 17, 2024 04:00
arXiv:2410.12172v1 Announce Type: new Abstract: This paper reviews the large spectrum of methods for generating robot motion proposed over the 50 years of robotics research culminating in recent developments. It crosses the boundaries of methodologies,…
Human-Inspired Long-Term Indoor Localization in Human-Oriented Environment
https://arxiv.org/abs/2410.12362
Published: October 17, 2024 04:00
arXiv:2410.12362v1 Announce Type: new Abstract: Lifelong localization is crucial for enabling the autonomy of service robots. In this paper, we present an overview of our past research on long-term localization and mapping, exploiting geometric priors…
In-Context Learning Enables Robot Action Prediction in LLMs
https://arxiv.org/abs/2410.12782
Published: October 17, 2024 04:00
arXiv:2410.12782v1 Announce Type: new Abstract: Recently, Large Language Models (LLMs) have achieved remarkable success using in-context learning (ICL) in the language domain. However, leveraging the ICL capabilities within LLMs to directly predict robot…
PAPL-SLAM: Principal Axis-Anchored Monocular Point-Line SLAM
https://arxiv.org/abs/2410.12324
Published: October 17, 2024 04:00
arXiv:2410.12324v1 Announce Type: new Abstract: In point-line SLAM systems, the utilization of line structural information and the optimization of lines are two significant problems. The former is usually addressed through structural regularities, while…
MFC-EQ: Mean-Field Control with Envelope Q-Learning for Moving Decentralized Agents in Formation
https://arxiv.org/abs/2410.12062
Published: October 17, 2024 04:00
arXiv:2410.12062v1 Announce Type: new Abstract: We study a decentralized version of Moving Agents in Formation (MAiF), a variant of Multi-Agent Path Finding aiming to plan collision-free paths for multiple agents with the dual objectives of reaching their…
InterACT: Inter-dependency Aware Action Chunking with Hierarchical Attention Transformers for Bimanual Manipulation
https://arxiv.org/abs/2409.07914
Published: October 17, 2024 04:00
arXiv:2409.07914v3 Announce Type: replace Abstract: Bimanual manipulation presents unique challenges compared to unimanual tasks due to the complexity of coordinating two robotic arms. In this paper, we introduce InterACT: Inter-dependency aware Action…
Off-dynamics Conditional Diffusion Planners
https://arxiv.org/abs/2410.12238
Published: October 17, 2024 04:00
arXiv:2410.12238v1 Announce Type: cross Abstract: Offline Reinforcement Learning (RL) offers an attractive alternative to interactive data acquisition by leveraging pre-existing datasets. However, its effectiveness hinges on the quantity and quality of…
Robust RL with LLM-Driven Data Synthesis and Policy Adaptation for Autonomous Driving
https://arxiv.org/abs/2410.12568
Published: October 17, 2024 04:00
arXiv:2410.12568v1 Announce Type: new Abstract: The integration of Large Language Models (LLMs) into autonomous driving systems demonstrates strong common sense and reasoning abilities, effectively addressing the pitfalls of purely data-driven methods.…
One-Shot Imitation under Mismatched Execution
https://arxiv.org/abs/2409.06615
Published: October 17, 2024 04:00
arXiv:2409.06615v4 Announce Type: replace Abstract: Human demonstrations as prompts are a powerful way to program robots to do long-horizon manipulation tasks. However, translating these demonstrations into robot-executable actions presents significant…
Harmon: Whole-Body Motion Generation of Humanoid Robots from Language Descriptions
https://arxiv.org/abs/2410.12773
Published: October 17, 2024 04:00
arXiv:2410.12773v1 Announce Type: new Abstract: Humanoid robots, with their human-like embodiment, have the potential to integrate seamlessly into human environments. Critical to their coexistence and cooperation with humans is the ability to understand…
Imagine2Servo: Intelligent Visual Servoing with Diffusion-Driven Goal Generation for Robotic Tasks
https://arxiv.org/abs/2410.12432
Published: October 17, 2024 04:00
arXiv:2410.12432v1 Announce Type: new Abstract: Visual servoing, the method of controlling robot motion through feedback from visual sensors, has seen significant advancements with the integration of optical flow-based methods. However, its application…
Sample-Efficient Reinforcement Learning with Temporal Logic Objectives: Leveraging the Task Specification to Guide Exploration
https://arxiv.org/abs/2410.12136
Published: October 17, 2024 04:00
arXiv:2410.12136v1 Announce Type: new Abstract: This paper addresses the problem of learning optimal control policies for systems with uncertain dynamics and high-level control objectives specified as Linear Temporal Logic (LTL) formulas. Uncertainty is…
Stable Object Placement Planning From Contact Point Robustness
https://arxiv.org/abs/2410.12483
Published: October 17, 2024 04:00
arXiv:2410.12483v1 Announce Type: new Abstract: We introduce a planner designed to guide robot manipulators in stably placing objects within intricate scenes. Our proposed method reverses the traditional approach to object placement: our planner selects…
AIC MLLM: Autonomous Interactive Correction MLLM for Robust Robotic Manipulation
https://arxiv.org/abs/2406.11548
Published: October 17, 2024 04:00
arXiv:2406.11548v5 Announce Type: replace Abstract: The ability to reflect on and correct failures is crucial for robotic systems to interact stably with real-life objects. Observing the generalization and reasoning capabilities of Multimodal Large…
Dynamic Open-Vocabulary 3D Scene Graphs for Long-term Language-Guided Mobile Manipulation
https://arxiv.org/abs/2410.11989
Published: October 17, 2024 04:00
arXiv:2410.11989v1 Announce Type: new Abstract: Enabling mobile robots to perform long-term tasks in dynamic real-world environments is a formidable challenge, especially when the environment changes frequently due to human-robot interactions or the…
Vector Field-Guided Learning Predictive Control for Motion Planning of Mobile Robots with Uncertain Dynamics
https://arxiv.org/abs/2405.08283
Published: October 17, 2024 04:00
arXiv:2405.08283v3 Announce Type: replace Abstract: In obstacle-dense scenarios, providing safe guidance for mobile robots is critical to improve the safe maneuvering capability. However, the guidance provided by standard guiding vector fields (GVFs) may…
Trajectory Manifold Optimization for Fast and Adaptive Kinodynamic Motion Planning
https://arxiv.org/abs/2410.12193
Published: October 17, 2024 04:00
arXiv:2410.12193v1 Announce Type: new Abstract: Fast kinodynamic motion planning is crucial for systems to effectively adapt to dynamically changing environments. Despite some efforts, existing approaches still struggle with rapid planning in…
Physics-Informed Learning for the Friction Modeling of High-Ratio Harmonic Drives
https://arxiv.org/abs/2410.12685
Published: October 17, 2024 04:00
arXiv:2410.12685v1 Announce Type: new Abstract: This paper presents a scalable method for friction identification in robots equipped with electric motors and high-ratio harmonic drives, utilizing Physics-Informed Neural Networks (PINN). This approach…
Learning to Control and Coordinate Mixed Traffic Through Robot Vehicles at Complex and Unsignalized Intersections
https://arxiv.org/abs/2301.05294
Published: October 17, 2024 04:00
arXiv:2301.05294v3 Announce Type: replace-cross Abstract: Intersections are essential road infrastructures for traffic in modern metropolises. However, they can also be the bottleneck of traffic flows as a result of traffic incidents or the absence of…
Instruction-Guided Visual Masking
https://arxiv.org/abs/2405.19783
Published: October 17, 2024 04:00
arXiv:2405.19783v2 Announce Type: replace-cross Abstract: Instruction following is crucial in contemporary LLM. However, when extended to multimodal setting, it often suffers from misalignment between specific textual instruction and targeted local region…
An Online Self-learning Graph-based Lateral Controller for Self-Driving Cars
https://arxiv.org/abs/2410.11979
Published: October 17, 2024 04:00
arXiv:2410.11979v1 Announce Type: new Abstract: The hype around self-driving cars has been growing over the past years and has sparked much research. Several modules in self-driving cars are thoroughly investigated to ensure safety, comfort, and…
Characterizing Behavioral Differences and Adaptations of Automated Vehicles and Human Drivers at Unsignalized Intersections: Insights from Waymo and Lyft Open Datasets
https://arxiv.org/abs/2410.12538
Published: October 17, 2024 04:00
arXiv:2410.12538v1 Announce Type: new Abstract: The integration of autonomous vehicles (AVs) into transportation systems presents an unprecedented opportunity to enhance road safety and efficiency. However, understanding the interactions between AVs and…
Closed-Loop Visuomotor Control with Generative Expectation for Robotic Manipulation
https://arxiv.org/abs/2409.09016
Published: October 17, 2024 04:00
arXiv:2409.09016v3 Announce Type: replace Abstract: Despite significant progress in robotics and embodied AI in recent years, deploying robots for long-horizon tasks remains a great challenge. Majority of prior arts adhere to an open-loop philosophy and…
Fast Online Learning of CLiFF-maps in Changing Environments
https://arxiv.org/abs/2410.12237
Published: October 17, 2024 04:00
arXiv:2410.12237v1 Announce Type: new Abstract: Maps of dynamics are effective representations of motion patterns learned from prior observations, with recent research demonstrating their ability to enhance performance in various downstream tasks such as…
Vehicle Localization in GPS-Denied Scenarios Using Arc-Length-Based Map Matching
https://arxiv.org/abs/2410.12208
Published: October 17, 2024 04:00
arXiv:2410.12208v1 Announce Type: new Abstract: Automated driving systems face challenges in GPS-denied situations. To address this issue, kinematic dead reckoning is implemented using measurements from the steering angle, steering rate, yaw rate, and…
A Data-driven Contact Estimation Method for Wheeled-Biped Robots
https://arxiv.org/abs/2410.12345
Published: October 17, 2024 04:00
arXiv:2410.12345v1 Announce Type: new Abstract: Contact estimation is a key ability for limbed robots, where making and breaking contacts has a direct impact on state estimation and balance control. Existing approaches typically rely on gate-cycle priors…
Neural Signal Operated Intelligent Robot: Human-guided Robot Maze Navigation through SSVEP
https://arxiv.org/abs/2410.11867
Published: October 17, 2024 04:00
arXiv:2410.11867v1 Announce Type: cross Abstract: Brain-computer Interface (BCI) applications based on steady-state visual evoked potentials (SSVEP) have the advantages of being fast, accurate and mobile. SSVEP is the EEG response evoked by visual stimuli…
A Lyapunov-Based Switching Scheme for Selecting the Stable Closed-Loop Fixed Attitude-Error Quaternion During Flight
https://arxiv.org/abs/2410.12054
Published: October 17, 2024 04:00
arXiv:2410.12054v1 Announce Type: new Abstract: We present a switching scheme, which uses both the attitude-error quaternion (AEQ) and the angular-velocity error, for controlling the rotational degrees of freedom of an uncrewed aerial vehicle (UAV) during…
A Novel Twisted-Winching String Actuator for Robotic Applications: Design and Validation
https://arxiv.org/abs/2410.12097
Published: October 17, 2024 04:00
arXiv:2410.12097v1 Announce Type: new Abstract: This paper presents a novel actuator system combining a twisted string actuator (TSA) with a winch mechanism. Relative to traditional hydraulic and pneumatic systems in robotics, TSAs are compact and…
ECoDe: A Sample-Efficient Method for Co-Design of Robotic Agents
https://arxiv.org/abs/2309.04085
Published: October 17, 2024 04:00
arXiv:2309.04085v2 Announce Type: replace Abstract: Co-designing autonomous robotic agents involves simultaneously optimizing the controller and physical design of the agent. Its inherent bi-level optimization formulation necessitates an outer loop design…
Visual Manipulation with Legs
https://arxiv.org/abs/2410.11345
Published: October 17, 2024 04:00
arXiv:2410.11345v2 Announce Type: replace Abstract: Animals use limbs for both locomotion and manipulation. We aim to equip quadruped robots with similar versatility. This work introduces a system that enables quadruped robots to interact with objects…
FlowBotHD: History-Aware Diffuser Handling Ambiguities in Articulated Objects Manipulation
https://arxiv.org/abs/2410.07078
Published: October 17, 2024 04:00
arXiv:2410.07078v2 Announce Type: replace Abstract: We introduce a novel approach for manipulating articulated objects which are visually ambiguous, such doors which are symmetric or which are heavily occluded. These ambiguities can cause uncertainty over…
Non-Conservative Obstacle Avoidance for Multi-Body Systems Leveraging Convex Hulls and Predicted Closest Points
https://arxiv.org/abs/2410.12659
Published: October 17, 2024 04:00
arXiv:2410.12659v1 Announce Type: new Abstract: This paper introduces a novel approach that integrates future closest point predictions into the distance constraints of a collision avoidance controller, leveraging convex hulls with closest point distance…
Know your limits! Optimize the robot's behavior through self-awareness
https://arxiv.org/abs/2409.10308
Published: October 17, 2024 04:00
arXiv:2409.10308v2 Announce Type: replace Abstract: As humanoid robots transition from labs to real-world environments, it is essential to democratize robot control for non-expert users. Recent human-robot imitation algorithms focus on following a…
3D Gaussian Splatting in Robotics: A Survey
https://arxiv.org/abs/2410.12262
Published: October 17, 2024 04:00
arXiv:2410.12262v1 Announce Type: new Abstract: Dense 3D representations of the environment have been a long-term goal in the robotics field. While previous Neural Radiance Fields (NeRF) representation have been prevalent for its implicit,…
Learning Differentiable Tensegrity Dynamics using Graph Neural Networks
https://arxiv.org/abs/2410.12216
Published: October 17, 2024 04:00
arXiv:2410.12216v1 Announce Type: new Abstract: Tensegrity robots are composed of rigid struts and flexible cables. They constitute an emerging class of hybrid rigid-soft robotic systems and are promising systems for a wide array of applications, ranging…
AdaCropFollow: Self-Supervised Online Adaptation for Visual Under-Canopy Navigation
https://arxiv.org/abs/2410.12411
Published: October 17, 2024 04:00
arXiv:2410.12411v1 Announce Type: new Abstract: Under-canopy agricultural robots can enable various applications like precise monitoring, spraying, weeding, and plant manipulation tasks throughout the growing season. Autonomous navigation under the canopy…
Affordance-Centric Policy Learning: Sample Efficient and Generalisable Robot Policy Learning using Affordance-Centric Task Frames
https://arxiv.org/abs/2410.12124
Published: October 17, 2024 04:00
arXiv:2410.12124v1 Announce Type: new Abstract: Affordances are central to robotic manipulation, where most tasks can be simplified to interactions with task-specific regions on objects. By focusing on these key regions, we can abstract away…
NAR-*ICP: Neural Execution of Classical ICP-based Pointcloud Registration Algorithms
https://arxiv.org/abs/2410.11031
Published: October 17, 2024 04:00
arXiv:2410.11031v2 Announce Type: replace Abstract: This study explores the intersection of neural networks and classical robotics algorithms through the Neural Algorithmic Reasoning (NAR) framework, allowing to train neural networks to effectively reason…
Faster Algorithms for Growing Collision-Free Convex Polytopes in Robot Configuration Space
https://arxiv.org/abs/2410.12649
Published: October 17, 2024 04:00
arXiv:2410.12649v1 Announce Type: new Abstract: We propose two novel algorithms for constructing convex collision-free polytopes in robot configuration space. Finding these polytopes enables the application of stronger motion-planning frameworks such as…
Leveraging Augmented Reality for Improved Situational Awareness During UAV-Driven Search and Rescue Missions
https://arxiv.org/abs/2410.12556
Published: October 17, 2024 04:00
arXiv:2410.12556v1 Announce Type: new Abstract: In the high-stakes domain of search-and-rescue missions, the deployment of Unmanned Aerial Vehicles (UAVs) has become increasingly pivotal. These missions require seamless, real-time communication among…
~ 458 additional posts are not shown ~