Manipulation and Perception Synergy for Autonomous Robots in Unknown Environments

Search for this publication on Google Scholar
Mao, H. (2019). Manipulation and Perception Synergy for Autonomous Robots in Unknown Environments. Unc Charlotte Electronic Theses And Dissertations.
Download PDF

Analytics

35 views ◎
16 downloads ⇓


Abstract

Intelligent robots have been increasingly used in unstructured and unknown environments rather than being limited in well-controlled settings. The key to successful autonomous robot operations in such environments is to combine robot manipulation and perception in a synergy, such that the perception guides robot motion, and the robot motion in turn enables better perception.This dissertation first addresses how to perceive an unknown object effectively and efficiently in an unknown environment through robot and object contact interaction. The novel approaches introduced efficiently generate continuum wraps around unknown objects based on contact interaction and use the resulting robot shape to capture the object shape information to achieve effective object classification, recognition and shape estimation. Additionally, experimental results also demonstrate that object classification can be achieved through simulation-to-real-world transferable learning.This dissertation further considers appearance-based object modeling in cluttered environments. Leveraging flexible continuum manipulation, an approach is introduced to plan robot motion that positions a tip camera at suitable spots around the target object to take RGBD images and register them to build and extend the object $3$D model progressively, while avoiding obstacles in unknown and cluttered environments. This dissertation also addresses how to achieve more flexible and autonomous robotic manipulation based on perception. A real-time adaptive motion planning approach is introduced to enable automatic conflict resolutions between task constraints and obstacle avoidance based on real-time visual sensing. More natural robot motion that seamlessly switches between task-constrained and non-task-constrained modes is achieved for improved motion adaptiveness in dynamically unknown environments.Last but not least, pose uncertainty reduction under complex contacts for fine manipulation is also investigated. A novel force forecast approach that relates real-world force sensing to a simulated world to enable pose uncertainty reduction is introduced. This approach does not require knowing contact locations or pre-define any contact types, and it can be directly applied to reduce pose uncertainty in real-world contact-rich assembly tasks.

Details
Author

Mao, Huitan

Title

Manipulation and Perception Synergy for Autonomous Robots in Unknown Environments

Physical Description

1 online resource (163 pages) : PDF

Date

2019

Degree Granting Institution

University of North Carolina at Charlotte

Abstract

Intelligent robots have been increasingly used in unstructured and unknown environments rather than being limited in well-controlled settings. The key to successful autonomous robot operations in such environments is to combine robot manipulation and perception in a synergy, such that the perception guides robot motion, and the robot motion in turn enables better perception.This dissertation first addresses how to perceive an unknown object effectively and efficiently in an unknown environment through robot and object contact interaction. The novel approaches introduced efficiently generate continuum wraps around unknown objects based on contact interaction and use the resulting robot shape to capture the object shape information to achieve effective object classification, recognition and shape estimation. Additionally, experimental results also demonstrate that object classification can be achieved through simulation-to-real-world transferable learning.This dissertation further considers appearance-based object modeling in cluttered environments. Leveraging flexible continuum manipulation, an approach is introduced to plan robot motion that positions a tip camera at suitable spots around the target object to take RGBD images and register them to build and extend the object $3$D model progressively, while avoiding obstacles in unknown and cluttered environments. This dissertation also addresses how to achieve more flexible and autonomous robotic manipulation based on perception. A real-time adaptive motion planning approach is introduced to enable automatic conflict resolutions between task constraints and obstacle avoidance based on real-time visual sensing. More natural robot motion that seamlessly switches between task-constrained and non-task-constrained modes is achieved for improved motion adaptiveness in dynamically unknown environments.Last but not least, pose uncertainty reduction under complex contacts for fine manipulation is also investigated. A novel force forecast approach that relates real-world force sensing to a simulated world to enable pose uncertainty reduction is introduced. This approach does not require knowing contact locations or pre-define any contact types, and it can be directly applied to reduce pose uncertainty in real-world contact-rich assembly tasks.

Genre

doctoral dissertations

Subjects--Topics

Computer science
Robotics

Degree

Ph.D.

Keywords

Autonomous Robots
Robot Controls
Robotic Manipulation
Robot Motion Planning
Robot Perception

Subject Area

Computer Science

Advisor(s)

Xiao, Jing

Committee Members

Akella, Srinivas
Fan, Jianping
Willis, Andrew

Degree Note

Thesis (Ph.D.)--University of North Carolina at Charlotte, 2019.

Rights Statement

This Item is protected by copyright and/or related rights. You are free to use this Item in any way that is permitted by the copyright and related rights legislation that applies to your use. For other uses you need to obtain permission from the rights-holder(s). For additional information, see http://rightsstatements.org/page/InC/1.0/.

Rights Holder Information

Copyright is held by the author unless otherwise indicated.

Identifier

Mao_uncc_0694D_12265

Permalink

http://hdl.handle.net/20.500.13093/etd:1853