Multi-Task Generalization using Practice for Distributed Deep Reinforcement Learning

Search for this publication on Google Scholar
Pattnaik, U. (2021). Multi-Task Generalization using Practice for Distributed Deep Reinforcement Learning. Unc Charlotte Electronic Theses And Dissertations.
Download PDF

Analytics

70 views ◎
47 downloads ⇓


Abstract

Feedback driven deep reinforcement learning methodologies are widely favoured approaches to solving artificial intelligence problems. The algorithms navigate complex decision-making tasks without manual state space engineering. Notable problems considered out of reach by machines, like mastering Go, StarCraft, Dota2 and Atari 2600 games were solved successfully. However, these algorithms require extensive amounts of time and data to specialize in one problem. Transfer learning strategies approach this challenge by supplementing the reinforcement learning task with shareable knowledge from a source task. The source provides basal knowledge about the environment, thus reducing the time to learn. Additionally, these strategies can be adopted in the multi-task learning domain. This strategy favours building generalized representations capable of solving different problems simultaneously using shared representation from similar tasks as a source of inductive bias. The addition of transfer learning helps to ground the simultaneous training of different learning objectives.This thesis employs the transfer learning paradigm Practice as an auxiliary task to improve the generalization capabilities of a distributed deep reinforcement learning algorithm in the multi-task problem setting. The algorithm implements distributed learners that optimize on different task objectives and contribute to training a single representation proficient in all objectives. Experimental results indicate that Practice's addition of state dynamics information effectively improves the generalization capabilities of the algorithm. Additionally, the contributions of each learner are analyzed to study their impact on the overall multi-task learning objective.

Details
Author

Pattnaik, Upasana

Title

Multi-Task Generalization using Practice for Distributed Deep Reinforcement Learning

Physical Description

1 online resource (75 pages) : PDF

Date

2021

Degree Granting Institution

University of North Carolina at Charlotte

Abstract

Feedback driven deep reinforcement learning methodologies are widely favoured approaches to solving artificial intelligence problems. The algorithms navigate complex decision-making tasks without manual state space engineering. Notable problems considered out of reach by machines, like mastering Go, StarCraft, Dota2 and Atari 2600 games were solved successfully. However, these algorithms require extensive amounts of time and data to specialize in one problem. Transfer learning strategies approach this challenge by supplementing the reinforcement learning task with shareable knowledge from a source task. The source provides basal knowledge about the environment, thus reducing the time to learn. Additionally, these strategies can be adopted in the multi-task learning domain. This strategy favours building generalized representations capable of solving different problems simultaneously using shared representation from similar tasks as a source of inductive bias. The addition of transfer learning helps to ground the simultaneous training of different learning objectives.This thesis employs the transfer learning paradigm Practice as an auxiliary task to improve the generalization capabilities of a distributed deep reinforcement learning algorithm in the multi-task problem setting. The algorithm implements distributed learners that optimize on different task objectives and contribute to training a single representation proficient in all objectives. Experimental results indicate that Practice's addition of state dynamics information effectively improves the generalization capabilities of the algorithm. Additionally, the contributions of each learner are analyzed to study their impact on the overall multi-task learning objective.

Genre

masters theses

Subjects--Topics

Computer science
Artificial intelligence

Degree

M.S.

Keywords

Auxiliary Task
Distributed Deep Reinforcement Learning
Multi-Task Generalization
Multi-Task Learning
State Dynamics Prediction
Transfer Learning

Subject Area

Computer Science

Advisor(s)

Lee, Minwoo

Committee Members

Shin, Min
Fan, Liyue

Degree Note

Thesis (M.S.)--University of North Carolina at Charlotte, 2021.

Rights Statement

This Item is protected by copyright and/or related rights. You are free to use this Item in any way that is permitted by the copyright and related rights legislation that applies to your use. For other uses you need to obtain permission from the rights-holder(s). For additional information, see http://rightsstatements.org/page/InC/1.0/.

Rights Holder Information

Copyright is held by the author unless otherwise indicated.

Identifier

Pattnaik_uncc_0694N_12799

Permalink

http://hdl.handle.net/20.500.13093/etd:1904