Instance-Based Generalization In Reinforcement Learning.pdf

2011.01089.pdf
Preview of Instance-Based Generalization in Reinforcement Learning
🔗 Source: arxiv.org
📊 Size: 780 KB
📄 Pages: 21 pages
⬇️ Downloads: 147

Summary

Agents trained via deep reinforcement learning (RL) fail to generalize to unseen environments despite sharing the same underlying dynamics as the training levels. This is due to the agent learning instance-specific policies instead of generalizable ones, resulting from maximizing expected rewards and inducing undesired speed-running policies. The effective Markov dynamics the agent observes during training are significantly changed when reusing instances, leading to sub-optimal policies on the training set. Generalization bounds to the value gap in train and test environments are provided based on the number of training instances. A proposed solution involves training a shared belief representation over an ensemble of specialized policies and computing a consensus policy for data collection, disallowing instance-specific exploitation. Experimental validation is provided using the CoinRun benchmark.

Description

Agents trained via deep reinforcement learning (RL) fail to generalize to unseen environments despite sharing the same underlying dynamics as the training...

Technical Information

  • File Format: PDF
  • File Size: 780 KB
  • Pages: 21
  • Language: EN
  • Total Downloads: 147
  • Last Updated: 3 days ago

Document Overview

This PDF document about Instance-Based Generalization in Reinforcement Learning provides comprehensive information and guidance. Whether you're a beginner or advanced user, this resource offers valuable insights into Instance-Based Generalization in Reinforcement Learning.

Related Topics

If you're interested in Instance-Based Generalization in Reinforcement Learning, you might also want to explore:

Download Instance-Based Generalization in Reinforcement Learning eBooks for free and learn more about Instance-Based Generalization in Reinforcement Learning. These books contain exercises and tutorials to improve your practical skills, at all levels!

Not satisfied with this document? We have related documents to Instance-Based Generalization in Reinforcement Learning, try searching with similar keywords: Instance-Based Generalization in Reinforcement Learning, Instance Segmentation via Instance Categories: A Simple and Flexible Framework, learning and generalization, Networks of Relations: Distributed Learning and Generalization, Solutions Reinforcement And Answers Reinforcement, POET: Open-ended Reinforcement Learning through Unbounded Invention of Learning Challenges and their Solutions, Poet Open Ended Reinforcement Learning Through Unbounded Invention Of Learning Challenges And Their Solutions, A Sample Html Instance

You can download PDF versions of the user's guide, manuals and ebooks about Instance-Based Generalization in Reinforcement Learning, you can also find and download for free A free online manual (notices) with beginner and intermediate, Downloads Documentation, You can download PDF files (or DOC and PPT) about Instance-Based Generalization in Reinforcement Learning for free, but please respect copyrighted ebooks.