Alexey A. Melnikov, Adi Makmal, Vedran Dunjko, Hans J. Briegel
Scientific Reports 7, 14430
Publication year: 2017
  

The ability to generalize is an important feature of any intelligent agent. Not only because it may allow the agent to cope with large amounts of data, but also because in some environments, an agent with no generalization capabilities cannot learn. In this work we outline several criteria for generalization, and present a dynamic and autonomous machinery that enables projective simulation agents to meaningfully generalize. Projective simulation, a novel, physical approach to artificial intelligence, was recently shown to perform well in standard reinforcement learning problems, with applications in advanced robotics as well as quantum experiments. Both the basic projective simulation model and the presented generalization machinery are based on very simple principles. This allows us to provide a full analytical analysis of the agent’s performance and to illustrate the benefit the agent gains by generalizing. Specifically, we show that already in basic (but extreme) environments, learning without generalization may be impossible, and demonstrate how the presented generalization machinery enables the projective simulation agent to learn.

Leave a Reply

Your email address will not be published. Required fields are marked *

By continuing to use the site, you agree to the use of cookies. more information

The cookie settings on this website are set to "allow cookies" to give you the best browsing experience possible. Cookies are used to retrieve and process the following user data using Google Analytics: a location of user’s device, type and version of operating system, type and version of a browser, type of user’s device and screen resolution, the source from which user came from, a language of operating system and browser. The following operations will be performed with cookies and user data: collection, recording, arrangement, accumulation, storage, specification (updating, alteration), retrieval, use, transmission (providing access), blocking, erasure or destruction of data. If you continue to use this website or you click "Accept" then you are consenting to this.

Close