Memories

Default memory: Replay with default argument capacity, so an int is a short-form specification of a replay memory with corresponding capacity:

Agent.create(
    ...
    memory=10000,
    ...
)
class tensorforce.core.memories.Replay(capacity=None, *, device='CPU', name=None, values_spec=None, min_capacity=None)

Replay memory which randomly retrieves experiences (specification key: replay).

Parameters:
  • capacity (int > 0) – Memory capacity (default: minimum capacity).
  • device (string) – Device name (default: CPU:0).
  • name (string) – internal use.
  • values_spec (specification) – internal use.
  • min_capacity (int >= 0) – internal use.
class tensorforce.core.memories.Recent(capacity=None, *, device='CPU', name=None, values_spec=None, min_capacity=None)

Batching memory which always retrieves most recent experiences (specification key: recent).

Parameters:
  • capacity (int > 0) – Memory capacity (default: minimum capacity).
  • device (string) – Device name (default: CPU:0).
  • name (string) – internal use.
  • values_spec (specification) – internal use.
  • min_capacity (int >= 0) – internal use.