Memories

Default memory: Replay with default argument capacity

class tensorforce.core.memories.Recent(name, capacity, values_spec, device=None, summary_labels=None)[source]

Batching memory which always retrieves most recent experiences (specification key: recent).

Parameters:
  • name (string) – Memory name (internal use).
  • capacity (int > 0) – Memory capacity, in experience timesteps (required).
  • values_spec (specification) – Values specification (internal use).
  • device (string) – Device name (default: inherit value of parent module).
  • summary_labels ('all' | iter[string]) – Labels of summaries to record (default: inherit value of parent module).
class tensorforce.core.memories.Replay(name, capacity, values_spec, device=None, summary_labels=None)[source]

Replay memory which randomly retrieves experiences (specification key: replay).

Parameters:
  • name (string) – Memory name (internal use).
  • capacity (int > 0) – Memory capacity, in experience timesteps (required).
  • values_spec (specification) – Values specification (internal use).
  • device (string) – Device name (default: inherit value of parent module).
  • summary_labels ('all' | iter[string]) – Labels of summaries to record (default: inherit value of parent module).