A Reinforcement Learning system comprises several key components: the agent (learner), the environment (with which the agent interacts), actions (choices made by the agent), states (current situations), rewards (feedback from the environment), policy (strategy for action selection), and value function (estimation of expected rewards).