In contextual bandits, the reward produced by each arm is dependent on the context