Value iteration is guaranteed to converge if the discount factor satisfies 0 < γ < 1