a. For a good unbiased estimator, we could use the average of the value-function for all the states in our state space