Distillation produces a more efficient model after the training is complete, but requires additional steps during training