-
Ensembling at inference time: voting, stacking, and when it’s worth the latency
A model that achieves 92% accuracy in 2 milliseconds may be more valuable in production than an ensemble that achieves 93% accuracy in 40 milliseconds. But what if the ensemble reaches 95%? And what i