Today AI chip startup Groq announced that their new processor has achieved 21,700 inferences per second (IPS) for ResNet-50 v2 inference. Groq’s level of inference performance exceeds that of other ...

So is ResNet-50 a good benchmark for evaluating relative performance of inference accelerators? If your application is going to process small images (300 x 300 pixels or smaller), then ResNet-50 ...