Hi,
I am confused about the ResNet results from the neural part. I did the same test on my local M1 max machine using the script benchmark_coreml_infer.py The results curve is quite flat.
batch | sam/sec
25 | 487.92
50 | 486.80
100 | 477.55
150 | 470.45
Also, could I know where the GPU part curve comes from since cuda machines are not supporting CoreML.
Many thanks~