Object detection Inference Speed Benchmarking on UP Squared Pro 7000

Hey Community,
Has anyone tested yolo or other object detection inferencing on Up Squared Pro 7000 GPUs (24EUs/32EUs)? For my application, I want to inference yolo-v8m fp16 model at ~30fps. Any insights on Up Squared Pro 7000 inferencing speed and AI TOPS would be a great help.

Privacy Policy