[Tech Update] AI Performance Benchmarks with Hailo-8™ AI Modules on UP

FredyHsu

AI Performance Benchmarks with Hailo-8™ AI Modules on UP  UP aims to bridge the gap for your AI needs. Leveraging a wide range of platforms based on Intel technology alongside extensive AI partners, UP offers solutions to power artificial intelligence and edge computing. We are happy to announce our next generation of AI capabilities using the Hailo-8™ M.2 AI Acceleration Module together with UP platforms. Check below for more details. Hailo AI module  The latest Hailo-8 M.2 AI module delivers unprecedented AI performance for UP edge devices with high power efficiency Hailo-8™ AI Processor. Power your AI solutions to meet next-generation demands and step up your UP Squared Pro/ UP Squared 6000/ UP Xtreme i11 performance with best-in-class AI processor in a module. Execute in real-time and with low-power deep neural network inferencing for a broad range of market segments.   Form Factor M.2 2280 B+M key AI Processor Hailo-8™ M.2 AI processor with up to 26 TOPS and best-in-class power efficiency Dimensions 22 x 80mm via breakable extensions Interface PCIe Gen-3.0, 2 lanes (up to 16Gbs) Supported Frameworks TensorFlow and ONNX Supported OS Linux, Windows Certification CEE, FCC See below benchmarks for details on performance and power-efficiency data of Hailo-8™ AI Processor.  Xavier NX results are using batch=8 (while Hailo-8 and Jetson Nano are using batch=1) and that Jetson Nano is limited to FP16 (while Hailo-8 and Xavier NX are INT8). NVIDIA results for batch=1 and INT8, respectively, are expected to be lower. * MobileNet_v3 – the benchmarked model flavor is MobileNet_v3 Large Minimalistic ** Figure for processing 8 simultaneous video streams NOTE: Check the link for the latest benchmark results from Hailo. Supported UP Products  The Hailo-8 M.2 2280 B+M key AI Acceleration module is compatible with UP Squared Pro, UP Squared 6000, and UP Xtreme i11  which are powerful computing platforms built for industrial applications to scale the Industry Edge Solution. UP Squared Pro features the Intel Atom® Series processors (formerly Apollo Lake), which run at speeds up to 2.5 GHz. UP Squared 6000 comes with the latest Intel Atom® Series processors (formerly Elkhart Lake) which offer up to 1.7x better performance and twice the performance for 3D graphics compared with the previous generation UP Squared Pro (formerly Apollo Lake). UP Xtreme i11 is powered by the latest 11th Generation Intel® Core™ Processors, which can clock up to 4.4 GHz with only 28 watts TDP and 15 watts cTDP. For the even more power-efficient performance at the edge.    UP Products UP Squared Pro UP Squared 6000 UP Xtreme i11 Dimension 101.6mm x 101.6mm 101.6mm x 101.6mm 120 mm x 122mm CPU Intel® Celeron® N3350 (up to 2.4 GHz) Intel® Pentium® N4200 (up to 2.5 GHz) Intel Atom® x7-E3950 (up to 2.0 GHz) Intel® Celeron® N6210 (up to 2.6 GHz) Intel® Pentium® J6426 (up to 3.0 GHz) Intel Atom® x6413E (up to 3.0 GHz) Intel Atom® x6425RE (up to 1.9 GHz) Intel® Core™ i7-1185GRE (up to 4.4 GHz) Intel® Core™ i5-1145GRE (up to 4.1 GHz) Intel® Core™ i3-1115GRE (up to 3.9 GHz) Intel® Celeron® 6305E (up to 1.8 GHz) RAM 2GB, 4GB, 8GB LPDDR4 2GB, 4GB, 8GB LPDDR4 2x DDR4 2 channel SO-DIMM VERTICAL MAX 64GB @ 3200MT/s Storage eMMC 32 GB / 64 GB eMMC 32 GB / 64 GB via 1x SATA 3.0 connector with power connector Expansion slot used for Hailo module 1x M.2 M key 2280 (PCIe Gen-2.0, 1 lane) 1x M.2 M key 2280 (PCIe Gen-3.0, 2 lanes) 1x M.2 M key 2280 (PCIe Gen-3.0, 2 lanes) Supported OS Ubuntu 20.04 host OS, Hailo software via Ubuntu container Ubuntu 20.04 host OS, Hailo software via Ubuntu container Ubuntu 20.04 host OS, Hailo software via Ubuntu container   This table is also available on our wiki. Try Hailo-8™ M.2 2280 B+M key AI Acceleration Module on UP products: UP Squared Pro: https://up-shop.org/upsproboardswith-add-ons.html UP Squared 6000: https://up-shop.org/ups6000series.html UP Xtreme i11: https://up-shop.org/up-xtreme-i11-boards-0001-series.html Set up information & related documents: https://github.com/up-board/up-community/wiki/Hailo Getting Started Guide video: https://youtu.be/ookjOPzhIxc   Additional information on Hailo Hailo-8™ AI Acceleration Module Demos and White papers: https://hailo.ai/resources/  Developer Zone: https://hailo.ai/developer-zone/

Hailo 8 Getting Started Guide on UP series
 

Watch our step-by-step getting started guide video now!

SeanPark

I signed up Hailo's website as an advanced user with Hailo-8 module serial number.
By the way, I cannot download S/W(Software suite, docker image, etc.) on their developer zone.

At this link (https://downloads.up-community.org/download/hailo-8-setup/),
it only has old version and there seems to be a download error.

Could you check the latest S/W version and access authorization to Hailo?

Thanks

FredyHsu

Hi @SeanPark ,

Kindly contact directly with Hailo for their developer zone question.

Please refers to our Wiki page for prevalidated docker version and more information.
https://github.com/up-board/up-community/wiki/Hailo#compatible-boardssystems

Cheers,
UP Team

SeanPark

Thanks

SeanPark

Dear @UP Team,

By the way, Hailo had released TAPPAS 3.19.1.
When would the data be uploaded on up-board web site?
And how can we compile new model which is not included on TAPPAS or Hailo's model-zoo?

Thanks

SeanPark

Hi @FredyHsu

Though I signed up Hailo's website,
Hailo's developer zone is not authorizing my account as 'advanced' grade.

How can I download dataflow compiler?

Thanks

Pablitinho

@SeanPark I have the same problem. Did you get the compiler?
Thanks in advance!!