Raspberry PI AI Cov Khoom Siv

Yuav ua li cas ua raspberry PI AI KIT ua haujlwm

Lub Raspberry PI AI KIT hloov koj lub PI 5 mus rau hauv lub zog muaj peev xwm ntawm lub platform uas muaj peev xwm los ntawm kev sib txuas nrog Hailo {}} 8l accelerator nti. Hauv cov lus yooj yooj yim, nws ua haujlwm los ntawm kev ua haujlwm oi cov kev ua haujlwm ntawm CPU rau cov haujlwm ua noj ua ke thib ob (13}} 2 watts thaum cov neeg ua haujlwm raug (Source Rau $ 70, koj tau txais cov khoom siv nrawm nrawm uas ua kom pom cov khoom siv tiag tiag, ntsuas kev kwv yees, thiab cov duab cais tawm tau zoo rau ntawm $ 60 ib leeg-board computer.

Kuv tau pom qhov no Architecture tshwj xeeb ntse. Hloov chaw tos xyoo rau raspberry PI los tsim tsa NPU, lawv tau koom tes nrog 26 saum toj no tau muaj rau cov uas xav tau ntau lub zog ntxiv (source: techcrunch.com, 2024).

Lub vajtse architecture: li cas cov khoom sib txuas

Cov khoom siv AI AI muaj ob daim ntawm lub cev uas ua haujlwm ua ib qho system. Ua ntej, koj muaj cov nom raspberry pi m.2 lub kaus mom + ntawm yog ib tus PIs 5's 40 {{{{5.2 2242 lossis 2280 qhov. Thib ob, muaj tus hailo-8l ai Accelerator Module-ib daim npav me me - ib daim npav me me ntawm tus pas uas ntsaws rau hauv qhov ntawd.

Ntawm no yog dab tsi tshwm sim thaum koj txuas txhua yam:

Lub kaus mom M.2 kos lub zog los ntawm PI 5 Gpio Pins thiab teeb tsa PCIE Gen 2 lossis Gen 3 Txuas ntxiv los ntawm Pawg Thawj Pcie interface. Tus lawg -} 8l module tau txais ob lub zog thiab cov ntaub ntawv los ntawm kev sib txuas no M.2. Koj lub PI 5's CPU daws cov haujlwm ua haujlwm, thov logic, thiab ua ntej ua ntej, thaum lub Hailo Chip yuav siv thaum muaj kev sib tw Network Intererence yuav tsum tshwm sim.

PCI Ps Kev Sib Txuas Txuas Rau Kev Ua Haujlwm

Qhov kev sib txuas ceev teeb meem tseem ceeb ntawm no. Kev soj ntsuam soj ntsuam tus nqi coj los ua thaum khiav PCIs rau gen 2 ntawm tib lub yolov8s qauv (Source: Ringasperrypi.com, 2024). Lub PI 5 txhawb nqa PCIE Gen 3 x 1, muab koj cov lej ntawm lub CPU thiab} Accelerator- txaus cov haujlwm hauv computer uas tsis muaj lub zeem muag computer.

Lub Hailo-8L ua tiav 3-4 saum toj ib watt efficiency, tso nws ua ke ntawm kev ua tau zoo ib yam li ib qho thiab ua tau zoo ib qho (Source: Jeffgeerling.com, 2024). Thaum koj muaj nuj nqi nyob rau hauv PI 5's 3-4W daim ntawv sau cia, tag nrho cov txheej txheem kos tsis muaj zog dua lub xov tooj charger thaum ua ai workloads.

Sab hauv Hailo-8L: neural network nrawm piav qhia

Tus lawg - 8l tsis yog ib qho dav dav- nws yog ib qho tshwj xeeb rau kev khiav neural network tau zoo. Xav txog nws zoo li daim npav graphics, tab sis es tsis txhob muab cov duab peb ceg, nws tau ua kom zoo rau kev sib npaug rau kev sib npaug thiab cov kev hloov pauv uas muaj zog AI qauv AI qauv.

Lub nti siv cov qauv khoom ntiag tug Hailo hu "kev teeb tsa zoo li qub." Yog tias tsis tau sib sib zog nqus hauv cov khoom lag luam sillicon, qhov no txhais tau tias cov nti muaj cov haujlwm ua haujlwm rau cov khoom siv neural

Yuav ua li cas inference yeej tshwm sim

Thaum koj khiav ib tus qauv zoo li Yolov8 rau cov khoom nrhiav, ntawm no yog cov haujlwm yooj yim:

Koj lub koob yees duab ntes cov thav ntawv thiab xa lawv mus rau PI CPU. Lub CPU ntawm cov duab ua ntej - r resizing rau tus qauv qhov ntev, hloov xim xim, li qub pixel values. Cov ntaub ntawv npaj ua ntej no tau xa los ntawm PCIE npav mus rau Hailo - 8l. Tus accelerator sau neural network, tso tawm cov cim raw cov txiaj ntsig tau (bounding thawv, cog qoob loo cov qhab nia, kev twv ua ntej). CPU tau txais cov txiaj ntsig thiab cov lus tshaj tawm {{} Kev ua cov thawv luam tawm, kev sib nqus ntawm cov duab, hloov kho koj daim ntawv thov UI.

Qhov kev zoo nkauj ntawm kev faib ua haujlwm ntawm kev ua haujlwm no tau qhia hauv cov qauv. Cov ntawv xeem ua qauv qhia cov khoom siv Ai thiab Landmark tshaj li 5.8 zaug nrawm dua li 30's CPU ib leeg (source: raspberrypi.com, 2024).

Txhawb hom qauv tawm tswv yim

Tus Hailo-8L tsis khiav Tensorflow lossis Pytorch qauv ncaj qha. Koj yuav tsum hloov koj cov qauv uas siv Hailo's Dataflow compiler, uas ua kom zoo rau lawv rau lub nti kos duab. Cov txheej txheem ua ke yuav siv koj cov qauv kawm (feem ntau onnx hom ntawv) thiab muab nws rau Hailo kho vajtse, thov kom muaj nuj nqis thiab lwm yam kev xaiv tau.

Ua ntej -}} Muab sau ua qauv rau cov qauv Hailo muaj ntau qhov, Yolov 5 variants nyob rau ntau qhov kev faib tawm, thiab ua qauv kwv yees. Yog tias koj ua haujlwm nrog cov qauv kev cai, cov khoom ua ke ua ke yuav tsum muaj qee qhov kev kawm tab sis ua raws li kev coj ua Ai.

Kev Siv Fais Fab thiab Kev Tswj Cov thermal

Ib ntawm cov khoom siv AI uas muaj nqis tshaj plaws yog qhov ua tau zoo. Tus Hailo-8L feem ntau kos 1-2 watts thaum nquag ua hauj lwm, nrog peaks nyob ib ncig ntawm 5 watts nyob ntawm cov qauv nyuaj thiab qhov chaw: liviater, 2024). Ua ke nrog PI 5's Kev noj pib pib, koj tab tom saib ntawm 5-9 Watts tag nrho cov zog hauv qab kabmob AI hauv qab kabmob AI raws li cov haujlwm AI hauv tebchaws AI hauv qab kabmob AI hauv qab kabmob AI hauv qab kabmob AI raws li AI cov haujlwm.

M.23 muaj xws li cov cua sov me me, thiab ua haujlwm ib txwm muaj, passive txias ua pov thawj txaus. Kuv tau pom cov nti nyob twj ywm txaus uas thermal throtling tsis yog kev txhawj xeeb rau cov kev thov computer. Rau cov phiaj xwm ua haujlwm lossis cov khoom siab txuas ntxiv {{3} Luv mus rau koj PI 5 rooj plaub pab ob qho tib si CPU thiab Ai Accelerator kom ua tiav.

Muab piv rau cov kev xaiv qhia txog cov txiaj ntsig nqi: an Nvidia jetson orin nano pib ib ncig $ 249 thiab rub tawm 7-15w nyob rau hauv kev thauj khoom. Google's coral USB tus nqi accelerator raug nqi $ 60 tab sis tsuas yog 4 saum thiab yuav tsum tau USB 3.0 bandwidth. Lub intel neural laij lo 2 yog txiav. Cov khoom siv AI AI ntaus cov khoom qab zib ntawm tus nqi, kev ua tau zoo, thiab kev ua tau zoo thiab kev ua haujlwm tsis muaj nyob ua ntej 2024.

Software stack: los ntawm OS los thov

Cov khoom siv AI yuav tsum tau Raspberry Pi OS (64- ntsis) bookworm los yog tom qab. Hailo muab cov software suite uas suav nrog cov ntsiav kev tsav tsheb rau kev sib txuas lus pcie, Runthon kev sib koom ua ke, thiab cov rpicam {}} apps koom kev koom ua ke rau cov koob yees duab ua haujlwm.

Teem koj thawj tus qauv

Kev teeb tsa yuav siv li 15 feeb yog tias koj ua raws li cov ntaub ntawv ua haujlwm. Tom qab nyem lub OS thiab txuas cov khoom siv kho vajtse, koj khiav Hailo txoj kev teeb tsa, uas ntxiv cov qauv siv tau tsim nyog thiab cov tsev qiv ntawv. Rpicam - Cov apps tau hloov kho kom suav nrog Hailo txhawb nqa, cia koj khiav AI qauv ncaj qha los ntawm lub koob yees duab raj.

Kuaj nrog cov Demos muaj nrog cov qauv hauv kev ua:

rpicam-hello --post-process-file /usr/share/rpicam-assets/hailo_yolov8_pose.json

Qhov lus txib tau ntes cov duab yees duab, khiav lawv los ntawm ib qho kev kwv yees qauv ntawm Hailo Chip, thiab qhia cov txiaj ntsig hauv {{lub sijhawm. Tus ncej theem yog nyob ntawm cov qauv ua qauv nyuaj- Cov qauv sib zog zoo li Yolove8m yuav khiav ntawm 20-30 FPS.

Rau lub sej kev loj hlob, cov haujlwm ua haujlwm zoo li tus qauv OpenCT Hailo -} hu rau:

Koj import lub Wailort Library, thauj koj cov qauv sau ua ke, pub ua ntej cov ntawv sau ua ntej, thiab cov txheej txheem ua tiav rau hauv koj cov ntawv thov kev sau ntawv. Cov Abstract hwm feem ntau cov nyom, tab sis to taub cov tswv yim / output tensor formats yuav tsum tau nyeem cov qauv ntaub ntawv.

{- world thov cov piv txwv

Ob peb txoj haujlwm ua cov tswv yim Ai cov khoom siv. Cov khw muag khoom muag khoom siv cov khoom siv AI uas tau ua tiav ntawm CPU saib xyuas cov khoom lag luam CPU rau Warehouse intrusions (Source: forums.rasperrypi.com, 2024). Qhov dual - Qauv kev qhia pom tias koj tuaj yeem ua ke nrawm nrog CPU {{}} raws qauv thaum xav tau.

Cov ntawv thov kev nyab xeeb tau txais txiaj ntsig los ntawm cov khoom siv tiag tiag - lub peev xwm. Lub ntsej muag pom tau cov tshuab ntws ntawm 25-30 FPS, enabling kev tswj hwm lossis qhua nkag mus tsis muaj huab chaw ua haujlwm. Pose Kev kwv yees khiav nrawm txaus rau kev siv dag zog uas tau taug ib ce ib ce lossis suav rov ua dua.

Cov tsiaj qus saib xyuas kev siv hluav taws xob tsawg dua {{}} solar {solar} Solit thiab lawv tus cwjpwm tsis muaj roj teeb hloov roj. Kev sib xyaw ntawm PI cov versatility thiab hardware - accelerated Ai ua rau yav dhau los cov khoom siv tsis tau.

[Kev Pom Zoo Tshawb Pom: ntxig duab qhia cov ntaub ntawv ntws los ntawm lub koob yees duab ntws los ntawm lub koob yees duab → pcie → pi cpu (cov txiaj ntsig) → zaub / Cia]

Txwv thiab thaum tsis txhob siv cov khoom siv AI

Cov khoom siv ua haujlwm ci ntsa iab rau qhov tseem ceeb tab sis yuav tsis pab nrog qauv kev cob qhia {}} uas tseem xav tau huab gpus lossis chaw ua haujlwm. 13 saum yuav zoo li zoo nkauj, tab sis nws yog tam sim no nyob ze Datacine. Cov qauv sib txawv lossis ntau yam ntws ib txhij zuj zus tuaj yeem cuam tshuam ntau dhau tus accelerator.

Cov qauv sib xyaw yuav tsum tau ua kom pom zoo. Koj raug kaw rau hauv architectures uas Hailo tus neeg tsim cov compiler txhawb nqa. Txiav - cov qauv kev tshawb fawb los ntawm cov ntaub ntawv tshawb fawb yuav tsis ua haujlwm kom txog thaum tus neeg txhawb nqa lossis koj nqis peev tau sijhawm hauv kev ua kev cai ua ke. Tus qauv uas muaj kev siv tsiaj zoo tshaj plaws, tab sis cov ntawv thov tshwj xeeb kuj yuav xav tau kev ua haujlwm.

Latency teeb meem rau qee cov ntawv thov. Thaum lub hailo - 8l yog ceev nrawm, khiav secrerence, thiab rov qab los ntxiv ob peb multiseconds piv rau kev sib xyaw NPUS. Txog Robotics lossis Real-Time Contre-lub sij hawm tswj cov tshuab uas txhua millisecond suav, qhov kev ncua sij hawm tom qab no yuav tseem ceeb.

Kev siv nyiaj txiag cuam tshuam rau cov lus tshaj tawm tus nqi. Yog tias koj twb muaj ib lub PI 5, qhov $ 70 AI khoom siv tsis muaj - lub hlwb. Yog tias koj pib kos los ntawm kos, koj siv $ {{} rau cov khoom siv ua tiav +}}} Ai cov khoom sib tw pib nyob ntawm koj cov kev xav tau kev ua tau zoo.

Muab piv cov khoom siv kho vajtse

Lub kaus mom AI + cov nqi muaj kev sib xyaw zoo dua nrog PI 5 tus qauv thiab xa cov khoom siv neeg zoo ib yam li cov khoom siv qub ntawm 13 theem tier (sourmedeekly.com, 205). Cov 26 saum version ob npaug dhau los ntawm kev siv uas yuav tsum ua cov qauv kev daws teeb meem ntau dua.

Cov teeb meem teeb tsa teeb tsa thiab cov kev daws teeb meem

Cov khoom siv AI tsis raug kuaj pom tom qab kev teeb tsa

Qhov no feem ntau qhia tau tias muaj teeb meem PCI. Kuaj xyuas cov PCIE nyob rau hauv PI tus config.txt cov ntaub ntawv thiab tias M.23 lub kaus mom yog zaum ntawm txhua tus gpio pins. Khiav LSPCI yuav tsum qhia lub hailo ntaus ntawv yog tias kev sib txuas ua haujlwm.

Cov qauv khiav qeeb dua li qhov kev cia siab

Txheeb xyuas koj tau siv lub hailo accelerator thiab tsis poob rov qab mus rau cpu inference. Kos lub cav rau qhov yuam kev thaum lub sijhawm thauj khoom. Xyuas kom koj tus qauv yog muab tso ua ke rau Hailo architecture- Sim ua cov qauv khiav tsis hloov dua tshiab yuav swb lossis ua txhaum cai CPU.

Qhov kev sib tsoo hauv lub nra

Cov teeb meem hluav taws xob muaj zog ua rau muaj peev xwm hnyav. Lub pi 5 xav tau 5V / 5A (27W) yam tsawg kawg, thiab cov khoom siv AI ntxiv rau qhov yuav tsum tau ua. Siv cov nom raspberry pi 27W muab khoom siv lossis sib npaug. Lub zog uas tsis txaus ua rau voltage tee uas tsoo lub system thaum lub sij hawm intrerence.

Lub koob yees duab sib xyaw ua haujlwm tsis ua haujlwm

Rpicam -} Cov apps hilo yuav tsum muaj cov rpicam version tshwj xeeb. Hloov kho txhua yam nrog sudo apt hloov tshiab thiab sudo apt kev hloov kho ua ntej kev daws teeb meem ntxiv. Qee lub koob yees duab cov qauv xav tau kev teeb tsa kev hloov pauv hauv /Boot/config.txt ua haujlwm ua haujlwm tau zoo nrog AI pipeline.

Yav tom ntej - Ua pov thawj koj cov peev

Lub modular tsim txhais tau tias koj tuaj yeem hloov kho nws tus kheej. Tam sim no, koj yuav khiav $ 70 AI cov khoom siv nrog 13 saum. Lwm xyoo, yog tias koj daim ntawv thov xav tau kev ua tau zoo ntxiv rau 26 saum toj kawg nkaus + rau $ 11. Lub software uas tsis tau hloov pauv ntawm Hailo-8L thiab Hailo-8 Chips.

Hailo tseem nthuav dav lawv tus qauv zoo thiab txhim kho cov compiler txhawb nqa. Cov qauv uas yuav tsum tau ua kom zoo rau lub Rau Hli 2024 tam sim no muaj pre- compiled versions. Qhov no hloov kho kom sai li lub platform matures. The ecosystem around Pi-based AI projects grows rapidly-forums, tutorials, and third-party tools make implementation easier every month.

Software hloov tshiab coj kev ua tau zoo dhau. Cov qauv qhia thaum ntxov pom qee cov qauv khiav ntawm x FPS; Cov tsav tsheb tau zoo thiab cov kho firmware firmware tau muaj zog tau txhawb cov lej ntawm 10-20% tsis muaj cov khoom siv hloov kho. Nyob tam sim no nrog OS thiab Hailo Pob hloov tshiab maximizes koj cov khoom siv lub peev xwm.

Cov Lus Nquag Nug

Puas yog Raspberry PI AI cov khoom siv ua haujlwm nrog cov qauv PI qub?

Tsis yog, cov khoom siv AI yuav tsum muaj raspberry pi 5. Tus PCIE txuas yog qhov tseem ceeb rau lub siab- bandwidth xav tau ntawm CPU thiab ceev dua. Thaum ntxov PI qauv tsis muaj kev txhawb nqa PCI, ua rau lawv tsis sib xws nrog cov architecture no.

Kuv tuaj yeem khiav ntau AI qauv ib txhij?

Yog lawm, tab sis kev ua tau zoo nyob ntawm cov qauv muaj kev nyuaj thiab tus lej cim. Tus lawg - 8l tuaj yeem ua lub sijhawm {}}}}}}}} Cov qauv hnyav grurrately yuav txo tus ncej tus kheej. Cov tswv yim tswv yim feem ntau khiav ib tus qauv nrawm thiab ib lossis ntau dua CPU-based qauv hauv parallel.

Yuav ua li cas ua qauv coj ua ke?

Yooj yim qauv compile compile nyob rau hauv 5 -} 15 feeb nyob rau ib lub laptop zoo. Cov qauv nyuaj nrog ntau txheej yuav siv sijhawm 30-60 feeb. Koj tsuas yog suav ib zaug ib tus qauv, tom qab ntawd tso cov khoom sau ua ke .Hef ntawv rau koj pi. Pre-compiled qauv los ntawm tus qauv zoo xav tau tsis muaj kev muab tso ua ke txhua.

Puas yog AI khoom ua haujlwm tsis muaj internet txuas?

Kiag li. Thaum koj tau nruab lub software thiab sau ua ke koj cov qauv, txhua yam khiav hauv zos. Qhov no ua rau cov khoom siv ua kom zoo rau kev ceev ntiag tug, chaw taws teeb, lossis lwm qhov chaw nkag mus tsis tau lossis tsis muaj.

Kuv puas tuaj yeem qhia cov qauv ncaj qha rau ntawm cov khoom AI?

Tsis yog, tus hailo - 8l yog cov khoom siv tau tshwj xeeb nkaus xwb. Kev cob qhia yuav tsum muaj kev cob qhia ua kom zoo sib txawv thiab kev siv zog ntau dua. Cov neeg ua haujlwm raug cuam tshuam nrog huab gpus lossis cov chaw ua haujlwm nrog pytorch / tensorflow, hloov nrog hailo cov cuab yeej, tom qab ntawd xa tawm cov qauv sau rau koj PI.

Dab tsi yog qhov txawv ntawm AI cov khoom thiab ai kaus mom +?

Cov khoom siv AI qub AI Bundles Lub M.2 lub kaus mom nrog Hailo-8L module rau $ 70. Lub kaus mom AI "yog cov ntaub ntawv hloov kho tau zoo dua nrog cov ntaub ntawv zoo dua, muaj nrog ib tus 13 saum toj no Hailo-8L ($ 26 saum Hailo-8 ($ 110). Kev ua tau zoo ib yam nyob rau ntawm 13 theem tier; Xaiv raws li qhov muaj thiab seb koj puas xav tau kev txhim kho lub cev zoo dua.

Cov khoom siv AI siv cov duab sib txawv ntawm cov duab?

Cov txheej txheem ntsuas nrawm dab tsi uas daws tau koj tus qauv tau kawm ntawm - ib txwm 640x640 lossis zoo sib xws rau cov khoom kuaj pom. Koj lub CPU daws cov koob yees duab lub koob yees duab tawm tswv yim kom phim cov qauv kev xav tau. Cov kev daws teeb meem siab dua yuav tsum muaj ntau lub sijhawm ua haujlwm dua tab sis tsis txhob cuam tshuam rau Hailo Inference nrawm txij li tus qauv tswv yim nyob qis qis tas mus li.

Puas yog tus hailo-8L tau tshaj tawm nrog tensorflow lite qauv?

Tsis ncaj qha. Koj yuav tsum hloov Tensorflow lite ua qauv rau onnx hom ntawv, tom qab ntawd sau lawv nrog hailo cov ntaub ntawv dataflow compiler. Coob tus uas muaj Tensorflow Lite Kev Hloov Paus yim yuav tsum tau hloov kho nyob ntawm cov qauv kev ua haujlwm thiab kev ua haujlwm siv.

Noj koj thawj kauj ruam

Pib nrog ua ntej -}} compiled demos kom nkag siab cov yam ntxwv ua ntej dhia rau hauv cov qauv kev cai. Cov khoom nrhiav pom thiab teeb tsa cov qauv kev twv kwv yees pom tias cov khoom siv lub peev xwm tsis xav tau ua cov qauv kev paub. Thaum koj nyiam nrog kho vajtse, kev sim ua nrog cov qauv sib txawv los ntawm Hailo Model Zoo kom pom qhov sib npaug ntawm qhov tseeb thiab nrawm rau koj daim ntawv thov.

Lub Raspberry PI AI KIT sawv cev rau kev hloov pauv tseem ceeb hauv ntug AI kev nkag tau. Thawj thawj zaug, cov hobbyists thiab me me- Cov neeg tsim kho computers tau tuaj yeem tso cov khoom siv tau zoo uas yav dhau los siv kho vajtse lossis huab. Kev sib xyaw ntawm Raspberry Pi cov ecosystem thiab hailo lub nrawm nrawm tsim uas tsis muaj nyob rau hauv lub sub- $ 100 pawg kom txog thaum 2024.

Txawm hais tias koj ua lub koob yees duab ntse kev ruaj ntseg, kev tshawb xyuas kev lag luam, lossis sim nrog Ai ntawm ntug, AI khoom muab cov haujlwm sib xyaw ua ke. Cov cuab yeej yog muaj pov thawj, cov software tau ua tiav sai sai, thiab cov zej zog yog nquag tsim cov kev daws teeb meem koj tuaj yeem kawm tau los ntawm thiab hloov kho.