IBM's NorthPole chip runs AI-based image recognition 22 times faster than current chips (techxplore.com)
from throws_lemy@lemmy.nz to technology@lemmy.world on 21 Oct 2023 11:34
https://lemmy.nz/post/2550068

#technology

threaded - newest

dsemy@lemm.ee on 21 Oct 2023 12:25 collapse

I wonder if we’ll ever see dedicated AI cards for end users (like we have GPUs and sometimes sound cards).

Schmeckinger@feddit.de on 21 Oct 2023 12:33 collapse

Isnt that already a thing? Its just not PCIE yet as far as I know.

Munkisquisher@lemmy.nz on 21 Oct 2023 12:41 collapse

Google Coral. I use one for accelerating person detection on my home cameras. They are usb3 or single lane m.2 pcie

BigBlackCockroach@lemmy.world on 21 Oct 2023 13:16 collapse

Can you help us better understand how you integrated Coral powerd accelerated person detection across your home camera surveillance system?

nikt@lemmy.ca on 21 Oct 2023 14:20 next collapse

www.scrypted.app with tensorflow plugin is a good option

glimse@lemmy.world on 21 Oct 2023 14:29 collapse

Check this page out:

docs.frigate.video

I don’t currently have cameras but Frigate is the NVR I will be using when I move.

As for using Coral, someone on lemmy tipped me off that Intel’s gen6 (and beyond) have performance similar to Coral using OpenVino. I haven’t dug into it yet but here’s a doc on it, seems pretty easy to set up.

docs.frigate.video/configuration/detectors/

Munkisquisher@lemmy.nz on 21 Oct 2023 17:59 collapse

Yes this is what I’m using, frigate with home assistant. Thanks for the openvino tip, I’m looking at adding local voice assistant now so I’ll see if that or the coral can be used.

glimse@lemmy.world on 21 Oct 2023 19:26 collapse

I can’t confirm but my understanding is that any Intel CPU newer than like 2015 has the right component to do it so yeah it’s worth looking into!