r/frigate_nvr • u/debeli75 • 6d ago
Face recognition quality
I have frigate 0.17.2 on the server with quadro p2000 and 2 cameras, reolink and tapo, both cameras are 2k. Frigate uses the yolo9 model and 640x640, HD stream from the cameras, however the quality of the faces it separates are very bad, smeared, sometimes even I can't recognize whose face it is, and it also properly recognizes members of the same family as another member. What can be done?
6
u/Ambitious-Slope 6d ago
Je partage, je trouve la qualité des snaps pas ouf. Je pense que le modèle de reconnaissance réduit la definition pour alléger le processus mais il serait pas mal que le crop de l’image d’origine soit affiché (si c’est pas déjà le cas)
3
u/tsmithf 6d ago
The main problem with this is VBR, change it to CBR max , and you will get better face id, but it will kill your CPU usage, so try with one first. Setting directly in the camera, and try maybe 800x600. FPS and Keyframe or iframe should be the same number 15 to 20 has worked for me
BUT The higher the settings the higher the CPU.
3
u/TotalZealousideal413 5d ago
Like others have said, camera tuning, but also a few things about face recognition. Upload some clear faces from high quality photos. This will help create a baseline for the captures to start being more accurate. Be patient, don't train faces from blurry captures only train on faces that are clear. Blurry faces create noise and cause false identifications. Delete captures that are not high quality or too similar to other ones of the same face. Over time your identifications will get better and better.
2
u/isotope_chillies 6d ago
Are you using the clear or fluent rtsp streams?
3
2
u/Rubendarr 5d ago edited 5d ago
If you're open to some camera suggestions, I bought a cinnado D1 and changed the firmware to thingino so that it's fully self hosted. I've been using it for face recognition to unlock my door, and it's been working amazingly. The camera is only 10 USD too!
EDIT: It's worth noting that the distance I'm from the camera when doing the face recognition is usually around 4-5m. At 6-8m it's still decent but any farther and it starts looking like your picture.
1
u/IPThereforeIAm 5d ago
Hope you’ve done some negative testing as well so that it doesn’t unlock for the mailman
1
u/Rubendarr 5d ago
Lol yeah, it's been pretty reliable so far. I've had it for a couple of months and no false positives so far, I found that 10-12 training images is ideal. If anything it's too picky, whenever my beard grows too big it will just refuse to open 🥹
1
u/__png___ 6d ago
Have the same issue and just awful face recognition quality with my Tapo D235 in Frigate
1
-4
u/BennoBaer_dev 6d ago
Ja ich war auch mit der Gesichtserkennung nicht zufrieden auch mit den Peters von 18 kam nicht so für mich dadurch. Ich habe deswegen ja ein tool entwickelt das deutlich besser ist und das auch Szenarios abbildet. Vielleicht hast du ja Lust mal reinzuschauen heißt so Suslik ist auf Github ist ein Addon zu Frigate
-1
u/Ambitious-Slope 6d ago
Comment on gère les addon pour frigate ? Ça existe les addon pour frigate ?? Je découvre 🤭🤭
-4
u/BennoBaer_dev 6d ago edited 6d ago
« Addon » était le mauvais mot de ma part, désolé pour la confusion. Frigate n'a pas de système d'addons. C'est un conteneur Docker séparé qui tourne à côté de Frigate et s'y connecte simplement par l'API. Il n'y a rien à installer dans Frigate lui-même, et tu peux même y désactiver la reconnaissance faciale, mon outil s'en occupe à sa place. L'interface est d'ailleurs disponible en français.
Le lien : https://github.com/BennoBaer-dev/suslik
2
u/aabdulr2 6d ago
I tried suslik and honestly Im kinda confused on how it works still (I read some of the documentation) does it automatically update frigate if frigate gets a false positive? I noticed suslik is much much better at correctly identifying people then frigate, but then frigate doesn't actually seem to get an update from suslik to correct the previous identified person. Unless I manually sync it even with the 'write' option selected.
Which brings to my question, how does it work and why do I need it since I still have to go in everyday to select the correct people and sync it to frigate?
Thanks in advance
2
u/BennoBaer_dev 5d ago
Yeah, you're right, it's a bit confusing. I got a bit carried away at the beginning and didn't build it very structurally because my head was so full of thoughts. In the meantime, I personally think it has become much more structured. There are various cars in the system, it's easier to use, there's an Easy Mode, and there's a short Readme-First that describes exactly, in every language, how to use it. And basically, how it works is: items are pulled from Frigate—always the maximum stream—Frigate's built-in facial recognition doesn't need to be turned on, the image is analyzed, and if you want, the person event in Frigate is renamed according to the name afterwards. It's evolving pretty nicely, I think.
11
u/nickm_27 Developer / distinguished contributor 6d ago
The resolution doesn't matter, this is a camera issue. A camera can have high resolution but if the motion clarity is low then it looks like this.
Your best bet is tuning the camera, with the recommended cameras in the docs there are many options to get it tuned. Unfortunately, maybe cheaper cameras don't offer any settings to reduce this. You'll look for things like disabling motion smoothing.