How does Face Tracking work?
1325 5 2018-12-28
Uploading and Loding Picture ...(0/1)
o(^-^)o
fans52700e84
lvl.1
Flight distance : 1088064 ft
United States
Offline

Hello
  How does face tracking work on the Osmo Poclet?  What makes it think it sees a face?  Eye, hair,  a special kind of movement?    What info does it use to calculate it sees a face?

2018-12-28
Use props
Ray-CubeAce
lvl.4

United Kingdom
Offline

Faces, within a little, and between most but not all people, have similar spacing between features that have strong contrast that a contrast detecting focus system can use. Lighting conditions may throw up problems from time to time though, as could stronger vertical contrasting objects in the background if the head movement was faster than the tracking ability. I'm sure these systems are tweaked and worked on all the time for improvement. A lot will depend on how much of the processing power is of the camera is devoted to this task. Some cameras have dedicated focusing systems using a separate sensor and processing chip for such things that in general have more space inside for such things.
2018-12-28
Use props
Nacho Rolling
lvl.1
Flight distance : 1088064 ft
United States
Offline

Ray-CubeAce Posted at 12-28 10:30
Faces, within a little, and between most but not all people, have similar spacing between features that have strong contrast that a contrast detecting focus system can use. Lighting conditions may throw up problems from time to time though, as could stronger vertical contrasting objects in the background if the head movement was faster than the tracking ability. I'm sure these systems are tweaked and worked on all the time for improvement. A lot will depend on how much of the processing power is of the camera is devoted to this task. Some cameras have dedicated focusing systems using a separate sensor and processing chip for such things that in general have more space inside for such things.

Do you think baldness could effect face tracking?
2018-12-28
Use props
DJI Gamora
Administrator

Offline

Hi, Apologies for the confusion. Facetrack will automatically enable when face is detected when the camera faces the user. You may refer to the User Manual for more detailed information. Hope this helps. Thank you for your support.
2018-12-28
Use props
Nacho Rolling
lvl.1
Flight distance : 1088064 ft
United States
Offline

DJI Gamora Posted at 12-28 11:13
Hi, Apologies for the confusion. Facetrack will automatically enable when face is detected when the camera faces the user. You may refer to the User Manual  for more detailed information. Hope this helps. Thank you for your support.

Thank you,  I was more interested in the technical side of how it works.  What markers it uses.  How it understands there is a face.
2018-12-28
Use props
Ray-CubeAce
lvl.4

United Kingdom
Offline

Nacho Rolling Posted at 12-28 10:50
Do you think baldness could effect face tracking?

Difficult for me to say but I suspect it's an offshoot from digitizing animation characters from live performance actors from the gaming and film industries. As in most instances, people judge how sharply eyes are in focus and the fact that eye colouring differs so much that some eye colouring from a shading point of view would be better than others. I would imagine it has more to do with the triangular spacing between say, eyes and mouth with possibly additional parameters depending on how much additional spare processing power there is to be had on the Pocket.
DJI has walked a very fine line with this.
Using such a wide aperture on such a small sensor is a very brave move on their part.
It does produce a slight background blur but using such a small sensor and a relatively wide viewing angle makes tracking and keeping focus much more difficult than a longer focal length would be.
The wider a viewing angle is the more difficult it is to get good separation between foreground and background. That makes the contrast around any object it is supposed to be tracking less contrasty than if it was a much narrower field of view where depth would be easier to separate. Phones manage it when taking still images by combining several shots and selectively blending them together while when shooting video they tend to use the advantage of using the narrower use of their lens aperture to keep both background and foreground in relative sharpness and therefore make it look as if they are doing a better job when they aren't.
I'm surprised the Osmo Pocket does as good a job as it is doing.
It's the same with the focus breathing problem some seem to be suffering from. They try focusing on a relatively bland section of the frame with no discernable strong contrast and the result is the camera hunts slightly to confirm it is focusing correctly. This is easier to control using larger sensors or smaller apertures on longer focal length lenses but difficult to achieve on wide angle lenses with larger apertures on smaller sensors.
I suspect this is why the active tracking asks for large boxes to be drawn around a whole object before it locks on. It needs some sharp edges of contrast to lock onto. If the subject then wanders close to another object with stronger contrast, the camera could switch to that if it gets within the target box area.
I'm not saying these things can't be improved upon but technically it is harder to achieve the more you miniaturize the equipment. This is also why mirrorless cameras are now incorporating phase detection pixels within the image sensor as phase detection is better in general and faster, and more capable as lighting conditions become less contrasty or dimmer. I can only hope that it will be possible in the near future to incorporate some of that technology into these smaller sensors.
2018-12-28
Use props
Advanced
You need to log in before you can reply Login | Register now

Credit Rules