Stereo: Add support for extended and subpixel together - #572
Conversation
|
Thanks. I think this logic makes sense. But to just check if I understand it correctly, here's my summary:
Is that a correct summary? |
It runs subpixel for range [0,96), and combines with extended range [96, 190], which is without subpixel, so the result is a hybrid. High resolution for long-range, small for close range (which already has high res). The smaller the disparity, the higher the depth, thus the difference between 2 consecutive depth values is larger, which results in a quantization effect. That's what subpixel does, fills the gap. E.g. the difference between disparity 30 and 31 in terms of depth is 7.1 cm (makes sense to do subpixel to reduce the gap), while the difference between disp 96 and 98 is just 1.4 cm (would it make sense to do subpixel to get sub 1.4 cm accuracy given sensor noise etc.?). This was mainly done to enable median filtering, but up to debate if we want to do subpixel for the extended range too. |
|
Ah I get it! This is slick! Thanks! |
Note:
When subpixel and extended are enabled extended mode runs without subpixel interpolation. The reasoning behind it is:
The above behavior is subject to change before mainlining.
Update:
Behavior changed, extended mode does subpixel interpolation too, as per community request.
Up to 6080 distinct disparities with 5 fractional bits, 3040 with 4, 1520 with 3.
Known issues:
-
extended mode together with confidence map output doesn't work as expectedRelated:
luxonis/depthai-core#498