I have two videos which I want to fuse. I plan to take the visible light video, capture frames, and convert the frames to YUV. Before fusing this with the IR video, I want to extract the Y component, put it in another image(variable) of type Mat of the same size and fuse that with the luminance of IR frame. After fusion, I want to put the Cb and Cr back to get the colors.
I saw this link: Getting the Y and Cb , Cr values of a frame in openCV c++
But I couldn't figure out how I can create my own matrices with this method of extracting Y, Cb and Cr.
Any ideas how I can do this?