Practical Algorithm for Real-Time Panorama Mosaic

A real-time algorithm for cylindrical panorama mosaic from un-calibrated images is presented. A novel scheme based on feature matching is proposed to align the images. Feature candidates are extracted with Plessy's corner detector and then are matched between consecutive frames based on FFT. Overlays between consecutive frames are detected with an improved two-step feature matching. Finally, the images are stitched by fusing in accordance with the found seam linked matched features. This method can be implemented efficiently and show robustness to varying illumination and perspective distortion.