Wednesday, March 7, 2007

Motion Estimation from video input

As mentioned in my previous post on motion estimation i implemented the lucas-kanade optical flow method as a first attempt at performing motion estimation. This method had a major drawback in that the method is only applicable for displacements on the order of one or two high resolution pixels, this limitation posses a serious problem for static images, as in order reconstruct increasingly high resolution images an increasing number of low resolution images are required.

Since this point i have been looking into using video clips at the input to the super-resolution algorithm, this method of data input offers the benefit that if the frame rate of the camera is high enough then the relative motions between the frames will be small (on the order of or two pixels) which means that lucas-kanade's optical flow algorithm should be effective at calculating the motions between frames, this data can then be used to calculate the relative motions with respect to a reference frame. As i have implemented it at the moment i am assuming that the reference frame is simply the first frame in the input sequence, however i intend to modify this so that the displacements are given relative to some 'central frame', this central frame may or may not exist in the set of LR input frames, it is merely the point around which the reconstruction takes place.


I attempted to use the results generated by this image registration approach to perform super-resolution on the video clip that i captured, however the reconstruction did not go well, so i have now taken a step back and am trying to verify the results of the image registration code in order to track down the error.