Scientific Research Fund of Hunan Provincial Education Department [07C191, 08C195]; Scientific Research Fund of Hunan City University [07C017]; Scientific Research Fund of Hunan Provincial Construction Department 
We consider the problem of the correspondence leaning of two high-dimensional data sets via the manifold leaning techniques. It's convenient for us to find the shared latent structure of the high-dimensional data sets, if they can be aligned in a uniformed low-dimensional data space. A local affine technique to address this problem is present here. Our method preserves more geometrical knowledge of the high-dimensional data sets and can easily project the new test data into the aligned data space by the local transformation obtained during the training step. The effectiveness of our algorithm is validated by applying it to the problem of image sequences alignment.