This paper presents a generalized learning based framework for improving both speed and accuracy of the existing deformable registration method. The key of our framework involves the utilization of a support vector regression (SVR) to learn the correlation between brain image appearances and their corresponding shape deformations to a template, for helping significantly cut down the computation cost and improve the robustness to local minima by using the learned correlation to instantly predict a good subject-specific deformation initialization for any given subject under registration. Our framework consists of three major parts: 1) training of SVR models based on the statistics of image samples and their shape deformations to capture intrinsic image-deformation correlations, 2) deformation prediction for a new subject with the trained SVR models to generate a subject-resemblance intermediate template by warping the original template with the predicted deformations, and 3) estimating of the residual deformation from the intermediate template to the subject for refined registration. Any existing deformable registration methods can be easily employed for training the SVR models and estimating the residual deformation. We have tested in this paper the two widely used deformable registration algorithms, i.e., HAMMER  and diffeomorphic demons , for demonstration of our proposed frameowrk. Experimental results show that, compared to the registration using the original methods (with no deformation prediction), our framework achieves a significant speedup (6X faster than HAMMER, and 3X faster than diffeomorphic demons), while maintaining comparable (or even slighly better) registration accuracy.