Cortical surface atlases play an increasingly important role for analysis, visualization, and comparison of results across different neuroimaging studies. As the first two years of life is the most dynamic period of postnatal structural and functional development of the highly-folded cerebral cortex, longitudinal (4D) cortical surface atlases for the infant brains during this period is highly desired yet still lacking for early brain development studies. In this paper, we construct the first longitudinal (4D) cortical surface atlases for the dynamic developing infant cortical structures at 1, 3, 6, 9, 12, 18 and 24 months of age, based on 202 serial MRI scans from 35 healthy infants. To ensure longitudinal consistency and unbiasedness of the 4D infant cortical surface atlases, we first compute the within-subject mean cortical folding geometries by groupwise registration of longitudinal surfaces of each infant. Then we establish intersubject cortical correspondences by groupwise registration of the within-subject mean cortical folding geometries of all infants. More importantly, for the first time, we further parcellate the 4D infant surface atlases into developmentally and functionally distinctive regions based solely on the dynamic developmental trajectories of the cortical thickness, by using the spectral clustering method. Specifically, to deal with the problem that each infant has different number of scans, we first compute the within-subject affinity matrix of vertices' cortical thickness trajectories of each infant, and then we use the averaged affinity matrix of all infants for parcellation. Our constructed 4D infant cortical surface atlases with developmental trajectories based parcellation will greatly facilitate the surface-based analysis of dynamic brain development in infants.