To study the influence of the polished depth of rail profile at the gauge angle on the low-frequency vibration of high-speed train, a group of rail profiles were obtained by interpolating between the standard CN60 profile and the measured rail profile which was excessively polished at the gauge angle. Choosing a certain type of EMUs as the research object, and selecting the standard profile S1002CN as the wheel profile, the evolution law of the wheel-rail contact relationship and the lateral vibration of the carbody were calculated and analyzed when it matched with different rail profiles. The analysis results showed that with the increasing of grinding depth at the rail gauge angle, the equivalent conicity under the matching relationship between the rail and the standard profile S1002CN decreased gradually, and the wheel-rail contact points moved to the nominal rolling circle of the tread and the rail top. Moreover, the frequency of the vibration decreased while the amplitude of vibration and the lateral sperling index increased. Finally, one of the rail profiles was selected as the critical profile to limit the reasonable range of rail grinding.