The novel compensating method directly demodulates the signals without the carrier recovery processes, in which the carrier with original modulation frequency is used as the local coherent carrier. In this way, the phase offsets due to frequency shift are linear. Based on this premise, the compensation processes are: firstly, the phase offsets between the base band neighbor-symbols after clock recovery are unbiasedly estimated among the reference symbols; then, the receiving signals symbols are adjusted by the phase estimation value; finally, the phase offsets after adjusting are compensated by the least mean squares (LMS) algorithm. In order to express the compensation processes and ability clearly, the quadrature phase shift keying (QPSK) modulation signals are regarded as examples for Matlab simulation. BER simulations are carried out using the Monte-Carlo method. The learning curves are obtained to study the algorithm’s convergence ability. The constellation figures are also simulated to observe the compensation results directly.