For most atom interferometers, the vibration isolation unit is applied to reduce vibration noise. In our experiment, instead of isolation, the vibration signals are monitored, and combining with the sensitive function, the compensation phase shift for the atom interferometer is obtained. We focus on the correction over a wide spectrum rather than on “monochromatic” frequencies. The sensitivity of the atom gravimeter can be upgraded by a factor of more than two. Furthermore, we demonstrate that the atom interferometer can still produce a good measurement result without passive vibration isolation in extremely noisy environments by using vibration compensation.