A simple method for improving grating couplers’ coupling efficiency without any extra microfabrication processes is proposed. This method can improve the coupling efficiency with 1.69 dB by utilizing the combined interference in the cladding layer and air gap between the cladding surface and the paralleled angle polished fiber facet. The proposed method can be applied to various kinds of on-chip grating couplers. Back reflection, 1 dB bandwidth, and fiber alignment tolerance have also been improved at the same time.