In Brillouin distributed optical fiber sensor, using optical coherent detection to detect Brillouin scattering optical signal is a good method, but there exists the polarization correlated detection problem. A novel detecting scheme is presented and demonstrated experimentally, which adopts orthogonal polarization diversity reception to resolve the polarization correlated detection problem. A laser is used as pump and reference light sources, a microwave electric-optical modulator (EOM) is adopted to produce frequency shift reference light, a polarization controller is used to control the polarization of the reference light which is changed into two orthogonal polarization for two adjacent acquisition periods. The Brillouin scattering light is coherently detected with the reference light, and the Brillouin scattering optical signal is taken out based on Brillouin frequency shift. After electronic processing, better Brillouin distributed sensing signal is obtained. A 25-km Brillouin distributed optical fiber sensor is achieved.