For manufacturing a fine optical glass lens, it is important to obtain a 3D profile of a semi-finished product with a rough surface. We develop an active binocular 3D scanning setup to measure the 3D profile of a rough surface optical element. Two cameras simultaneously capture the band-pass binary random patterns which are projected on the target object. The highlight of this system is using the temporal correlation technique to determine the stereo correspondence between the pixels of the two cameras. The 3D point cloud can be reconstructed by the triangulation principle. Experiment results confirmed that this method effectively measures the rough surface of an optical element with sufficient accuracy.