Chinese Optics Letters, 2017, 15 (8): 081202, Published Online: Jul. 20, 2018  

Dark-field detection method of shallow scratches on the super-smooth optical surface based on the technology of adaptive smoothing and morphological differencing Download: 1205次

Author Affiliations
1 State Key Laboratory of Modern Optical Instrumentation, College of Optical Science and Engineering, Zhejiang University, Hangzhou 310027, China
2 Research Center of Laser Fusion, CAEP, Mianyang 621900, China
Abstract
There exist some shallow scratch defects on the super-smooth optical surface. Their detection has a low efficiency with the existing technologies. So a new detection method, dark-field detection of adaptive smoothing and morphological differencing (DFD-ASMD), is proposed. On one hand, the information of shallow scratches can be kept in dark-field images. On the other hand, their weak characteristics can be separated and protected from being overly reduced during the elimination of noise and background in the image. Experiments show the detection rate of shallow scratches is around 82%, and DFD-ASMD can lay a foundation for quality control of defects on the high-quality optical surface.

In recent years, modern optical processing technologies, such as single point diamond turning, ion beam etching, and magneto-rheological finishing, are getting breakthroughs. Machining precisions of super-smooth optics have also been significantly improved[13" target="_self" style="display: inline;">–3]. However, with increasing demands for the optical surface quality, existing precision defect detection technology is often unable to meet the requirements of quality control. Sometimes, there are some special scratch defects on the super-smooth optical surface, and we find that their depth is below 50 nm, which are called shallow scratches in this Letter. Because of their existence, some high precision and high power applications are always under their influence. For instance, in the application of extreme ultraviolet lithography (EUVL), shallow scratches on the optical surface often have some impact on the power spectral density of the surfaces, reducing the accuracy of lithography[4,5]. Furthermore, since they can increase the frequency spectrum energy in the width direction[6], the damage threshold value[7] of optics will be reduced with the increase of the high power laser’s running time[8]. Nevertheless, the shallow scratches cannot be detected effectively and quickly through the existing detection technology. And their detection of shallow scratches can improve the optical processing technologies and lay a foundation for the classification of scratches[9].

According to ISO 10110, scratch defects can be detected effectively by visual inspection. The depth of common scratches[10,11] observed is between 100–400 nm. Many studies can detect them effectively[12], but there are also some shallow scratches below 50 nm. Wang et al.[13] has compared these two kinds of scratches and discovered that the scattering intensity of the shallow scratches is about 20%–50% of that of common scratches with the same width. As a result, shallow scratches are undetected easily under the condition of visual fatigue and the machine vision system[12].

In addition, an atomic force microscope (AFM) can detect the depth of the defects in the nm level, but it has the disadvantages of low detection efficiency and high cost because of its detection method of spot scanning. Moreover, the interference method can also be employed in detecting these scratches. One of the shallow scratches (shown in Fig. 1) can be measured by a white light scanning profiler. But it still can’t be used in the rapid detection, with its complex demodulation method and small testing aperture.

Fig. 1. (a) Measuring result of the shallow scratch on the super-smooth optics; (b) geometrical features of the shallow scratch.

下载图片 查看所有图片

To meet the requirements of effective and fast detection, a new detection method of shallow scratches has been proposed in this Letter. That is a dark-field detection method based on the technology of adaptive smoothing and morphological differencing (DFD-ASMD). First, the optical imaging system only receives the scattered light of defects under the dark-field lighting condition. On one hand, the sensitivity of detection system can be improved[12,14]. On the other hand, a large field of view can be formed, and the detection efficiency can also be improved[15]. Then, with the use of gray window transformation, the gray values of shallow scratches in the dark-field image are still very low, and it is difficult to separate them from noise and nonuniform background surroundings in the image.

Then, according to the geometric features and imaging features of shallow scratches, the algorithm for adaptive smoothing and morphological differencing (ASMD) has been designed. With the use of gray window transformation, the gray interval, including shallow scratches, can be extracted. Then, according to the differences of shallow scratches, noise, and background in the space field and morphological features, we have designed the adaptive smoothing with a Gaussian filter based on different filter windows and morphological differencing based on the differential threshold. For one thing, noise and background can be eliminated as much as possible. For another, the faint characteristics of shallow scratches can also be protected from being overly reduced during the processing. As a result, the information of shallow scratches can be separated. And then, the total length of scratch defects on the optical surface, can be calculated easily.

First, we attempt to capture the images of shallow scratches utilizing the dark-field imaging principle, which is shown in Fig. 2.

Fig. 2. (a) Schematic of dark-field imaging; (b) dark-field images captured (the grayscales of the shallow scratch have been artificially enhanced to be observed conveniently).

下载图片 查看所有图片

It can be seen from Fig. 2(a) that the CCD, in the condition of lighting with a low angle, can only accept the scattered light of defects, without reflected light. The defect images and background have a high image contrast. Figure 2(b) illustrates that the common scratch with high grayscales in the dark-field, can be easily found. However, the grayscales of the shallow scratch are so low that it cannot easily be separated because of its weak scattered light; but its information can be highlighted with the gray threshold of segmentation reduced, which is shown in Fig. 3.

Fig. 3. Results of separating the image with different gray thresholds. (a) Dark-field image including the shallow scratch; (b) the result with T1=60; (c) the result with T2=45.

下载图片 查看所有图片

The information of the shallow scratch does not obviously appear with the gray threshold of T1=60. Subsequently, when the gray threshold is reduced to T2=45, the information of the shallow scratch appears, but it also is accompanied with background and noise, which will disturb the feature’s extraction and calculation of the shallow scratch.

Next, we select three images to analyze their histogram and grayscale distribution, shown as Fig. 4.

Fig. 4. (a), (c), (e) Partial histogram of background, shallow scratch, and common scratch; (b), (d), (f) grayscale distribution.

下载图片 查看所有图片

Seen from Figs. 4(a) and 4(b), the histogram of the background is very concentrated, and its grayscale distribution seems relatively smooth. The grayscales of the common scratch are concentrated above T1, but the grayscale distribution of the image, including the shallow scratch, is similar to that of the background. The grayscales of the shallow scratch are similar to some background surrounding, both of which are distributed between T1 and T2.

Through the analysis above, the information of shallow scratches can be kept in the “mixed grayscales” ([T2,T1]) of the image with the method of dark-field imaging. Next, a technology of ASMD will be proposed, shown in Fig. 5.

Fig. 5. Flow chart of the ASMD.

下载图片 查看所有图片

First, the mixed grayscales should be calculated. T1 and T2 are the segmentation thresholds of common scratches and most backgrounds, respectively. Assume that the grayscale and pixel ratio of the common defects are p1 and k1. Besides, compared to common defects with high grayscales, shallow scratches and background with very low grayscales can be classified as the same gray level. So, their grayscale and pixel ratio are p2 and k2. k1<0.15 and k2>0.85 are the statistical data. And the grayscale average (I¯) and variance (σ2) can be expressed as {I¯=k1×p1+k2×p2σ2=k1(p1I¯)2+k2(p2I¯)2,where{p2<I¯<p10<k1<k2<1,k1+k2=1.

The grayscales (p1, p2) can be calculated as p1=I¯±k2/k1σ,p2=I¯±k1/k2σ.

Because the gray scales of common defects are higher than the grayscale average. So, T1 can be chosen as T1=I¯+k2/k1σ. Inversely, T2 can be chosen as T2=I¯k1/k2σ. Furtherly, gray intervals ([T2,T1]) of many dark-field images are calculated to find out the minimum of T2 and the maximum of T1. And then, they can be used for later applications ([0.14, 0.25]).

Then, shallow scratches and some background with noise can be separated with gray window transformation, which is shown asI1={T2/2,ifI<T2orI>T1I,ifT2IT1.

And common defects and most of background can also be eliminated. After the operation, shallow scratches is still mixed with the noise and nonuniform background. Next, ASMD will eliminate different interference and also protect the weak feature of shallow scratches.

To eliminate the noise (Salt and Pepper noise, which is mainly from CCD) in the image (I1), Gaussian filters [G(x,y,δ)] work better. However, if a single filter window is used to smooth the whole image, the weak characteristics of shallow scratches will also be smoothed excessively. Consider that parameter δ of the Gaussian filter determines the smoothing degree of the filter to the image, and the width of the Gaussian filter is characterized mainly by parameter δ[16]. The adaptive Gaussian filter has been designed. That is, different parameters (δ1, δ2, δ3) can be calculated to eliminate the noise and protect shallow scratches.

Assume that the grayscale of the pixel to be smoothed is I¯1(x,y), and the gray average of the filter window is I¯1(x,y). Then, the change of the gray value [CGV, Δf(x,y)] in the filter window can be calculated by Δf(x,y)=|I1(x,y)I¯1(x,y)|.

Then, two special assumptions will be discussed. First, the current filter window is located in the region of the background, which is very smooth. And the grayscales of pixels in the filter window are approximately equal. So, Δf(x,y)0. The other assumption is that there is only one pixel of noise and its grayscale is higher than others in the window. The higher the grayscale of the noise is, the greater its CGV is. So, the value of Δf(x,y) is inversely proportional to the smoothness of the current filter window and the same as the value δ(x,y) of the Gaussian filter. So, δ(x,y) can be replaced with Δf(x,y). Then, the adaptive Gaussian filter will be designed as G(x,y)(i,j)=Aei2+j22δ(x,y)2,whereA=12πδ(x,y)2,andδ(x,y)=Δf(x,y).

To protect the weak information of shallow scratches, a threshold Tδ is introduced (Tδ=3, which can be gotten by statistical calculating), which is shown as δ(x,y)={Δf(x,y),ifΔf(x,y)>Tδ0.1,ifΔf(x,y)Tδ.

Equation (6) reveals that if Δf(x,y)>Tδ, the current filter window can be judged to locate in the region of the noise. Then, the noise can be smoothed largely by replacing parameter δ(x,y) with CGV. Also, the parameter δ(x,y) of the Gaussian filter is set to 0.1 in the region of the background or shallow scratch, and the current filter window will not be smoothed.

After the adaptive smoothing, there is also some non-uniformed background. Consider that the size of the shallow scratches is smaller than that of the nonuniform background. And the opening operation is used to remove small bright pixels[17]. So, the background (I1,2) can be separated, and the image only containing shallow scratches can be separated by the subtraction. In general, the size of the selected structuring element (9×9) in the opening operation is less than the size of the background and larger than the width of shallow scratches.

Besides, the image size of large fine optics is always so huge that morphological operations will cost much time. In order to improve its efficiency, structuring element SE is decomposed into two smaller ones[18]. So, the operation above is shown as I1,3=I1,1I1,2=I1,1I1,1SE=I1,1I1,1(SE1SE2)=I1,1[(I1,1SE1)SE2],where and are morphological opening and closing operations.

However, there are some gray values at the position of the shallow scratch. After the differencing operation, the grayscales of the shallow scratch are reduced, and the contrast of the image is also very low. To solve these problems, a differential threshold (TΔ) will be added (TΔ=2, which can be gotten by statistical calculating). Then, the shallow scratch with gray jump can be reserved during morphological differencing, which is shown as I1,3(i,j)={I1,1(i,j)(I1,1SE)(i,j),ifI1,1(i,j)(I1,1SE)(i,j)<TΔI1,1(i,j),ifI1,1(i,j)(I1,1SE)(i,j)TΔ.

Through the operation above, image I1,3, containing only shallow scratches, can be extracted. The whole processing of DFD-ASMD is shown as Fig. 6.

Fig. 6. (a) Image of optical surface gotten by the dark-field detection method; (b)–(d) results of the ASMD; (e) result of gray stretching; (f) result of ASMD in region A; (g) result of ASMD in region B.

下载图片 查看所有图片

It can be seen from Fig. 6(f) that the useless information out of the interval in region A can be decreased by gray window transformation. With the method of adaptive smoothing, the noise in region B can be largely smoothed, which is shown as Fig. 6(g). And the weak information of shallow scratch cannot be smoothed excessively in the Fig. 6(c). Furthermore, the nonuniform background in Fig. 6(b) can be eliminated through the operation of morphological differencing. In addition, by comparing Figs. 6(c) and 6(d), the contrast of the image of the shallow scratch and background surrounding has been enhanced. Finally, the weak information of the shallow scratch can be enhanced to the “common” scratch by gray stretching. Now, DFD-ASMD is applied into the surface defects evaluation system (SDES)[15].

As is shown in region A of Fig. 7(b), SDES can detect parts of the scratch defects, most of which are common scratches. The shallow scratch included in region A cannot be detected effectively. And the total length of scratches included in Fig. 7(a) is 3.73 mm, which is calculated by SDES. However, with the method of ASMD, shallow scratches included in each sub-image have been enhanced and can be easily recognized. And the total length of scratches is 138.42 mm.

Fig. 7. (a) Dark-field image without using the ASMD; (b) the positions of scratches contained in (a) are marked by SDES; (c) the dark-field image after using the ASMD; (d) the positions of scratches contained in (c). The 6×6 images are located on different optical surfaces. We just stitch them to conveniently calculate the total length of scratches. (e) Depth of shallow scratches. Depths above 10 nm can be detected effectively, while some shallow scratches (near 5 nm) cannot be detected.

下载图片 查看所有图片

Further, the regions on the optical surfaces, which correspond to the dark-field images shown in Fig. 7, are re-detected by careful visual inspection. The results are shown as Table 1. The actual length of the scratches can also be calculated by AFM. But it will cost much more time so that it isn’t suitable to the detection for a large size of region. So, we regard total length calculated by careful visual inspection as the actual length, according to the ISO 10110. For the images of shallow scratches shown as Fig. 7, if the ASMD is added in SDES, the detection rate of scratches can be increased to about 85%. Moreover, taking no account of common scratches, the detection rate of shallow scratches is around 82%.

Table 1. Results of Scratch Detection With or Without ASMD

 SDES without using ASMDSDES using ASMDVisual inspection
The size of region detectedThe number of images is 6×6, and field of view of each image is about 15×15mm.
Total length3.73 mm138.42 mm162.75 mm
Detection rate2.29%85.05%

查看所有表

However, because of nonuniform illumination or reflected light of the environment, the grayscales of fractured shallow scratches of regions B and C in Fig. 7(c) and 7(d) (the depth of them is near 5 nm) are approximately equal to the grayscales of background surrounding, so it may be judged as the background. And SDES has calculated the length of two parts of the fractured shallow scratches, respectively, resulting that the length calculated is lower than the actual length. Some studies can be done to improve the detection rate of scratch defects in the future, such as optimizing the design of lighting.

In conclusion, a new and effective detection of shallow scratches is proposed in this Letter (DFD-ASMD). A dark-field imaging technology is employed to keep the information of shallow scratches in a gray interval of the dark-field image. However, they are still difficult to be separated from noise and nonuniform background. Therefore, based on the differences of different information in the space field and morphological features, ASMD is also designed. On one hand, noise and background can be eliminated. On the other hand, the weak characteristics of shallow scratches can also be protected from being overly reduced. As a result, shallow scratches can be separated from the original dark-field images and can be merged into the total scratch defects with the common scratches on the optical surface. In the experiments, the detection rate of shallow scratches is around 82%. DFD-ASMD can be used to improve the capacity of existing detection technology for scratch defects and can lay a foundation for quality control of defects on the high-quality optical surface.

References

[1] XuQ.WangJ.LiW.ZengX.JingS., in International Symposium on Industrial Lasers (1999), p. 236.

[2] LiuW.WeiC.YiK.ShaoJ., Chin. Opt. Lett.13, 041407 (2015).

[3] ChenJ.XuX.WeiC.YangM.GuJ.ShaoJ., Chin. Opt. Lett.13, 032201 (2015).

[4] YanP., Handbook of Photomask Manufacturing Technology (CRC Press/Taylor & Francis Information Group, 2005).

[5] SugawaraM.NishiyamaI.MotaiK.CullinsJ., Jpn. J. Appl. Phys.45, 9044 (2006).

[6] HuanR.HongzhenJ.XuL., High Power Laser Part. Beams26, 26092011 (2014).

[7] CaoP.YangY.LiC.ChaiH.LiY.XieS.LiuD., Chin. Opt. Lett.13, 041102 (2015).

[8] BakerL. R., Metrics for High-Quality Specular Surfaces (SPIE Press, 2004), Vol. 65.

[9] KimmelR. K.ParksR. E., ISO 10110 Optics and Optical Instruments: Preparation of Drawings for Optical Elements and Systems: A User’s Guide (Optical Society of America, 2002).

[10] WangY.XuQ.ChaiL.-Q.ChenN.ZhuX.-Q., High Power Laser Part. Beams17, 67 (2005).

[11] BennettJ.BurgeD.RahnJ.BennettH., in Techincal Symposium East (1979), p. 124.

[12] YangY.LuC.LiangJ.LiuD.YangL.LiR., Acta Opt. Sin.27, 1031 (2007).GUXUDC0253-2239

[13] WangS.YangY.ZhaoL.ChaiH.LiuD.BaiJ.ShenY., Chin. J. Lasers42, 0708005 (2015).

[14] BatchelderJ. S.TaubenblattM. A., “Dark Field Imaging Defect Inspection System for Repetitive Pattern Integrated Circuits,” U.S. patent 5,177,559 (January5, 1993).

[15] LiuD.YangY.WangL.ZhuoY.LuC.YangL.LiR., Opt. Commun.278, 240 (2007).

[16] YoungI. T.Van VlietL. J., Signal Process.44, 139 (1995).SGNAE5

[17] MendoncaA. M.CampilhoA., IEEE Trans. Med. Imaging25, 1200 (2006).

[18] ParkH.YooJ., IEE Proc. Vis. Image Signal Process.148, 31 (2001).

Chen Li, Yongying Yang, Huiting Chai, Yihui Zhang, Fan Wu, Lin Zhou, Kai Yan, Jian Bai, Yibing Shen, Qiao Xu, Hongzhen Jiang, Xu Liu. Dark-field detection method of shallow scratches on the super-smooth optical surface based on the technology of adaptive smoothing and morphological differencing[J]. Chinese Optics Letters, 2017, 15(8): 081202.

引用该论文: TXT   |   EndNote

相关论文

加载中...

关于本站 Cookie 的使用提示

中国光学期刊网使用基于 cookie 的技术来更好地为您提供各项服务,点击此处了解我们的隐私策略。 如您需继续使用本网站,请您授权我们使用本地 cookie 来保存部分信息。
全站搜索
您最值得信赖的光电行业旗舰网络服务平台!