ing at the defects of fragmentation, low matching precision, and slow speed for Terracotta blocks matching, we propose a fracture surface matching method based on intrinsic shape signature (ISS) feature points. Firstly, the outer surfaces of blocks are segmented, and the fracture surfaces are extracted. Secondly, the ISS feature points of fracture surfaces are extracted, the feature sequences of feature points are calculated, and the fracture surfaces are matched based on feature sequences. Finally, an improved iterative closest point algorithm based on simulated annealing is used to match the feature point sets again. Thus, the fine matching of fracture surfaces is completed, and the blocks are matched accurately. We match four groups of Terracotta blocks, and the results show that the proposed method is more accurate and faster than other methods and effective for Terracotta blocks matching.