A prior knowledge-embedded deformable convolutional network for vision-based fabric defect detection

The vision-based defect detection of textile surface is an essential problem in evaluating the appearance quality. In previous studies on vision-based defect detection, the following two points were neglected: (1) The proportion of defects on fabric is small, resulting in a low signal-to-noise ratio of defect images and a lack of sampling features; (2) the irregular shape of defects can overlap in position, leading to localization difficulty. In this paper, we propose a prior knowledge-embedded deformable convolutional network (PKE-DCNet) based on deep learning to address these two issues. First, a feature extraction method with prior information is designed with a shape-matching deep clustering module and a region-biased sampling module for detecting defects with complex shape. Then, a defect boundary boxes adaptive generation method is proposed with an anchor-free search mechanism and irregular edge contour computation to detect the key points in the region. Extensive experiments with mixed fabric defect datasets demonstrated that PKE-DCNet reached an overall mAP of 95.36% for six types of defects within a detection speed of 322 FPS, which was better than state-of-the-art methods.