Quasi-autonomous bolt-loosening detection method using vision-based deep learning and image processing

Cited 1 time in webofscience Cited 0 time in scopus
  • Hit : 69
  • Download : 0
In this study, a quasi-autonomous vision-based method is newly proposed for detecting loosened bolts in critical connections. The main idea of the approach is to estimate the rotational angles of bolts from the connection images by integrating deep learning technology with image processing techniques. Firstly, a regional convolutional neural network (RCNN)-based deep learning algorithm is developed to automatically detect and crop plausible bolts in the connection image. Also, the Hough line transform (HLT)-based image processing algorithm is designed to automatically estimate the bolt angles from the cropped bolt images. Secondly, the proposed vision-based approach is validated for bolt-loosening detection in a lab-scale girder connection using images captured by a smartphone camera. The accuracy of the RCNN-based bolt detector and the HLT-based bolt angle estimator are examined under different levels of perspective distortion and shooting distance. Finally, the practicality of the proposed vision-based method is verified on a real-scale girder bridge connection containing numerous bolts. The images of the connection are captured by an unmanned aerial vehicle and transferred to a computer where a quasi-autonomous bolt-loosening detection process is performed via the proposed algorithm. The experimental results demonstrate potentials of the proposed approach for quasi real-time bolt-loosening monitoring of large bolted connections. The results show that the perspective angle should not go beyond 40 degrees to ensure the accuracy of the detection results.
Publisher
ELSEVIER SCIENCE BV
Issue Date
2019-09
Language
English
Article Type
Article
Citation

AUTOMATION IN CONSTRUCTION, v.105

ISSN
0926-5805
DOI
10.1016/j.autcon.2019.102844
URI
http://hdl.handle.net/10203/263726
Appears in Collection
CE-Journal Papers(저널논문)
Files in This Item
There are no files associated with this item.
This item is cited by other documents in WoS
⊙ Detail Information in WoSⓡ Click to see webofscience_button
⊙ Cited 1 items in WoS Click to see citing articles in records_button

qr_code

  • mendeley

    citeulike


rss_1.0 rss_2.0 atom_1.0