Title:
An Introduction to Deep Learning
Author(s):
Maria Pantoja, Anahid Behrouzi, and Drazen Fabris
Publication:
Concrete International
Volume:
40
Issue:
9
Appears on pages(s):
35-41
Keywords:
neuron, image, weights, input
DOI:
10.14359/51711112
Date:
9/1/2018
Abstract:
Deep learning (DL) is currently being researched and implemented to solve civil engineering related problems, including autonomous inspection and inventory of civil infrastructure projects. The article introduces DL, specifically a convolutional neural network and the supervised learning process used to train a model that will enable professional structural engineers to automatically detect types of earthquake damage.
Related References:
1. Esteva, A.; Kuprel, B.; Novoa, R.A.; Ko, J.; Swetter, S.M.; Blau, H.M.; and Thrun, S., “Dermatologist-Level Classification of Skin Cancer with Deep Neural Networks,” Nature, Feb. 2017, V. 542, No. 7639, pp. 115-118.
2. Neurala, Inc., “Reducing Costs, Turnaround Time and Risk,” 2017, 10 pp.
3. Patterson, B.; Leone, G.; Pantoja, M.; and Behrouzi, A., “Deep Learning for Automated Image Classification of Seismic Damage to Built Infrastructure,” Proceedings of the 11th National Conference in Earthquake Engineering, 2018.
4. Behrouzi, A.; and Pantoja, M., “Photo Tagging Tool for Rapid and Detailed Post-Earthquake Structural Damage Identification,” Proceedings of the 11th National Conference in Earthquake Engineering, 2018, poster presentation.
5. Lukka, T.J.; Tossavainen, T.; Kujala, J.V.; and Raiko, T., “ZenRobotics Recycler – Robotic Sorting Using Machine Learning,” Sensor-Based Sorting, 2014, pp. 169-176.
6. Cohen, B.; Ye, S.; Karaman, G.; Khan, F.; Bartoli, I.; Pradhan, A.; Ellenberg, A.; Moon, F.; Gurian, P.; Antonios, K.; Minaeie, E.; Young, C.; Lowdemilk, D.; and Aktan, E., “Design an Implementation of an Integrated Operations and Preservation Performance Monitoring System for Asset Management of Major Bridges,” 7th European Workshop on Structural Health Monitoring, July 2014, pp. 1521-1528.
7. Janocha, K., and Czarnecki, W.M., “On Loss Functions for Deep Neural Networks in Classification,” arxiv:1702.05659, Feb. 2017, 10 pp., https://arxiv.org.
8. LeCun, Y.; Bengio, Y.; and Hinton, G., “Deep Learning,” Nature, V. 521, May 2015, pp. 436-444.
9. Lee, H.; Grosse, R.; Ranganath, R.; and Ng, A., “Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical Representations,” Proceedings of the 26th Annual International Conference on Machine Learning, 2009, pp. 609-616.
10. Rouder, S., “An Overview of Gradient Descent Optimization Algorithms,” arxiv:1609.04747, Sept. 2016, 12 pp., https://arxiv.org.
11. Rumelhart, D.; Hinton, G.; and Williams, R., “Learning Representations by Back-Propagating Errors,” Nature, V. 323, Oct. 1986, pp. 533-536.
12. Karpathy, A., “A Hackers Guide to Neural Networks,” http://karpathy.github.io/neuralnets/.
13. LeCun, Y.; Bottou, L.; Bengio, Y.; and Hafner, P., “Gradient-Based Learning Applied to Document Recognition,” Proceedings of the IEEE, V. 86, No. 11, Nov. 1998, pp. 2278-2324.
14. Krizhevsky, A.; Sutskever, I.; and Hinton, G., “ImageNet Classification with Deep Convolutional Neural Networks,” Proceedings of the 25th International Conferences on Neural Information Processing, Dec. 2012, pp. 1097-1105.
15. Abadi, M.; Barham, P.; Chen, J.; Chen, Z.; Davis, A.; Dean, J.; Devin, M.; Ghemawat, S.; Irving, G.; Isard, M.; Kudlur, M.; Levenberg, J.; Monga, R.; Moore, S.; Murray, D.G.; Steiner, B.; Tucker, P.; Vasudevan, V.; Warden, P.; Wicke, M.; Yu, Y.; and Zheng, X., “TensorFlow: A System for Large-Scale Machine Learning,” Proceedings of the 12th USENIX Conference on Operating