{"type":"ScholarlyArticle","title":"Cost-Aware Pre-Training for Multiclass Cost-Sensitive Deep Learning","authors":[{"name":"Yu-An Chung","slug":"yu-an-chung","given":"Yu-An","family":"Chung","affiliation":""},{"name":"Hsuan-Tien Lin","slug":"hsuan-tien-lin","given":"Hsuan-Tien","family":"Lin","affiliation":""},{"name":"Shao-Wen Yang","slug":"shao-wen-yang","given":"Shao-Wen","family":"Yang","affiliation":""}],"abstract":"Deep learning has been one of the most prominent machine learning techniques nowadays, being the state-of-the-art on a broad range of applications where automatic feature extraction is needed. Many such applications also demand varying costs for different types of mis-classification errors, but it is not clear whether or how such cost information can be incorporated into deep learning to improve performance. In this work, we first design a novel loss function that embeds the cost information for the training stage of cost-sensitive deep learning. We then show that the loss function can also be integrated into the pre-training stage to conduct cost-aware feature extraction more effectively. Extensive experimental results justify the validity of the novel loss function for making existing deep learning models cost-sensitive, and demonstrate that our proposed model with cost-aware pre-training and training outperforms non-deep models and other deep models that digest the cost information in other stages.","doi":null,"url":"https://ijcai.org/proceedings/2016/203","pdf":"https://ijcai.org/proceedings/2016/0203.pdf","markdown":"https://ijcai.org/proceedings/2016/203.md","bibtex":"https://ijcai.org/proceedings/2016/bibtex/203","volume":{"slug":"2016","title":"Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2016","url":"https://ijcai.org/proceedings/2016/","year":2016,"location":"New York, NY, USA","dates":"9–15 July 2016","editors":"Subbarao Kambhampati","isbn":"978-1-57735-770-4; 978-1-57735-771-1","publisher":"AAAI Press / International Joint Conferences on Artificial Intelligence","doi_prefix":""},"section":null,"track":"","number":203,"pages":{"first":1411,"last":1416},"keywords":[],"videos":[],"references":[],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}