An Explainable Deep Learning Model for Illegal Dress Code Detection and Classification

DOI: https://doi.org/10.33003/jobasr

Mukhtar Abubakar

Yusuf Surajo

Suleiman Tasiu

Abstract
This study introduces an explainable deep learning model for detecting and classifying dress code violations, leveraging a custom dataset of 130 images categorized into four classes: illegal male dressing, illegal female dressing, legal male dressing, and legal female dressing. The proposed model was built on a pre-trained MobileNetV2 architecture, fine-tuned to achieve a training accuracy of 100% and a validation accuracy of 90%. The model's performance is further validated through a confusion matrix, demonstrating robust classification capabilities, particularly for legal male and female dress codes, with minor misclassifications in the illegal categories. To ensure interpretability, SHAP (SHapley Additive exPlanations) and Gradient Magnitude Heatmaps are employed, providing insights into the model’s decision-making process. The SHAP visualizations reveal the pixel-level contributions to the predictions, while the Gradient Magnitude Heatmaps highlight regions of sensitivity, emphasizing the model's focus on distributed patterns across the images. The alignment between these techniques confirms the reliability of the model's feature extraction capabilities and underscores its generalizability. This paper not only achieves high classification accuracy but also integrates explainability techniques to enhance transparency and trust, making it suitable for socially sensitive applications. The results demonstrated the effectiveness of combining high-performance deep learning models with robust explainability frameworks to address complex classification challenges.
References
Agarwal, D., Gupta, P., &Eapen, N. G. (2023). A framework for dress code monitoring system using transfer learning from pre-trained YOLOv4 model. 11thInternational Conference on Emerging Trends in Engineering & Technology – Signal and Information Processing (ICETET-SIP). IEEE. Azizan, M. A., & Zaini, N. (2023).Video analysis to detect dress code violations in laboratories.IEEE Symposium on Industrial Electronics & Applications (ISIEA). IEEE Castelvecchi, D. (2016). Can we open the black box of AI? Nature, 538(7623), 20-23. https://doi.org/10.1038/538020a Dress Code Surveillance Using Deep Learning. (2020, July 1). IEEE Conference Publication. Retrieved from https://ieeexplore.ieee.org/document/9155668 Johnson, A. (2022). Trends in criminal appearance and attire in high-risk locations. Journal of Criminology, 55(2), 15-30. https://doi.org/xxxx Petsiuk, V., Das, A., &Saenko, K. (2018). RISE: Randomized input sampling for explanation of black-box models. arXiv preprint arXiv:1806.07421. Renugadevi, A. S., Ramesh, M., Jayavadivel, R., Palanisamy, P., Ananthi, B., & Praveen, M. V. (2024). Real-time dress code surveillance of college students using deep learning techniques.15th ICCCNT IEEE Conference. IEEE Rudin, C. (2019). Stop explaining black box machine learning models for high-stakes decisions and use interpretable models instead. Nature Machine Intelligence, 1(5), 206-215. https://doi.org/10.1038/s42256-019-0048-x Stassin, S., Liagre, M., Benkedadra, M., &Mancas, M. (2023). A Review and Comparative Study of Explainable Deep Learning Models Applied on Action Recognition in Real-Time. Electronics, 12(9) Tjoa, E., & Guan, C. (2021). A survey on explainable artificial intelligence (XAI): Towards medical XAI. IEEE Transactions on Neural Networks and Learning Systems, 32(11), 4793-4813. https://doi.org/10.1109/TNNLS.2019.2944951 Zhang, J., Wang, X., & Zhu, J. Y. (2022).Interpretable deep learning under fire.In Proceedings of the IEEE/CVF Conference on Com. Zou, J., Song, T., Cao, S., Zhou, B., & Jiang, Q. (2024). Dress code monitoring method in industrial scene based on improved YOLOv8n and DeepSORT. Sensors, 24(18), 6063. https://doi.org/10.3390/s24186063
PDF