Semantic Image Retrieval Analysis Based on Deep Learning and Singular Value Decomposition
Article Sidebar
PDF
118 views
Main Article Content
Abstract
The exponential growth in the total quantity of digital images has necessitated the development of systems that are capable of retrieving these images. Content-based image retrieval is a technique used to get images from a database. The user provides a query image, and the system retrieves those photos from the database that are most similar to the query image. The image retrieval problem pertains to the task of locating digital photographs inside extensive datasets. Image retrieval researchers are transitioning from the use of keywords to the utilization of low-level characteristics and semantic features. The push for semantic features arises from the issue of subjective and time-consuming keywords, as well as the limitation of low-level characteristics in capturing high-level concepts that users have in mind. The main goal of this study is to examine how convolutional neural networks can be used to acquire advanced visual features. These high-level feature descriptors have the potential to be the most effective compared to the handcrafted feature descriptors in terms of image representation, which would result in improved image retrieval performance. The (CBIR-VGGSVD) model is an ideal solution for content-based image retrieval that is based on the VGG-16 algorithm and uses the Singular Value Decomposition (SVD) technique. The suggested model incorporates the VGG-16 model for the purpose of extracting features from both the query images and the images kept in the database. Afterwards, the dimensionality of the features retrieved from the VGG-16 model is reduced using SVD. Then, we compare the query photographs to the dataset images using the cosine metric to see how similar they are. When all is said and done, images that share a high degree of similarity will be successfully extracted from the dataset. A validation of the retrieval performance of the CBIR-VGGSVD model is performed using the Corel-1K dataset. When the VGG-16 standard model is the sole one used, the implementation will produce an average precision of 0.864. On the other hand, when the CBIR-VGGSVD model is utilized, this average precision is revealed to be (0.948). The findings of the retrieval ensured that the CBIR-VGGSVD model provided an improvement in performance on the test pictures that were utilized, surpassing the performance of the most recent approaches.
Downloads
Article Details
This work is licensed under a Creative Commons Attribution 4.0 International License.
References
J. Pradhan, A. K. Pal, M. S. Obaidat, and S. H. Islam, "A post dynamic clustering approach for classification-based image retrieval," in 2020 International Conference on Communications, Computing, Cybersecurity, and Informatics (CCCI), 2020, pp. 1-7: IEEE.
M. L. Shuwandy et al., "Sensor-Based Authentication in Smartphone; a Systematic Review," Journal of Engineering Research, 2024.
M. Alrahhal and K. Supreethi, "Content-based image retrieval using local patterns and supervised machine learning techniques," in 2019 Amity International Conference on Artificial Intelligence (AICAI), 2019, pp. 118-124: IEEE.
R. Abada, A. M. Abubakar, and M. T. Bilal, "An overview on deep leaning application of big data," Mesopotamian Journal of Big Data, vol. 2022, pp. 31-35, 2022.
J. Yao, Y. Deng, Y. Yu, and C. Sun, "A fast image retrieval method with convolutional neural networks," in 2017 36th Chinese Control Conference (CCC), 2017, pp. 11110-11115: IEEE.
J. Pradhan, A. Ajad, A. K. Pal, and H. Banka, "Multi-level colored directional motif histograms for content-based image retrieval," The Visual Computer, vol. 36, no. 9, pp. 1847-1868, 2020.
E. Yakubchyk and I. Yurchak, "RESEARCH OF CONTENT-BASED IMAGE RETRIEVAL ALGORITHMS," 2021.
O. Albahri et al., "Systematic review of artificial intelligence techniques in the detection and classification of COVID-19 medical images in terms of evaluation and benchmarking: Taxonomy analysis, challenges, future solutions and methodological aspects," Journal of infection and public health, vol. 13, no. 10, pp. 1381-1396, 2020.
D. Agrawal, A. Agarwal, and D. K. Sharma, "Content-Based Image Retrieval (CBIR): A Review," Recent Innovations in Computing, pp. 439-452, 2022.
M. H. Jasim et al., "Emotion detection among Muslims and non-Muslims while listening to Quran recitation using EEG," Int J Acad Res Bus Soc Sci, vol. 9, p. 14, 2019.
T. Musta, "PRACTICAL PERFORMANCE OF IMAGE RETRIEVAL METHODS," 2020.
S. M. Samuri, T. V. Nova, B. Rahmatullah, S. L. Wang, and Z. T. Al-Qaysi, "Classification model for breast cancer mammograms," IIUM Engineering Journal, vol. 23, no. 1, pp. 187-199, 2022.
X. Li, J. Yang, and J. Ma, "Recent developments of content-based image retrieval (CBIR)," Neurocomputing, vol. 452, pp. 675-689, 2021.
R. Bibi, Z. Mehmood, R. M. Yousaf, T. Saba, M. Sardaraz, and A. Rehman, "Query-by-visual-search: multimodal framework for content-based image retrieval," Journal of Ambient Intelligence and Humanized Computing, vol. 11, no. 11, pp. 5629-5648, 2020.
A. Albahri et al., "A Trustworthy and Explainable Framework for Benchmarking Hybrid Deep Learning Models Based on Chest X-Ray Analysis in CAD Systems," International Journal of Information Technology & Decision Making, 2024.
M. A. Ahmed et al., "Real-time sign language framework based on wearable device: analysis of MSL, DataGlove, and gesture recognition," Soft Computing, vol. 25, no. 16, pp. 11101-11122, 2021.
N. Seth and S. Jindal, "A review on content based image retrieval," INTERNATIONAL JOURNAL, vol. 15, no. 14, 2018.
Z. Al-qaysi, A. Albahri, M. Ahmed, and M. M. Salih, "Dynamic decision-making framework for benchmarking brain–computer interface applications: a fuzzy-weighted zero-inconsistency method for consistent weights and VIKOR for stable rank," Neural Computing and Applications, pp. 1-24, 2024.
Y. Cai, Y. Li, C. Qiu, J. Ma, and X. Gao, "Medical image retrieval based on convolutional neural network and supervised hashing," IEEE access, vol. 7, pp. 51877-51885, 2019.
S. Garfan et al., "Telehealth utilization during the Covid-19 pandemic: A systematic review," Computers in biology and medicine, vol. 138, p. 104878, 2021.
Ö. Göksu and E. Aptoula, "Content based image retrieval of remote sensing images based on deep features," in 2018 26th Signal Processing and Communications Applications Conference (SIU), 2018, pp. 1-4: IEEE.
Z. Rian, V. Christanti, and J. Hendryli, "Content-based image retrieval using convolutional neural networks," in 2019 IEEE International Conference on Signals and Systems (ICSigSys), 2019, pp. 1-7: IEEE.
R. Ashraf, M. Ahmed, U. Ahmad, M. A. Habib, S. Jabbar, and K. Naseer, "MDCBIR-MF: multimedia data for content-based image retrieval by using multiple features," Multimedia tools and applications, vol. 79, no. 13, pp. 8553-8579, 2020.
S. Devulapalli, A. Potti, R. Krishnan, and M. S. Khan, "Experimental evaluation of unsupervised image retrieval application using hybrid feature extraction by integrating deep learning and handcrafted techniques," Materials Today: Proceedings, 2021.
K. Kalaivani et al., "A Novel Hyperparameter Tuned Deep Learning Model for Content based Image Retrieval," in 2022 International Conference on Sustainable Computing and Data Communication Systems (ICSCDS), 2022, pp. 207-213: IEEE.
T. Karthik, R. Krishna, T. R. Rao, V. Manoranjithem, S. Kalaiarasi, and B. Jegajothi, "Evolutionary Optimization Algorithm on Content based Image Retrieval System using Handcrafted features with Squeeze Networks," in 2022 Second International Conference on Artificial Intelligence and Smart Energy (ICAIS), 2022, pp. 1425-1431: IEEE.
P. Staszewski, M. Jaworski, J. Cao, and L. Rutkowski, "A new approach to descriptors generation for image retrieval by analyzing activations of deep neural network layers," IEEE Transactions on neural networks and learning systems, 2021.
F. Mustafic, I. Prazina, and V. Ljubovic, "A new method for improving content-based image retrieval using deep learning," in 2019 XXVII International Conference on Information, Communication and Automation Technologies (ICAT), 2019, pp. 1-4: IEEE.
S. Wang, K. Han, and J. Jin, "Review of image low-level feature extraction methods for content-based image retrieval," Sensor Review, 2019.
M. M. Adnan, M. S. M. Rahim, A. Rehman, Z. Mehmood, T. Saba, and R. A. Naqvi, "Automatic image annotation based on deep learning models: a systematic review and future challenges," IEEE Access, vol. 9, pp. 50253-50264, 2021.
A. J. Trappey, C. V. Trappey, and S. Shih, "An intelligent content-based image retrieval methodology using transfer learning for digital IP protection," Advanced Engineering Informatics, vol. 48, p. 101291, 2021.
Z. Al-Qaysi et al., "A systematic rank of smart training environment applications with motor imagery brain-computer interface," Multimedia Tools and Applications, vol. 82, no. 12, pp. 17905-17927, 2023.
M. Azeem, B. M. Abualsoud, and D. Priyadarshana, "Mobile Big Data Analytics Using Deep Learning and Apache Spark," Mesopotamian Journal of Big Data, vol. 2023, pp. 16-28, 2023.
A. Qayyum, S. M. Anwar, M. Awais, and M. Majid, "Medical image retrieval using deep convolutional neural network," Neurocomputing, vol. 266, pp. 8-20, 2017.
M. M. Salih, M. Ahmed, B. Al-Bander, K. F. Hasan, M. L. Shuwandy, and Z. Al-Qaysi, "Benchmarking framework for COVID-19 classification machine learning method based on fuzzy decision by opinion score method," Iraqi Journal of Science, pp. 922-943, 2023.
A. Albahri et al., "A systematic review of using deep learning technology in the steady-state visually evoked potential-based brain-computer interface applications: current trends and future trust methodology," International Journal of Telemedicine and Applications, vol. 2023, 2023.
E. C. Too, L. Yujian, S. Njuki, and L. Yingchun, "A comparative study of fine-tuning deep learning models for plant disease identification," Computers and Electronics in Agriculture, vol. 161, pp. 272-279, 2019.
Z. Al-Qaysi, M. M. Salih, M. L. Shuwandy, M. Ahmed, and Y. S. Altarazi, "Multi-Tiered CNN Model for Motor Imagery Analysis: Enhancing UAV Control in Smart City Infrastructure for Industry 5.0," Applied Data Science and Analysis, vol. 2023, pp. 88-101, 2023.
B. Koonce, Convolutional Neural Networks with Swift for Tensorflow: Image Recognition and Dataset Categorization. Springer, 2021.
R. A. Aljanabi, Z. Al-Qaysi, M. Ahmed, and M. M. Salih, "Hybrid Model for Motor Imagery Biometric Identification," Iraqi Journal For Computer Science and Mathematics, vol. 5, no. 1, pp. 1-12, 2024.
M. Hadid, Q. M. Hussein, Z. Al-Qaysi, M. Ahmed, and M. M. Salih, "An Overview of Content-Based Image Retrieval Methods And Techniques," Iraqi Journal For Computer Science and Mathematics, vol. 4, no. 3, pp. 66-78, 2023.
R. Zebari, A. Abdulazeez, D. Zeebaree, D. Zebari, and J. Saeed, "A comprehensive review of dimensionality reduction techniques for feature selection and feature extraction," Journal of Applied Science and Technology Trends, vol. 1, no. 2, pp. 56-70, 2020.
E. A. Compton and S. L. Ernstberger, "Singular Value Decomposition: Applications to Image Processing," Citations Journal of Undergraduate Research, vol. 17, 2020.
M. Majhi and A. K. Pal, "An image retrieval scheme based on block level hybrid dct-svd fused features," Multimedia Tools and Applications, vol. 80, no. 5, pp. 7271-7312, 2021.
N. S. Baqer, H. A. Mohammed, A. Albahri, A. Zaidan, Z. Al-Qaysi, and O. Albahri, "Development of the Internet of Things sensory technology for ensuring proper indoor air quality in hospital facilities: Taxonomy analysis, challenges, motivations, open issues and recommended solution," Measurement, vol. 192, p. 110920, 2022.
J. Yadav and K. Sehra, "Large scale dual tree complex wavelet transform based robust features in PCA and SVD subspace for digital image watermarking," Procedia computer science, vol. 132, pp. 863-872, 2018.
F. Anowar, S. Sadaoui, and B. Selim, "Conceptual and empirical comparison of dimensionality reduction algorithms (pca, kpca, lda, mds, svd, lle, isomap, le, ica, t-sne)," Computer Science Review, vol. 40, p. 100378, 2021.
S. Sudha and S. Aji, "A review on recent advances in remote sensing image retrieval techniques," Journal of the Indian Society of Remote Sensing, vol. 47, no. 12, pp. 2129-2139, 2019.
M. Ahmed, B. Zaidan, A. Zaidan, M. M. Salih, Z. Al-Qaysi, and A. Alamoodi, "Based on wearable sensory device in 3D-printed humanoid: A new real-time sign language recognition system," Measurement, vol. 168, p. 108431, 2021.
F. Baig et al., "Boosting the performance of the BoVW model using SURF–CoHOG-based sparse features with relevance feedback for CBIR," Iranian Journal of Science and Technology, Transactions of Electrical Engineering, vol. 44, no. 1, pp. 99-118, 2020.
R. Kapoor, D. Sharma, and T. Gulati, "State of the art content based image retrieval techniques using deep learning: a survey," Multimedia Tools and Applications, vol. 80, no. 19, pp. 29561-29583, 2021.
Y. D. Mistry, "Textural and color descriptor fusion for efficient content-based image retrieval algorithm," Iran Journal of Computer Science, vol. 3, no. 3, pp. 169-183, 2020.
S. Agrawal, A. Chowdhary, S. Agarwala, V. Mayya, and S. Kamath S, "Content-based medical image retrieval system for lung diseases using deep CNNs," International Journal of Information Technology, vol. 14, no. 7, pp. 3619-3627, 2022.
F. Malik and B. Baharudin, "Analysis of distance metrics in content-based image retrieval using statistical quantized histogram texture features in the DCT domain," Journal of king saud university-computer and information sciences, vol. 25, no. 2, pp. 207-218, 2013.
Q. Zheng, X. Tian, M. Yang, and H. Wang, "Differential Learning: A Powerful Tool for Interactive Content-Based Image Retrieval," Engineering Letters, vol. 27, no. 1, 2019.
S. R. Dubey, "A decade survey of content based image retrieval using deep learning," IEEE Transactions on Circuits and Systems for Video Technology, vol. 32, no. 5, pp. 2687-2704, 2021.
Z. Al-Qaysi, A. Al-Saegh, A. F. Hussein, and M. Ahmed, "Wavelet-based Hybrid learning framework for motor imagery classification," Iraqi J Electr Electron Eng, 2022.
M. S. Ghaleb, H. M. Ebied, H. A. Shedeed, and M. F. Tolba, "Image Retrieval Based on Deep Learning," Journal of System and Management Sciences, vol. 12, no. 2, pp. 477-496, 2022.
U. A. Khan, A. Javed, and R. Ashraf, "An effective hybrid framework for content based image retrieval (CBIR)," Multimedia Tools and Applications, vol. 80, no. 17, pp. 26911-26937, 2021.
K. T. Ahmed, S. Ummesafi, and A. Iqbal, "Content based image retrieval using image features information fusion," Information Fusion, vol. 51, pp. 76-99, 2019.
D. Sarvamangala and R. V. Kulkarni, "Convolutional neural networks in medical image understanding: a survey," Evolutionary intelligence, vol. 15, no. 1, pp. 1-22, 2022.
"Corel-1K dataset, available on https://www.kaggle.com/datasets/elkamel/corel-images.."
"Corel-1K dataset, available on http://wang.ist.psu.edu/docs/related.."
Z. Xiaobo, P. Jinye, L. Tian, and A. Zhigang, "Image retrieval method based on improved local binary pattern," in 2021 International Conference on Communications, Information System and Computer Engineering (CISCE), 2021, pp. 256-260: IEEE.
P. Desai, J. Pujari, and C. Sujatha, "Impact of multi-feature extraction on image retrieval and classification using machine learning technique," SN Computer Science, vol. 2, no. 3, pp. 1-9, 2021.
P. Desai, J. Pujari, C. Sujatha, A. Kamble, and A. Kambli, "Hybrid Approach for Content-Based Image Retrieval using VGG16 Layered Architecture and SVM: An Application of Deep Learning," SN Computer Science, vol. 2, no. 3, pp. 1-9, 2021.
S. Kokilambal, "Intelligent content based image retrieval model using adadelta optimized residual network," in 2021 International Conference on System, Computation, Automation and Networking (ICSCAN), 2021, pp. 1-5: IEEE.