eprintid: 14362 rev_number: 2 eprint_status: archive userid: 1 dir: disk0/00/01/43/62 datestamp: 2023-11-10 03:28:56 lastmod: 2023-11-10 03:28:56 status_changed: 2023-11-10 01:56:42 type: article metadata_visibility: show creators_name: Usmani, U.A. creators_name: Watada, J. creators_name: Jaafar, J. creators_name: Aziz, I.A. creators_name: Roy, A. title: A reinforcement learning algorithm for automated detection of skin lesions ispublished: pub note: cited By 10 abstract: Skin cancers are increasing at an alarming rate, and detection in the early stages is essential for advanced treatment. The current segmentation methods have limited labeling ability to the ground truth images due to the numerous noisy expert annotations present in the datasets. The precise boundary segmentation is essential to correctly locate and diagnose the various skin lesions. In this work, the lesion segmentation method is proposed as a Markov decision process. It is solved by training an agent to segment the region using a deep reinforcement-learning algorithm. Our method is similar to the delineation of a region of interest by the physicians. The agent follows a set of serial actions for the region delineation, and the action space is defined as a set of continuous action parameters. The segmentation model learns in continuous action space using the deep deterministic policy gradient algorithm. The proposed method enables continuous improvement in performance as we proceed from coarse segmentation results to finer results. Finally, our proposed model is evaluated on the International Skin Imaging Collaboration (ISIC) 2017 image dataset, Human against Machine (HAM10000), and PH2 dataset. On the ISIC 2017 dataset, the algorithm achieves an accuracy of 96.33 for the naevus cases, 95.39 for the melanoma cases, and 94.27 for the seborrheic keratosis cases. The other metrics are evaluated on these datasets and rank higher when compared with the current state-of-the-art lesion segmentation algorithms. © 2021 by the authors. Licensee MDPI, Basel, Switzerland. date: 2021 publisher: MDPI official_url: https://www.scopus.com/inward/record.uri?eid=2-s2.0-85117046576&doi=10.3390%2fapp11209367&partnerID=40&md5=f83694c874bc2dd594285a8ab4281b8c id_number: 10.3390/app11209367 full_text_status: none publication: Applied Sciences (Switzerland) volume: 11 number: 20 refereed: TRUE issn: 20763417 citation: Usmani, U.A. and Watada, J. and Jaafar, J. and Aziz, I.A. and Roy, A. (2021) A reinforcement learning algorithm for automated detection of skin lesions. Applied Sciences (Switzerland), 11 (20). ISSN 20763417