Framework

The SMARTSKINS framework is composed by the 3 main components:

  1. Mobile Application for the patients
  2. Back-end Server that hosts the image processing module and database
  3. Web Interface for the dermatologists and system administrator

Patient Mobile Application

Using the Mobile Application, the patients can capture images of their skin lesions or load them from the mobile image gallery. Each patient can add several skin lesions, and each skin lesion can have several check-up images along time. For each skin lesion, the patient also indicates its localization and size, as well as some additional information to transmit to the doctor, like itching or redness.

After a doctor validates a check-up using the SMARTSKINS Web Interface, the system sends a report to the patient’s mobile application. In this way, the patient can keep a record of the evolution of their skin moles, always under the supervision of a dermatology specialist.

Main menu for sign up or log in

Send skin mole images and receive feedback from dermatologists of the submitted check-ups

List all moles under regular monitoring and respective status.

Back-end Server

The Back-end Server hosts the system database and the Image Processing Module (IPM). The IPM receives the skin lesion images acquired by the patient using the Mobile Application, and analyzes different features of the skin lesion using supervised classification. Particularly, the IPM evaluates the Asymmetry, Border and Color criteria score according the ABCD rule, as well as the Overall Risk of the skin lesion.

Moreover, when the doctors examine a new check-up, they can always consult the output of the automatic analysis, which can assist them in the risk triage of the skin mole.

Segmentation

Asymmetry

Border

Color

Web Interface

Using the Web Interface, doctors can consult and validate the check-up images sent by the patients. Each doctor can keep a record of the patients and respective skin lesions. Moreover, the doctors can also consult the automatic analysis provided by IPM, where it is possible to agree or correct the evaluation given by the automatic analysis.

The Web Interface is also used by the system administrator, which has the possibility to add new doctors to the database. Additionally, the administrator can consult the automatically generated statistics that compare the automatic analysis with the doctor’s analysis. In this way, the administrator has the option to use the contribution of the specialist community to retrain the IPM classifiers, which turns the SMARTSKINS framework in an adaptable tool that continuously “learns” with the dermatologist community.

Doctors can consult and validate the check-up images sent by the patients, together with the automatic analysis

Doctor can consult the record of the patients and respective skin lesions.

Administrator can add new doctors to the system

Administrator can consult statistics and use the validation data generated by the dermatologist to retrain the IPM classifiers