According to the Finnish Cancer Registry, approximately 30,000 people receive cancer diagnoses in Finland every year, and the number of patients with cancer continues to rise.

Cancer treatments cause adverse events and long-term consequences. Patients receiving radiotherapy may experience irritation, redness of skin, pain, and fatigue. If the acute reactions remain improperly treated, patients may discontinue radiotherapy, leading to a loss of local control [1].

During chemotherapy patients commonly experience side effects such as nausea, fatigue, neutropenic infections, mucositis, peripheral neuropathy, and pain. These side effects impair patients’ quality of life and may require emergency room visits, hospital stays, reductions in the following chemotherapy doses, or lead to treatment interruption [2]. Recognizing adverse events of chemotherapy early remains important to ensure proper medical interventions [3].

Digital communication between patients and cancer clinics via electronic patient-reported outcomes (ePROs) enables early detection of adverse events during chemotherapy, decreases emergency room visits and hospitalization, increases quality of life, and may even improve survival [3]. In the study by Denis et al [4], after primary treatment of lung cancer, disease relapse was detected earlier and the patients lived longer if they reported their symptoms via electronic software, compared with traditional follow-up visits. The overall survival was 19 months (95% CI 12.5 to noncalculable) in the study arm, compared with 12 months (95% CI 8.6-16.4, P=.001) in the control arm [4]. Because of these advantages, ePROs will likely be implemented in routine cancer care in the near future [5].

The aim of this study is to describe the usability of the first version of Noona, a web-mediated PRO application.

The investigated ePRO tool Noona is a web-mediated application developed by Noona Healthcare Oy in collaboration with Helsinki University Hospital Comprehensive Cancer Center. The Noona mobile service is developed for remote monitoring of patients with cancer, and to be used as a support tool for communication between patients with cancer and health care professionals. Noona is an online application, which can be used with a web browser and a suitable device, such as desktop, laptop, tablet, and smartphone. Noona has 2 clear user groups: patients with cancer and cancer care professionals, specifically nurses and doctors working in cancer hospitals. At the beginning of their treatment, patients with cancer are registered to Noona, and they will continue to use Noona during the follow-up and rehabilitation periods. During the treatment phase, Noona is designed to evaluate symptoms and recovery progress based on patient-reported outcome data. During the follow-up and rehabilitation periods, the intended use is to enable fluent and accessible communication between the patient and the professionals, and to monitor patient recovery from cancer and related symptoms.

Noona has 2 user interfaces: one for the patients (Figure 1) and the other for the professionals (Figure 2). The main functionalities of the patient interface are symptom reporting and a diary. Patients can report on cancer- and treatment-related symptoms using question wizards that cover the clinically relevant questions and evaluate the most common and relevant symptoms, such as pain, fatigue, nausea, vomiting, and bowel symptoms. In addition to the symptoms, patients may contact their clinic regarding other topics using an open question form. Patients can also receive messages from their care team via Noona.

The main functionalities for the professionals are (1) a work queue to monitor new patients who have asked assistance or responded to a scheduled questionnaire, (2) a view of patient information as well as symptom history, and (3) a possibility to send messages directly to patients. When a patient starts to use Noona, the application provides a tutorial for the patient. As part of its implementation in the hospital, nurses are trained to give patients end user support. In the first version of Noona no alarm or reminder function was included and professionals were asked to check Noona regularly as part of their clinical work.

As part of the clinical evaluation of Noona, a prospective pilot trial was designed to study its usability and reliability by recruiting both patients with cancer and medical personnel, as both groups are expected to use the software during cancer treatments (ie, chemotherapy and radiotherapy or after cancer surgery). This clinical evaluation was part of the mandatory process before introducing Noona as a medical device to the markets in Finland and countries in Europe.

Patients were eligible if they were at least 18 years old; could read Finnish; received either radiotherapy, surgery, or medical therapy as a treatment for their cancer; and had a computer, phone, or tablet with an internet access available to be able to use Noona. Patients were asked to participate in the study by their physician during their routine visit at the hospital; otherwise their treatment continued according to local guidelines. All the doctors and nurses treating patients with cancer in the Helsinki University Comprehensive Cancer Center and willing to participate were eligible. Professionals (nurses, surgeons, medical oncologists, and radiotherapists) were recruited by the research doctor. A written informed consent was obtained from all participants. At the beginning, professionals had a training session about the use of Noona.

Patients were trained individually on the use of Noona by the research nurses and were introduced to the online tutorial. The information collected via Noona corresponded to that normally obtained in the clinical practice, and no additional information was requested. In case of a technical problem or if participants did not get a response from Noona within 24 hours, they were advised to contact their care team (nurse) by phone. Emergency patients were advised to contact their local emergency room.

A total of 45 patients with cancer and 18 health care professionals (nurses or medical doctors) were initially recruited at the Helsinki University Hospital Comprehensive Cancer Center in Finland in 2016. None of the participants declined to participate in the study; 1 patient and 1 professional were later excluded as they failed to fill in the questionnaire. Thus, the final number of patients and professionals recruited was 44 and 17, respectively. The study period was from June 26 to October 27, 2016, for the patients and from September 6 to November 1, 2016, for the professionals.

During the study period, the patients reported their symptoms and adverse events after surgery or during radiotherapy on Noona instead of reporting these via phone or at the doctor’s appointment. During chemotherapy the participating nurses sent their patients structured questionnaires via Noona a couple of days before chemotherapy infusion instead of contacting them over the phone. In addition, all patients could report using Noona how they are doing at any time. At the end of the study period, all participants answered questionnaires on the usability and reliability of Noona (Multimedia Appendix 1). Outcome measures of usability were ease of use, operability, and learnability. Participants were also asked about reliability (subjective opinion about Noona), whether they would recommend Noona to others, and if there was any harmful event related to the use of Noona. The questionnaires are described in detail in Multimedia Appendix 1.

The study was approved by the Ethics Committee of the Helsinki University Hospital.