Next Article in Journal
Adherence to Mediterranean Diet in Individuals on Renal Replacement Therapy
Previous Article in Journal
Impact of Contextual-Level Social Determinants of Health on Newer Antidiabetic Drug Adoption in Patients with Type 2 Diabetes
Previous Article in Special Issue
Impact of Social Media Use on Mental Health within Adolescent and Student Populations during COVID-19 Pandemic: Review
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Review

Economic and Performance Evaluation of E-Health before and after the Pandemic Era: A Literature Review and Future Perspectives

by
Helena Biancuzzi
1,
Francesca Dal Mas
2,*,
Chiara Bidoli
1,
Veronica Pegoraro
1,
Maristella Zantedeschi
1,
Pietro Antonio Negro
1,
Stefano Campostrini
1,* and
Lorenzo Cobianchi
3,4,5
1
Department of Economics, Ca’ Foscari University of Venice, 30123 Venice, Italy
2
Department of Management, Ca’ Foscari University of Venice, 30123 Venice, Italy
3
Department of Clinical, Diagnostic and Pediatric Sciences, University of Pavia, 27100 Pavia, Italy
4
General Surgery Department, IRCCS Policlinico San Matteo Foundation, 27100 Pavia, Italy
5
ITIR—Institute for Transformative Innovation Research, 27100 Pavia, Italy
*
Authors to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2023, 20(5), 4038; https://doi.org/10.3390/ijerph20054038
Submission received: 28 December 2022 / Revised: 20 February 2023 / Accepted: 22 February 2023 / Published: 24 February 2023

Abstract

:
E-Health represents one of the pillars of the modern healthcare system and a strategy involving the use of digital and telemedicine tools to provide assistance to an increasing number of patients, reducing, at the same time, healthcare costs. Measuring and understanding the economic value and performance of e-Health tools is, therefore, essential to understanding the outcome and best uses of such technologies. The aim of this paper is to determine the most frequently used methods for measuring the economic value and the performance of services in the framework of e-Health, considering different pathologies. An in-depth analysis of 20 recent articles, rigorously selected from more than 5000 contributions, underlines a great interest from the clinical community in economic and performance-related topics. Several diseases are the object of detailed clinical trials and protocols, leading to various economic outcomes, especially in the COVID-19 post-pandemic era. Many e-Health tools are mentioned in the studies, especially those that appear more frequently in people’s lives outside of the clinical setting, such as apps and web portals, which allow for clinicians to keep in contact with their patients. While such e-Health tools and programs are increasingly studied from practical perspectives, such as in the case of Virtual Hospital frameworks, there is a lack of consensus regarding the recommended models to map and report their economic outcomes and performance. More investigations and guidelines by scientific societies are advised to understand the potential and path of such an evolving and promising phenomenon.

1. Introduction

The World Health Organization (WHO) estimates that life expectancy has increased by six years over the past two decades. At a global level, the average age has risen from 67 years in 2000 to 73 in 2019 [1]. This is mainly due to improved socioeconomic and environmental conditions and better treatments and medical care [2]. Along with the rise in life expectancy, an increase in the volume of chronic diseases has been noted. Patients affected by chronic health conditions often require frequent and specialized medical care that are not easily accessible in rural areas. All these factors increase the overall costs of healthcare services to monitor patients, communicate with them, and offer proper care.
In this framework, e-Health, defined by the World Health Organization as “the cost-effective and secure use of information and communication technologies (ICT) in support of health and health-related fields”[3] may be an essential tool for improving healthcare accessibility while, at the same time, reducing costs. Compared to the concept of telemedicine, which refers to a reduction in the geographic distance between the patient and medical personnel, e-Health is much broader and impacts the whole health system from an organizational perspective [4,5]. Furthermore, according to the WHO, e-Health encompasses “multiple interventions, including telehealth, telemedicine, mobile health (mHealth), electronic medical or health records (eMR/eHR), big data, wearables, and even artificial intelligence” [3].
With the outbreak of the COVID-19 pandemic and the consequent introduction of social distancing rules, the use of e-Health to monitor and assist patients has dramatically accelerated [6,7,8,9,10,11,12,13]. Since the very beginning of the pandemic, e-Health and telemedicine tools have been used for forward triage and screening, telemonitoring, infection control procedures, televisits, teleconsultation with experts, and data and report sharing [14]. Later, more solutions were implemented to increase resilience and offer adequate assistance in collecting and sharing data among citizens, healthcare institutions, decision-makers, and public entities engaged in disaster management [15].
Several medical specialities have started to implement telemedicine and e-Health solutions following the pandemic, for instance, for neurodegenerative disorders, such as Alzheimer’s disease and amyotrophic lateral sclerosis. As these diseases progress, patients experience a loss of autonomy in daily life activities, becoming more dependent on their caregivers. The outbreak of the COVID-19 pandemic led to the confinement of the majority of the world population at home [7], with even longer periods of isolation recommended for frail patients, thus hindering most chronic/neurodegenerative patients from being assisted in person. In order to assist patients at home, telemedicine solutions were implemented to monitor patients and support them and their caregivers. The post-pandemic literature shows the potential advantages of this kind of monitoring in patient management [16,17,18,19,20].
All in all, the pandemic and the management responses to COVID-19 have sped the adoption of digital technologies in healthcare and beyond [21,22,23,24] by several years [25]. As a result, e-Health has become the third fastest-growing healthcare industry, after pharmaceuticals and medical devices [26], with an increasing number of applications, and even gave birth to the new concept of the Virtual Hospital [27,28,29].
These premises highlight the increasing importance of the e-Health concept, which should be studied more in-depth to evaluate in detail its economic value and general performance. In fact, in the international literature reviews currently available, there seems to be a lack of systematic methods able to analyze these aspects [30,31]. For this reason, several recent research papers have called for further studies and models of analysis on the topic [30,32,33].
Among the most common methods reported by the literature for the economic assessment of e-Health [34], we can mention:
  • The cost-effectiveness analysis (CEA), which compares the costs of a program with its nonmonetary outcomes (e.g., life years gained, diseases avoided) [30,32,35,36,37];
  • The cost–benefit analysis (CBA), which compares the costs and the benefits in monetary terms. Results gathered from this method may later be converted into broader measures of value [32];
  • The cost–utility analysis (CUA), which measures the benefits in terms of utility (e.g., quality-weighted life years gained) through the quality-adjusted life years (QALY) method. This analysis requires a study of direct, indirect, and lost productivity costs [30,32].
Starting from these premises, the aim of this study was to investigate the evolution of the different methods proposed in the literature for the economic and performance evaluation of e-Health, by conducting a structured review of the most recent literature on the topic, especially in a pre- and post-pandemic scenario.

2. Materials and Methods

A structured literature review was performed [38] using the Scopus database, the largest dataset of abstracts and citations of peer-reviewed literature in the fields of science, technology, medicine, social sciences, arts, and humanities [39], as well as the datasets Web of Science (WoS) and Pubmed.
A preliminary research protocol was established to document the procedures that were followed in conducting the literature review in order to make it reproducible and reliable (validity). Preliminary research questions were developed to provide new insights [40]. The formalization of the research protocol helped us to identify the central question to be investigated, defined as follows:
Research Question (RQ): What are the most frequent methods for measuring the economic value and the performance of services in the framework of e-Health in a pre- and post-pandemic scenario?
The query terms “e-health”, “telemedicine”, “digital health”, and “telehealth” were used in combination with words that represented the three evaluation methods and performance measurement indications. The same search, tailored to the specific search engine characteristics, was conducted on Scopus, WoS, and Pubmed.
The findings from the first step of the analysis, which targeted articles’ titles, abstracts, and keywords, gave 2063 results on Scopus, 5136 on WoS, and 2447 on Pubmed. The search was then further refined by including only journal articles written in English, related to topics in medicine, economics, econometrics, and finance published after 2019, in order to obtain a framework that mirrored the context of the study, also considering the fast development of the latest technologies and the COVID-19 booster effect. The new search led to 439 unique results, excluding duplicates.
Once all the titles and the abstracts were read, 21 papers were finally selected and analyzed by two authors (HB and FD). As a result of this latter step, reading the full text, 20 papers were considered eligible, while one was marked as off-topic. Figure 1 below summarizes the process of analysis and selection of contributions to be included in the sample according to the PRISMA methodology [41,42].
The selected articles were coded and analyzed using Nvivo software (version 12).
The main nodes and subnodes were selected according to the literature [43,44,45] and adapted to the aim of the present study.
The first node collected information on the author’s profile, such as academics, clinicians, and multidisciplinary groups, while the second contained information about the location in which the reported studies were conducted [44,46,47,48,49]. Details about the analyzed sector (public or private) were included in the third node, while information about the applied research methodology was coded in the fourth one [45]. The fifth and sixth nodes collected information about clinical discipline and pathology targeted mentioned by the 20 papers under review [43], while the seventh, eighth, ninth, and tenth nodes reported information on research implications, practices, policies, and outcomes. In the last node, the e-Health tools used were mapped.

3. Results

The 20 articles reported in the sample are summarized in the following Table 1, along with their publishing information.
Table 1. Articles analyzed and coded.
Table 1. Articles analyzed and coded.
N.AuthorsTitleYearJournalRef.
1Marcuzzi, A., Bach, K., Nordstoga, A.L., Bertheussen, G.F., Ashikhmin, I., Boldermo, N., Kvarner, E.-N., Nilsen, T.I.L., Marchand, G.H., Ose, S.O., Aasdahl, L., Kaspersen, S.L.,Individually tailored self-management app-based intervention (selfBACK) versus a self-management web-based intervention (e-Help) or usual care in people with low back and neck pain referred to secondary care: Protocol for a multiarm randomised clinical trial2021BMJ Open[50]
2Buntrock, C., Kählke, F., Smit, F., Ebert, D.D.A systematic review of trial-based economic evaluations of internet- and mobile-based interventions for substance use disorders2021European Journal of Public Health[51]
3Ochoa-Arnedo, C., Medina, J.C., Flix-Valle, A., Anastasiadou, D.E-health ecosystem with integrated and stepped psychosocial services for breast cancer survivors: Study protocol of a multicentre randomised controlled trial2021BMJ Open[52]
4Cadilhac, D.A., Sheppard, L., Kim, J., et al.Economic evaluation protocol and statistical analysis plan for the cost-effectiveness of a novel Australian stroke telemedicine (VST) program2021Frontiers in Neurology[53]
5Ionov, M.V., Zhukova, O.V., Yudina, Y.S., et al.Value-based approach to blood pressure telemonitoring and remote counseling in hypertensive patients2021Blood Pressure[54]
6Rubee, D., Jinghua, L., Donglan, Z., et al.An economic evaluation of a mobile text messaging intervention to improve mental health care in resource-poor communities in China: a cost-effectiveness study2020BMC Health Services Research[55]
7Terhorst, Y., Braun, L., Titzler, I., et al.Clinical and cost-effectiveness of a guided internet-based Acceptance and Commitment Therapy to improve chronic pain–related disability in green professions (PACT-A): study protocol of a pragmatic randomised controlled trial2020BMC[56]
8Fioratti, I., Saragiotto, B.T., Reis, F.J.J., et al.Evaluation of the efficacy of an internet-based pain education and exercise program for chronic musculoskeletal pain in comparison with online self-management booklet: a protocol of a randomised controlled trial with assessor-blinded, 12-month follow-up, and economic evaluation2020BMC Musculoskeletal Disorders[57]
9Birkemeyer, R., Müller, A., Wahler, S., et al.A cost-effectiveness analysis model of Preventicus atrial fibrillation screening from the point of view of statutory health insurance in Germany2020Health Economics Review[58]
10Koppenaal, T., Arensman, R.M., van Dongen, J.M., et al.Effectiveness and cost-effectiveness of stratified blended physiotherapy in patients with non-specific low back pain: study protocol of a cluster randomized controlled trial2020BMC Musculoskeletal Disorders[59]
11Tsou, C., Robinson, S., Boyd, J., et al.Effectiveness and cost-effectiveness of telehealth in rural and remote emergency departments: a systematic review protocol2020Systematic Reviews[60]
12Yang, Y., Chen, H., Qazi, H., et al.Intervention and Evaluation of Mobile Health Technologies in Management of Patients Undergoing Chronic Dialysis: Scoping Review2020JMIR mHealth and uHealth[61]
13Thao, V., Nyman, J.A., Nelson, D.B., et al.Cost-effectiveness of population-level proactive tobacco cessation outreach among socio-economically disadvantaged smokers: evaluation of a randomized control trial2019Addiction[62]
14Nadort, E., Schouten, R.W., Dekker, F.W., et al.The (cost) effectiveness of guided internet-based self-help CBT for dialysis patients with symptoms of depression: study protocol of a randomised controlled trial2019BMC Psychiatry[56]
15de Ruijter, D., Hoving, C., Evers, S., et al.An economic evaluation of a computer-tailored e-learning program to promote smoking cessation counseling guideline adherence among practice nurses2019Patient Education and Counseling[63]
16Braun, L., Titzler, I., Ebert, D.D., et al.Clinical and cost-effectiveness of guided internet-based interventions in the indicated prevention of depression in green professions (PROD-A): study protocol of a 36-month follow-up pragmatic randomized controlled trial2019BMC Psychiatry[56]
17Lizée, T., Basch, E., Trémolières, P., et al.Cost-Effectiveness of Web-Based Patient-Reported Outcome Surveillance in Patients with Lung Cancer2019Journal of Thoracic Oncology[64]
18Golchert, J., Roehr, S., Berg, F., et al.HELP@APP: development and evaluation of a self-help app for traumatized Syrian refugees in Germany—a study protocol of a randomized controlled trial2019BMC Psychiatry [65]
19Williams, A., Van Dongen, J.M., Kamper, S.J., et al.Economic evaluation of a healthy lifestyle intervention for chronic low back pain: A randomized controlled trial2019European Journal of Pain[66]
20Willcox, M., Moorthy, A., Mohan, D., et al.Mobile Technology for Community Health in Ghana: Is Maternal Messaging and Provider Use of Technology Cost-Effective in Improving Maternal and Child Health Outcomes at Scale?2019Journal of Medical Internet Research[67]
A total of 19 out of 20 articles (95% of the sample) were published in medical journals, and only 1 (1 of the 2 systematic reviews) was published in the journal of Systematic Reviews.
The average number of authors per paper analyzed was approximately eight. Specifically, papers that were written only by clinicians or academics (5 in total) had, on average, 7.6 authors, which is slightly lower than the number of authors of the papers written by multidisciplinary groups (15 in total), which was 8.4. From this perspective, it is interesting to note that even though the majority of papers were published in medical journals, the authors of the studies were not only clinicians. On the contrary, different competencies were brought together.
Geographically, it is crystal clear that most of the studies were conducted in European countries, specifically in Germany and the Netherlands, where there is a peak of contributions. As for Oceania and America, only two contributions were found, and only one for Africa and Asia continents. Results are reported in Table 2.
More than half of the contributions analyzed are research protocols (11 contributions, 55% of the total sample), which present methods that will later be applied in order to proceed with the performance analysis of programs in the e-Health field. Seven contributions (35% of the total sample) are instead quantitative clinical cases, which, therefore, apply the identified evaluation methods to the practical case. Four of these quantitative clinical cases analyze non-European situations: two Australian, one American, and one African.
In analyzing the content of the various papers, in relation to the clinical discipline and the pathology treated under study, it can be seen that the medical fields most affected are pain medicine and mental health, as represented in Figure 2.
The most frequently mentioned treated pathologies are pain, such as low back and neck pain, psychological problems, including depression, schizophrenia and post-traumatic stress, and alcohol and smoking addictions, as shown in Figure 3 below.
Considering the suggestions and final remarks, research implications are almost always present, in contrast to practical implications, which are named in only nine contributions (45% of the total sample), and policy implications in eight (40%). The research results are present in the quantitative clinical cases but not present in the protocols and reviews, which instead report state of the art in the field.
The e-Health tools presented in the reviewed articles, or which are used by described programs, vary, but with a higher diffusion of mobile apps, phone calls and online sessions, as illustrated in Figure 4 below.
The methods used for measuring performance in the analyzed e-Health programs are indicated in the identified contributions. Table 3 below provides a description of the measurement methods, placing the data side by side with the treated pathology and e-Health tools used, presenting a visual to help us determine whether there may be links among the three variables. Table 4 aggregates the papers in the sample by pathology, reporting the e-Health tool and method(s) of performance measurement.
Concerning pre- and post-pandemic differences, 12 articles (60% of the sample) were published between 2020 and 2021, while the remaining 8 papers were published in the pre-pandemic era. Still, only one of the papers [54] explicitly mentions the pandemic. In particular, the study by Ionov and colleagues [54] underlines the need to find solutions for patients confined at home. Concerning the tools used, telemonitoring with or without remote counseling may improve blood pressure control and adherence to protocols, especially in force majeure events such as a pandemic outbreak. Still, no specific impact on costs or cost calculation is reported.

4. Discussion

Almost all articles published in medical journals express an almost exclusive interest in discussing the topic solely within the boundaries of the clinical setting, presenting a gap in the managerial and statistical literature. This result leads to an interesting reflection, which underlines the increasing relevance of economic and managerial issues in the clinical literature as well. Such findings are consistent with the growing importance of the role of medical doctors as “hybrid managers” [68,69] with cost, budget, and economic outcome responsibilities. Department chiefs should, therefore, be in charge of managing such aspects, which differ from pure clinical practice, and require specific training and decision-making mindsets [70].
The geographical spread of the contributions suggests that the e-Health phenomenon may have recently been widespread in Northern Europe or that it originated in these areas first, allowing for sufficient data to make reasoning about performance evaluations. However, the fact that only four of the seven quantitative clinical cases analyze non-European situations—two Australian, one American, and one African—suggests that it is Europe that is at an earlier stage than the other continents. A few contributions propose field studies that have already been carried out. Europe has thus been the most interested region in the topic for the past four years, but research protocols have a significant impact on the data.
Relative to the clinical discipline and the treated pathology, pain medicine and mental health appear to be the ones attracting the most interest, as described in Figure 2. For this reason, it can be assumed that these disciplines offer more possibilities for remote clinical pathways compared to others, that more often require direct contact with medical personnel [71]. Still, even those specialities that require an in-person approach, such as surgery, allow for online pre-surgical consultation, follow-up, and telemonitoring in the rehabilitation phase [6,72,73,74,75], despite doubts and open questions posed by surgeons about the practical applications and “its efficacy in improving patients’ health, cost-effectiveness and user satisfaction” [72].
This reflection is linked to recent studies on the possibility of launching integrated patient management paths according to the Virtual Hospital model [28,29]. This model offers continuous assistance for the patient, carried out remotely, similar to that provided in a physical hospital. A high level of digitalization permits early identification and analysis of diseases, enabling proactive intervention (defined as “initiative medicine”) and thus improving the understanding of disease progression, resulting in a significant reduction in mortality and a substantial improvement in quality of life.
Moreover, in Virtual Hospitals, the number of patients who can be cared for remotely is greater than that in physical hospitals, and this is because patients can be cared for from anywhere (their own home, residences for the elderly, nursing homes or hospices, or other care facilities), without the need for outpatient clinics or hospitals [76,77]. A Virtual Hospital offers numerous advantages due to its unique and high-tech environment, both for patients and healthcare providers as well as for the healthcare institution itself. Furthermore, this model ensures better accessibility and equity of care and healthcare by providing access to services not otherwise available (thus reducing inequalities in access to healthcare services) and offers greater efficiency, especially in monitoring elderly or chronically ill patients who require follow-up care [78]. In fact, it seems to be more efficient if it is aimed at a specific target group of patients, i.e., those who are in a follow-up phase. These include, for example, frail, elderly patients and/or those who have one or more chronic conditions, such as heart disease, stroke, diabetes, chronic respiratory disorders, etc. [79]. Therefore, when applying Virtual Hospital frameworks to such conditions, e-Health tools represent key aspects, and so their economic and sustainability-related issues and performances should be considered and monitored.
Compared to other e-Health tools, the significant diffusion of apps, text messages, and phone calls is undoubtedly due to the fact that these are the most easily used devices for a wide target population. More complex techniques require more specific tools and skills on the part of both the patient and the clinical staff [71], who do not always have adequate training in technology and data analysis [80]. In this regard, one of the major criticalities is a poor level of digital literacy, which affects not only the population (potential patients), but also the health personnel themselves. While the acquisition of new digital skills may be easy for the younger segment of the population and for clinicians—for whom competencies may be implemented during undergraduate or postgraduate modules or in their lifelong learning education—in other cases, training and accompaniment in the use of these tools may be necessary, both among patients and caregivers [81,82]. In some cases, the accompaniment of the patient by a third-party figure (for example, for seniors) may also be necessary. Moreover, the use of complex tools implies the adoption of a new digital mindset by healthcare personnel, patients, and caregivers [71,79]. On the other hand, widely used online tools (such as those related to mobile technology) may represent facilitators in the management of the clinical relationship [83,84,85,86] and in the related communication with the patients.
The recent COVID-19 pandemic, with the reorganization of several clinical processes [10,87,88,89,90], has forced clinicians and clinical institutions to use and apply e-Health tools to monitor patients [11,14], assist them, even in end-of-life care [12], and communicate with them. The COVID-19 experience has, therefore, encouraged and promoted the use of e-Health tools, which have been named among the winning strategies for a resilient and antifragile response to the post-pandemic healthcare system [91]. Still, the results of our literature review do not reveal any particular changes before and after the pandemic outbreak in terms of costs or cost calculation. Interesting enough, only one paper among those published after the beginning of the COVID-19 pandemic specifically mentions this issue [54]. What could be determined was that the pandemic appears to be the ideal context to foster and encourage the use of telemedicine and e-Health tools, but the economic and performance evaluation issue appears independent, as it is discussed by a specific part of the literature. Undoubtedly, the COVID-19 emergency and the subsequent increase in the use of e-Health tools and applications require a deep understanding of the surrounding economic dynamics.
In agreement with other recent studies [30,37], our literature review, albeit it had a limited sample, does not reveal any link or repeatability between the pathology treated and the e-Health tool used, as shown in Table 4. Thus, it might be worthwhile to devote specific studies to determine whether there are more or less suitable or effective instruments relative to each pathology treated at a distance.

5. Conclusions

E-Health appears to be a growing phenomenon, especially in the COVID-19 post-pandemic era. E-Health is destined to be one of the winning strategies for caring for an increasing number of patients while controlling healthcare costs. Moreover, it is at the basis of modern phenomena such as the Virtual Hospital [79,92]. Within this context, cost dynamics are relevant, as they require measuring the performance of e-Health tools.
The studies included in the search protocol of this literature review identified a combined use of the three main methods—cost-effectiveness, cost–benefit, and cost–utility—with no preference emerging for any one depending on the pathology identified. Therefore, we identified an effort in the medical literature to understand not only the clinical result but also the economic outcome of the use of e-Health tools linked to new technologies.
Although the sample selected was limited, multiple pathologies and various technological tools for patient support emerged. This fact emphasizes once again the strategic role that e-Health tools are playing in the healthcare landscape and their future development prospects, also from a Virtual Hospital perspective.
The cross-fertilization between economic studies and clinical outcomes appears to be an efficient way to study and understand the phenomenon as a cornerstone for the development of the future health system. Furthermore, in agreement with other literature reviews [30], the need to set standard and shareable guidelines is recalled. In this sense, the role of scientific societies could be strategic in guiding the clinical and managerial community towards certain solutions and methods that are more relevant to specific situations.

Limitations of the Study and Future Research Avenues

As with every piece of research, our study has several limitations. Although the methodology used to select the literature for the analysis is rigorous and has already been used by multiple international studies, the sample size is far too limited. The studies did not identify a precise link between the pathology, the preferred e-Health tool, and the performance evaluation method. Still, this limitation could be overcome by changing the search keys or adding more specific ones, such as, for instance, “telepsychiatry”, “telecardiology”, or “telephysiotherapy”. A more comprehensive article sample may also allow a comparison of methodologies and technologies applied to the different e-Health types to reveal new practical implications for healthcare institutions and clinicians. Moreover, as e-Health stands as a general topic, which today involves a variety of medical specialities and diseases, more focused research could deepen the same analysis on specific conditions or subjects.
Finally, given the speed of technological and also organizational change in the healthcare domain also following the effects and responses to the COVID-19 pandemic, it would be appropriate to repeat the investigation in the near future in order to understand innovations and, thus, paradigm shifts in the use and economic measurement of performance. All these aspects constitute interesting future lines of research. Clinicians and experts in economics, healthcare management, and statistics should combine their expertise to produce multidisciplinary results that can help the medical sphere to fully understand, map, and implement the e-Health phenomenon and its potential.

Author Contributions

Conceptualization, H.B. and F.D.M.; methodology, H.B. and F.D.M.; software, H.B.; validation, S.C. and L.C.; formal analysis, H.B. and F.D.M.; investigation, H.B. and F.D.M.; resources, H.B. and F.D.M.; data curation, H.B. and F.D.M.; writing—original draft preparation, H.B., F.D.M., C.B. and V.P.; writing—review and editing M.Z., P.A.N., S.C. and L.C.; visualization, M.Z., P.A.N., S.C. and L.C.; supervision, S.C. and L.C.; project administration, S.C.; funding acquisition, S.C. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Data can be provided by the corresponding author upon reasonable request.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. WHO. Ageing and Health. 2022. Available online: https://www.who.int/news-room/fact-sheets/detail/ageing-and-health (accessed on 14 June 2022).
  2. Eurostat. Archive: Statistiche Demografiche a Livello Regionale; Eurostat: Luxembourg, 2016. [Google Scholar]
  3. WHO. Using e-Health and Information Technology to Improve Health. Health Topics. 2022. Available online: https://www.who.int/westernpacific/activities/using-e-health-and-information-technology-to-improve-health (accessed on 5 December 2022).
  4. Roine, R.; Ohinmaa, A.; Hailey, D. Assessing telemedicine: A systematic review of the literature. Can. Med. Assoc. J. 2001, 165, 765–771. [Google Scholar]
  5. Della Mea, V. What is e-Health: The death of telemedicine? J. Med. Internet Res. 2001, 3, e834. [Google Scholar] [CrossRef] [PubMed]
  6. Sorensen, M.J.; Bessen, S.; Danford, J.; Fleischer, C.; Wong, S.L. Telemedicine for Surgical Consultations—Pandemic Response or Here to Stay? Ann. Surg. 2020, 272, e174–e180. [Google Scholar] [CrossRef]
  7. Massaro, M.; Tamburro, P.; La Torre, M.; Dal Mas, F.; Thomas, R.; Cobianchi, L.; Barach, P. Non-pharmaceutical interventions and the Infodemic on Twitter: Lessons learned from Italy during the COVID-19 Pandemic. J. Med. Syst. 2021, 45, 50. [Google Scholar] [CrossRef] [PubMed]
  8. Biancuzzi, H.; Dal Mas, F.; Drago, C.; Ruggeri, M.; Trua, N.; Menegazzi, G.; Rizzardo, A.; Cobianchi, L.; Ruta, F.; Bednarova, R.; et al. La frontiera delle cure a distanza. Assetto normativo ed il caso Doctor@Home. Prof. Inferm. 2022, 75. Available online: https://www.profinf.net/pro3/index.php/IN/article/view/1008 (accessed on 27 December 2022).
  9. Leo, D.G.; Buckley, B.J.R.; Chowdhury, M.; Harrison, S.L.; Isanejad, M.; Lip, G.Y.H.; Wright, D.J.; Lane, D.A. Interactive Remote Patient Monitoring Devices for Managing Chronic Health Conditions: Systematic Review and Meta-analysis. J. Med. Internet Res. 2022, 24, e35508. [Google Scholar] [CrossRef]
  10. Romani, G.; Dal Mas, F.; Massaro, M.; Cobianchi, L.; Modenese, M.; Barcellini, A.; Ricciardi, W.; Barach, P.; Lucà, R.; Ferrara, M. Population Health Strategies to Support Hospital and Intensive Care Unit Resiliency during the COVID-19 Pandemic: The Italian Experience. Popul. Health Manag. 2021, 24, 174–181. [Google Scholar] [CrossRef]
  11. Keesara, S.; Jonas, A.; Schulman, K. COVID-19 and Health Care’s Digital Revolution. N. Engl. J. Med. 2020, 382, e82. [Google Scholar] [CrossRef]
  12. Wakam, G.K.; Montgomery, J.R.; Biesterveld, B.E.; Brown, C.S. Not Dying Alone—Modern Compassionate Care in the COVID-19 Pandemic. N. Engl. J. Med. 2020, 382, e88. [Google Scholar] [CrossRef]
  13. Abdel-Basset, M.; Chang, V.; Nabeeh, N.A. An intelligent framework using disruptive technologies for COVID-19 analysis. Technol. Forecast. Soc. Chang. 2021, 163, 120431. Available online: https://www.sciencedirect.com/science/article/pii/S0040162520312579 (accessed on 27 December 2022). [CrossRef]
  14. Hollander, J.E.; Carr, B.G. Virtually Perfect? Telemedicine for COVID-19. N. Engl. J. Med. 2020, 382, 1679–1681. [Google Scholar] [CrossRef]
  15. Dal Mas, F.; Massaro, M.; Verde, J.M.; Garcia Vazquez, A.; Cobianchi, L.; Gimenez, M.E.; Gallix, B. Resilience, Digital Tools, and Knowledge Management Systems in the Pandemic Era: The IHU Strasbourg Experience. In Resilience in a Digital Age Global Challenges in Organisations and Society; Matos, F., Selig, P.M., Henriqson, E., Eds.; Springer: Cham, Switzerland, 2022. [Google Scholar]
  16. Vasta, R.; Moglia, C.; D’Ovidio, F.; Di Pede, F.; De Mattei, F.; Cabras, S.; Peotta, L.; Iazzolino, B.; Giusiano, S.; Manera, U.; et al. Telemedicine for patients with amyotrophic lateral sclerosis during COVID-19 pandemic: An Italian ALS referral center experience. Amyotroph. Lateral Scler. Front. Degener. 2021, 22, 308–311. [Google Scholar] [CrossRef]
  17. De Marchi, F.; Sarnelli, M.F.; Serioli, M.; De Marchi, I.; Zani, E.; Bottone, N.; Ambrosini, S.; Garone, R.; Cantello, R.; Mazzini, L.; et al. Telehealth approach for amyotrophic lateral sclerosis patients: The experience during COVID-19 pandemic. Acta Neurol. Scand. 2021, 143, 489–496. [Google Scholar] [CrossRef]
  18. Capozzo, R.; Zoccolella, S.; Musio, M.; Barone, R.; Accogli, M.; Logroscino, G. Telemedicine is a useful tool to deliver care to patients with Amyotrophic Lateral Sclerosis during COVID-19 pandemic: Results from Southern Italy. Amyotroph. Lateral Scler. Front. Degener. 2020, 21, 542–548. [Google Scholar] [CrossRef]
  19. Sharbafshaaer, M.; Buonanno, D.; Passaniti, C.; De Stefano, M.; Esposito, S.; Canale, F.; D’Alvano, G.; Silvestro, M.; Russo, A.; Tedeschi, G.; et al. Psychological Support for Family Caregivers of Patients with Amyotrophic Lateral Sclerosis at the Time of the Coronavirus Disease 2019 Pandemic: A Pilot Study Using a Telemedicine Approach. Front. Psychiatry 2022, 13, 904841. Available online: https://www.frontiersin.org/articles/10.3389/fpsyt.2022.904841 (accessed on 27 December 2022). [CrossRef]
  20. De Stefano, M.; Esposito, S.; Iavarone, A.; Carpinelli Mazzi, M.; Siciliano, M.; Buonanno, D.; Atripaldi, D.; Trojsi, F.; Tedeschi, G. Effects of Phone-Based Psychological Intervention on Caregivers of Patients with Early-Onset Alzheimer Disease: A Six-Months Study during the COVID-19 Emergency in Italy. Brain Sci. 2022, 12, 310. [Google Scholar] [CrossRef]
  21. Ghosh, S.; Hughes, M.; Hodgkinson, I.; Hughes, P. Digital transformation of industrial businesses: A dynamic capability approach. Technovation 2021, 113, 102414. Available online: https://www.sciencedirect.com/science/article/pii/S0166497221001954 (accessed on 27 December 2022). [CrossRef]
  22. Pereira, V.; Hadjielias, E.; Christofi, M.; Vrontis, D. A systematic literature review on the impact of artificial intelligence on workplace outcomes: A multi-process perspective. Hum. Resour. Manag. Rev. 2021, 33, 100857. Available online: https://www.sciencedirect.com/science/article/pii/S105348222100036X (accessed on 27 December 2022). [CrossRef]
  23. Ceipek, R.; Hautz, J.; Petruzzelli, A.M.; De Massis, A.; Matzler, K. A motivation and ability perspective on engagement in emerging digital technologies: The case of Internet of Things solutions. Long Range Plann. 2021, 54, 101991. Available online: https://www.sciencedirect.com/science/article/pii/S0024630118305557 (accessed on 27 December 2022). [CrossRef]
  24. Urbinati, A.; Chiaroni, D.; Chiesa, V.; Frattini, F. The role of digital technologies in open innovation processes: An exploratory multiple case study analysis. R&D Manag. 2020, 50, 136–160. [Google Scholar] [CrossRef]
  25. McKinsey. How COVID-19 Has Pushed Companies over the Technology Tipping Point—And Transformed Business Forever. Strategy and Corporate-Finance. 2020. Available online: https://www.mckinsey.com/capabilities/strategy-and-corporate-finance/our-insights/how-covid-19-has-pushed-companies-over-the-technology-tipping-point-and-transformed-business-forever#/ (accessed on 8 February 2023).
  26. Dal Mas, F.; Piccolo, D.; Cobianchi, L.; Edvinsson, L.; Presch, G.; Massaro, M.; Skrap, M.; Ferrario di Tor Vajana, A.; D’Auria, S.; Bagnoli, C. The effects of Artificial Intelligence, Robotics, and Industry 4.0 technologies. Insights from the Healthcare Sector. In Proceedings of the first European Conference on the impact of Artificial Intelligence and Robotics, Oxford, UK, 31 October–1 November 2019; Academic Conferences and Publishing International Limited: Reading, UK, 2019; pp. 88–95. [Google Scholar]
  27. Ryan, P.P.; Hawkins, K.L.; Altman, S.; Granatowski, L.; Shy, B.D.; Long, J.; Hanratty, R. A novel virtual hospital at home model during the coronavirus disease 2019 (COVID-19) pandemic. Infect. Control Hosp. Epidemiol. 2021, 42, 1140–1142. Available online: https://www.cambridge.org/core/article/novel-virtual-hospital-at-home-model-during-the-coronavirus-disease-2019-covid19-pandemic/C013C98E9B2D48D7C187CBA47B3CF0AE (accessed on 24 August 2020). [CrossRef]
  28. Lewis, G.; Vaithianathan, R.; Wright, L.; Brice, M.R.; Lovell, P.; Rankin, S.; Bardsley, M. Integrating care for high-risk patients in England using the virtual ward model: Lessons in the process of care integration from three case sites. Int. J. Integr. Care 2013, 13, e046. Available online: https://pubmed.ncbi.nlm.nih.gov/24250284 (accessed on 27 December 2022). [CrossRef] [PubMed]
  29. Moore, G.; Du Toit, A.; Jameson, B.; Liu, A.; Harris, M. The Effectiveness of ‘Virtual Hospital’ Models of Care: A Rapid Evidence Scan. The Effectiveness of Virtual Hospital Models of Care. Sydney. 2020. Available online: https://www.saxinstitute.org.au/wp-content/uploads/20.04_Rapid-Evidence-Scan_The-effectiveness-of-virtual-hospitals.pdf (accessed on 27 December 2022).
  30. Gentili, A.; Failla, G.; Melnyk, A.; Puleo, V.; Luca, G.; Tanna, D.; Ricciardi, W.; Cascini, F. The cost-e ectiveness of digital health interventions: A systematic review of the literature. Front. Public Health 2022, 10, 787135. [Google Scholar] [CrossRef]
  31. Iribarren, S.J.; Cato, K.; Falzon, L.; Stone, P.W. What is the economic evidence for mHealth? A systematic review of economic evaluations of mHealth solutions. PLoS ONE 2017, 12, e0170581. [Google Scholar] [CrossRef] [Green Version]
  32. Bergmo, T.S. How to Measure Costs and Benefits of eHealth Interventions: An Overview of Methods and Frameworks. J. Med. Internet Res. 2015, 17, e254. [Google Scholar] [CrossRef] [PubMed]
  33. Sanyal, C.; Stolee, P.; Juzwishin, D.; Husereau, D. Economic evaluations of eHealth technologies: A systematic review. PLoS ONE 2018, 13, e0198112. [Google Scholar] [CrossRef] [Green Version]
  34. de la Torre-Díez, I.; López-Coronado, M.; Vaca, C.; Aguado, J.S.; de Castro, C. Cost-utility and cost-effectiveness studies of telemedicine, electronic, and mobile health systems in the literature: A systematic review. Telemed. J. e-Health Off. J. Am. Telemed. Assoc. 2015, 21, 81–85. [Google Scholar] [CrossRef] [Green Version]
  35. Johannesson, M.; Meltzer, D. Some Reflections on Cost-Effectiveness Analysis. Health Econ. 1998, 7, 1–7. [Google Scholar] [CrossRef]
  36. Bonder, S.; Zajtchuk, R. Changing the paradigm for telemedicine development and evaluation: A prospective model-based approach. Socioecon. Plann. Sci. 1997, 31, 257–280. Available online: https://www.sciencedirect.com/science/article/pii/S0038012197000189 (accessed on 27 December 2022). [CrossRef]
  37. Ghani, Z.; Jarl, J.; Berglund, J.S.; Andersson, M.; Anderberg, P. The Cost-E ff ectiveness of Mobile Health (mHealth) Interventions for Older Adults: Systematic Review. Int. J. Environ. Res. Public Health 2020, 17, 5290. [Google Scholar] [CrossRef]
  38. Massaro, M.; Dumay, J.C.; Guthrie, J. On the shoulders of giants: Undertaking a structured literature review in accounting. Account. Audit. Account. J. 2016, 29, 767–901. [Google Scholar] [CrossRef]
  39. Palumbo, R. Contextualizing co-production of health care: A systematic literature review. Int. J. Public Sect. Manag. 2016, 29, 72–90. [Google Scholar] [CrossRef]
  40. Hart, C. Hart, Chris, Doing a Literature Review: Releasing the Social Science Research Imagination; Sage: London, UK, 1998. [Google Scholar]
  41. Liberati, A.; Altman, D.G.; Tetzlaff, J.; Mulrow, C.; Gøtzsche, P.C.; Ioannidis, J.P.A.; Clarke, M.; Devereaux, P.J. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: Explanation and elaboration. J. Clin. Epidemiol. 2009, 62, 1–34. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  42. Page, M.J.; McKenzie, J.E.; Bossuyt, P.M.; Boutron, I.; Hoffmann, T.C.; Mulrow, C.D.; Shamseer, L.; Tetzlaff, J.M.; Akl, E.A.; Brennan, S.E.; et al. The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. BMJ 2021, 372, n71. Available online: https://www.bmj.com/content/372/bmj.n71 (accessed on 27 December 2022). [CrossRef] [PubMed]
  43. Biancuzzi, H.; Dal Mas, F.; Brescia, V.; Campostrini, S.; Cascella, M.; Cuomo, A.; Cobianchi, L.; Dorken-Gallastegi, A.; Gebran, A.; Kaafarani, H.M.; et al. Opioid Misuse: A Review of the Main Issues, Challenges, and Strategies. Int. J. Environ. Res. Public Health 2022, 19, 1754. [Google Scholar] [CrossRef]
  44. Dal Mas, F.; Massaro, M.; Lombardi, R.; Garlatti, A. From Output to Outcome Measures in the Public Sector. A Structured Literature Review. Int. J. Organ. Anal. 2019, 27, 1631–1656. [Google Scholar] [CrossRef]
  45. Dal Mas, F.; Garcia-Perez, A.; Sousa, M.J.; Lopes da Costa, R.; Cobianchi, L. Knowledge Translation in the Healthcare Sector. A Structured Literature Review. Electron. J. Knowl. Manag. 2020, 18, 198–211. [Google Scholar] [CrossRef]
  46. Massaro, M.; Dumay, J.; Garlatti, A. Public sector knowledge management: A structured literature review. J. Knowl. Manag. 2015, 19, 530–558. [Google Scholar] [CrossRef]
  47. Guthrie, J.; Dumay, J.; Puntillo, P. IC and public sector: A structured literature review. J. Intellect. Cap. 2015, 16, 267–284. [Google Scholar]
  48. Guthrie, J.; Ricceri, F.; Dumay, J. Reflections and projections: A decade of intellectual capital accounting research. Br. Account. Rev. 2012, 44, 68–92. [Google Scholar] [CrossRef]
  49. Dumay, J.; Bernardi, C.; Guthrie, J.; Demartini, P. Integrated reporting: A structured literature review. Account. Forum. 2016, 40, 166–185. [Google Scholar] [CrossRef]
  50. Marcuzzi, A.; Bach, K.; Nordstoga, A.L.; Bertheussen, G.F.; Ashikhmin, I.; Boldermo, N.Ø.; Kvarner, E.-N.; Nilsen, T.I.L.; Marchand, G.H.; Ose, S.O. Individually tailored self-management app-based intervention (selfBACK) versus a self-management web-based intervention (e-Help) or usual care in people with low back and neck pain referred to secondary care: Protocol for a multiarm randomised clinical tr. BMJ Open 2021, 11, e047921. [Google Scholar] [CrossRef] [PubMed]
  51. Buntrock, C.; Kählke, F.; Smit, F.; Ebert, D.D. A systematic review of trial-based economic evaluations of internet-and mobile-based interventions for substance use disorders. Eur. J. Public Health 2021, 31, i19–i28. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  52. Ochoa-Arnedo, C.; Medina, J.C.; Flix-Valle, A.; Anastasiadou, D. E-health ecosystem with integrated and stepped psychosocial services for breast cancer survivors: Study protocol of a multicentre randomised controlled trial. BMJ Open 2021, 11, e041548. [Google Scholar] [CrossRef] [PubMed]
  53. Cadilhac, D.A.; Sheppard, L.; Kim, J.; Tan, E.; Gao, L.; Sookram, G.; Dewey, H.M.; Bladin, C.F.; Moodie, M. Economic evaluation protocol and statistical analysis plan for the cost-effectiveness of a novel Australian stroke telemedicine program; the victorian stroke telemedicine (VST) program. Front. Neurol. 2021, 11, 602044. [Google Scholar] [CrossRef] [PubMed]
  54. Ionov, M.V.; Zhukova, O.V.; Yudina, Y.S.; Avdonina, N.G.; Emelyanov, I.V.; Kurapeev, D.I.; Zvartau, N.E.; Konradi, A.O. Value-based approach to blood pressure telemonitoring and remote counseling in hypertensive patients. Blood Press. 2021, 30, 20–30. [Google Scholar] [CrossRef]
  55. Dev, R.; Li, J.; Zhang, D.; Cai, Y.; Hao, C.; Hou, F.; Wang, R.; Lin, M.; Xu, D.R. An economic evaluation of a mobile text messaging intervention to improve mental health care in resource-poor communities in China: A cost-effectiveness study. BMC Health Serv. Res. 2020, 20, 989. [Google Scholar] [CrossRef]
  56. Terhorst, Y.; Braun, L.; Titzler, I.; Buntrock, C.; Freund, J.; Thielecke, J.; Ebert, D.; Baumeister, H. Clinical and cost-effectiveness of a guided internet-based Acceptance and Commitment Therapy to improve chronic pain–related disability in green professions (PACT-A): Study protocol of a pragmatic randomised controlled trial. BMJ Open 2020, 10, e034271. [Google Scholar] [CrossRef]
  57. Fioratti, I.; Saragiotto, B.T.; Reis, F.J.J.; Miyamoto, G.C.; Lee, H.; Yamato, T.P.; Fandim, J.V.; Dear, B.; Maher, C.G.; Costa, L.O.P. Evaluation of the efficacy of an internet-based pain education and exercise program for chronic musculoskeletal pain in comparison with online self-management booklet: A protocol of a randomised controlled trial with assessor-blinded, 12-month follow-up. BMC Musculoskelet. Disord. 2020, 21, 404. [Google Scholar] [CrossRef]
  58. Birkemeyer, R.; Müller, A.; Wahler, S.; von der Schulenburg, J.-M. A cost-effectiveness analysis model of Preventicus atrial fibrillation screening from the point of view of statutory health insurance in Germany. Health Econ. Rev. 2020, 10, 16. [Google Scholar] [CrossRef]
  59. Koppenaal, T.; Arensman, R.M.; Van Dongen, J.M.; Ostelo, R.W.J.G.; Veenhof, C.; Kloek, C.J.J.; Pisters, M.F. Effectiveness and cost-effectiveness of stratified blended physiotherapy in patients with non-specific low back pain: Study protocol of a cluster randomized controlled trial. BMC Musculoskelet. Disord. 2020, 21, 265. [Google Scholar] [CrossRef] [Green Version]
  60. Tsou, C.; Robinson, S.; Boyd, J.; Jamieson, A.; Blakeman, R.; Bosich, K.; Yeung, J.; Waters, S.; Hendrie, D. Effectiveness and cost-effectiveness of telehealth in rural and remote emergency departments: A systematic review protocol. Syst. Rev. 2020, 9, 82. [Google Scholar] [CrossRef] [PubMed]
  61. Yang, Y.; Chen, H.; Qazi, H.; Morita, P.P. Intervention and evaluation of mobile health technologies in management of patients undergoing chronic dialysis: Scoping review. JMIR mHealth uHealth 2020, 8, e15549. [Google Scholar] [CrossRef] [PubMed]
  62. Thao, V.; Nyman, J.A.; Nelson, D.B.; Joseph, A.M.; Clothier, B.; Hammett, P.J.; Fu, S.S. Cost-effectiveness of population-level proactive tobacco cessation outreach among socio-economically disadvantaged smokers: Evaluation of a randomized control trial. Addiction 2019, 114, 2206–2216. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  63. de Ruijter, D.; Hoving, C.; Evers, S.; Hudales, R.; de Vries, H.; Smit, E. An economic evaluation of a computer-tailored e-learning program to promote smoking cessation counseling guideline adherence among practice nurses. Patient Educ. Couns. 2019, 102, 1802–1811. [Google Scholar] [CrossRef]
  64. Lizée, T.; Basch, E.; Trémolières, P.; Voog, E.; Domont, J.; Peyraga, G.; Urban, T.; Bennouna, J.; Septans, A.-L.; Balavoine, M. Cost-effectiveness of web-based patient-reported outcome surveillance in patients with lung cancer. J. Thorac. Oncol. 2019, 14, 1012–1020. [Google Scholar] [CrossRef] [PubMed]
  65. Golchert, J.; Roehr, S.; Berg, F.; Grochtdreis, T.; Hoffmann, R.; Jung, F.; Nagl, M.; Plexnies, A.; Renner, A.; König, H.-H. HELP@ APP: Development and evaluation of a self-help app for traumatized Syrian refugees in Germany—A study protocol of a randomized controlled trial. BMC Psychiatry 2019, 19, 131. [Google Scholar] [CrossRef] [Green Version]
  66. Williams, A.; van Dongen, J.M.; Kamper, S.J.; O’Brien, K.M.; Wolfenden, L.; Yoong, S.L.; Hodder, R.K.; Lee, H.; Robson, E.K.; Haskins, R. Economic evaluation of a healthy lifestyle intervention for chronic low back pain: A randomized controlled trial. Eur. J. Pain 2019, 23, 621–634. [Google Scholar] [CrossRef]
  67. Willcox, M.; Moorthy, A.; Mohan, D.; Romano, K.; Hutchful, D.; Mehl, G.; Labrique, A.; LeFevre, A. Mobile technology for community health in Ghana: Is maternal messaging and provider use of technology cost-effective in improving maternal and child health outcomes at scale? J. Med. Internet Res. 2019, 21, e11268. [Google Scholar] [CrossRef]
  68. Kippist, L.; Fitzgerald, A. Organisational professional conflict and hybrid clinician managers: The effects of dual roles in Australian health care organisations. J. Health Organ. Manag. 2009, 23, 642–655. [Google Scholar] [CrossRef] [Green Version]
  69. Bresnen, M.; Hodgson, D.; Bailey, S.; Hassard, J.; Hyde, P. Hybrid managers, career narratives and identity work: A contextual analysis of UK healthcare organizations. Hum. Relat. 2019, 72, 1341–1368. [Google Scholar] [CrossRef]
  70. Giacomelli, G.; Ferré, F.; Furlan, M.; Nuti, S. Involving hybrid professionals in top management decision-making: How managerial training can make the difference. Health Serv. Manag. Res. 2019, 32, 168–179. [Google Scholar] [CrossRef] [PubMed]
  71. Miceli, L.; Dal Mas, F.; Biancuzzi, H.; Bednarova, R.; Rizzardo, A.; Cobianchi, L.; Holmboe, E.S. Doctor@Home: Through a Telemedicine Co-production and Co-learning Journey. J. Cancer Educ. 2022, 37, 1236–1238. [Google Scholar] [CrossRef] [PubMed]
  72. Sartori, A.; Balla, A.; Agresta, F.; Guerrieri, M.; Ortenzi, M. Telemedicine in surgery during COVID-19 pandemic: Are we doing enough? Minerva Surg. 2022, 77, 50–56. [Google Scholar] [CrossRef]
  73. Tripepi, M.; Pizzocaro, E.; Giardino, A.; Frigerio, I.; Guglielmi, A.; Butturini, G. Telemedicine and Pancreatic Cancer: A Systematic Review. Telemed. J. e-Health Off. J. Am. Telemed. Assoc. 2022. ahead-of-print. [Google Scholar] [CrossRef]
  74. Grenda, T.R.; Whang, S.; Evans, N.R. Transitioning a Surgery Practice to Telehealth during COVID-19. Ann. Surg. 2020, 272, e168–e169. [Google Scholar] [CrossRef] [PubMed]
  75. Coccolini, F.; Cicuttin, E.; Cremonini, C.; Tartaglia, D.; Viaggi, B.; Kuriyama, A.; Picetti, E.; Ball, C.; Abu-Zidan, F.; Ceresoli, M.; et al. A pandemic recap: Lessons we have learned. World J. Emerg. Surg. 2021, 16, 46. [Google Scholar] [CrossRef]
  76. Biancone, P.; Secinaro, S.; Marseglia, R.; Calandra, D. E-health for the future. Managerial perspectives using a multiple case study approach. Technovation 2021, 120, 102406. Available online: https://www.sciencedirect.com/science/article/pii/S0166497221001875 (accessed on 27 December 2022). [CrossRef]
  77. Marques, I.C.P.; Ferreira, J.J.M. Digital transformation in the area of health: Systematic review of 45 years of evolution. Health Technol. 2020, 10, 575–586. [Google Scholar] [CrossRef]
  78. Barcellini, A.; Dal Mas, F.; Paoloni, P.; Loap, P.; Cobianchi, L.; Locati, L.; Rodriguez-Luna, M.R.; Orlandi, E. Please mind the gap—About equity and access to care in oncology. ESMO Open 2021, 6, 100335. [Google Scholar] [CrossRef]
  79. Bidoli, C.; Pegoraro, V.; Dal Mas, F.; Bagnoli, C.; Cordiano, C.; Minto, G.; Zantedeschi, M.; Stocco, P.; Bonin, M.; Pilerci, C.; et al. Virtual hospital: Il futuro del sistema sociosanitario? Un approccio basato su un expert consensus all’interno della Regione Veneto. Polit. Sanit. 2022, 23, 133–148. [Google Scholar]
  80. Cobianchi, L.; Dal Mas, F.; Ansaloni, L. Editorial: New Frontiers for Artificial Intelligence in Surgical Decision Making and its Organizational Impacts. Front. Surg. 2022, 9, 933673. Available online: https://www.frontiersin.org/article/10.3389/fsurg.2022.933673 (accessed on 27 December 2022). [CrossRef] [PubMed]
  81. Sousa, M.J.; Dal Mas, F.; Pesqueira, A.; Lemos, C.; Verde, J.M.; Cobianchi, L. The potential of AI in Health Higher Education to Increase the Students’ Learning Outcomes. TEM J. 2021, 10, 488–497. [Google Scholar] [CrossRef]
  82. Balch, J.A.; Efron, P.A.; Bihorac, A.; Loftus, T.J. Gamification for Machine Learning in Surgical Patient Engagement. Front. Surg. 2022, 9, 896351. [Google Scholar] [CrossRef]
  83. Mohaghegh, N.; Zarghani, M.; Tahamtan, I.; Ghasghaee, A.; Mousavi, S. Assessing Knowledge Translation in Iranian Medical Research Centres. Int. J. Inf. Sci. Manag. 2017, 15, 145–156. [Google Scholar]
  84. Baigorri, A.; Villadangos, J.; Astrain, J.J.; Córdoba, A. A medical knowledge management system based on expert tagging (MKMST). WIT Trans. Inf. Commun. Technol. 2013, 45, 221–231. [Google Scholar] [CrossRef] [Green Version]
  85. Dadich, A.; Abbott, P.; Hosseinzadeh, H. Strategies to promote practice nurse capacity to deliver evidence-based care: An example from sexual healthcare. J. Health Organ. Manag. 2015, 29, 988–1010. [Google Scholar] [CrossRef]
  86. Haynes, A.S.; Derrick, G.E.; Chapman, S.; Redman, S.; Hall, W.D.; Gillespie, J.; Sturk, H. From “our world” to the “real world”: Exploring the views and behaviour of policy-influential Australian public health researchers. Soc. Sci. Med. 2011, 72, 1047–1055. [Google Scholar] [CrossRef]
  87. Cobianchi, L.; Pugliese, L.; Peloso, A.; Dal Mas, F.; Angelos, P. To a New Normal: Surgery and COVID-19 during the Transition Phase. Ann. Surg. 2020, 272, e49–e51. [Google Scholar] [CrossRef]
  88. Barcellini, A.; Filippi, A.R.; Dal Mas, F.; Cobianchi, L.; Corvò, R.; Price, P.; Orlandi, E. To a new normal in radiation oncology: Looking back and planning forward. Tumori J. 2020, 106, 440–444. [Google Scholar] [CrossRef]
  89. Grasselli, G.; Pesenti, A.; Cecconi, M. Critical Care Utilization for the COVID-19 Outbreak in Lombardy, Italy. JAMA 2020, 323, 1545–1546. [Google Scholar] [CrossRef] [Green Version]
  90. Peters, A.W.; Chawla, K.S.; Turnbull, Z.A. Transforming ORS into ICUs. N. Engl. J. Med. 2020, 382, e52. [Google Scholar] [CrossRef] [PubMed]
  91. Cobianchi, L.; Dal Mas, F.; Peloso, A.; Pugliese, L.; Massaro, M.; Bagnoli, C.; Angelos, P. Planning the Full Recovery Phase: An Antifragile Perspective on Surgery after COVID-19. Ann. Surg. 2020, 272, e296–e299. [Google Scholar] [CrossRef] [PubMed]
  92. Shah, S.S.; Gvozdanovic, A.; Knight, M.; Gagnon, J. Mobile app-based remote patient monitoring in acute medical conditions: Prospective feasibility study exploring digital health solutions on clinical workload during the covid crisis. JMIR Form. Res. 2021, 5, e23190. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Flowchart of literature review steps, according to the PRISMA protocol. Adapted from Page et al. [42]. Search conducted on 3 December 2022.
Figure 1. Flowchart of literature review steps, according to the PRISMA protocol. Adapted from Page et al. [42]. Search conducted on 3 December 2022.
Ijerph 20 04038 g001
Figure 2. Clinical disciplines covered in the reviewed papers.
Figure 2. Clinical disciplines covered in the reviewed papers.
Ijerph 20 04038 g002
Figure 3. Treated pathologies in the reviewed papers.
Figure 3. Treated pathologies in the reviewed papers.
Ijerph 20 04038 g003
Figure 4. E-Health tools presented in the reviewed articles.
Figure 4. E-Health tools presented in the reviewed articles.
Ijerph 20 04038 g004
Table 2. Geographical areas of the studies under review.
Table 2. Geographical areas of the studies under review.
ContinentNationNumber of Contributions
EuropeFrance1
Germany4
Netherlands3
Russia1
Norway1
Spain1
AmericaUnited States1
Brazil1
AfricaGhana1
OceaniaAustralia2
AsiaChina1
Table 3. Performance measurement methods, treated pathology, and tools used for each contribution analyzed (excluding literature reviews).
Table 3. Performance measurement methods, treated pathology, and tools used for each contribution analyzed (excluding literature reviews).
TitleTreated PathologyTools UsedPerformance Measurement Methods
Economic evaluation protocol and statistical analysis plan for the cost-effectiveness of a novel Australian stroke telemedicine (VST) programIctusVirtual network of specialistsCEA
CBA
CUA
Value-based approach to blood pressure telemonitoring and remote counseling in hypertensive patientsHypertensionApp, WebsiteCUA
An economic evaluation of a mobile text messaging intervention to improve mental health care in resource-poor communities in China: a cost-effectiveness studySchizophreniaSMSCEA
CUA
Clinical and cost-effectiveness of a guided internet-based Acceptance and Commitment Therapy to improve chronic pain–related disability in green professions (PACT-A): study protocol of a pragmatic randomised controlled trialChronic painE-mail, Phone calls, Online sessions, E-coachCEA
CUA
Evaluation of the efficacy of an internet-based pain education and exercise program for chronic musculoskeletal pain in comparison with online self-management booklet: a protocol of a randomised controlled trial with assessor-blinded, 12-month follow-up, and economic evaluationChronic painSMS, Phone calls, Website, Online brochure CEA
CUA
A cost-effectiveness analysis model of Preventicus atrial fibrillation screening from the point of view of statutory health insurance in GermanyIctusAppCEA
Effectiveness and cost-effectiveness of stratified blended physiotherapy in patients with non-specific low back pain: study protocol of a cluster randomized controlled trialLumbagoAppCEA
Effectiveness and cost-effectiveness of telehealth in rural and remote emergency departments: a systematic review protocolMultiple pathologiesNot definedCEA
Cost-effectiveness of population-level proactive tobacco cessation outreach among socio-economically disadvantaged smokers: evaluation of a randomized control trialSmokingE-mail, Phone callsCEA
The (cost) effectiveness of guided internet-based self-help CBT for dialysis patients with symptoms of depression: study protocol of a randomised controlled trialDepressionOnline sessionsCEA
CUA
An economic evaluation of a computer-tailored e-learning program to promote smoking cessation counseling guideline adherence among practice nursesSmokingOnline sessionsCEA
CUA
Clinical and cost-effectiveness of guided internet-based interventions in the indicated prevention of depression in green professions (PROD-A): study protocol of a 36-month follow-up pragmatic randomized controlled trialDepressionSMS, Phone calls, Online sessions, E-coachCEA
CUA
Cost-Effectiveness of Web-Based Patient-Reported Outcome Surveillance in Patients with Lung CancerLung cancerOnline questionnaireCEA
HELP@APP: development and evaluation of a self-help app for traumatized Syrian refugees in Germany—a study protocol of a randomized controlled trialPost-traumatic stressAppCEA
CBA
Economic evaluation of a healthy lifestyle intervention for chronic low back pain: A randomized controlled trialLumbagoPhone callsCEA
Individually tailored self-management app-based intervention (selfBACK) versus a self-management web-based intervention (e-Help) or usual care in people with low back and neck pain referred to secondary care: protocol for a multiarm randomised clinical trialLumbago
neck pain
App, WebsiteCEA
E-health ecosystem with integrated and stepped psychosocial services for breast cancer survivors: study protocol of a multicentre randomised controlled trialBreast cancerWebsiteCEA
CUA
Table 4. Possible relationships among the treated pathologies, tools, and performance measurement methods used.
Table 4. Possible relationships among the treated pathologies, tools, and performance measurement methods used.
TitleTreated PathologyTools UsedPerformance Measurement Methods
Economic evaluation protocol and statistical analysis plan for the cost-effectiveness of a novel Australian stroke telemedicine (VST) programIctusVirtual network of specialistsCEA
CBA
CUA
A cost-effectiveness analysis model of Preventicus atrial fibrillation screening from the point of view of statutory health insurance in GermanyAppCEA
An economic evaluation of a mobile text messaging intervention to improve mental health care in resource-poor communities in China: a cost-effectiveness studyMental disorders SMSCEA
CUA
The (cost) effectiveness of guided internet-based self-help CBT for dialysis patients with symptoms of depression: study protocol of a randomised controlled trialOnline sessionsCEA
CUA
Clinical and cost-effectiveness of guided internet-based interventions in the indicated prevention of depression in green professions (PROD-A): study protocol of a 36-month follow-up pragmatic randomized controlled trialSMS, Phone calls, Online sessions, E-coachCEA
CUA
HELP@APP: development and evaluation of a self-help app for traumatized Syrian refugees in Germany—a study protocol of a randomized controlled trialAppCEA
CBA
Clinical and cost-effectiveness of a guided internet-based Acceptance and Commitment Therapy to improve chronic pain–related disability in green professions (PACT-A): study protocol of a pragmatic randomised controlled trialPainE-mail, Phone calls, Online sessions, E-coachCEA
CUA
Effectiveness and cost-effectiveness of stratified blended physiotherapy in patients with non-specific low back pain: study protocol of a cluster randomized controlled trialAppCEA
Evaluation of the efficacy of an internet-based pain education and exercise program for chronic musculoskeletal pain in comparison with online self-management booklet: a protocol of a randomised controlled trial with assessor-blinded, 12-month follow-up, and economic evaluationSMS, Phone calls, Website, Online brochure CEA
CUA
Economic evaluation of a healthy lifestyle intervention for chronic low back pain: A randomized controlled trialPhone callsCEA
Individually tailored self- management app- based intervention (selfBACK) versus a self- management web- based intervention (e-Help) or usual care in people with low back and neck pain referred to secondary care: protocol for a multiarm randomised clinical trialApp, WebsiteCEA
Cost-effectiveness of population-level proactive tobacco cessation outreach among socio-economically disadvantaged smokers: evaluation of a randomized control trialSmokingE-mail, Phone callsCEA
An economic evaluation of a computer-tailored e-learning program to promote smoking cessation counseling guideline adherence among practice nursesOnline sessionsCEA
CUA
Cost-Effectiveness of Web-Based Patient-Reported Outcome Surveillance in Patients with Lung CancerCancerOnline questionnaireCEA
E- health ecosystem with integrated and stepped psychosocial services for breast cancer survivors: study protocol of a multicentre randomised controlled trialWebsiteCEA
CUA
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Biancuzzi, H.; Dal Mas, F.; Bidoli, C.; Pegoraro, V.; Zantedeschi, M.; Negro, P.A.; Campostrini, S.; Cobianchi, L. Economic and Performance Evaluation of E-Health before and after the Pandemic Era: A Literature Review and Future Perspectives. Int. J. Environ. Res. Public Health 2023, 20, 4038. https://doi.org/10.3390/ijerph20054038

AMA Style

Biancuzzi H, Dal Mas F, Bidoli C, Pegoraro V, Zantedeschi M, Negro PA, Campostrini S, Cobianchi L. Economic and Performance Evaluation of E-Health before and after the Pandemic Era: A Literature Review and Future Perspectives. International Journal of Environmental Research and Public Health. 2023; 20(5):4038. https://doi.org/10.3390/ijerph20054038

Chicago/Turabian Style

Biancuzzi, Helena, Francesca Dal Mas, Chiara Bidoli, Veronica Pegoraro, Maristella Zantedeschi, Pietro Antonio Negro, Stefano Campostrini, and Lorenzo Cobianchi. 2023. "Economic and Performance Evaluation of E-Health before and after the Pandemic Era: A Literature Review and Future Perspectives" International Journal of Environmental Research and Public Health 20, no. 5: 4038. https://doi.org/10.3390/ijerph20054038

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop