Characteristics of Mobile Health Platforms for Depression and Anxiety: Content Analysis Through a Systematic Review of the Literature and Systematic Search of Two App Stores

Abstract

Background: Mobile health (mHealth) platforms show promise in the management of mental health conditions such as anxiety and depression. This has resulted in an abundance of mHealth platforms available for research or commercial use.

Objective: The objective of this review is to characterize the current state of mHealth platforms designed for anxiety or depression that are available for research, commercial use, or both.

Methods: A systematic review was conducted using a two-pronged approach: searching relevant literature with prespecified search terms to identify platforms in published research and simultaneously searching 2 major app stores—Google Play Store and Apple App Store—to identify commercially available platforms. Key characteristics of the mHealth platforms were synthesized, such as platform name, targeted condition, targeted group, purpose, technology type, intervention type, commercial availability, and regulatory information.

Results: The literature and app store searches yielded 169 and 179 mHealth platforms, respectively. Most platforms developed for research purposes were designed for depression (116/169, 68.6%), whereas the app store search reported a higher number of platforms developed for anxiety (Android: 58/179, 32.4%; iOS: 27/179, 15.1%). The most common purpose of platforms in both searches was treatment (literature search: 122/169, 72.2%; app store search: 129/179, 72.1%). With regard to the types of intervention, cognitive behavioral therapy and referral to care or counseling emerged as the most popular options offered by the platforms identified in the literature and app store searches, respectively. Most platforms from both searches did not have a specific target age group. In addition, most platforms found in app stores lacked clinical and real-world evidence, and a small number of platforms found in the published research were available commercially.

Conclusions: A considerable number of mHealth platforms designed for anxiety or depression are available for research, commercial use, or both. The characteristics of these mHealth platforms greatly vary. Future efforts should focus on assessing the quality—utility, safety, and effectiveness—of the existing platforms and providing developers, from both commercial and research sectors, a reporting guideline for their platform description and a regulatory framework to facilitate the development, validation, and deployment of effective mHealth platforms.

Introduction

Mobile health (mHealth) refers to medical, health care, and public health practices that use mobile computing or technologies such as mobile phones, wireless devices, patient monitoring devices, and web-based platforms [1-3]. With the overarching objective of improving health-related outcomes and awareness, mHealth platforms can either serve as standalone or complementary platforms and offer the potential to cater to the needs of many users, from health care professionals to patients and consumers. The existing infrastructure and technology of mobile devices, such as mobile apps and mobile sensors, make them ideal candidates for offering convenience while addressing clinical concerns and improving health-related outcomes. For example, mobile apps can be installed on a mobile device that allows for the measurement and collection of vital information such as location data and activities. These tracking data are invaluable as they may help inform users about their health status or provide necessary information to health care professionals during their decision-making process [4] to subsequently provide actionable feedback to their patients [5]. In addition, as most of the world’s population already uses mobile devices, it is possible that mHealth interventions may allow greater access to care [6]. According to a digital global report published in October 2020, mobile phones and the internet had a penetration rate of 60% and 67% worldwide, respectively [7], both of which increased by a staggering 1% in just 3 months compared with July 2020 [8]. It is plausible that the COVID-19 pandemic that has driven most of the world into forceful isolation may have contributed to this increment. It is evident that mobile devices are increasingly becoming an indispensable part of our lives and will continue to be so [9]. As such, mHealth may offer a feasible approach for targeting a wide range of health conditions.

In recent years, there has been an increase in the use of mHealth platforms to intervene in the management of mental health conditions [10,11]. As a result, research is emerging on the implementation and clinical outcomes of mHealth platforms [10,11], and preliminary evidence on their efficacy is beginning to surface. Anxiety and depression, which have the highest prevalence among mental health conditions, are at the forefront of these targeted mHealth interventions [12,13]. The convenience facilitated by technology coupled with a higher quality of interventions—evidenced from randomized controlled trials (RCTs) and real-world evidence (RWE) delivered for those with anxiety or depression compared with those delivered for people with general health issues [10,11]—further propels mHealth as an increasingly appealing solution for the prevention and management of anxiety or depression. As a result, a plethora of mHealth platforms for anxiety or depression have been and continue to be developed.

This accelerated proliferation of anxiety or depression mHealth platforms that are readily available makes it difficult for stakeholders to determine not only those that may be useful but also those that may be potentially counterproductive. In addition, the resulting quantity of available platforms does not necessarily correlate with the scale of effectiveness validation. mHealth, as a whole, is still a relatively new field. Subsequently, regulatory policies and standards for the development of these platforms and the claims made by their developers have not been fully established [14,15], adding to the difficulty for stakeholders in identifying appropriate and safe mHealth apps. Accordingly, as the number of mHealth platforms for anxiety or depression continues to grow, it is important for relevant stakeholders, including users, clinicians, researchers, and developers, to understand what is currently available.

A recent review [16] has provided a comprehensive overview of commercially and academically available mental health apps offered in the Spanish language in the United States; however, a similar review of mental health mHealth apps available in the English language, to our knowledge, has not been conducted to date. Therefore, the aim of this review is to systematically identify and amalgamate the characteristics of the currently available English language mHealth platforms for anxiety or depression that have been developed for research, commercial use, or both. The outcome of this review may provide insights into considerations in the development, regulation, implementation, and adoption of future mHealth platforms for anxiety or depression.

Methods

Study Design

A cross-sectional study was performed to characterize mHealth platforms developed for depression or anxiety that were available for commercial, research, or both purposes. The mHealth platforms included apps, websites, and web-based software. A 2-pronged approach was used in this study. This included systematically searching relevant literature that described mHealth platforms as interventions developed for research and simultaneously searching 2 major app stores systematically to identify commercially available platforms. The protocol was registered on PROSPERO (International Prospective Register of Systematic Reviews; CRD42020193956) after preliminary searches were conducted. The piloting of inclusion and exclusion criteria and formal screening were conducted after the official PROSPERO registration.

Identifying Platforms Described in Research Literature

Search

The PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines were used and adhered to for the literature search [17]. A systematic search of the databases PubMed, Embase, CINAHL, and PsycINFO was completed on June 23, 2020, from database inception dates. The search string was developed using the population, intervention, comparison, outcome strategy [18] using keywords and search terms combined with Boolean operators (Textbox 1). The search terms were carefully selected so that the homogeneous terms could be used in both the literature and app store searches. The full search strings per database can be found in Multimedia Appendix 1. All searches were performed with no restriction on the publication period or year of release. There were no age or location restrictions on the target population.

Keywords and search terms used for the formulation of the search string in the literature search.

Mental health condition

Mental health, mindfulness, anxiety, depression

Platform

mHealth, mobile health, mobile device, mobile application, digital therapeutics, digital intervention, ehealth, smartphone, mobile phone, text message, web based, web application

Textbox 1. Keywords and search terms used for the formulation of the search string in the literature search.

Selection

After duplicate articles were removed, 2 reviewers (SS and QYL) independently applied the eligibility criteria to titles and abstracts and subsequently to full-text articles using the Covidence software (Veritas Health Innovation) [19]. A third reviewer (AR) resolved any discrepancies. Articles were included if they were published in English, were full-text original journal articles or conference papers, and provided at least one characteristic of interest about an mHealth platform for anxiety or depression.

Articles were excluded if they were reviews (but reference lists were cross-checked for included studies), had no characteristic description of the mHealth platform, did not have the name of the mHealth platform, were not designed specifically for anxiety or depression, described mHealth platforms that targeted physical conditions only, or targeted secondary mental health problems related to a physical condition, health behaviors (eg, smoking cessation, risky drinking, obesity, and exercise), neurodegenerative disorders (eg, dementia), chronic pain, a specific phobia, posttraumatic stress disorder, addictions, subclinical symptoms, or a severe mental illness.

As the primary focus of the review was to characterize mHealth platforms, a formal assessment of the study quality and risk of bias was not performed.

Identifying Platforms Available Commercially

Search

Building on the methodologies by Bender et al [20] and Giunti et al [21], we systematically completed our search of all available platforms from 2 major app stores accessible from Singapore—Google Play Store and Apple App Store—on June 19, 2020. In-depth searches across the Apple App Store were included to identify platforms compatible with iOS or macOS devices. The search terms used were anxiety, depression, mental health, and mindfulness (Textbox 1), with no restriction on the app category.

Selection

Apps were initially included if the title or description of the app included the terms anxiety or depression. After the removal of duplicates, 2 reviewers (SS and QYL) independently assessed the eligibility of the app using the a priori determined criteria. Any discrepancies were addressed by a third independent reviewer (AR).

The included mHealth platforms comprised apps targeting mental health, specifically anxiety, depression, or both. Apps were excluded if they were no longer available, not available in English, or provided app descriptions that lacked the characteristics of interest.

Data Coding and Extraction

Data Coding

An mHealth platform characteristic coding scheme was developed based on an internally identified mHealth platform’s characteristics of interest. If the mHealth platform characteristics were not clearly described or discrepancies were found during the classification of the mHealth platforms, discussions were held until consensus was reached. The final coding scheme and outcomes are detailed in Table 1.

Table 1. The mobile health (mHealth) characteristic coding scheme of the characteristics of interest from the respective searches and the description of each item.

Characteristic	Description	Literature search	App store search
Platform name	The name of the platform that was developed for research, available for commercial use, or both	✓	✓
Targeted condition	The condition the platform was designed for: anxiety, depression, or both	✓	✓
Targeted group	The intended users the platform was designed for	✓	✓
Commercial availability	The commercial availability of the platform in either the Apple App Store, Google Play Store, or both	✓	✓
Purpose of platform	The intended use that the platform was designed for. For example, diagnostics, monitoring, prevention, treatment, education, and support	✓	✓
Type of technology	The mobile modality and operating system in which the mHealth platform was rolled out	✓	✓
Type of intervention	Applicable only for platforms that offer treatment	✓	✓
App store categorization	App store category assigned to the platform by the development team that best describes its main function or subject matter		✓
Additional mHealth characteristics	Additional characteristics reported such as language, ratings, and cost of the platform	✓	✓
Clinical evidence and regulatory information	A secondary search was performed to obtain additional information of the identified platforms which included the availability of clinical evidence in the form of randomized control trials, real-world evidence, and regulatory approval	✓	✓
Other studies that reported the platform	Studies cited in the platform’s article regarding the development, validation, or further evaluation of the platform	✓
Cited literature	References to academic publications provided in the platform’s app store description		✓

Data Extraction

The mHealth platforms and their characteristics of interest from both searches were extracted and recorded in a custom-developed Microsoft Excel template. The collected and assessed data included characteristic information of the mHealth platforms, which were based on the description in the app stores, provided by 2 reviewers (SS and QYL), and any discrepancies were resolved by a third reviewer (AR).

Statistical Analysis

Descriptive statistical analyses were performed for all the variables. The categorical variables were presented as absolutes and relative frequencies. Statistical analyses were performed using Microsoft Excel (version 16.43).

Results

Platforms Available in Literature Search

Selection

As depicted in Figure 1, after duplicate removal and review of reference list cross-checking, 8362 articles were initially screened. This resulted in the identification of 169 mHealth platforms described in 1.7% (145/8362) of articles (Multimedia Appendix 2 [22-166]). Some articles reported ≥1 platform, whereas some platforms were described in ≥1 article. Examples of platforms found across multiple studies were Deprexis (6/169, 3.6%), MoodGYM (6/169, 3.6%), Happy@Work (4/169, 2.4%), myCompass (4/169, 2.4%), and Partners in Parenting (4/169, 2.4%).

Figure 1. PRISMA (Preferred Reporting Item for Systematic Reviews and Meta-Analyses) flow diagram of search strategy and the finalized number of articles and resulting mHealth platforms included for this review. mHealth: mobile health.

Commercial Availability of Apps From the Literature Search

Of the 169 apps identified in the literature search, 8 (4.7%) were available in the app stores. All 8 apps were found in the Google Play Store, whereas a subset (6/8, 75%) was commercially available in the Apple App Store. No platform was reported as a medical device. However, of the 169 platforms, 2 (1.2%)—myStrength and HelpID—were reported as being used in health care settings. myStrength was used as a psychological intervention and had affiliations with health care providers, whereas HelpID was included in health care plans and insurance.

Targeted Condition

Of the 169 platforms reported in the articles, 116 (68.6%) targeted depression, 22 (13%) targeted anxiety, and 31 (18.3%) targeted both (Table 2). Approximately 1.8% (3/169) platforms—Situman, TeleCoach, and LifeRhythm—acted as complementary apps to other platforms targeting depression. The roles played by these apps varied, where Situman provided situational awareness to the Moodbuster platform, TeleCoach involved weekly calls to help with adherence to the MoodManager intervention, and LifeRhythm helped in data collection for the DepWatch system.

Table 2. Summary of the mobile health (mHealth) platforms characteristics from the literature search (N=169).

mHealth platform characteristics		Platforms, n (%)
Targeted condition
	Anxiety	22 (13)
	Depression	116 (68.6)
	Both	31 (18.3)
Target group
	Children	3 (1.8)
	Young people	15 (8)
	University students	3 (1.8)
	Adults	8 (4.7)
	Older adults	1 (0.6)
	Employees	3 (1.8)
	Migrants	1 (0.6)
	Patient or clinician	2 (1.2)
	Not specified	136 (79.9)
Purposes
	1 only	90 (53.3)
	2	71 (42)
	≥3	8 (4.7)
Number of languages
	1	2 (1.2)
	2	5 (3)
	≥3	4 (2.4)
	Not specified	158 (93.5)

Targeted Group

Of the 169 platforms reported in the articles, 135 (79.9%) were not developed for a specific target group. The remaining 20.1% (34/169) targeted 8 different groups: children, young people, university students, adults, older adults, employees, migrants, and patient or clinician communication. Of the 169 apps, 2 (1.2%)—BiP Anxiety and Supporting Our Valued Adolescents—involved ≥1 target group and required the engagement of parents along with their children and adolescents, respectively.

Purpose

Approximately half of the platforms were designed with ≥1 purpose (Table 2). Treatment was the most common purpose, with 72.2% (122/169) of the platforms including it (Table 3).

Table 3. The primary purpose of mobile health platforms for anxiety or depression identified in the literature search (N=169).

Purpose	Description	Example	Platforms, n (%)
Education	Provide mental health and medication information Teach a variety of skills, including self-management and problem solving Impart lessons through modules	Text-based information, audio or visual materials, and blogs	45 (26.6)
Diagnostic	Identify depression and anxiety symptoms Serve as a screening tool	Psychological questionnaires before use or over time	12 (7.1)
Monitoring	Track self-reported symptoms and medical adherence Collect relevant sensor data such as location and mobility information	Ecological momentary assessment through a mobile app, prompts to rate mood or complete short questionnaires, and data collection through wearable devices and mobile phones	38 (22.5)
Treatment	Deliver psychological interventions through modules Teach a variety of skills such as positive emotion skills, self-management skills, and guided meditation Learn about coping strategies	Cognitive behavioral therapy, problem-solving therapy, gamification, lessons by topic, and homework	122 (72.2)
Prevention	Similar to Treatment but targets individuals who are at risk of anxiety or depression	Text-based information and audio or visual, synchronous, or offline asynchronous activity	29 (16.2)
Support	Offer a decision support system to clinicians Manage care activities Provide access to peer-to-peer support or health care professionals for support	Messaging service, discussion forum, web-based interaction in self-help groups, and web-based directory of bodies offering support	11 (6.5)

Type of Intervention

In platforms designed for treatment purposes, the incorporation of ≥2 intervention types was common (20/169, 11.8%). The most common types of intervention were cognitive behavioral therapy (CBT; 50/169, 29.6%), problem-solving therapy (11/169, 6.5%), and psychoeducation (9/169, 5.3%). An average of 8 (SD 5.04) modules was offered by 41.4% (70/169) of platforms that provided module-based sessions. The common frequency of intervention was weekly (32/169, 18.9%), followed by daily (8/169, 4.7%) on the (42/169, 24.9%) platforms that reported this characteristic. Of note, some (5/169, 3%) platforms incorporated some form of in-app human interaction, where the interaction personnel included medical physicians (1/5, 20%; Ascend), psychologists (1/5, 20%; HelpID), therapists (1/5, 20%; SmartCAT), trained health care professionals (1/5, 20%; PratenOnline), Master’s degree–level students in clinical psychology (2/5, 40%; Happy@Work and Ascend), and occupational social workers (1/5, 20%; Happy@Work).

Type of Technology

Various types of technology have been deployed to fulfill the purposes of the mHealth platforms. Some (22/169, 13%) platforms used ≥1type of technology, with top choices including web-based interventions (90/169, 53.3%) and mobile apps (57/169, 33.7%; Table 4).

Table 4. Types of technology used by the platforms made for research purposes (N=169).

Technology type	Platforms, n (%)
Web-based platforms	90 (53.3)
Mobile apps	57 (33.7)
Text messaging	12 (7.1)
Others	6 (3.6)
Not specified	25 (14.8)

Additional mHealth Characteristics

Of the 169 platforms, 9 (5.3%) were available in ≥2 languages (Table 2). Of these, the most common languages besides English were German (4/9, 44%) and Spanish (4/9, 44%).

App Store Search

Selection

The search terms yielded 179 mHealth platforms from the selection of apps in the Singapore region’s Google Play Store and Apple App Store (Figure 2; Multimedia Appendix 3).

Figure 2. PRISMA (Preferred Reporting Item for Systematic Reviews and Meta-Analyses) flow diagram of search strategy and the finalized number of platforms included in the app store search for this review.

Commercial Availability

More apps were available in the Google Play Store (140/179, 78.2%) than in the Apple App Store (61/179, 34.1%; Table 5). Approximately 12.3% (22/179) apps were available in both app stores.

Table 5. Summary of characteristics of commercially available mHealth platforms (N=179).

Characteristics			Google Play Store (n=140), n (%)		Apple App Store (n=61), n (%)		Botha (n=22), n (%)		All, (n=179), n (%)
Targeted condition
	Anxiety	58 (41.4)		27 (44.3)		12 (54.6)		73 (40.8)
	Depression	39 (27.9)		13 (21.3)		2 (9.1)		50 (27.9)
	Both	43 (30.7)		21 (34.4)		8 (36.4)		56 (31.3)
Purposes
	1	77 (55)		32 (52.5)		7 (31.8)		102 (57)
	2	45 (32.1)		16 (26.2)		7 (31.8)		54 (30.2)
	≥3	18 (12.9)		13 (21.3)		8 (36.4)		23 (12.9)
Frequency of intervention
	Daily	4 (2.8)		3 (4.9)		0 (0)		7 (3.9)
	Weekly	1 (0.7)		2 (3.3)		1 (4.6)		2 (1.1)
	Not specified	135 (96.4)		56 (91.8)		21 (95.5)		170 (95)
Number of downloads
	< 5000	67 (47.9)		4 (6.6)		4 (18.2)		67 (37.4)
	5000-10,000	12 (8.6)		1 (1.6)		1 (4.6)		12 (6.7)
	10,000-50,000	26 (18.6)		3 (4.9)		3 (13.6)		26 (14.5)
	50,000-100,000	8 (5.7)		0 (0)		0 (0)		8 (4.5)
	100,000-500,000	14 (10)		5 (8.2)		5 (22.7)		14 (7.8)
	500,000-1,000,000	3 (2.2)		1 (1.6)		1 (4.6)		3 (1.7)
	> 1,000,000	6 (4.3)		4 (6.6)		4 (18.2)		6 (3.4)
	Not available	4 (2.9)		43 (70.5)		4 (18.2)		43 (24)
Ratingsb
	1 star	1 (0.7)		1 (1.6)		0 (0)		2 (1.1)
	2 stars	0 (0)		1 (1.6)		0 (0)		1 (0.6)
	3 stars	7 (5)		4 (6.6)		0 (0)		10 (5.6)
	4 stars	58 (41.4)		21 (34.4)		10 (45.6)		70 (39.1)
	5 stars	43 (30.7)		33 (54.1)		12 (54.6)		64 (35.8)
	Not specified	31 (22.1)		1 (1.6)		0 (0)		32 (17.9)
Cost
	Free	85 (60.7)		19 (31.2)		4 (18.2)		100 (55.9)
	Free and paid versions available	39 (27.9)		30 (49.2)		13 (59.1)		56 (31.3)
	Payment required	16 (11.4)		12 (19.7)		5 (22.7)		23 (12.8)

^aBoth refer to platforms found in both Google Play Store and the Apple App Store.

^bRatings were rounded to the nearest integer.

Targeted Condition

The mHealth apps identified in both app stores were designed predominantly for anxiety (73/179, 40.8%). Approximately 30.7% (43/140) of the apps in the Google Play Store and 34% (21/61) of the apps in the Apple App Store claimed to address both anxiety and depression (Table 5).

Targeted Group

All platforms provided suitable age groups. One of the platforms, the Geriatric Depression Scale 2.0, detailed a specified target group, that is, older adults.

Purpose

Most apps found in both stores offered 1 purpose (Android devices: 77/179, 43%; iOS devices: 32/179, 17.9%; Table 5). Among the identified purposes available through the apps, treatment was the most common purpose in both app stores, with 72.1% (129/179) of the apps including it (Table 6).

Table 6. The primary purpose mobile health platforms for anxiety or depression identified from the Google Play Store and Apple App Store (N=179).

Purpose	Description	Examples	Apps, n (%)
Education	Provide information and communication of self-monitoring procedures Dissemination of information by health care professionals	Text-based information, video materials, and SMS text messaging	50 (27.9)
Diagnostic	Interpret symptoms Identify possible mental health conditions	Self-administered questionnaires and psychological tests	34 (19)
Treatment	Offer treatment tips, recommendations, and advice Provide some form of intervention	SMS text messaging, real-time videoconferencing, and text-based treatment suggestions	129 (72.1)
Monitoring	Tracking of symptoms Prompts and reminders for tasks and appointments	In-app notifications, self-administered questionnaires, and journaling	26 (14.5)
Support	Provide access to some form of support Features option to call a friend, a family member, health care professionals, or a nearby help center directly from the platform	Forums, chatbots, and SMS text messages	34 (19)
Prevention	Claim to prepare for and prevent anxiety-related or depressive episodes Offer modules or activities that serve as preventive measures	Text-based information, audio, and activities	8 (4.5)

Type of Intervention

A total of 22 types of interventions were identified from the 72.1% (129/179) of apps that offered some form of treatment. Of these, referral to care or counseling (36/129, 27.9%), problem solving (27/129, 20.9%), and CBT (22/129, 17.1%) were the most common types of interventions available. Apart from encouraging to seek or directly offering specialist support, some apps provided support from the community, for example, access to forums with like-minded users (16/179, 8.9%). A subset of the apps that offered referral (14/179, 7.8%), counseling (4/179, 2.2%), or forum services (2/179, 1.1%) was subscription-based or required payment to gain access.

Type of Technology

Of the 179 platforms, all the platforms were available for mobile devices, except for 1 (0.6%; At Ease Anxiety and Worry Relief), which was accessible from both iOS and macOS devices. Of these 179 platforms, 140 (78.2%) were available on the Android operating system, 61 (34.1%) were available on iOS, and 22 (12.3%) were available on both operating systems. Other notable forms of technology that complemented or were incorporated in the platforms included wearable devices, such as headsets or smartwatches (1/179, 0.6%), and artificial intelligence–backed counseling sessions (3/179, 1.7%).

App Store Categorization

The app categorization and classification differed between the 2 stores. In Google Play Store, mHealth apps were categorized into 14 categories (Health and Fitness, Medical, Lifestyle, Books and Reference, Education, Trivia, Casual, Simulation, Adventure, Puzzle, Music and Audio, Social, Personalization, and Productivity), whereas Apple App Store mHealth apps were categorized into 5 categories (Health and Fitness, Medical, Lifestyle, Games, and Social Networking). The Health and Fitness category was the most common classification of mHealth platforms available on both the Google Play Store (81/179, 45.3%) and Apple App Store (39/179, 21.8%). The Medical category was the second most common classification available on both the Google Play Store (27/140, 19.3%) and Apple App Store (18/61, 29.5%).

Additional mHealth Characteristics

Of the 179 mHealth platforms, 100 (55.9%) were made freely available, with 56 (31.3%) providing both free and paid versions and 23 (12.8%) offering only paid versions. The costs of platforms that required payments ranged from SGD 1.21 (US $0.90) per installation to SGD 399.99 (US $296.20) for lifetime use.

Clinical Evidence and Regulatory Information for Literature and App Store mHealth Platforms

RCTs are clinical evidence and a prerequisite for regulatory approval. However, not all platforms had RCTs. Additional regulatory information—RWE and regulatory approval—was searched. In the secondary search mentioned in Table 1, a subset of apps had a credible source that offered some form of empirical evidence. In the app store searches, 3.4% (6/179) of the apps included scientific evidence claims, whereas 2.8% (5/179) of the apps were affiliated with health care experts and reputable institutions.

None of the apps in both literature and app store searches were reported as medical devices. In the literature search, 44.4% (75/169) and 45% (76/169) of articles presented evidence from RCTs and RCT protocols (Table 7), respectively, whereas the remaining 10.7% (18/169) did not provide evidence from RCTs. Further analysis of the clinical and regulatory evidence—through the search for additional RCTs, RWE, and regulatory approvals—demonstrated that 41.4% (70/169) of platforms presented evidence from RCTs, 0.6% (1/169; Wysa) presented preliminary RWE, 1.2% (2/169; myStrength and Moodgym) presented evidence from RCTs and RWE, and 0.6% (1/169; Deprexis) presented evidence from RCTs and RWE and had obtained regulatory approval.

From the app store search, a subset of apps was pinpointed to be based on substantial validation studies to assess effectiveness. In particular, RWE can serve as a key gateway and vitally important indicator for supporting health care decisions, as well as impact and value toward patient care and the broader health care ecosystem. For example, 1.1% (2/179) of the apps provided evidence from each of the following sources: RCTs (Sanvello and Moodmission); RWE (Talkspace and Wysa); RCTs, RWE, and regulatory approval when applicable (Flow and Sooma).

Table 7. Availability of clinical-grade evidence and regulatory oversight in mobile health platforms for anxiety or depression identified from the literature and app store searches.

Evidence	Literature search (N=169), n (%)	App stores search (N=179), n (%)
RCTsa protocol	75 (44.4)	—b
RCTs	76 (45)	2 (1.1)
RWEc	—b	2 (1.1)
RCT+RWE	—b	0 (0)
RCT+RWE + regulatory approval	—b	2 (1.1)
None	18 (10.7)	173 (96.7)

^aRCT: randomized controlled trial.

^bNo reported clinical evidence or additional regulatory information found.

^cRWE: real-world evidence.

Discussion

Principal Findings

This review provides an in-depth analysis of the current mHealth platforms developed for anxiety or depression available for research and commercial purposes. Through a novel combined approach—a 2-pronged systematic search across the research literature and marketplace—we identified 169 and 179 mHealth platforms, respectively. Most platforms developed for research purposes were designed for depression (116/169, 68.6%), whereas the platforms made available in the app stores were mainly developed for anxiety (Android: 58/179, 32.4%; iOS: 27/179, 15.1%). We identified that mHealth characteristics such as platform name, aspects of mental health addressed, purpose, type of intervention, type of technology, and level of evidence varied largely across these platforms. In addition, we highlighted a significant lack of adoption of the regulatory framework and standards governing these mHealth platforms. An overview of the existing platforms for anxiety and depression available for research, commercial use, or both, as reported in this review, allowed us to identify gaps in the literature and marketplace and subsequently provide guidance for recommendations for future frameworks of mHealth development and regulations.

Targeted Group, Purpose, and Intervention Type of Available mHealth Platforms for Anxiety and Depression

Among the abundance of mHealth options currently available for anxiety or depression, relatively few have been developed for youths and emerging adults [167,168]. This is surprising, as these age groups are among the most prevalent users of mobile technologies as well as the groups that are most in need of mental health interventions. In particular, typical engagement with standard care for mental health has low appeal to young people and can be antagonistic to their developmental needs [168]. The low motivation inherent in emotional disorders; the need for agency, anonymity, and privacy; the greater sensitivity to stigma and discrimination associated with mental health; and the development of self-monitoring among young people can be addressed by mHealth approaches that provide personalized and timely treatment [169,170]. Future developers of mHealth platforms for anxiety or depression should consider developing them with this targeted group in mind.

The main purpose of most of the mHealth platforms for anxiety or depression identified in this review focused on treatment. The treatment used features such as module-based sessions and the teaching of coping and management strategies, which were based on the principles and guidelines of CBT, problem-solving therapy, and psychoeducation. Previous research has revealed 3 primary areas for enhancing the effectiveness of the treatment function of mHealth [167]. First, mHealth needs to be complemented by human interactions, especially with a medical physician or health care worker, to increase compliance, adherence, dropout [2,171,172], and efficacy in treatment [173-175]. However, findings from this review highlighted that few mHealth platforms included human interactions. To be effective, the digital framework for human interaction needs to consider individuals’ desire for anonymity and privacy. Second, initial engagement and sustained use of mHealth platforms for young people require some form of social support from peers, schools, or mental health professionals. Although the role of social support and the associated outcomes are similar to that found with the standard of care, the distinct feature of digital social support that mHealth platforms provide is anonymity and accessibility. The opportunity to share similar lived experiences of anxiety or depression with one’s peers and being accountable to an authority (eg, health care professional) for the purpose of monitoring or assessment of their symptoms has the potential to increase their engagement and adherence to the mHealth platforms. Notwithstanding the support function of mHealth platforms, few platforms included this in their design feature. Finally, an mHealth platform needs to be easy to navigate, relatable, engaging, and esthetically appealing in providing education for mental health users—another common function of mHealth platforms. Previous studies have found that the boring and repetitive nature of modules and lessons presents a barrier to greater engagement with the education feature of an mHealth platform [10].

Type of Technology

mHealth can be deployed via one or a combination of mobile technologies. An increasing trend, which is also observed in health care, is to reach the individuals by communication technologies that are already in use for the seamless incorporation of the intervention into their daily life. Our literature search reported web-based platforms (90/169, 53.3%), mobile apps (57/169, 33.7%), and messaging (12/169, 7.1%) as the most common modalities deployed, which is consistent with findings in other studies [176]. In our literature search, 13% (22/169) of the platforms used ≥1 type of technology.

The app stores search identified discrepancies in the number of apps available in each app store. The higher number of apps in the Google Play Store (140/179, 78.2%) than in the Apple App Store (61/179, 34.1%) can be attributed to a preference for the Android operating system over iOS in Asia (82.7% vs 16.5%) and Singapore (65.2% vs 33.9%), as recorded in June 2020 [177]. Although the infrequent download count data from iOS disables the comparison in this category in our review, the literature suggests that in the United States, the iOS preference is reversed (41.7% vs 58.2% for Android and iOS, respectively) [177], and iOS apps show a higher number of downloads of behavioral health mobile apps [178]. Interestingly, a recent study collecting location data has shown that the platform type had a measurable effect on the retention of passive data collection because of the increased battery consumption of the app for the iOS system. In addition, the operating systems differ in their battery-saving modes and memory space–saving strategies, for example, app offloading to a cloud, which may have further implications. In the same study, no differences were detected in active data collection retention, suggesting that the operating system had no effect on active user interactions with the mHealth platform [179].

The deployment technology type and its specific technical considerations (eg, operating system) can make or break an mHealth platform. A digital intervention design should carefully consider the context of how each technology is already being used, as well as its technical and behavioral limitations. An mHealth platform can be deployed either via one technology type only or in a hybrid model to reap the benefits of each technology type to maximize usability with sustained functionality toward the highest efficiency of the intervention.

Commercial Versus Academic Motivation Considerations

Of note, only 4.7% (8/169) of the mobile apps identified in the literature search were available in app stores. This can be potentially related to the geographical constraints of the app store search compared with the unconstrained geography of the literature search. In addition, the literature searches covered articles from inception to 2020, whereas the app store search included only the apps present in the marketplace in June 2020. It is not unusual that after the gathering of evidence, the apps become unavailable in the marketplace [178,180,181]. The lack of commercial translation of research published in literature can be attributed to multiple factors: funding timelines (eg, relatively short grant duration and high staff rotation may not enable long term app management) and downstream research objectives (basic or fundamental research, tool development, and proof-of-concept to support potential future commercial and large-scale deployment) [182].

From the perspective of the marketplace, 1.7% (3/179) of apps in the app store search were described in a peer-reviewed article identified in our search. This can be potentially attributed to a business strategy that favors quick-in and quick-out rather than laborious and costly app evaluation without prevailing guidelines or incentives—monetary, regulatory, or otherwise—in doing so. Although consumers make the initial decision of which app to download based on easy-to-judge attributes such as graphics, price, and rating [178,183], it is the credibility and trustworthiness that drive engagement with mental health apps [184-186]. With this realization, it is important for commercial app developers to generate scientific evidence that validates their apps to substantiate the scientific descriptions, which will collectively enhance the app’s appeal. In a study of the app descriptions of the top-ranked apps, it was previously found that apps use scientific jargon and are not supported by principles backed by peer review and validation studies, or they do not align with established findings in the scientific literature [187]. Instead of objectively informing about the evidence, the function of the app description is to appeal to consumers and drive the number of app downloads, independent of the platform’s objective quality [187]. Accordingly, app user ratings do not indicate clinical utility or quality [188,189].

Regulatory Information: Scientific Evidence and Regulatory Status of mHealth Platforms for Research and Commercial Use

Clinical evidence, in the form of RCTs, reported in the publications found in the literature search (151/169, 89.4%) vastly exceeded that for apps found in the app store (2/179, 1.1%). Regulatory approvals (0.6% vs 1.1%) and RWE (0.6% vs 1.1%) were more balanced between platforms from the literature and app stores. The relatively high frequency of RCTs but low numbers in RWE and regulatory approvals for platforms featured in the literature search seem to indicate a pre-eminently investigative intent of those platforms. In addition, 33.7% (57/169) of the platforms were available as mobile apps, further hinting at treatment commercialization as a secondary possibility. Maintenance and update of the website platforms were, in some cases, not frequent, indicating ad hoc use.

A large proportion of the mHealth platforms from the app store were unregulated, clinically untested, and unevaluated for real-world effectiveness (173/179, 96.7%), indicating a potential need for business models that support investment in robust clinical or real-world validation. Importantly, although 1.7% (3/179) of the apps found in the app store search in this review could claim to have scientific evidence or regulatory approval, 15.1% (27/179) and 10.1% (18/179) of the mHealth platforms for anxiety or depression extracted from the Google Play Store and Apple App Store, respectively, were included in the Medical category. Under this category (excluding telehealth), 8.4% (15/179) of the platforms affirmed that health professionals were involved in the design of the apps. From the app stores, 8.9% (16/179) of the platforms included a disclaimer notifying that the app was not intended to be a replacement for treatment or any sort of medical intervention. Another 12.3% (22/179) of the apps mentioned information sources used to design the app, such as validated tests (eg, Patient Health Questionnaire-9 for the assessment of depression and Generalized Anxiety Disorder-7 for the assessment of anxiety), international organization guidelines (eg, World Health Organization), validated therapies (eg, CBT), or peer-reviewed articles. These numbers reflect the need to develop more actionable and meaningful app store categorizations for medical apps. In addition, increased app store categorization oversight and strategies to enable or incentivize owners to implement changes, as well as clearer accountability guidelines pertaining to store content quality, may be needed. For example, oversight could be extended to app store owners to assist in enhancing specificity regarding the medical classification of apps. In addition, greater user education in the selection of apps may be a downstream consideration for health authorities. Consumers may need to be able to discern real-value apps by analyzing their claims, the involvement of health professionals, regulatory status, and scientific evidence. Apps that have not been supported by established validation guidelines adversely affect the field and users in multiple ways. For example, they may add a burden to already strained health care systems. In addition, they may create opportunity costs when the technological promise is not realized, resulting in mHealth fatigue of the clinicians, patients, and consumers, thus delaying the implementation of evidence-based, efficient mHealth platforms.

Overall, a need for enhanced regulation, especially in the Medical category of the stores, indicates that authorities may be able to positively affect the mHealth landscape toward requirements that include threshold validation and other applicable compliance guidelines. Several attempts have been made in that direction from various government organizations and professional societies. For example, the Institute of Electrical and Electronics Engineers—an engineering professional society—developed the Institute of Electrical and Electronics Engineers 1752 standards in 2017, which define specifications for standardized representations for mHealth data and metadata for cardiovascular, respiratory, and metabolic measures [190]. Health Level Seven International—an international mHealth professional workgroup—released the Consumer Mobile Health Application Functional Framework in 2018 with the primary goal of providing a standard whereby a mobile app’s characteristics can be assessed [191]. In 2020, the American Psychiatric Association—a professional organization of psychiatrists—developed the American Psychiatric Association App Advisor, an initiative to identify an app evaluation model that was specific to mental health to be used by clinicians and their patients [192]. Most recently, in February 2021, a joint unit formed by the National Health Service England and the Department of Health and Social Care—released the Digital Technology Assessment Criteria with the aim to set the expectation of digital health technologies for potential developers [193]. In addition, other digital health and medicine professional societies, such as the Digital Medicine Society and Digital Therapeutics Alliance, also have initiatives to develop frameworks, standards, and resources for the different stakeholders of digital health interventions [194,195]. Furthermore, the International Organization for Standardization Technical Specification, in collaboration with the European Committee for Standardization, is currently developing a health app quality label ISO/TS 82304-2 Health software–Part 2: Health and wellness apps–Quality and reliability [196,197]. Although the continued development of these regulatory frameworks is critical, to have a real-world impact on the quality of mHealth platforms and apps, they must also be widely adopted by developers and requested by regulators, marketplace owners, and target populations alike. This will ultimately result in the development of high-quality mHealth platforms with stringent safety and security measures required in health care.

Methodological Limitations and Further Considerations

Although we took a novel approach of combining both a systematic literature search and app store search, some mHealth platforms may have been excluded. For example, although we had no geographical filters in our literature search, our commercially available app search was based on regional availability in Singapore’s Google Play Store and Apple App Store. Although this may be a region-specific search, this review also provides new insight into the field as it serves as an early resource detailing available mHealth apps and platforms in South-East Asia. As Singapore is a globally recognized regional information communications technology hub with a well-established and efficient health care innovation ecosystem, this review provides the basis for a review of commercially available mHealth platforms available in surrounding countries and worldwide, alongside actionable recommendations. In addition, we restricted our inclusion criteria to mHealth platforms in English. It is possible that some apps may be published exclusively in other countries’ stores (eg, United States, United Kingdom, or Canadian stores) and in other languages that were ultimately excluded from our search and this review. Furthermore, in the academic setting, the goal of the research team may be to assess the efficacy of the mHealth intervention they developed. After proven efficacious, commercialization may be the next step in the pipeline, in which case a name may be given to the platform. As such, this review does not include nameless mHealth platforms that were developed solely for research purposes. This decision was made so that we could identify the app crossover between the 2 searches. In addition, we used exclusion criteria such as mHealth platforms developed for specific target populations (eg, comorbidities), secondary mental health problems related to a physical condition (eg, pregnancy), and platforms targeting health behaviors (eg, anxiety for smoking cessation) and severe mental illnesses. These criteria narrowed down the included platforms considerably. Overall, the possibility of mHealth platform exclusion may have introduced bias into our analysis. However, by including a comprehensive search of both the literature and multiple app stores, we aimed to minimize the possibility of mHealth platform exclusion in this review. Finally, as previously mentioned, we carefully selected search terms that could be used in both the literature and app store searches to ensure that these searches could be conducted as homogeneously as possible despite the different methodological requirements for each. As a result, some common key terms (eg, treatment and prevention) and phrases for the clinical conditions (eg, mood, sadness, affective disorder, phobias, and CBT) that would be included in a traditional literature database search were excluded. Therefore, it is plausible that some mHealth platforms described in the literature may have been excluded from this review. However, this review aimed to provide an overview of current mHealth platforms developed specifically for general nonspecific anxiety or depression; thus, we do not expect many potentially excluded platforms from this review. If more specific anxiety and depression conditions such as mood disorders or phobias are of interest, the keywords should be developed accordingly.

Furthermore, this review does not include a quality assessment of the mHealth platforms. We intended to use the Mobile App Rating Scale [198], as indicated in our PROSPERO registration (CRD42020193956). However, it was beyond the scope of this project to download all the included mHealth platforms, many of which required payment for installation or were not accessible (ie, from the literature). Therefore, we used the information detailed in the descriptions provided by the app stores or in the literature. As a result, some data were not available, and we could not avail of the Mobile App Rating Scale for the intended purpose. We attempted to use an alternative mHealth quality assessment tool; however, we did not find one that would be suitable for these purposes. Nouri et al [199] has previously identified substantial heterogeneity in the assessment criteria for mHealth apps in different studies. As valid and reliable frameworks to assess the quality of mHealth platforms are developed, future reviews, such as ours, should incorporate them.

Future Directions: Digital Therapeutics as the Next Step for mHealth Solutions for Anxiety and Depression

It is estimated that 264 million people have depression and 284 million people have anxiety worldwide [200]. The COVID-19 pandemic may exacerbate these numbers [201]. Although effective treatments exist, many health systems worldwide are underresourced and struggling to respond to the burden of anxiety, depression, and other mental health disorders effectively and efficiently [201]. As a result, mHealth platforms continue to gain popularity and are emerging as a feasible option for improving the quality of and overcoming access barriers to mental health support. However, the aforementioned concerns of lack of regulation and low levels of evidence are limiting factors for the current mHealth platforms developed for anxiety and depression to become successful solutions. A leap forward would involve venturing into digital therapeutics (DTx), which is widely regarded as the next step for mHealth. DTx offers effective, safe, highly personalized, objective, and cost-saving health care where barriers between information silos are overcome [202], all of which are ideal for addressing mental health conditions such as anxiety and depression. DTx require clinical and regulatory oversight and demonstrated RWE and are further differentiated by the delivery of a clinical-grade intervention (beyond tracking) to treat or manage a disease [198]. In other words, DTx interfere with the patient to modify their state, often through behavioral alteration. They can operate as a standalone treatment (eg, treating a mental disorder through gamification) or adjunct to other therapies to enhance them (eg, improving drug adherence). With the expectation to grow dramatically over the next few years, DTx can potentially affect users, organizations, and the health care industry in different ways: new treatment options, improved care pathways, incorporation of new standards of care, improved patient and population health outcomes, similar coverage to existing therapies, international product quality standards, and acceptance as an independent class of medicine, among others [203]. DTx is a favorable next step in mHealth solutions for anxiety and depression.

Conclusions

This study analyzed the characteristics of mHealth platforms for anxiety or depression that were available for research, commercial use, or both. A systematic search of the current literature and 2 popular app stores identified 169 and 179 mHealth platforms, respectively. mHealth platforms varied in their targeted condition, targeted group, purpose, intervention type, and technology type. In addition, most platforms from popular app stores lacked clinical and RWE, and a small number of platforms present in the literature were available commercially. Future efforts should focus on further accessing the quality—utility, safety, and effectiveness—of the existing platforms and ensuring the adoption by developers, from both commercial and academic sectors alike, of a reporting guideline for their platform description, as well as a regulatory framework to facilitate the development, validation, and deployment of mHealth platforms for anxiety or depression.

Acknowledgments

The authors gratefully acknowledge funding from the Wellcome Trust Mental Health Priority Area Active Ingredients Commission and Institute for Digital Medicine Translational Research Programme (R-719-000-037-733) at the Yong Loo Lin School of Medicine, the National University of Singapore, and the National Research Foundation Singapore under its AI Singapore Programme (award number: AISG-GC-2019-002) for undertaking this review. The funders had no role in the study design, data collection, management, data interpretation, and writing of this publication.

Conflicts of Interest

DH is a shareholder of KYAN Therapeutics, which has licensed intellectual property pertaining to artificial intelligence–based drug development.

Multimedia Appendix 1

Table of search strings used across the 4 databases and their respective numbers of outcomes.

References

Frequently asked questions on Global Task Force on digital health for TB and its work. World Health Organization. 2017. URL: https://tinyurl.com/ycknp9en [accessed 2020-12-10]

Berrouiguet S, Baca-García E, Brandt S, Walter M, Courtet P. Fundamentals for future mobile-health (mHealth): a systematic review of mobile phone and web-based text messaging in mental health. J Med Internet Res 2016 Dec 10;18(6):e135

Walters K. The purpose and value of mHealth for the University of North Carolina at Chapel Hill: a white paper on mHealth. UNC Health Sciences Library. 2014. URL: https://hsl.lib.unc.edu/wp-content/uploads/2016/09/mHealthWhitePaper_1.pdf [accessed 2022-01-10]

Rowland SP, Fitzgerald JE, Holme T, Powell J, McGregor A. What is the clinical value of mHealth for patients? NPJ Digit Med 2020 Jan 13;3(1):4

Bradway M, Carrion C, Vallespin B, Saadatfard O, Puigdomènech E, Espallargues M, et al. mHealth assessment: conceptualization of a global framework. JMIR Mhealth Uhealth 2017 May 02;5(5):e60

Price M, Yuen EK, Goetter EM, Herbert JD, Forman EM, Acierno R, et al. mHealth: a mechanism to deliver more accessible, more effective mental health care. Clin Psychol Psychother 2014 Aug;21(5):427-436

Kemp S. Digital 2020: October global statshot. DataReportal. 2020. URL: https://datareportal.com/reports/digital-2020-october-global-statshot [accessed 2020-12-10]

Digital 2020 in Singapore. We Are Social. 2020. URL: https://wearesocial.com/sg/digital-2020-singapore [accessed 2020-12-10]

Number of smartphone users worldwide from 2016 to 2021 (in billions). Newzoo © Statista 2020. 2020. URL: https://tinyurl.com/yjbf8ehw [accessed 2020-12-15]

Lecomte T, Potvin S, Corbière M, Guay S, Samson C, Cloutier B, et al. Mobile apps for mental health issues: meta-review of meta-analyses. JMIR Mhealth Uhealth 2020 May 29;8(5):e17458

Miralles I, Granell C, Díaz-Sanahuja L, Van Woensel W, Bretón-López J, Mira A, et al. Smartphone apps for the treatment of mental disorders: systematic review. JMIR Mhealth Uhealth 2020 Apr 02;8(4):e14897

Andlin-Sobocki P, Wittchen H. Cost of anxiety disorders in Europe. Eur J Neurol 2005 Jun;12 Suppl 1(s1):39-44.

Cuijpers P, Beekman AT, Reynolds CF. Preventing depression: a global priority. J Am Med Assoc 2012 Mar 14;307(10):1033-1034

Sun J, Guo Y, Wang X, Zeng Q. mHealth for aging China: opportunities and challenges. Aging Dis 2016;7(1):53.

Cortez NG, Cohen IG, Kesselheim AS. FDA regulation of mobile health technologies. N Engl J Med 2014 Jul 24;371(4):372-379.

Muñoz AO, Camacho E, Torous J. Marketplace and literature review of Spanish language mental health apps. Front Digit Health 2021 Feb 15;3:615366

Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med 2009 Jul 21;6(7):e1000097

Ho GJ, Liew SM, Ng CJ, Shunmugam RH, Glasziou P. Development of a search strategy for an evidence based retrieval service. PLoS One 2016 Dec 9;11(12):e0167170

Covidence Systematic Review Software. URL: https://www.covidence.org/ [accessed 2022-01-10]

Bender JL, Yue RYK, To MJ, Deacken L, Jadad AR. A lot of action, but not in the right direction: systematic review and content analysis of smartphone applications for the prevention, detection, and management of cancer. J Med Internet Res 2013 Dec;15(12):e287

Giunti G, Giunta DH, Guisado-Fernandez E, Bender JL, Fernandez-Luque L. A biopsy of breast cancer mobile applications: state of the practice review. Int J Med Inform 2018 Dec;110:1-9

Yokomitsu K, Irie T, Sekiguchi M, Shimizu A, Matsuoka H, Merry SN, et al. Gamified mobile computerized cognitive behavioral therapy for Japanese university students with depressive symptoms: protocol for a randomized controlled trial. JMIR Res Protoc 2020 Apr 07;9(4):e15164

Reins JA, Ebert DD, Lehr D, Riper H, Cuijpers P, Berking M. Internet-based treatment of major depression for patients on a waiting list for inpatient psychotherapy: protocol for a multi-centre randomised controlled trial. BMC Psychiatry 2013 Nov 26;13(1):318

Hirsch A, Luellen J, Holder JM, Steinberg G, Dubiel T, Blazejowskyj A, et al. Managing depressive symptoms in the workplace using a web-based self-care tool: a pilot randomized controlled trial. JMIR Res Protoc 2017 Apr 04;6(4):e51

Mira A, Bretón-López J, García-Palacios A, Quero S, Baños RM, Botella C. An Internet-based program for depressive symptoms using human and automated support: a randomized controlled trial. Neuropsychiatr Dis Treat 2017 Mar;Volume 13:987-1006.

Ranney ML, Freeman JR, Connell G, Spirito A, Boyer E, Walton M, et al. A depression prevention intervention for adolescents in the Emergency Department. J Adolesc Health 2016 Oct;59(4):401-410

Robertson L, Smith M, Castle D, Tannenbaum D. Using the internet to enhance the treatment of depression. Australas Psychiat 2006 Dec;14(4):413-417.

Parker BL, Achilles MR, Subotic-Kerry M, O'Dea B. Youth StepCare: a pilot study of an online screening and recommendations service for depression and anxiety among youth patients in general practice. BMC Fam Pract 2020 Jan 07;21(1):2

Landback J, Prochaska M, Ellis J, Dmochowska K, Kuwabara SA, Gladstone T, et al. From prototype to product: development of a primary care/internet based depression prevention intervention for adolescents (CATCH-IT). Community Ment Health J 2009 Oct 30;45(5):349-354.

Bakker D, Rickard N. Engagement with a cognitive behavioural therapy mobile phone app predicts changes in mental health and wellbeing: MoodMission. Aus Psychol 2020 Nov 12;54(4):245-260.

Hung S, Li M, Chen Y, Chiang J, Chen Y, Hung GC. Smartphone-based ecological momentary assessment for Chinese patients with depression: an exploratory study in Taiwan. Asian J Psychiatr 2016 Oct;23:131-136.

Addington EL, Cheung EO, Bassett SM, Kwok I, Schuette SA, Shiu E, et al. The MARIGOLD study: feasibility and enhancement of an online intervention to improve emotion regulation in people with elevated depressive symptoms. J Affect Disord 2019 Oct 01;257:352-364

Felder J. Mindful mood balance: a case report of web-based treatment of residual depressive symptoms. Perm J 2014 Nov 3:58-62.

Garrido S, Cheers D, Boydell K, Nguyen QV, Schubert E, Dunne L, et al. Young people's response to six smartphone apps for anxiety and depression: focus group study. JMIR Ment Health 2019 Oct 02;6(10):e14385

Szigethy E, Solano F, Wallace M, Perry DL, Morrell L, Scott K, et al. A study protocol for a non-randomised comparison trial evaluating the feasibility and effectiveness of a mobile cognitive-behavioural programme with integrated coaching for anxious adults in primary care. BMJ Open 2018 Dec 13;8(1):e019108

Witlox M, Kraaij V, Garnefski N, de Waal MW, Smit F, Hoencamp E, et al. An internet-based Acceptance and Commitment Therapy intervention for older adults with anxiety complaints: study protocol for a cluster randomized controlled trial. Trials 2018 Sep 17;19(1):502

van Ballegooijen W, Ruwaard J, Karyotaki E, Ebert DD, Smit JH, Riper H. Reactivity to smartphone-based ecological momentary assessment of depressive symptoms (MoodMonitor): protocol of a randomised controlled trial. BMC Psychiatry 2016 Oct 21;16(1):359

Stiles-Shields C, Montague E, Kwasny MJ, Mohr DC. Behavioral and cognitive intervention strategies delivered via coached apps for depression: pilot trial. Psychol Serv 2019 May;16(2):233-238

Fleming JB, Hill YN, Burns MN. Usability of a culturally informed mHealth intervention for symptoms of anxiety and depression: feedback from young sexual minority men. JMIR Hum Factors 2017 Aug 25;4(3):e22

Chung K, Park JY, Joung D, Jhung K. Response time as an implicit self-schema indicator for depression among undergraduate students: preliminary findings from a mobile app-based depression assessment. JMIR Mhealth Uhealth 2019 Sep 13;7(9):e14657

Stoll RD, Pina AA, Gary K, Amresh A. Usability of a smartphone application to support the prevention and early intervention of anxiety in youth. Cogn Behav Pract 2017 Nov;24(4):393-404

Meglic M, Furlan M, Kuzmanic M, Kozel D, Baraga D, Kuhar I, et al. Feasibility of an eHealth service to support collaborative depression care: results of a pilot study. J Med Internet Res 2010 Dec 19;12(5):e63

Nakao S, Nakagawa A, Oguchi Y, Mitsuda D, Kato N, Nakagawa Y, et al. Web-based cognitive behavioral therapy blended with face-to-face sessions for major depression: randomized controlled trial. J Med Internet Res 2018 Dec 21;20(9):e10743

Moeini B, Bashirian S, Soltanian A, Ghaleiha A, Taheri M. Examining the effectiveness of a web-based intervention for depressive symptoms in female adolescents: applying social cognitive theory. J Res Health Sci 2019;19(3).

Berger T, Krieger T, Sude K, Meyer B, Maercker A. Evaluating an e-mental health program ("deprexis") as adjunctive treatment tool in psychotherapy for depression: results of a pragmatic randomized controlled trial. J Affect Disord 2018 Dec;227:455-462.

Pinto MD, Greenblatt AM, Hickman RL, Rice HM, Thomas TL, Clochesy JM. Assessing the critical parameters of eSMART-MH: a promising avatar-based digital therapeutic intervention to reduce depressive symptoms. Perspect Psychiatr Care 2016 Jul 19;52(3):157-168.

MacLean S, Corsi DJ, Litchfield S, Kucharski J, Genise K, Selaman Z, et al. Coach-facilitated web-based therapy compared with information about web-based resources in patients referred to secondary mental health care for depression: randomized controlled trial. J Med Internet Res 2020 Jun 09;22(6):e15001

Geraedts AS, Kleiboer AM, Wiezer NM, Cuijpers P, van Mechelen W, Anema JR. Feasibility of a worker-directed web-based intervention for employees with depressive symptoms. Internet Interven 2014 Jul;1(3):132-140.

Christensen H, Griffiths KM, Korten A. Web-based cognitive behavior therapy: analysis of site usage and changes in depression and anxiety scores. J Med Internet Res 2002 Feb;4(1):e3

Goldin PR, Lindholm R, Ranta K, Hilgert O, Helteenvuori T, Raevuori A. Feasibility of a therapist-supported, mobile phone-delivered online intervention for depression: longitudinal observational study. JMIR Form Res 2019 Jan 22;3(1):e11509

Karyotaki E, Klein AM, Riper H, Wit LD, Krijnen L, Bol E, et al. Examining the effectiveness of a web-based intervention for symptoms of depression and anxiety in college students: study protocol of a randomised controlled trial. BMJ Open 2019;9(5):e028739

Geraedts AS, Kleiboer AM, Wiezer NM, van Mechelen W, Cuijpers P. Web-based guided self-help for employees with depressive symptoms (Happy@Work): design of a randomized controlled trial. BMC Psychiatry 2013 Feb 18;13(1).

Lopes RT, Meyer B, Berger T, Svacina MA. Effectiveness of an internet-based self-guided program to treat depression in a sample of Brazilian users: a study protocol. Braz J Psychiatry 2020 Jun;42(3):322-328

Pramana G, Parmanto B, Kendall PC, Silk JS. The SmartCAT: an m-health platform for ecological momentary intervention in child anxiety treatment. Telemed J E Health 2014 May;20(5):419-427

Yap MB, Mahtani S, Rapee RM, Nicolas C, Lawrence KA, Mackinnon A, et al. A tailored web-based intervention to improve parenting risk and protective factors for adolescent depression and anxiety problems: postintervention findings from a randomized controlled trial. J Med Internet Res 2018 Dec 19;20(1):e17

Fulgoni CM, Melvin GA, Jorm AF, Lawrence KA, Yap MB. The Therapist-assisted Online Parenting Strategies (TOPS) program for parents of adolescents with clinical anxiety or depression: development and feasibility pilot. Internet Interv 2019 Dec;18:100285

Kladnitski N, Smith J, Uppal S, James MA, Allen AR, Andrews G, et al. Transdiagnostic internet-delivered CBT and mindfulness-based treatment for depression and anxiety: a randomised controlled trial. Internet Interv 2020 Apr;20:100310

Farrer L, Christensen H, Griffiths KM, Mackinnon A. Internet-based CBT for depression with and without telephone tracking in a national helpline: randomised controlled trial. PLoS One 2011 Nov;6(11):e28099

Jolstedt M, Ljótsson B, Fredlander S, Tedgård T, Hallberg A, Ekeljung A, et al. Implementation of internet-delivered CBT for children with anxiety disorders in a rural area: a feasibility trial. Internet Interv 2018 Jun;12:121-129

Berger T, Hämmerli K, Gubser N, Andersson G, Caspar F. Internet-based treatment of depression: a randomized controlled trial comparing guided with unguided self-help. Cogn Behav Ther 2011 Dec;40(4):251-266.

Moberg C, Niles A, Beermann D. Guided self-help works: randomized waitlist controlled trial of Pacifica, a mobile app integrating cognitive behavioral therapy and mindfulness for stress, anxiety, and depression. J Med Internet Res 2019 Jun 08;21(6):e12556

Dimidjian S, Beck A, Felder JN, Boggs JM, Gallop R, Segal ZV. Web-based Mindfulness-based Cognitive Therapy for reducing residual depressive symptoms: an open trial and quasi-experimental comparison to propensity score matched controls. Behav Res Ther 2014 Dec;63:83-89

Moukaddam N, Truong A, Cao J, Shah A, Sabharwal A. Findings from a trial of the smartphone and online usage-based evaluation for depression (SOLVD) application: what do apps really tell us about patients with depression? Concordance between app-generated data and standard psychiatric questionnaires for depression and anxiety. J Psychiatr Pract 2019 Sep;25(5):365-373.

Kamath J, Bi J, Russell A, Wang B. Grant report on SCH: personalized depression treatment supported by mobile sensor analytics. J Psychiatr Brain Sci 2020;5

Fitzpatrick KK, Darcy A, Vierhile M. Delivering cognitive behavior therapy to young adults with symptoms of depression and anxiety using a fully automated conversational agent (Woebot): a randomized controlled trial. JMIR Ment Health 2017 Jun 06;4(2):e19

Geraedts AS, Kleiboer AM, Twisk J, Wiezer NM, van Mechelen W, Cuijpers P. Long-term results of a web-based guided self-help intervention for employees with depressive symptoms: randomized controlled trial. J Med Internet Res 2014 Jul;16(7):e168

El Morr C, Ritvo P, Ahmad F, Moineddin R, Team M. Correction: effectiveness of an 8-week web-based mindfulness virtual community intervention for university students on symptoms of stress, anxiety, and depression: randomized controlled trial. JMIR Ment Health 2020 Sep 30;7(9):e24131

Watts S, Mackenzie A, Thomas C, Griskaitis A, Mewton L, Williams A, et al. CBT for depression: a pilot RCT comparing mobile phone vs. computer. BMC Psychiatry 2013;13:49

Watanabe N, Horikoshi M, Yamada M, Shimodera S, Akechi T, Miki K, Steering Committee of the Fun to Learn to ActThink through Technology Project. Adding smartphone-based cognitive-behavior therapy to pharmacotherapy for major depression (FLATT project): study protocol for a randomized controlled trial. Trials 2015 Jul 07;16:293

Silk JS, Pramana G, Sequeira SL, Lindhiem O, Kendall PC, Rosen D, et al. Using a smartphone app and clinician portal to enhance brief cognitive behavioral therapy for childhood anxiety disorders. Behav Ther 2020 Jan;51(1):69-84

Farvolden P, McBride C, Bagby RM, Ravitz P. A Web-based screening instrument for depression and anxiety disorders in primary care. J Med Internet Res 2003 Sep 29;5(3):e23

Massoudi B, Blanker MH, van Valen E, Wouters H, Bockting CL, Burger H. Blended care vs. usual care in the treatment of depressive symptoms and disorders in general practice [BLENDING]: study protocol of a non-inferiority randomized trial. BMC Psychiatry 2017 Dec 13;17(1):218

Lara MA, Tiburcio M, Abrego AA, Sánchez-Solís A. A four-year experience with a web-based self-help intervention for depressive symptoms in Mexico. Rev Panam Salud Public 2014;35(5-6):399-406.

Fortney J, Pyne J, Steven C, Williams JS, Hedrick RG, Lunsford AK, et al. A web-based clinical decision support system for depression care management. Am J Manag Care 2010 Nov;16(11):849-854

Ünlü Ince B, Gökçay D, Riper H, Cuijpers P. Effectiveness of a web- and mobile-guided psychological intervention for depressive symptoms in turkey: protocol for a randomized controlled trial. JMIR Res Protoc 2019 Apr 05;8(4):e13239

Høifødt RS, Mittner M, Lillevoll K, Katla SK, Kolstrup N, Eisemann M, et al. Predictors of response to web-based cognitive behavioral therapy with high-intensity face-to-face therapist guidance for depression: a Bayesian analysis. J Med Internet Res 2015 Sep 02;17(9):e197

Pratap A, Renn BN, Volponi J, Mooney SD, Gazzaley A, Arean PA, et al. Using mobile apps to assess and treat depression in Hispanic and Latino populations: fully remote randomized clinical trial. J Med Internet Res 2018 Aug 09;20(8):e10130

Cheung EO, Addington EL, Bassett SM, Schuette SA, Shiu EW, Cohn MA, et al. A self-paced, web-based, positive emotion skills intervention for reducing symptoms of depression: protocol for development and pilot testing of MARIGOLD. JMIR Res Protoc 2018 Jun 05;7(6):e10494

Schneider BC, Schröder J, Berger T, Hohagen F, Meyer B, Späth C, et al. Bridging the "digital divide": a comparison of use and effectiveness of an online intervention for depression between Baby Boomers and Millennials. J Affect Disord 2018 Aug 15;236:243-251.

Buntrock C, Ebert DD, Lehr D, Cuijpers P, Riper H, Smit F, et al. Evaluating the efficacy and cost-effectiveness of web-based indicated prevention of major depression: design of a randomised controlled trial. BMC Psychiatry 2014 Jan 31;14(1).

Dahne J, Lejuez CW, Kustanowitz J, Felton JW, Diaz VA, Player MS, et al. Moodivate: a self-help behavioral activation mobile app for utilization in primary care - Development and clinical considerations. Int J Psychiatry Med 2017 Mar;52(2):160-175

Yap MB, Cardamone-Breen MC, Rapee RM, Lawrence KA, Mackinnon AJ, Mahtani S, et al. Medium-term effects of a tailored web-based parenting intervention to reduce adolescent risk of depression and anxiety: 12-month findings from a randomized controlled trial. J Med Internet Res 2019 Aug 15;21(8):e13628.

Rice S, O'Bree B, Wilson M, McEnery C, Lim MH, Hamilton M, et al. Leveraging the social network for treatment of social anxiety: pilot study of a youth-specific digital intervention with a focus on engagement of young men. Internet Interv 2020 Apr;20:100323

Economides M, Ranta K, Nazander A, Hilgert O, Goldin PR, Raevuori A, et al. Long-term outcomes of a therapist-supported, smartphone-based intervention for elevated symptoms of depression and anxiety: quasiexperimental, pre-postintervention study. JMIR Mhealth Uhealth 2019 Aug 26;7(8):e14284

Bücker L, Schnakenberg P, Karyotaki E, Moritz S, Westermann S. Diminishing effects after recurrent use of self-guided internet-based interventions in depression: randomized controlled trial. J Med Internet Res 2019 Oct 02;21(10):e14240

Ranney ML, Patena JV, Dunsiger S, Spirito A, Cunningham RM, Boyer E, et al. A technology-augmented intervention to prevent peer violence and depressive symptoms among at-risk emergency department adolescents: protocol for a randomized control trial. Contemp Clin Trials 2019 Jul;82:106-114

Whitton AE, Proudfoot J, Clarke J, Birch M, Parker G, Manicavasagar V, et al. Breaking open the black box: isolating the most potent features of a web and mobile phone-based intervention for depression, anxiety, and stress. JMIR Ment Health 2015 Mar 04;2(1):e3

Christensen H, Mackinnon AJ, Batterham PJ, O'Dea B, Guastella AJ, Griffiths KM, et al. The effectiveness of an online e-health application compared to attention placebo or Sertraline in the treatment of Generalised Anxiety Disorder. Internet Interv 2014 Oct;1(4):169-174.

Pramana G, Parmanto B, Lomas J, Lindhiem O, Kendall PC, Silk J. Using mobile health gamification to facilitate cognitive behavioral therapy skills practice in child anxiety treatment: open clinical trial. JMIR Serious Games 2018 May 10;6(2):e9

Proudfoot J, Clarke J, Birch M, Whitton AE, Parker G, Manicavasagar V, et al. Impact of a mobile phone and web program on symptom and functional outcomes for people with mild-to-moderate depression, anxiety and stress: a randomised controlled trial. BMC Psychiatry 2013;13:312

Bae J, Wolpin S, Kim E, Lee S, Yoon S, An K. Development of a user-centered health information service system for depressive symptom management. Nurs Health Sci 2009 Jun;11(2):185-193.

Mohr DC, Tomasino KN, Lattie EG, Palac HL, Kwasny MJ, Weingardt K, et al. IntelliCare: an eclectic, skills-based app suite for the treatment of depression and anxiety. J Med Internet Res 2017 Jan 05;19(1):e10

Cardamone-Breen MC, Jorm AF, Lawrence KA, Rapee RM, Mackinnon AJ, Yap MB. A single-session, web-based parenting intervention to prevent adolescent depression and anxiety disorders: randomized controlled trial. J Med Internet Res 2018 Apr 26;20(4):e148

Kleiboer A, Donker T, Seekles W, van Straten A, Riper H, Cuijpers P. A randomized controlled trial on the role of support in internet-based problem solving therapy for depression and anxiety. Behav Res Ther 2015 Sep;72:63-71.

Beiwinkel T, Eißing T, Telle N, Siegmund-Schultze E, Rössler W. Effectiveness of a web-based intervention in reducing depression and sickness absence: randomized controlled trial. J Med Internet Res 2017 Jun 15;19(6):e213

Corden ME, Koucky EM, Brenner C, Palac HL, Soren A, Begale M, et al. MedLink: a mobile intervention to improve medication adherence and processes of care for treatment of depression in general medicine. Digit Health 2016 Aug 03;2:2055207616663069

Roy-Byrne P, Craske MG, Sullivan G, Rose RD, Edlund MJ, Lang AJ, et al. Delivery of evidence-based treatment for multiple anxiety disorders in primary care: a randomized controlled trial. J Am Med Assoc 2010 May 19;303(19):1921-1928

Mohr D, Stiles-Shields C, Brenner C, Palac H, Montague E, Kaiser SM, et al. MedLink: a mobile intervention to address failure points in the treatment of depression in general medicine. Int Conf Pervasive Comput Technol Healthc 2015 May;2015:100-107

March S, Spence SH, Donovan CL, Kenardy JA. Large-scale dissemination of internet-based cognitive behavioral therapy for youth anxiety: feasibility and acceptability study. J Med Internet Res 2018 Jul 04;20(7):e234

Narziev N, Goh H, Toshnazarov K, Lee SA, Chung K, Noh Y. STDD: Short-Term Depression Detection with Passive Sensing. Sensors (Basel) 2020 Mar 04;20(5):1396

Hobbs MJ, Mahoney AE, Andrews G. Integrating iCBT for generalized anxiety disorder into routine clinical care: treatment effects across the adult lifespan. J Anxiety Disord 2017 Oct;51:47-54.

Hatcher S, Whittaker R, Patton M, Miles WS, Ralph N, Kercher K, et al. Web-based therapy plus support by a coach in depressed patients referred to secondary mental health care: randomized controlled trial. JMIR Ment Health 2018 Jan 23;5(1):e5

Cook L, Mostazir M, Watkins E. Reducing Stress and Preventing Depression (RESPOND): randomized controlled trial of web-based rumination-focused cognitive behavioral therapy for high-ruminating university students. J Med Internet Res 2019 May 13;21(5):e11349

Meyer B, Berger T, Caspar F, Beevers CG, Andersson G, Weiss M. Effectiveness of a novel integrative online treatment for depression (Deprexis): randomized controlled trial. J Med Internet Res 2009 May 11;11(2):e15

Ramos RM, Cheng PG, Jonas SM. Validation of an mHealth app for depression screening and monitoring (Psychologist in a Pocket): correlational study and concurrence analysis. JMIR Mhealth Uhealth 2019 Sep 16;7(9):e12051

Dang M, Mielke C, Diehl A, Haux R. Accompanying depression with FINE - A smartphone-based approach. In: Studies in Health Technology and Informatics. Amsterdam: IOS Press; 2016:195-199.

Kwasny MJ, Schueller SM, Lattie E, Gray EL, Mohr DC. Exploring the use of multiple mental health apps within a platform: secondary analysis of the IntelliCare field trial. JMIR Ment Health 2019 Mar 21;6(3):e11572

Deady M, Johnston DA, Glozier N, Milne D, Choi I, Mackinnon A, et al. Smartphone application for preventing depression: study protocol for a workplace randomised controlled trial. BMJ Open 2018 Jul 13;8(7):e020510

Gaudiano BA, Davis CH, Miller IW, Uebelacker L. Pilot randomized controlled trial of a video self-help intervention for depression based on acceptance and commitment therapy: feasibility and acceptability. Clin Psychol Psychother 2020 May 28;27(3):396-407

Lintvedt OK, Griffiths KM, Sørensen K, Østvik AR, Wang CE, Eisemann M, et al. Evaluating the effectiveness and efficacy of unguided internet-based self-help intervention for the prevention of depression: a randomized controlled trial. Clin Psychol Psychother 2013 Sep 02;20(1):10-27.

Kemmeren LL, van Schaik DJ, Riper H, Kleiboer AM, Bosmans JE, Smit JH. Effectiveness of blended depression treatment for adults in specialised mental healthcare: study protocol for a randomised controlled trial. BMC Psychiatry 2016 Apr 21;16:113

Radovic A, Li Y, Landsittel D, Stein BD, Miller E. A social media website (supporting our valued adolescents) to support treatment uptake for adolescents with depression and/or anxiety and their parents: protocol for a pilot randomized controlled trial. JMIR Res Protoc 2019 Jan 23;8(1):e12117

Kelders SM, Bohlmeijer ET, Van Gemert-Pijnen JE. Participants, usage, and use patterns of a web-based intervention for the prevention of depression within a randomized controlled trial. J Med Internet Res 2013 Aug;15(8):e172

Kramer J, Conijn B, Oijevaar P, Riper H. Effectiveness of a web-based solution-focused brief chat treatment for depressed adolescents and young adults: randomized controlled trial. J Med Internet Res 2014;16(5):e141

Buntrock C, Ebert D, Lehr D, Riper H, Smit F, Cuijpers P, et al. Effectiveness of a web-based cognitive behavioural intervention for subthreshold depression: pragmatic randomised controlled trial. Psychother Psychosom 2015 Sep;84(6):348-358.

Zwerenz R, Baumgarten C, Becker J, Tibubos A, Siepmann M, Knickenberg RJ, et al. Improving the course of depressive symptoms after inpatient psychotherapy using adjunct web-based self-help: follow-up results of a randomized controlled trial. J Med Internet Res 2019 Oct 24;21(10):e13655

Clarke G, Reid E, Eubanks D, O'Connor E, DeBar LL, Kelleher C, et al. Overcoming depression on the internet (ODIN): a randomized controlled trial of an Internet depression skills intervention program. J Med Internet Res 2002 Dec;4(3):E14

Ponzo S, Morelli D, Kawadler JM, Hemmings NR, Bird G, Plans D. Efficacy of the digital therapeutic mobile app biobase to reduce stress and improve mental well-being among university students: randomized controlled trial. JMIR Mhealth Uhealth 2020 Apr 06;8(4):e17767

Arean PA, Hallgren KA, Jordan JT, Gazzaley A, Atkins DC, Heagerty PJ, et al. The use and effectiveness of mobile apps for depression: results from a fully remote clinical trial. J Med Internet Res 2016 Dec 20;18(12):e330

Unlü B, Riper H, van SA, Cuijpers P. Guided self-help on the internet for Turkish migrants with depression: the design of a randomized controlled trial. Trials 2010;11:101

Deady M, Johnston D, Milne D, Glozier N, Peters D, Calvo R, et al. Preliminary effectiveness of a smartphone app to reduce depressive symptoms in the workplace: feasibility and acceptability study. JMIR Mhealth Uhealth 2018 Dec 04;6(12):e11661

Palacios JE, Richards D, Palmer R, Coudray C, Hofmann SG, Palmieri PA, et al. Supported internet-delivered cognitive behavioral therapy programs for depression, anxiety, and stress in university students: open, non-randomised trial of acceptability, effectiveness, and satisfaction. JMIR Ment Health 2018 Dec 14;5(4):e11467

Duraimani S. A Cross-sectional and longitudinal study of the effects of a mindfulness meditation mobile application platform on reducing stress and anxiety. Int J Yoga 2019;12(3):226.

Bakker D, Kazantzis N, Rickwood D, Rickard N. Development and pilot evaluation of smartphone-delivered cognitive behavior therapy strategies for mood- and anxiety-related problems: MoodMission. Cogn Behav Pract 2018 Nov;25(4):496-514.

Trivedi M, Jha M, Kahalnik F, Pipes R, Levinson S, Lawson T, et al. VitalSign: a Primary Care First (PCP-First) Model for universal screening and measurement-based care for depression. Pharmaceuticals (Basel) 2019 May 14;12(2):71

Bevan Jones R, Thapar A, Rice F, Mars B, Agha SS, Smith D, et al. A digital intervention for adolescent depression (MoodHwb): mixed methods feasibility evaluation. JMIR Ment Health 2020 Jul 17;7(7):e14536

Lappalainen P, Langrial S, Oinas-Kukkonen H, Tolvanen A, Lappalainen R. Web-based acceptance and commitment therapy for depressive symptoms with minimal support: a randomized controlled trial. Behav Modif 2015 Nov;39(6):805-834.

Pham Q, Khatib Y, Stansfeld S, Fox S, Green T. Feasibility and efficacy of an mhealth game for managing anxiety: "Flowy" randomized controlled pilot trial and design evaluation. Games Health J 2016 Feb;5(1):50-67.

Mohr DC, Duffecy J, Ho J, Kwasny M, Cai X, Burns MN, et al. A randomized controlled trial evaluating a manualized TeleCoaching protocol for improving adherence to a web-based intervention for the treatment of depression. PLoS One 2013 Aug;8(8):e70086

Lüdtke T, Pult LK, Schröder J, Moritz S, Bücker L. A randomized controlled trial on a smartphone self-help application (Be Good to Yourself) to reduce depressive symptoms. Psychiatry Res 2018 Nov;269:753-762.

Clarke J, Proudfoot J, Whitton A, Birch M, Boyd M, Parker G, et al. Therapeutic alliance with a fully automated mobile phone and web-based intervention: secondary analysis of a randomized controlled trial. JMIR Ment Health 2016 Feb 25;3(1):e10

Chen RY, Feltes JR, Tzeng WS, Lu ZY, Pan M, Zhao N, et al. Phone-based interventions in adolescent psychiatry: a perspective and proof of concept pilot study with a focus on depression and autism. JMIR Res Protoc 2017 Jun 16;6(6):e114

Lambert JD, Greaves CJ, Farrand P, Price L, Haase AM, Taylor AH. Web-based intervention using behavioral activation and physical activity for adults with depression (The eMotion Study): pilot randomized controlled trial. J Med Internet Res 2018 Jul 16;20(7):e10112

Howell AN, Rheingold AA, Uhde TW, Guille C. Web-based CBT for the prevention of anxiety symptoms among medical and health science graduate students. Cogn Behav Ther 2019 Sep 11;48(5):385-405

Wisniewski SR, Eng H, Meloro L, Gatt R, Ritz L, Stegman D, et al. Web-based communications and management of a multi-center clinical trial: the Sequenced Treatment Alternatives to Relieve Depression (STAR*D) project. Clin Trials 2004 Sep 03;1(4):387-398.

Fulmer R, Joerin A, Gentile B, Lakerink L, Rauws M. Using psychological artificial intelligence (Tess) to relieve symptoms of depression and anxiety: randomized controlled trial. JMIR Ment Health 2018 Dec 13;5(4):e64

Wahle F, Kowatsch T, Fleisch E, Rufer M, Weidt S. Mobile sensing and support for people with depression: a pilot trial in the wild. JMIR Mhealth Uhealth 2016 Sep 21;4(3):e111

Burton C, Tatar A, McKinstry B, Matheson C, Matu S, Moldovan R, et al. Pilot randomised controlled trial of Help4Mood, an embodied virtual agent-based system to support treatment of depression. J Telemed Telecare 2016 Jul 09;22(6):348-355.

Kordy H, Wolf M, Aulich K, Bürgy M, Hegerl U, Hüsing J, et al. Internet-delivered disease management for recurrent depression: a multicenter randomized controlled trial. Psychother Psychosom 2016 Jan;85(2):91-98.

Bitsch J, Ramos R, Ix T, Ferrer-Cheng P, Wehrle K. Psychologist in a pocket: towards depression screening on mobile phones. In: Studies in Health Technology and Informatics. Amsterdam: IOS Press; 2015:153-159.

Torous J, Staples P, Shanahan M, Lin C, Peck P, Keshavan M, et al. Utilizing a personal smartphone custom app to assess the patient health questionnaire-9 (PHQ-9) depressive symptoms in patients with major depressive disorder. JMIR Ment Health 2015 Mar;2(1):e8

Mohr DC, Schueller SM, Tomasino KN, Kaiser SM, Alam N, Karr C, et al. Comparison of the effects of coaching and receipt of app recommendations on depression, anxiety, and engagement in the IntelliCare platform: factorial randomized controlled trial. J Med Internet Res 2019 Aug 28;21(8):e13609

Jones RB, Thapar A, Rice F, Beeching H, Cichosz R, Mars B, et al. A web-based psychoeducational intervention for adolescent depression: design and development of MoodHwb. JMIR Ment Health 2018 Feb 15;5(1):e13

Furukawa TA, Horikoshi M, Fujita H, Tsujino N, Jinnin R, Kako Y, et al. Cognitive and behavioral skills exercises completed by patients with major depression during smartphone cognitive behavioral therapy: secondary analysis of a randomized controlled trial. JMIR Ment Health 2018 Jan 11;5(1):e4

Aguilera A, Bruehlman-Senecal E, Demasi O, Avila P. Automated text messaging as an adjunct to cognitive behavioral therapy for depression: a clinical trial. J Med Internet Res 2017 May 08;19(5):e148

Christensen H, Guastella AJ, Mackinnon AJ, Griffiths KM, Eagleson C, Batterham PJ, et al. Protocol for a randomised controlled trial investigating the effectiveness of an online e-health application compared to attention placebo or sertraline in the treatment of generalised anxiety disorder. Trials 2010 Apr 30;11(1):48

Fogarty AS, Proudfoot J, Whittle EL, Clarke J, Player MJ, Christensen H, et al. Preliminary evaluation of a brief web and mobile phone intervention for men with depression: men's positive coping strategies and associated depression, resilience, and work and social functioning. JMIR Ment Health 2017 Aug 10;4(3):e33

Kauer SD, Reid SC, Crooke AH, Khor A, Hearps SJ, Jorm AF, et al. Self-monitoring using mobile phones in the early stages of adolescent depression: randomized controlled trial. J Med Internet Res 2012 Jun;14(3):e67

van der Zanden ZR, Kramer J, Gerrits R, Cuijpers P. Effectiveness of an online group course for depression in adolescents and young adults: a randomized trial. J Med Internet Res 2012;14(3):e86

Maideen SF, Mohd-Sidik S, Rampal L, Mukhtar F, Ibrahim N, Phang C, et al. A web-based psychoeducational intervention program for depression and anxiety in an adult community in Selangor, Malaysia: protocol of a randomized controlled trial. JMIR Res Protoc 2016 Jun 21;5(2):e112

Morris RR, Schueller SM, Picard RW. Efficacy of a web-based, crowdsourced peer-to-peer cognitive reappraisal platform for depression: randomized controlled trial. J Med Internet Res 2015 Mar;17(3):e72

Kumagai N, Tajika A, Hasegawa A, Kawanishi N, Horikoshi M, Shimodera S, et al. Predicting recurrence of depression using lifelog data: an explanatory feasibility study with a panel VAR approach. BMC Psychiatry 2019 Dec 11;19(1):391

Migoya-Borja M, Delgado-Gómez D, Carmona-Camacho R, Porras-Segovia A, López-Moriñigo JD, Sánchez-Alonso M, et al. Feasibility of a virtual reality-based psychoeducational tool (VRight) for depressive patients. Cyberpsychol Behav Soc Netw 2020 Apr 01;23(4):246-252.

Anttila K, Anttila M, Välimäki M. A web-based adolescent depression support system: feedback and implications for the future. Inform Health Soc Care 2020 Nov 04;45(2):111-129.

Goodwin BC, Ford DE, Hsiung RC, Houston TK, Fogel J, Van Voorhees BW. First, do no harm: referring primary care patients with depression to an internet support group. Telemed J E Health 2018 Jan;24(1):37-44

Inkster B, Sarda S, Subramanian V. An empathy-driven, conversational artificial intelligence agent (Wysa) for digital mental well-being: real-world data evaluation mixed-methods study. JMIR Mhealth Uhealth 2018 Nov 23;6(11):e12106

Soares Teles A, Rocha A, da Silva E Silva FJ, Correia Lopes J, O'Sullivan D, Van de Ven P, et al. Enriching mental health mobile assessment and intervention with situation awareness. Sensors (Basel) 2017 Jan 10;17(1):127

Christensen H, Batterham P, Mackinnon A, Griffiths KM, Kalia Hehir K, Kenardy J, et al. Prevention of generalized anxiety disorder using a web intervention, iChill: randomized controlled trial. J Med Internet Res 2014 Sep 02;16(9):e199

Radovic A, Gmelin T, Hua J, Long C, Stein BD, Miller E. Supporting Our Valued Adolescents (SOVA), a social media website for adolescents with depression and/or anxiety: technological feasibility, usability, and acceptability study. JMIR Ment Health 2018 Feb 26;5(1):e17

Dahne J, Collado A, Lejuez CW, Risco CM, Diaz VA, Coles L, et al. Pilot randomized controlled trial of a Spanish-language behavioral activation mobile app (¡Aptívate!) for the treatment of depressive symptoms among united states Latinx adults with limited English proficiency. J Affect Disord 2019 May 01;250:210-217.

Segal ZV, Dimidjian S, Beck A, Boggs JM, Vanderkruik R, Metcalf CA, et al. Outcomes of online mindfulness-based cognitive therapy for patients with residual depressive symptoms: a randomized clinical trial. JAMA Psychiatry 2020 Jun 01;77(6):563-573

Hur J, Kim B, Park D, Choi S. A scenario-based cognitive behavioral therapy mobile app to reduce dysfunctional beliefs in individuals with depression: a randomized controlled trial. Telemed J E Health 2018 Dec;24(9):710-716.

Miloff A, Marklund A, Carlbring P. The challenger app for social anxiety disorder: new advances in mobile psychological treatment. Internet Interv 2015 Nov;2(4):382-391.

Geraedts AS, Kleiboer AM, Wiezer NM, van Mechelen W, Cuijpers P. Short-term effects of a web-based guided self-help intervention for employees with depressive symptoms: randomized controlled trial. J Med Internet Res 2014 May 06;16(5):e121

Takahashi K, Takada K, Hirao K. Feasibility and preliminary efficacy of a smartphone application intervention for subthreshold depression. Early Interv Psychiatry 2019 Feb;13(1):133-136.

McCall HC, Richardson CG, Helgadottir FD, Chen FS. Evaluating a web-based social anxiety intervention among university students: randomized controlled trial. J Med Internet Res 2018 Dec 21;20(3):e91

Garrido S, Millington C, Cheers D, Boydell K, Schubert E, Meade T, et al. What works and what doesn't work? A systematic review of digital mental health interventions for depression and anxiety in young people. Front Psychiatry 2019 Nov 13;10:759

Grist R, Porter J, Stallard P. Mental health mobile apps for preadolescents and adolescents: a systematic review. J Med Internet Res 2017 May 25;19(5):e176

Clement S, Schauman O, Graham T, Maggioni F, Evans-Lacko S, Bezborodovs N, et al. What is the impact of mental health-related stigma on help-seeking? A systematic review of quantitative and qualitative studies. Psychol Med 2015 Jan;45(1):11-27.

Gulliver A, Griffiths KM, Christensen H. Perceived barriers and facilitators to mental health help-seeking in young people: a systematic review. BMC Psychiatry 2010;10:113

Hamine S, Gerth-Guyette E, Faulx D, Green BB, Ginsburg AS. Impact of mHealth chronic disease management on treatment adherence and patient outcomes: a systematic review. J Med Internet Res 2015 Feb 24;17(2):52-57

Zarski A, Lehr D, Berking M, Riper H, Cuijpers P, Ebert DD. Adherence to internet-based mobile-supported stress management: a pooled analysis of individual participant data from three randomized controlled trials. J Med Internet Res 2016 Jun 29;18(6):e146

Baumeister H, Reichler L, Munzinger M, Lin J. The impact of guidance on internet-based mental health interventions — A systematic review. Internet Interven 2014 Oct;1(4):205-215.

Palmqvist B, Carlbring P, Andersson G. Internet-delivered treatments with or without therapist input: does the therapist factor have implications for efficacy and cost? Expert Rev Pharmacoecon Outcomes Res 2007 Jun;7(3):291-297.

Richards D, Richardson T. Computer-based psychological treatments for depression: a systematic review and meta-analysis. Clin Psychol Rev 2012 Jun;32(4):329-342.

Uhlhaas P, Torous J. Digital tools for youth mental health. NPJ Digit Med 2019 Oct 18;2(1):104

Mobile operating system market share worldwide: Nov 2019 - Nov 2020. StatCounter. 2020. URL: https://gs.statcounter.com/os-market-share/mobile/ [accessed 2022-01-10]

Carlo AD, Ghomi RH, Renn BN, Areán PA. By the numbers: ratings and utilization of behavioral health mobile applications. NPJ Digit Med 2019 Jun 17;2(1):54

Lin Y, Chen S, Lin P, Tai A, Pan Y, Hsieh C, et al. Assessing user retention of a mobile app: survival analysis. JMIR Mhealth Uhealth 2020 Nov 26;8(11):e16309

Torous J, Levin ME, Ahern DK, Oser ML. Cognitive behavioral mobile applications: clinical studies, marketplace overview, and research agenda. Cogn Behav Pract 2017 May;24(2):215-225.

Wisniewski H, Liu G, Henson P, Vaidyam A, Hajratalli NK, Onnela J, et al. Understanding the quality, effectiveness and attributes of top-rated smartphone health apps. Evid Based Ment Health 2019 Feb;22(1):4-9.

Olff M. Mobile mental health: a challenging research agenda. Eur J Psychotraumatol 2015 May 19;6(1):27882

Huang H, Bashir M. Users' adoption of mental health apps: examining the impact of information cues. JMIR Mhealth Uhealth 2017 Jun 28;5(6):e83

Wei Y, Zheng P, Deng H, Wang X, Li X, Fu H. Design features for improving mobile health intervention user engagement: systematic review and thematic analysis. J Med Internet Res 2020 Dec 09;22(12):e21687

Torous J, Nicholas J, Larsen ME, Firth J, Christensen H. Clinical review of user engagement with mental health smartphone apps: evidence, theory and improvements. Evid Based Ment Health 2018 Aug 05;21(3):116-119.

Aref-Adib G, McCloud T, Ross J, O'Hanlon P, Appleton V, Rowe S, et al. Factors affecting implementation of digital health interventions for people with psychosis or bipolar disorder, and their family and friends: a systematic review. Lancet Psychiatry 2019 Mar;6(3):257-266.

Larsen ME, Huckvale K, Nicholas J, Torous J, Birrell L, Li E, et al. Using science to sell apps: evaluation of mental health app store quality claims. NPJ Digit Med 2019 Mar 22;2(1):18

Nicholas J, Larsen ME, Proudfoot J, Christensen H. Mobile apps for bipolar disorder: a systematic review of features and content quality. J Med Internet Res 2015 Aug;17(8):e198

Singh K, Drouin K, Newmark LP, Lee J, Faxvaag A, Rozenblum R, et al. Many mobile health apps target high-need, high-cost populations, but gaps remain. Health Aff (Millwood) 2016 Dec 01;35(12):2310-2318.

IEEE 1752.1-2021 - IEEE Standard for Open Mobile Health Data--Representation of Metadata, Sleep, and Physical Activity Measures. IEEE Standrads Association. 2021. URL: https://standards.ieee.org/project/1752_1.html [accessed 2021-06-05]

HL7 Consumer Mobile Health Application Functional Framework (CMHAFF). HL7 International. URL: https://www.hl7.org/implement/standards/product_brief.cfm?product_id=476 [accessed 2022-01-10]

App advisor: an American Psychiatric Association initiative. American Psychiatric Association. URL: https://www.psychiatry.org/psychiatrists/practice/mental-health-apps [accessed 2021-11-01]

The Digital Technology Assessment Criteria for Health and Social Care (DTAC). NHSX. 2021. URL: https://www.nhsx.nhs.uk/key-tools-and-info/digital-technology-assessment-criteria-dtac/ [accessed 2022-01-10]

Digital Medicine Society. URL: https://www.dimesociety.org/about-us/ [accessed 2021-06-05]

Advancing DTx: improving clinical and health economic outcomes. Digital Therapeutics Alliance. URL: https://dtxalliance.org/advancing-dtx/ [accessed 2021-06-05]

ISO/PRF TS 82304-2 Health software - Part 2: health and wellness apps - quality and reliability. ISO. URL: https://www.iso.org/standard/78182.html [accessed 2021-05-03]

Naden C. One step ahead with mobile apps. ISO. 2020. URL: https://www.iso.org/news/isofocus_141-6.html [accessed 2021-01-11]

Stoyanov SR, Hides L, Kavanagh DJ, Zelenko O, Tjondronegoro D, Mani M. Mobile app rating scale: a new tool for assessing the quality of health mobile apps. JMIR Mhealth Uhealth 2015 Mar;3(1):e27

Nouri R, Kalhori SR, Ghazisaeedi M, Marchand G, Yasini M. Criteria for assessing the quality of mHealth apps: a systematic review. J Am Med Inform Assoc 2018 Aug 01;25(8):1089-1098

Dattani S, Ritchie H, Roser M. Mental health. Our World in Data. 2018. URL: https://ourworldindata.org/mental-health [accessed 2022-01-10]

Bidargaddi N, Schrader G, Klasnja P, Licinio J, Murphy S. Designing m-Health interventions for precision mental health support. Transl Psychiatry 2020 Jul 07;10(1):222

Kaldy J. Digital therapeutics: health care wired for the future. Senior Care Pharm 2020 Aug 01;35(8):338-344.

“Digital Therapeutics: Combining Technology and Evidence-based Medicine to Transform Personalized Patient Care”. Digital Therapeutics Alliance. 2018. URL: https://www.dtxalliance.org/wp-content/uploads/2018/09/DTA-Report_DTx-Industry-Foundations.pdf [accessed 2020-12-18]