The diagnostic validity and reliability of an internet-based clinical assessment program for mental disorders
- Nguyen, David, Klein, Britt, Meyer, Denny, Austin, David, Abbott, Jo-Anne
- Authors: Nguyen, David , Klein, Britt , Meyer, Denny , Austin, David , Abbott, Jo-Anne
- Date: 2015
- Type: Text , Journal article
- Relation: Journal of Medical Internet Research Vol. 17, no. 9 (2015), p.
- Full Text:
- Reviewed:
- Description: Background: Internet-based assessment has the potential to assist with the diagnosis of mental health disorders and overcome the barriers associated with traditional services (eg, cost, stigma, distance). Further to existing online screening programs available, there is an opportunity to deliver more comprehensive and accurate diagnostic tools to supplement the assessment and treatment of mental health disorders. Objective: The aim was to evaluate the diagnostic criterion validity and test-retest reliability of the electronic Psychological Assessment System (e-PASS), an online, self-report, multidisorder, clinical assessment and referral system. Methods: Participants were 616 adults residing in Australia, recruited online, and representing prospective e-PASS users. Following e-PASS completion, 158 participants underwent a telephone-administered structured clinical interview and 39 participants repeated the e-PASS within 25 days of initial completion. Results: With structured clinical interview results serving as the gold standard, diagnostic agreement with the e-PASS varied considerably from fair (eg, generalized anxiety disorder:kappa=.37) to strong (eg, panic disorder:kappa=.62). Although the e-PASS' sensitivity also varied (0.43-0.86) the specificity was generally high (0.68-1.00). The e-PASS sensitivity generally improved when reducing the e-PASS threshold to a subclinical result. Test-retest reliability ranged from moderate (eg, specific phobia:kappa=.54) to substantial (eg, bulimia nervosa:kappa=.87). Conclusions: The e-PASS produces reliable diagnostic results and performs generally well in excluding mental disorders, although at the expense of sensitivity. For screening purposes, the e-PASS subclinical result generally appears better than a clinical result as a diagnostic indicator. Further development and evaluation is needed to support the use of online diagnostic assessment programs for mental disorders.
- Authors: Nguyen, David , Klein, Britt , Meyer, Denny , Austin, David , Abbott, Jo-Anne
- Date: 2015
- Type: Text , Journal article
- Relation: Journal of Medical Internet Research Vol. 17, no. 9 (2015), p.
- Full Text:
- Reviewed:
- Description: Background: Internet-based assessment has the potential to assist with the diagnosis of mental health disorders and overcome the barriers associated with traditional services (eg, cost, stigma, distance). Further to existing online screening programs available, there is an opportunity to deliver more comprehensive and accurate diagnostic tools to supplement the assessment and treatment of mental health disorders. Objective: The aim was to evaluate the diagnostic criterion validity and test-retest reliability of the electronic Psychological Assessment System (e-PASS), an online, self-report, multidisorder, clinical assessment and referral system. Methods: Participants were 616 adults residing in Australia, recruited online, and representing prospective e-PASS users. Following e-PASS completion, 158 participants underwent a telephone-administered structured clinical interview and 39 participants repeated the e-PASS within 25 days of initial completion. Results: With structured clinical interview results serving as the gold standard, diagnostic agreement with the e-PASS varied considerably from fair (eg, generalized anxiety disorder:kappa=.37) to strong (eg, panic disorder:kappa=.62). Although the e-PASS' sensitivity also varied (0.43-0.86) the specificity was generally high (0.68-1.00). The e-PASS sensitivity generally improved when reducing the e-PASS threshold to a subclinical result. Test-retest reliability ranged from moderate (eg, specific phobia:kappa=.54) to substantial (eg, bulimia nervosa:kappa=.87). Conclusions: The e-PASS produces reliable diagnostic results and performs generally well in excluding mental disorders, although at the expense of sensitivity. For screening purposes, the e-PASS subclinical result generally appears better than a clinical result as a diagnostic indicator. Further development and evaluation is needed to support the use of online diagnostic assessment programs for mental disorders.
A randomized head to head trial of MoodSwings.net.au: An internet based self-help program for bipolar disorder
- Lauder, Sue, Chester, Andrea, Castle, David, Dodd, Seetal, Gliddon, Emma, Berk, Lesley, Chamberlain, James, Klein, Britt, Gilbert, Monica, Austin, David, Berk, Michael
- Authors: Lauder, Sue , Chester, Andrea , Castle, David , Dodd, Seetal , Gliddon, Emma , Berk, Lesley , Chamberlain, James , Klein, Britt , Gilbert, Monica , Austin, David , Berk, Michael
- Date: 2014
- Type: Text , Journal article
- Relation: Journal of Affective Disorders Vol. 171, no. (2014), p. 13-21
- Full Text:
- Reviewed:
- Description: Background Adjunctive psychosocial interventions are efficacious in bipolar disorder, but their incorporation into routine management plans are often confounded by cost and access constraints. We report here a comparative evaluation of two online programs hosted on a single website (www.moodswings.net.au). A basic version, called MoodSwings (MS), contains psychoeducation material and asynchronous discussion boards; and a more interactive program, MoodSwings Plus (MS-Plus), combined the basic psychoeducation material and discussion boards with elements of Cognitive Behavioral Therapy. These programs were evaluated in a head-to-head study design. Method Participants with Bipolar I or II disorder (n=156) were randomized to receive either MoodSwings or MoodSwings-Plus. Outcomes included mood symptoms, the occurrence of relapse, functionality, Locus of Control, social support, quality of life and medication adherence. Results Participants in both groups showed baseline to endpoint reductions in mood symptoms and improvements in functionality, quality of life and medication adherence. The MoodSwings-Plus group showed a greater number of within-group changes on symptoms and functioning in depression and mania, quality of life and social support, across both poles of the illness. MoodSwings-Plus was superior to MoodSwings in improvement on symptoms of mania scores at 12 months (p=0.02) but not on the incidence of recurrence. Limitations The study did not have an attention control group and therefore could not demonstrate efficacy of the two active arms. There was notable (81%) attrition by 12 months from baseline. Conclusion This study suggests that both CBT and psychoeducation delivered online may have utility in the management of bipolar disorder. They are feasible, readily accepted, and associated with improvement. © 2014 Elsevier B.V. All rights reserved.
- Authors: Lauder, Sue , Chester, Andrea , Castle, David , Dodd, Seetal , Gliddon, Emma , Berk, Lesley , Chamberlain, James , Klein, Britt , Gilbert, Monica , Austin, David , Berk, Michael
- Date: 2014
- Type: Text , Journal article
- Relation: Journal of Affective Disorders Vol. 171, no. (2014), p. 13-21
- Full Text:
- Reviewed:
- Description: Background Adjunctive psychosocial interventions are efficacious in bipolar disorder, but their incorporation into routine management plans are often confounded by cost and access constraints. We report here a comparative evaluation of two online programs hosted on a single website (www.moodswings.net.au). A basic version, called MoodSwings (MS), contains psychoeducation material and asynchronous discussion boards; and a more interactive program, MoodSwings Plus (MS-Plus), combined the basic psychoeducation material and discussion boards with elements of Cognitive Behavioral Therapy. These programs were evaluated in a head-to-head study design. Method Participants with Bipolar I or II disorder (n=156) were randomized to receive either MoodSwings or MoodSwings-Plus. Outcomes included mood symptoms, the occurrence of relapse, functionality, Locus of Control, social support, quality of life and medication adherence. Results Participants in both groups showed baseline to endpoint reductions in mood symptoms and improvements in functionality, quality of life and medication adherence. The MoodSwings-Plus group showed a greater number of within-group changes on symptoms and functioning in depression and mania, quality of life and social support, across both poles of the illness. MoodSwings-Plus was superior to MoodSwings in improvement on symptoms of mania scores at 12 months (p=0.02) but not on the incidence of recurrence. Limitations The study did not have an attention control group and therefore could not demonstrate efficacy of the two active arms. There was notable (81%) attrition by 12 months from baseline. Conclusion This study suggests that both CBT and psychoeducation delivered online may have utility in the management of bipolar disorder. They are feasible, readily accepted, and associated with improvement. © 2014 Elsevier B.V. All rights reserved.
Optimizing prediction of binge eating episodes : A comparison approach to test alternative conceptualizations of the affect regulation model
- Fuller-Tyszkiewicz, Matthew, Richardson, Ben, Skouteris, Helen, Austin, David, Castle, David, Busija, Lucy, Klein, Britt, Holmes, Milllicent, Broadbent, Jaclyn
- Authors: Fuller-Tyszkiewicz, Matthew , Richardson, Ben , Skouteris, Helen , Austin, David , Castle, David , Busija, Lucy , Klein, Britt , Holmes, Milllicent , Broadbent, Jaclyn
- Date: 2014
- Type: Text , Journal article
- Relation: Journal of Eating Disorders Vol. 2, no. 1 (2014), p. 1-8
- Full Text:
- Reviewed:
- Description: Background: Although a wealth of studies have tested the link between negative mood states and likelihood of a subsequent binge eating episode, the assumption that this relationship follows a typical linear dose-response pattern (i.e., that risk of a binge episode increases in proportion to level of negative mood) has not been challenged. The present study demonstrates the applicability of an alternative, non-linear conceptualization of this relationship, in which the strength of association between negative mood and probability of a binge episode increases above a threshold value for the mood variable relative to the slope below this threshold value (threshold dose response model).Methods: A sample of 93 women aged 18 to 40 completed an online survey at random intervals seven times per day for a period of one week. Participants self-reported their current mood state and whether they had recently engaged in an eating episode symptomatic of a binge.Results: As hypothesized, the threshold approach was a better predictor than the linear dose-response modeling of likelihood of a binge episode. The superiority of the threshold approach was found even at low levels of negative mood (3 out of 10, with higher scores reflecting more negative mood). Additionally, severity of negative mood beyond this threshold value appears to be useful for predicting time to onset of a binge episode.Conclusions: Present findings suggest that simple dose-response formulations for the association between negative mood and onset of binge episodes miss vital aspects of this relationship. Most notably, the impact of mood on binge eating appears to depend on whether a threshold value of negative mood has been breached, and elevation in mood beyond this point may be useful for clinicians and researchers to identify time to onset. © 2014 Fuller-Tyszkiewicz et al.; licensee BioMed Central Ltd.
- Authors: Fuller-Tyszkiewicz, Matthew , Richardson, Ben , Skouteris, Helen , Austin, David , Castle, David , Busija, Lucy , Klein, Britt , Holmes, Milllicent , Broadbent, Jaclyn
- Date: 2014
- Type: Text , Journal article
- Relation: Journal of Eating Disorders Vol. 2, no. 1 (2014), p. 1-8
- Full Text:
- Reviewed:
- Description: Background: Although a wealth of studies have tested the link between negative mood states and likelihood of a subsequent binge eating episode, the assumption that this relationship follows a typical linear dose-response pattern (i.e., that risk of a binge episode increases in proportion to level of negative mood) has not been challenged. The present study demonstrates the applicability of an alternative, non-linear conceptualization of this relationship, in which the strength of association between negative mood and probability of a binge episode increases above a threshold value for the mood variable relative to the slope below this threshold value (threshold dose response model).Methods: A sample of 93 women aged 18 to 40 completed an online survey at random intervals seven times per day for a period of one week. Participants self-reported their current mood state and whether they had recently engaged in an eating episode symptomatic of a binge.Results: As hypothesized, the threshold approach was a better predictor than the linear dose-response modeling of likelihood of a binge episode. The superiority of the threshold approach was found even at low levels of negative mood (3 out of 10, with higher scores reflecting more negative mood). Additionally, severity of negative mood beyond this threshold value appears to be useful for predicting time to onset of a binge episode.Conclusions: Present findings suggest that simple dose-response formulations for the association between negative mood and onset of binge episodes miss vital aspects of this relationship. Most notably, the impact of mood on binge eating appears to depend on whether a threshold value of negative mood has been breached, and elevation in mood beyond this point may be useful for clinicians and researchers to identify time to onset. © 2014 Fuller-Tyszkiewicz et al.; licensee BioMed Central Ltd.
Anxiety online-A virtual clinic: Preliminary outcomes following completion of five fully automated treatment programs for anxiety disorders and symptoms
- Klein, Britt, Meyer, Denny, Austin, David, Kyrios, Michael
- Authors: Klein, Britt , Meyer, Denny , Austin, David , Kyrios, Michael
- Date: 2011
- Type: Text , Journal article
- Relation: Journal of Medical Internet Research Vol. 13, no. 4 (2011), p.
- Full Text:
- Reviewed:
- Description: Background: The development of e-mental health interventions to treat or prevent mental illness and to enhance wellbeing has risen rapidly over the past decade. This development assists the public in sidestepping some of the obstacles that are often encountered when trying to access traditional face-to-face mental health care services. Objective: The objective of our study was to investigate the posttreatment effectiveness of five fully automated self-help cognitive behavior e-therapy programs for generalized anxiety disorder (GAD), panic disorder with or without agoraphobia (PD/A), obsessive-compulsive disorder (OCD), posttraumatic stress disorder (PTSD), and social anxiety disorder (SAD) offered to the international public via Anxiety Online, an open-access full-service virtual psychology clinic for anxiety disorders. Methods: We used a naturalistic participant choice, quasi-experimental design to evaluate each of the five Anxiety Online fully automated self-help e-therapy programs. Participants were required to have at least subclinical levels of one of the anxiety disorders to be offered the associated disorder-specific fully automated self-help e-therapy program. These programs are offered free of charge via Anxiety Online. Results: A total of 225 people self-selected one of the five e-therapy programs (GAD, n = 88; SAD, n = 50; PD/A, n = 40; PTSD, n = 30; OCD, n = 17) and completed their 12-week posttreatment assessment. Significant improvements were found on 21/25 measures across the five fully automated self-help programs. At postassessment we observed significant reductions on all five anxiety disorder clinical disorder severity ratings (Cohen d range 0.72-1.22), increased confidence in managing one's own mental health care (Cohen d range 0.70-1.17), and decreases in the total number of clinical diagnoses (except for the PD/A program, where a positive trend was found) (Cohen d range 0.45-1.08). In addition, we found significant improvements in quality of life for the GAD, OCD, PTSD, and SAD e-therapy programs (Cohen d range 0.11-0.96) and significant reductions relating to general psychological distress levels for the GAD, PD/A, and PTSD e-therapy programs (Cohen d range 0.23-1.16). Overall, treatment satisfaction was good across all five e-therapy programs, and posttreatment assessment completers reported using their e-therapy program an average of 395.60 (SD 272.2) minutes over the 12-week treatment period. Conclusions: Overall, all five fully automated self-help e-therapy programs appear to be delivering promising high-quality outcomes; however, the results require replication. © Britt Klein, Denny Meyer, David William Austin, Michael Kyrios.
- Authors: Klein, Britt , Meyer, Denny , Austin, David , Kyrios, Michael
- Date: 2011
- Type: Text , Journal article
- Relation: Journal of Medical Internet Research Vol. 13, no. 4 (2011), p.
- Full Text:
- Reviewed:
- Description: Background: The development of e-mental health interventions to treat or prevent mental illness and to enhance wellbeing has risen rapidly over the past decade. This development assists the public in sidestepping some of the obstacles that are often encountered when trying to access traditional face-to-face mental health care services. Objective: The objective of our study was to investigate the posttreatment effectiveness of five fully automated self-help cognitive behavior e-therapy programs for generalized anxiety disorder (GAD), panic disorder with or without agoraphobia (PD/A), obsessive-compulsive disorder (OCD), posttraumatic stress disorder (PTSD), and social anxiety disorder (SAD) offered to the international public via Anxiety Online, an open-access full-service virtual psychology clinic for anxiety disorders. Methods: We used a naturalistic participant choice, quasi-experimental design to evaluate each of the five Anxiety Online fully automated self-help e-therapy programs. Participants were required to have at least subclinical levels of one of the anxiety disorders to be offered the associated disorder-specific fully automated self-help e-therapy program. These programs are offered free of charge via Anxiety Online. Results: A total of 225 people self-selected one of the five e-therapy programs (GAD, n = 88; SAD, n = 50; PD/A, n = 40; PTSD, n = 30; OCD, n = 17) and completed their 12-week posttreatment assessment. Significant improvements were found on 21/25 measures across the five fully automated self-help programs. At postassessment we observed significant reductions on all five anxiety disorder clinical disorder severity ratings (Cohen d range 0.72-1.22), increased confidence in managing one's own mental health care (Cohen d range 0.70-1.17), and decreases in the total number of clinical diagnoses (except for the PD/A program, where a positive trend was found) (Cohen d range 0.45-1.08). In addition, we found significant improvements in quality of life for the GAD, OCD, PTSD, and SAD e-therapy programs (Cohen d range 0.11-0.96) and significant reductions relating to general psychological distress levels for the GAD, PD/A, and PTSD e-therapy programs (Cohen d range 0.23-1.16). Overall, treatment satisfaction was good across all five e-therapy programs, and posttreatment assessment completers reported using their e-therapy program an average of 395.60 (SD 272.2) minutes over the 12-week treatment period. Conclusions: Overall, all five fully automated self-help e-therapy programs appear to be delivering promising high-quality outcomes; however, the results require replication. © Britt Klein, Denny Meyer, David William Austin, Michael Kyrios.
Therapist-Assisted, Internet-Based Treatment for Panic Disorder: Can General Practitioners achieve comparable patient outcomes to Psychologists?
- Shandley, Kerrie, Austin, David, Klein, Britt, Pier, Ciaran, Schattner, Peter, Pierce, David, Wade, Victoria
- Authors: Shandley, Kerrie , Austin, David , Klein, Britt , Pier, Ciaran , Schattner, Peter , Pierce, David , Wade, Victoria
- Date: 2008
- Type: Text , Journal article
- Relation: Journal of Medical Internet Research Vol. 10, no. 2 (2008), p. 1-15
- Full Text:
- Reviewed:
- Description: Background: Mental illness is an escalating concern worldwide. The management of disorders such as anxiety and depression largely falls to family doctors or general practitioners (GPs). However, GPs are often too time constrained and may lack the necessary training to adequately manage the needs of such patients. Evidence-based Internet interventions represent a potentially valuable resource to reduce the burden of care and the cost of managing mental health disorders within primary care settings and, at the same time, improve patient outcomes. Objective: The present study sought to extend the efficacy of a therapist-assisted Internet treatment program for panic disorder, Panic Online, by determining whether comparable outcomes could be achieved and maintained when Panic Online was supported by either GPs or psychologists. Methods: Via a natural groups design, 96 people with a primary diagnosis of panic disorder (with or without agoraphobia) completed the Panic Online program over 12 weeks with the therapeutic assistance of their GP (n = 53), who had received specialist training in cognitive behavioral therapy, or a clinical psychologist (n = 43). Participants completed a clinical diagnostic telephone interview, conducted by a psychologist, and a set of online questionnaires to assess panic-related symptoms at three time periods (pretreatment, posttreatment, and 6 month follow-up). Results: Both treatments led to clinically significant improvements on measures of panic and panic-related symptomatology from pretreatment to posttreatment. Both groups were shown to significantly improve over time. Improvements for both groups were maintained at follow-up; however, the groups did differ significantly on two quality of life domains: physical (F1,82 = 9.13, P = .00) and environmental (F1,82 = 4.41, P = .04). The attrition rate was significantly higher among those being treated by their GP (χ 2 1 = 4.40, P = .02, N = 96). Conclusions: This study provides evidence that Internet-based interventions are an effective adjunct to existing mental health care systems. Consequently, this may facilitate and enhance the delivery of evidence-based mental health treatments to increasingly large segments of the population via primary care systems and through suitably trained health professionals.
- Description: Background: Mental illness is an escalating concern worldwide. The management of disorders such as anxiety and depression largely falls to family doctors or general practitioners (GPs). However, GPs are often too time constrained and may lack the necessary training to adequately manage the needs of such patients. Evidence-based Internet interventions represent a potentially valuable resource to reduce the burden of care and the cost of managing mental health disorders within primary care settings and, at the same time, improve patient outcomes. Objective: The present study sought to extend the efficacy of a therapist-assisted Internet treatment program for panic disorder, Panic Online, by determining whether comparable outcomes could be achieved and maintained when Panic Online was supported by either GPs or psychologists. Methods: Via a natural groups design, 96 people with a primary diagnosis of panic disorder (with or without agoraphobia) completed the Panic Online program over 12 weeks with the therapeutic assistance of their GP (n = 53), who had received specialist training in cognitive behavioral therapy, or a clinical psychologist (n = 43). Participants completed a clinical diagnostic telephone interview, conducted by a psychologist, and a set of online questionnaires to assess panic-related symptoms at three time periods (pretreatment, posttreatment, and 6 month follow-up). Results: Both treatments led to clinically significant improvements on measures of panic and panic-related symptomatology from pretreatment to posttreatment. Both groups were shown to significantly improve over time. Improvements for both groups were maintained at follow-up; however, the groups did differ significantly on two quality of life domains: physical (F1,82 = 9.13, P = .00) and environmental (F1,82 = 4.41, P = .04). The attrition rate was significantly higher among those being treated by their GP (
- Authors: Shandley, Kerrie , Austin, David , Klein, Britt , Pier, Ciaran , Schattner, Peter , Pierce, David , Wade, Victoria
- Date: 2008
- Type: Text , Journal article
- Relation: Journal of Medical Internet Research Vol. 10, no. 2 (2008), p. 1-15
- Full Text:
- Reviewed:
- Description: Background: Mental illness is an escalating concern worldwide. The management of disorders such as anxiety and depression largely falls to family doctors or general practitioners (GPs). However, GPs are often too time constrained and may lack the necessary training to adequately manage the needs of such patients. Evidence-based Internet interventions represent a potentially valuable resource to reduce the burden of care and the cost of managing mental health disorders within primary care settings and, at the same time, improve patient outcomes. Objective: The present study sought to extend the efficacy of a therapist-assisted Internet treatment program for panic disorder, Panic Online, by determining whether comparable outcomes could be achieved and maintained when Panic Online was supported by either GPs or psychologists. Methods: Via a natural groups design, 96 people with a primary diagnosis of panic disorder (with or without agoraphobia) completed the Panic Online program over 12 weeks with the therapeutic assistance of their GP (n = 53), who had received specialist training in cognitive behavioral therapy, or a clinical psychologist (n = 43). Participants completed a clinical diagnostic telephone interview, conducted by a psychologist, and a set of online questionnaires to assess panic-related symptoms at three time periods (pretreatment, posttreatment, and 6 month follow-up). Results: Both treatments led to clinically significant improvements on measures of panic and panic-related symptomatology from pretreatment to posttreatment. Both groups were shown to significantly improve over time. Improvements for both groups were maintained at follow-up; however, the groups did differ significantly on two quality of life domains: physical (F1,82 = 9.13, P = .00) and environmental (F1,82 = 4.41, P = .04). The attrition rate was significantly higher among those being treated by their GP (χ 2 1 = 4.40, P = .02, N = 96). Conclusions: This study provides evidence that Internet-based interventions are an effective adjunct to existing mental health care systems. Consequently, this may facilitate and enhance the delivery of evidence-based mental health treatments to increasingly large segments of the population via primary care systems and through suitably trained health professionals.
- Description: Background: Mental illness is an escalating concern worldwide. The management of disorders such as anxiety and depression largely falls to family doctors or general practitioners (GPs). However, GPs are often too time constrained and may lack the necessary training to adequately manage the needs of such patients. Evidence-based Internet interventions represent a potentially valuable resource to reduce the burden of care and the cost of managing mental health disorders within primary care settings and, at the same time, improve patient outcomes. Objective: The present study sought to extend the efficacy of a therapist-assisted Internet treatment program for panic disorder, Panic Online, by determining whether comparable outcomes could be achieved and maintained when Panic Online was supported by either GPs or psychologists. Methods: Via a natural groups design, 96 people with a primary diagnosis of panic disorder (with or without agoraphobia) completed the Panic Online program over 12 weeks with the therapeutic assistance of their GP (n = 53), who had received specialist training in cognitive behavioral therapy, or a clinical psychologist (n = 43). Participants completed a clinical diagnostic telephone interview, conducted by a psychologist, and a set of online questionnaires to assess panic-related symptoms at three time periods (pretreatment, posttreatment, and 6 month follow-up). Results: Both treatments led to clinically significant improvements on measures of panic and panic-related symptomatology from pretreatment to posttreatment. Both groups were shown to significantly improve over time. Improvements for both groups were maintained at follow-up; however, the groups did differ significantly on two quality of life domains: physical (F1,82 = 9.13, P = .00) and environmental (F1,82 = 4.41, P = .04). The attrition rate was significantly higher among those being treated by their GP (
- «
- ‹
- 1
- ›
- »