A scalable framework for healthcare monitoring application using the Internet of Medical Things
- Balasubramanian, Venki, Jolfaei, Alireza
- Authors: Balasubramanian, Venki , Jolfaei, Alireza
- Date: 2021
- Type: Text , Journal article
- Relation: Software - Practice and Experience Vol. 51, no. 12 (2021), p. 2457-2468
- Full Text:
- Reviewed:
- Description: Internet of Things (IoT) is finding application in many areas, particularly in health care where an IoT can be effectively used in the form of an Internet of Medical Things (IoMT) to monitor the patients remotely. The quality of life of the patients and health care outcomes can be improved with the deployment of an IoMT because health care professionals can monitor conditions; access the electronic medical records and communicates with each other. This remote monitoring and consultations might reduce the traditional stressful and costly exercise of frequent hospitalization. Also, the rising costs of health care in many developed countries have influenced the introduction of the Healthcare Monitoring Application (HMA) to their existing health care practices. To materialize the HMA concepts for successful deployment for civilian and commercial use with ease, application developers can benefit from a generic, scalable framework that provides significant components for building an HMA. In this chapter, a generic maintainable HMA is advanced by amalgamating the advantages of event-driven and the layered architecture. The proposed framework is used to establish an HMA with an end-to-end Assistive Care Loop Framework (ACLF) to provide a real-time alarm and assistance to monitor pregnant women. © 2020 John Wiley & Sons, Ltd.
- Authors: Balasubramanian, Venki , Jolfaei, Alireza
- Date: 2021
- Type: Text , Journal article
- Relation: Software - Practice and Experience Vol. 51, no. 12 (2021), p. 2457-2468
- Full Text:
- Reviewed:
- Description: Internet of Things (IoT) is finding application in many areas, particularly in health care where an IoT can be effectively used in the form of an Internet of Medical Things (IoMT) to monitor the patients remotely. The quality of life of the patients and health care outcomes can be improved with the deployment of an IoMT because health care professionals can monitor conditions; access the electronic medical records and communicates with each other. This remote monitoring and consultations might reduce the traditional stressful and costly exercise of frequent hospitalization. Also, the rising costs of health care in many developed countries have influenced the introduction of the Healthcare Monitoring Application (HMA) to their existing health care practices. To materialize the HMA concepts for successful deployment for civilian and commercial use with ease, application developers can benefit from a generic, scalable framework that provides significant components for building an HMA. In this chapter, a generic maintainable HMA is advanced by amalgamating the advantages of event-driven and the layered architecture. The proposed framework is used to establish an HMA with an end-to-end Assistive Care Loop Framework (ACLF) to provide a real-time alarm and assistance to monitor pregnant women. © 2020 John Wiley & Sons, Ltd.
Online dispute resolution in mediating EHR disputes : a case study on the impact of emotional intelligence
- Bellucci, Emilia, Venkatraman, Sitalakshmi, Stranieri, Andrew
- Authors: Bellucci, Emilia , Venkatraman, Sitalakshmi , Stranieri, Andrew
- Date: 2020
- Type: Text , Journal article
- Relation: Behaviour and Information Technology Vol. 39, no. 10 (2020), p. 1124-1139
- Full Text:
- Reviewed:
- Description: An Electronic Health Record (EHR) is an individual’s record of all health events that enables critical information to be documented and shared electronically amongst health care providers and patients. The introduction of an EHR, particularly a patient-accessible EHR, can be expected to lead to an escalation of enquiries, complaints and ultimately, disputes. Prevailing opinion is that Online Dispute Resolution (ODR) systems can help with the mediation of certain types of disputes electronically, particularly systems which deploy Artificial Intelligence (AI) to reduce the need for a human mediator. However, disputes regarding health tend to invoke emotional responses from patients that may conceivably impact ODR efficacy. This raises an interesting question on the influence of emotional intelligence (EI) in the process of mediation. Using a phenomenological research methodology simulating doctor–patient disputes mediated with an AI Smart ODR system in place of a human mediator, we found an association between EI and the propensity for a participant to change their previously asserted claims. Our results indicate participants with lower EI tend to prolong resolution compared to those with higher EI. Future research include trialling larger scale ODR systems for specific cohorts of patients in the area of health related dispute resolution are advanced. © 2019 Informa UK Limited, trading as Taylor & Francis Group.
- Authors: Bellucci, Emilia , Venkatraman, Sitalakshmi , Stranieri, Andrew
- Date: 2020
- Type: Text , Journal article
- Relation: Behaviour and Information Technology Vol. 39, no. 10 (2020), p. 1124-1139
- Full Text:
- Reviewed:
- Description: An Electronic Health Record (EHR) is an individual’s record of all health events that enables critical information to be documented and shared electronically amongst health care providers and patients. The introduction of an EHR, particularly a patient-accessible EHR, can be expected to lead to an escalation of enquiries, complaints and ultimately, disputes. Prevailing opinion is that Online Dispute Resolution (ODR) systems can help with the mediation of certain types of disputes electronically, particularly systems which deploy Artificial Intelligence (AI) to reduce the need for a human mediator. However, disputes regarding health tend to invoke emotional responses from patients that may conceivably impact ODR efficacy. This raises an interesting question on the influence of emotional intelligence (EI) in the process of mediation. Using a phenomenological research methodology simulating doctor–patient disputes mediated with an AI Smart ODR system in place of a human mediator, we found an association between EI and the propensity for a participant to change their previously asserted claims. Our results indicate participants with lower EI tend to prolong resolution compared to those with higher EI. Future research include trialling larger scale ODR systems for specific cohorts of patients in the area of health related dispute resolution are advanced. © 2019 Informa UK Limited, trading as Taylor & Francis Group.
Collecting health and exposure data in Australian olympic combat sports : Feasibility study utilizing an electronic system
- Bromley, Sally, Drew, Michael, Talpey, Scott, McIntosh, Andrew, Finch, Caroline
- Authors: Bromley, Sally , Drew, Michael , Talpey, Scott , McIntosh, Andrew , Finch, Caroline
- Date: 2018
- Type: Text , Journal article
- Relation: Journal of Medical Internet Research Vol. 20, no. 10 (2018), p. 1-11
- Full Text:
- Reviewed:
- Description: Background: Electronic methods are increasingly being used to manage health-related data among sporting populations. Collection of such data permits the analysis of injury and illness trends, improves early detection of injuries and illnesses, collectively referred to as health problems, and provides evidence to inform prevention strategies. The Athlete Management System (AMS) has been employed across a range of sports to monitor health. Australian combat athletes train across the country without dedicated national medical or sports science teams to monitor and advocate for their health. Employing a Web-based system, such as the AMS, May provide an avenue to increase the visibility of health problems experienced by combat athletes and deliver key information to stakeholders detailing where prevention programs May be targeted. Objective: The objectives of this paper are to (1) report on the feasibility of utilizing the AMS to collect longitudinal injury and illness data of combat sports athletes and (2) describe the type, location, severity, and recurrence of injuries and illnesses that the cohort of athletes experience across a 12-week period. Methods: We invited 26 elite and developing athletes from 4 Olympic combat sports (boxing, judo, taekwondo, and wrestling) to participate in this study. Engagement with the AMS was measured, and collected health problems (injuries or illnesses) were coded using the Orchard Sports Injury Classification System (version 10.1) and International Classification of Primary Care (version 2). Results: Despite >160 contacts, athlete engagement with online tools was poor, with only 13% compliance across the 12-week period. No taekwondo or wrestling athletes were compliant. Despite low overall engagement, a large number of injuries or illness were recorded across 11 athletes who entered data—22 unique injuries, 8 unique illnesses, 30 recurrent injuries, and 2 recurrent illnesses. The most frequent injuries were to the knee in boxing (n=41) and thigh in judo (n=9). In this cohort, judo players experienced more severe, but less frequent, injuries than boxers, yet judo players sustained more illnesses than boxers. In 97.0% (126/130) of cases, athletes in this cohort continued to train irrespective of their health problems. Conclusions: Among athletes who reported injuries, many reported multiple conditions, indicating a need for health monitoring in Australian combat sports. A number of factors May have influenced engagement with the AMS, including access to the internet, the design of the system, coach views on the system, previous experiences with the system, and the existing culture within Australian combat sports. To increase engagement, there May be a requirement for sports staff to provide relevant feedback on data entered into the system. Until the Barriers are addressed, it is not feasible to implement the system in its current form across a larger cohort of combat athletes.
- Authors: Bromley, Sally , Drew, Michael , Talpey, Scott , McIntosh, Andrew , Finch, Caroline
- Date: 2018
- Type: Text , Journal article
- Relation: Journal of Medical Internet Research Vol. 20, no. 10 (2018), p. 1-11
- Full Text:
- Reviewed:
- Description: Background: Electronic methods are increasingly being used to manage health-related data among sporting populations. Collection of such data permits the analysis of injury and illness trends, improves early detection of injuries and illnesses, collectively referred to as health problems, and provides evidence to inform prevention strategies. The Athlete Management System (AMS) has been employed across a range of sports to monitor health. Australian combat athletes train across the country without dedicated national medical or sports science teams to monitor and advocate for their health. Employing a Web-based system, such as the AMS, May provide an avenue to increase the visibility of health problems experienced by combat athletes and deliver key information to stakeholders detailing where prevention programs May be targeted. Objective: The objectives of this paper are to (1) report on the feasibility of utilizing the AMS to collect longitudinal injury and illness data of combat sports athletes and (2) describe the type, location, severity, and recurrence of injuries and illnesses that the cohort of athletes experience across a 12-week period. Methods: We invited 26 elite and developing athletes from 4 Olympic combat sports (boxing, judo, taekwondo, and wrestling) to participate in this study. Engagement with the AMS was measured, and collected health problems (injuries or illnesses) were coded using the Orchard Sports Injury Classification System (version 10.1) and International Classification of Primary Care (version 2). Results: Despite >160 contacts, athlete engagement with online tools was poor, with only 13% compliance across the 12-week period. No taekwondo or wrestling athletes were compliant. Despite low overall engagement, a large number of injuries or illness were recorded across 11 athletes who entered data—22 unique injuries, 8 unique illnesses, 30 recurrent injuries, and 2 recurrent illnesses. The most frequent injuries were to the knee in boxing (n=41) and thigh in judo (n=9). In this cohort, judo players experienced more severe, but less frequent, injuries than boxers, yet judo players sustained more illnesses than boxers. In 97.0% (126/130) of cases, athletes in this cohort continued to train irrespective of their health problems. Conclusions: Among athletes who reported injuries, many reported multiple conditions, indicating a need for health monitoring in Australian combat sports. A number of factors May have influenced engagement with the AMS, including access to the internet, the design of the system, coach views on the system, previous experiences with the system, and the existing culture within Australian combat sports. To increase engagement, there May be a requirement for sports staff to provide relevant feedback on data entered into the system. Until the Barriers are addressed, it is not feasible to implement the system in its current form across a larger cohort of combat athletes.
Internet Gaming Disorder : The interplay between physical activity and user–avatar relationship
- Liew, Lucas, Stavropoulos, Vasileios, Adams, Baxter, Burleigh, Tyrone, Griffiths, Mark
- Authors: Liew, Lucas , Stavropoulos, Vasileios , Adams, Baxter , Burleigh, Tyrone , Griffiths, Mark
- Date: 2018
- Type: Text , Journal article
- Relation: Behaviour and Information Technology Vol. 37, no. 6 (2018), p. 558-574
- Full Text:
- Reviewed:
- Description: Understanding both the risk and protective factors associated with Internet Gaming Disorder (IGD) has been viewed by many in the gaming studies field as an area of research priority. The present study focused on the potential risk and protective effects of user–avatar (game figure) relationship and physical activity (PA), respectively. To address these aims, a cross-sectional and a longitudinal mixed-methods design were combined (comprising both psychological and physiological assessments). A sample of 121 emerging adult gamers (18–29 years) residing in Australia, who played massively multiplayer online games, were assessed in relation to their IGD behaviours using the nine-item Internet Gaming Disorder Scale–Short Form. Additionally, the Proto-Self-Presence (PSP) scale was used to evaluate the extent to which gamers identified with the body of their avatar. Finally, a PA monitor (Fitbit Flex) measured levels of energy consumed during real-world daily activities (active minutes). A number of linear regressions and moderation analyses were conducted. Findings confirmed that PSP functioned as an IGD risk factor and that PA acted protectively, weakening the association between PSP and IGD behaviours. Implications of these findings are discussed in relation to IGD treatment and gaming development aspects.
- Authors: Liew, Lucas , Stavropoulos, Vasileios , Adams, Baxter , Burleigh, Tyrone , Griffiths, Mark
- Date: 2018
- Type: Text , Journal article
- Relation: Behaviour and Information Technology Vol. 37, no. 6 (2018), p. 558-574
- Full Text:
- Reviewed:
- Description: Understanding both the risk and protective factors associated with Internet Gaming Disorder (IGD) has been viewed by many in the gaming studies field as an area of research priority. The present study focused on the potential risk and protective effects of user–avatar (game figure) relationship and physical activity (PA), respectively. To address these aims, a cross-sectional and a longitudinal mixed-methods design were combined (comprising both psychological and physiological assessments). A sample of 121 emerging adult gamers (18–29 years) residing in Australia, who played massively multiplayer online games, were assessed in relation to their IGD behaviours using the nine-item Internet Gaming Disorder Scale–Short Form. Additionally, the Proto-Self-Presence (PSP) scale was used to evaluate the extent to which gamers identified with the body of their avatar. Finally, a PA monitor (Fitbit Flex) measured levels of energy consumed during real-world daily activities (active minutes). A number of linear regressions and moderation analyses were conducted. Findings confirmed that PSP functioned as an IGD risk factor and that PA acted protectively, weakening the association between PSP and IGD behaviours. Implications of these findings are discussed in relation to IGD treatment and gaming development aspects.
Non-functional regression : A new challenge for neural networks
- Vamplew, Peter, Dazeley, Richard, Foale, Cameron, Choudhury, Tanveer
- Authors: Vamplew, Peter , Dazeley, Richard , Foale, Cameron , Choudhury, Tanveer
- Date: 2018
- Type: Text , Journal article
- Relation: Neurocomputing Vol. 314, no. (2018), p. 326-335
- Full Text:
- Reviewed:
- Description: This work identifies an important, previously unaddressed issue for regression based on neural networks – learning to accurately approximate problems where the output is not a function of the input (i.e. where the number of outputs required varies across input space). Such non-functional regression problems arise in a number of applications, and can not be adequately handled by existing neural network algorithms. To demonstrate the benefits possible from directly addressing non-functional regression, this paper proposes the first neural algorithm to do so – an extension of the Resource Allocating Network (RAN) which adds additional output neurons to the network structure during training. This new algorithm, called the Resource Allocating Network with Varying Output Cardinality (RANVOC), is demonstrated to be capable of learning to perform non-functional regression, on both artificially constructed data and also on the real-world task of specifying parameter settings for a plasma-spray process. Importantly RANVOC is shown to outperform not just the original RAN algorithm, but also the best possible error rates achievable by any functional form of regression.
- Authors: Vamplew, Peter , Dazeley, Richard , Foale, Cameron , Choudhury, Tanveer
- Date: 2018
- Type: Text , Journal article
- Relation: Neurocomputing Vol. 314, no. (2018), p. 326-335
- Full Text:
- Reviewed:
- Description: This work identifies an important, previously unaddressed issue for regression based on neural networks – learning to accurately approximate problems where the output is not a function of the input (i.e. where the number of outputs required varies across input space). Such non-functional regression problems arise in a number of applications, and can not be adequately handled by existing neural network algorithms. To demonstrate the benefits possible from directly addressing non-functional regression, this paper proposes the first neural algorithm to do so – an extension of the Resource Allocating Network (RAN) which adds additional output neurons to the network structure during training. This new algorithm, called the Resource Allocating Network with Varying Output Cardinality (RANVOC), is demonstrated to be capable of learning to perform non-functional regression, on both artificially constructed data and also on the real-world task of specifying parameter settings for a plasma-spray process. Importantly RANVOC is shown to outperform not just the original RAN algorithm, but also the best possible error rates achievable by any functional form of regression.
A multilevel longitudinal study of experiencing virtual presence in adolescence : The role of anxiety and openness to experience in the classroom
- Stavropoulos, Vasileios, Wilson, Peter, Kuss, Daria, Griffiths, Mark, Gentile, Douglas
- Authors: Stavropoulos, Vasileios , Wilson, Peter , Kuss, Daria , Griffiths, Mark , Gentile, Douglas
- Date: 2017
- Type: Text , Journal article
- Relation: Behaviour & Information Technology Vol. 36, no. 5 (2017), p. 524-539
- Full Text:
- Reviewed:
- Description: Presence describes the feeling of reality and immersion that users of virtual/Internet environments have. Importantly, it has been suggested that there are individual and contextual differences regarding susceptibility to presence. These aspects of presence have been linked to both beneficial and disadvantageous uses of the Internet, such as online therapeutic applications and addictive Internet behaviours. In the present study, presence was studied in relation to individual anxiety symptoms and classroom-level openness to experience (OTE) using a normative sample of 648 adolescents aged between 16 and 18 years. Presence was assessed with the Presence II questionnaire, anxiety symptoms with the relevant subscales of the SCL-90-R, and OTE with the Five-Factor Questionnaire. A three-level hierarchical linear model was calculated. Results showed that experiencing presence in virtual environments dropped between the ages of 16 and 18 years. Additionally, although anxiety symptoms were associated with higher presence at 16 years, this association decreased with age. Results also demonstrated that adolescents in classrooms higher on OTE reported reduced level of experiencing presence. The practical and theoretical implications of these findings are discussed.
- Authors: Stavropoulos, Vasileios , Wilson, Peter , Kuss, Daria , Griffiths, Mark , Gentile, Douglas
- Date: 2017
- Type: Text , Journal article
- Relation: Behaviour & Information Technology Vol. 36, no. 5 (2017), p. 524-539
- Full Text:
- Reviewed:
- Description: Presence describes the feeling of reality and immersion that users of virtual/Internet environments have. Importantly, it has been suggested that there are individual and contextual differences regarding susceptibility to presence. These aspects of presence have been linked to both beneficial and disadvantageous uses of the Internet, such as online therapeutic applications and addictive Internet behaviours. In the present study, presence was studied in relation to individual anxiety symptoms and classroom-level openness to experience (OTE) using a normative sample of 648 adolescents aged between 16 and 18 years. Presence was assessed with the Presence II questionnaire, anxiety symptoms with the relevant subscales of the SCL-90-R, and OTE with the Five-Factor Questionnaire. A three-level hierarchical linear model was calculated. Results showed that experiencing presence in virtual environments dropped between the ages of 16 and 18 years. Additionally, although anxiety symptoms were associated with higher presence at 16 years, this association decreased with age. Results also demonstrated that adolescents in classrooms higher on OTE reported reduced level of experiencing presence. The practical and theoretical implications of these findings are discussed.
Adaptive weighted non-parametric background model for efficient video coding
- Chakraborty, Subrata, Paul, Manoranjan, Murshed, Manzur, Ali, Mortuza
- Authors: Chakraborty, Subrata , Paul, Manoranjan , Murshed, Manzur , Ali, Mortuza
- Date: 2017
- Type: Text , Journal article
- Relation: Neurocomputing Vol. 226, no. (2017), p. 35-45
- Full Text:
- Reviewed:
- Description: Dynamic background frame based video coding using mixture of Gaussian (MoG) based background modelling has achieved better rate distortion performance compared to the H.264 standard. However, they suffer from high computation time, low coding efficiency for dynamic videos, and prior knowledge requirement of video content. In this paper, we introduce the application of the non-parametric (NP) background modelling approach for video coding domain. We present a novel background modelling technique, called weighted non-parametric (WNP) which balances the historical trend and the recent value of the pixel intensities adaptively based on the content and characteristics of any particular video. WNP is successfully embedded into the latest HEVC video coding standard for better rate-distortion performance. Moreover, a novel scene adaptive non-parametric (SANP) technique is also developed to handle video sequences with high dynamic background. Being non-parametric, the proposed techniques naturally exhibit superior performance in dynamic background modelling without a priori knowledge of video data distribution.
- Authors: Chakraborty, Subrata , Paul, Manoranjan , Murshed, Manzur , Ali, Mortuza
- Date: 2017
- Type: Text , Journal article
- Relation: Neurocomputing Vol. 226, no. (2017), p. 35-45
- Full Text:
- Reviewed:
- Description: Dynamic background frame based video coding using mixture of Gaussian (MoG) based background modelling has achieved better rate distortion performance compared to the H.264 standard. However, they suffer from high computation time, low coding efficiency for dynamic videos, and prior knowledge requirement of video content. In this paper, we introduce the application of the non-parametric (NP) background modelling approach for video coding domain. We present a novel background modelling technique, called weighted non-parametric (WNP) which balances the historical trend and the recent value of the pixel intensities adaptively based on the content and characteristics of any particular video. WNP is successfully embedded into the latest HEVC video coding standard for better rate-distortion performance. Moreover, a novel scene adaptive non-parametric (SANP) technique is also developed to handle video sequences with high dynamic background. Being non-parametric, the proposed techniques naturally exhibit superior performance in dynamic background modelling without a priori knowledge of video data distribution.
Softmax exploration strategies for multiobjective reinforcement learning
- Vamplew, Peter, Dazeley, Richard, Foale, Cameron
- Authors: Vamplew, Peter , Dazeley, Richard , Foale, Cameron
- Date: 2017
- Type: Text , Journal article
- Relation: Neurocomputing Vol. 263, no. (2017), p. 74-86
- Full Text:
- Reviewed:
- Description: Despite growing interest over recent years in applying reinforcement learning to multiobjective problems, there has been little research into the applicability and effectiveness of exploration strategies within the multiobjective context. This work considers several widely-used approaches to exploration from the single-objective reinforcement learning literature, and examines their incorporation into multiobjective Q-learning. In particular this paper proposes two novel approaches which extend the softmax operator to work with vector-valued rewards. The performance of these exploration strategies is evaluated across a set of benchmark environments. Issues arising from the multiobjective formulation of these benchmarks which impact on the performance of the exploration strategies are identified. It is shown that of the techniques considered, the combination of the novel softmax–epsilon exploration with optimistic initialisation provides the most effective trade-off between exploration and exploitation.
- Authors: Vamplew, Peter , Dazeley, Richard , Foale, Cameron
- Date: 2017
- Type: Text , Journal article
- Relation: Neurocomputing Vol. 263, no. (2017), p. 74-86
- Full Text:
- Reviewed:
- Description: Despite growing interest over recent years in applying reinforcement learning to multiobjective problems, there has been little research into the applicability and effectiveness of exploration strategies within the multiobjective context. This work considers several widely-used approaches to exploration from the single-objective reinforcement learning literature, and examines their incorporation into multiobjective Q-learning. In particular this paper proposes two novel approaches which extend the softmax operator to work with vector-valued rewards. The performance of these exploration strategies is evaluated across a set of benchmark environments. Issues arising from the multiobjective formulation of these benchmarks which impact on the performance of the exploration strategies are identified. It is shown that of the techniques considered, the combination of the novel softmax–epsilon exploration with optimistic initialisation provides the most effective trade-off between exploration and exploitation.
Steering approaches to Pareto-optimal multiobjective reinforcement learning
- Vamplew, Peter, Issabekov, Rustam, Dazeley, Richard, Foale, Cameron, Berry, Adam, Moore, Tim, Creighton, Douglas
- Authors: Vamplew, Peter , Issabekov, Rustam , Dazeley, Richard , Foale, Cameron , Berry, Adam , Moore, Tim , Creighton, Douglas
- Date: 2017
- Type: Text , Journal article
- Relation: Neurocomputing Vol. 263, no. (2017), p. 26-38
- Full Text:
- Reviewed:
- Description: For reinforcement learning tasks with multiple objectives, it may be advantageous to learn stochastic or non-stationary policies. This paper investigates two novel algorithms for learning non-stationary policies which produce Pareto-optimal behaviour (w-steering and Q-steering), by extending prior work based on the concept of geometric steering. Empirical results demonstrate that both new algorithms offer substantial performance improvements over stationary deterministic policies, while Q-steering significantly outperforms w-steering when the agent has no information about recurrent states within the environment. It is further demonstrated that Q-steering can be used interactively by providing a human decision-maker with a visualisation of the Pareto front and allowing them to adjust the agent’s target point during learning. To demonstrate broader applicability, the use of Q-steering in combination with function approximation is also illustrated on a task involving control of local battery storage for a residential solar power system.
- Authors: Vamplew, Peter , Issabekov, Rustam , Dazeley, Richard , Foale, Cameron , Berry, Adam , Moore, Tim , Creighton, Douglas
- Date: 2017
- Type: Text , Journal article
- Relation: Neurocomputing Vol. 263, no. (2017), p. 26-38
- Full Text:
- Reviewed:
- Description: For reinforcement learning tasks with multiple objectives, it may be advantageous to learn stochastic or non-stationary policies. This paper investigates two novel algorithms for learning non-stationary policies which produce Pareto-optimal behaviour (w-steering and Q-steering), by extending prior work based on the concept of geometric steering. Empirical results demonstrate that both new algorithms offer substantial performance improvements over stationary deterministic policies, while Q-steering significantly outperforms w-steering when the agent has no information about recurrent states within the environment. It is further demonstrated that Q-steering can be used interactively by providing a human decision-maker with a visualisation of the Pareto front and allowing them to adjust the agent’s target point during learning. To demonstrate broader applicability, the use of Q-steering in combination with function approximation is also illustrated on a task involving control of local battery storage for a residential solar power system.
Discrete state transition algorithm for unconstrained integer optimization problems
- Zhou, Xiaojun, Gao, David, Yang, Chunhua, Gui, Weihua
- Authors: Zhou, Xiaojun , Gao, David , Yang, Chunhua , Gui, Weihua
- Date: 2016
- Type: Text , Journal article
- Relation: Neurocomputing Vol. 173, no. (2016), p. 864-874
- Full Text:
- Reviewed:
- Description: A recently new intelligent optimization algorithm called discrete state transition algorithm is considered in this study, for solving unconstrained integer optimization problems. Firstly, some key elements for discrete state transition algorithm are summarized to guide its well development. Several intelligent operators are designed for local exploitation and global exploration. Then, a dynamic adjustment strategy "risk and restoration in probability" is proposed to capture global solutions with high probability. Finally, numerical experiments are carried out to test the performance of the proposed algorithm compared with other heuristics, and they show that the similar intelligent operators can be applied to ranging from traveling salesman problem, boolean integer programming, to discrete value selection problem, which indicates the adaptability and flexibility of the proposed intelligent elements. (C) 2015 Elsevier B.V. All rights reserved.
- Authors: Zhou, Xiaojun , Gao, David , Yang, Chunhua , Gui, Weihua
- Date: 2016
- Type: Text , Journal article
- Relation: Neurocomputing Vol. 173, no. (2016), p. 864-874
- Full Text:
- Reviewed:
- Description: A recently new intelligent optimization algorithm called discrete state transition algorithm is considered in this study, for solving unconstrained integer optimization problems. Firstly, some key elements for discrete state transition algorithm are summarized to guide its well development. Several intelligent operators are designed for local exploitation and global exploration. Then, a dynamic adjustment strategy "risk and restoration in probability" is proposed to capture global solutions with high probability. Finally, numerical experiments are carried out to test the performance of the proposed algorithm compared with other heuristics, and they show that the similar intelligent operators can be applied to ranging from traveling salesman problem, boolean integer programming, to discrete value selection problem, which indicates the adaptability and flexibility of the proposed intelligent elements. (C) 2015 Elsevier B.V. All rights reserved.
The diagnostic validity and reliability of an internet-based clinical assessment program for mental disorders
- Nguyen, David, Klein, Britt, Meyer, Denny, Austin, David, Abbott, Jo-Anne
- Authors: Nguyen, David , Klein, Britt , Meyer, Denny , Austin, David , Abbott, Jo-Anne
- Date: 2015
- Type: Text , Journal article
- Relation: Journal of Medical Internet Research Vol. 17, no. 9 (2015), p.
- Full Text:
- Reviewed:
- Description: Background: Internet-based assessment has the potential to assist with the diagnosis of mental health disorders and overcome the barriers associated with traditional services (eg, cost, stigma, distance). Further to existing online screening programs available, there is an opportunity to deliver more comprehensive and accurate diagnostic tools to supplement the assessment and treatment of mental health disorders. Objective: The aim was to evaluate the diagnostic criterion validity and test-retest reliability of the electronic Psychological Assessment System (e-PASS), an online, self-report, multidisorder, clinical assessment and referral system. Methods: Participants were 616 adults residing in Australia, recruited online, and representing prospective e-PASS users. Following e-PASS completion, 158 participants underwent a telephone-administered structured clinical interview and 39 participants repeated the e-PASS within 25 days of initial completion. Results: With structured clinical interview results serving as the gold standard, diagnostic agreement with the e-PASS varied considerably from fair (eg, generalized anxiety disorder:kappa=.37) to strong (eg, panic disorder:kappa=.62). Although the e-PASS' sensitivity also varied (0.43-0.86) the specificity was generally high (0.68-1.00). The e-PASS sensitivity generally improved when reducing the e-PASS threshold to a subclinical result. Test-retest reliability ranged from moderate (eg, specific phobia:kappa=.54) to substantial (eg, bulimia nervosa:kappa=.87). Conclusions: The e-PASS produces reliable diagnostic results and performs generally well in excluding mental disorders, although at the expense of sensitivity. For screening purposes, the e-PASS subclinical result generally appears better than a clinical result as a diagnostic indicator. Further development and evaluation is needed to support the use of online diagnostic assessment programs for mental disorders.
- Authors: Nguyen, David , Klein, Britt , Meyer, Denny , Austin, David , Abbott, Jo-Anne
- Date: 2015
- Type: Text , Journal article
- Relation: Journal of Medical Internet Research Vol. 17, no. 9 (2015), p.
- Full Text:
- Reviewed:
- Description: Background: Internet-based assessment has the potential to assist with the diagnosis of mental health disorders and overcome the barriers associated with traditional services (eg, cost, stigma, distance). Further to existing online screening programs available, there is an opportunity to deliver more comprehensive and accurate diagnostic tools to supplement the assessment and treatment of mental health disorders. Objective: The aim was to evaluate the diagnostic criterion validity and test-retest reliability of the electronic Psychological Assessment System (e-PASS), an online, self-report, multidisorder, clinical assessment and referral system. Methods: Participants were 616 adults residing in Australia, recruited online, and representing prospective e-PASS users. Following e-PASS completion, 158 participants underwent a telephone-administered structured clinical interview and 39 participants repeated the e-PASS within 25 days of initial completion. Results: With structured clinical interview results serving as the gold standard, diagnostic agreement with the e-PASS varied considerably from fair (eg, generalized anxiety disorder:kappa=.37) to strong (eg, panic disorder:kappa=.62). Although the e-PASS' sensitivity also varied (0.43-0.86) the specificity was generally high (0.68-1.00). The e-PASS sensitivity generally improved when reducing the e-PASS threshold to a subclinical result. Test-retest reliability ranged from moderate (eg, specific phobia:kappa=.54) to substantial (eg, bulimia nervosa:kappa=.87). Conclusions: The e-PASS produces reliable diagnostic results and performs generally well in excluding mental disorders, although at the expense of sensitivity. For screening purposes, the e-PASS subclinical result generally appears better than a clinical result as a diagnostic indicator. Further development and evaluation is needed to support the use of online diagnostic assessment programs for mental disorders.
Comorbidity structure of psychological disorders in the online e-PASS data as predictors of psychosocial adjustment measures: psychological distress, adequate social support, self-confidence, quality of life, and suicidal ideation
- Al-Asadi, Ali, Klein, Britt, Meyer, Denny
- Authors: Al-Asadi, Ali , Klein, Britt , Meyer, Denny
- Date: 2014
- Type: Text , Journal article
- Relation: Journal of Medical Internet Research Vol. 16, no. 10 (2014), p. e248
- Full Text:
- Reviewed:
- Description: BACKGROUND: A relative newcomer to the field of psychology, e-mental health has been gaining momentum and has been given considerable research attention. Although several aspects of e-mental health have been studied, 1 aspect has yet to receive attention: the structure of comorbidity of psychological disorders and their relationships with measures of psychosocial adjustment including suicidal ideation in online samples. OBJECTIVE: This exploratory study attempted to identify the structure of comorbidity of 21 psychological disorders assessed by an automated online electronic psychological assessment screening system (e-PASS). The resulting comorbidity factor scores were then used to assess the association between comorbidity factor scores and measures of psychosocial adjustments (ie, psychological distress, suicidal ideation, adequate social support, self-confidence in dealing with mental health issues, and quality of life). METHODS: A total of 13,414 participants were assessed using a complex online algorithm that resulted in primary and secondary Diagnostic and Statistical Manual of Mental Disorders (Fourth Edition, Text Revision) diagnoses for 21 psychological disorders on dimensional severity scales. The scores on these severity scales were used in a principal component analysis (PCA) and the resulting comorbidity factor scores were related to 4 measures of psychosocial adjustments. RESULTS: A PCA based on 17 of the 21 psychological disorders resulted in a 4-factor model of comorbidity: anxiety-depression consisting of all anxiety disorders, major depressive episode (MDE), and insomnia; substance abuse consisting of alcohol and drug abuse and dependency; body image-eating consisting of eating disorders, body dysmorphic disorder, and obsessive-compulsive disorders; depression-sleep problems consisting of MDE, insomnia, and hypersomnia. All comorbidity factor scores were significantly associated with psychosocial measures of adjustment (P<.001). They were positively related to psychological distress and suicidal ideation, but negatively related to adequate social support, self-confidence, and quality of life. CONCLUSIONS: This exploratory study identified 4 comorbidity factors in the e-PASS data and these factor scores significantly predicted 5 psychosocial adjustment measures. TRIAL REGISTRATION: Australian and New Zealand Clinical Trials Registry ACTRN121611000704998; http://www.anzctr.org.au/trial_view.aspx?ID=336143 (Archived by WebCite at http://www.webcitation.org/618r3wvOG).
- Authors: Al-Asadi, Ali , Klein, Britt , Meyer, Denny
- Date: 2014
- Type: Text , Journal article
- Relation: Journal of Medical Internet Research Vol. 16, no. 10 (2014), p. e248
- Full Text:
- Reviewed:
- Description: BACKGROUND: A relative newcomer to the field of psychology, e-mental health has been gaining momentum and has been given considerable research attention. Although several aspects of e-mental health have been studied, 1 aspect has yet to receive attention: the structure of comorbidity of psychological disorders and their relationships with measures of psychosocial adjustment including suicidal ideation in online samples. OBJECTIVE: This exploratory study attempted to identify the structure of comorbidity of 21 psychological disorders assessed by an automated online electronic psychological assessment screening system (e-PASS). The resulting comorbidity factor scores were then used to assess the association between comorbidity factor scores and measures of psychosocial adjustments (ie, psychological distress, suicidal ideation, adequate social support, self-confidence in dealing with mental health issues, and quality of life). METHODS: A total of 13,414 participants were assessed using a complex online algorithm that resulted in primary and secondary Diagnostic and Statistical Manual of Mental Disorders (Fourth Edition, Text Revision) diagnoses for 21 psychological disorders on dimensional severity scales. The scores on these severity scales were used in a principal component analysis (PCA) and the resulting comorbidity factor scores were related to 4 measures of psychosocial adjustments. RESULTS: A PCA based on 17 of the 21 psychological disorders resulted in a 4-factor model of comorbidity: anxiety-depression consisting of all anxiety disorders, major depressive episode (MDE), and insomnia; substance abuse consisting of alcohol and drug abuse and dependency; body image-eating consisting of eating disorders, body dysmorphic disorder, and obsessive-compulsive disorders; depression-sleep problems consisting of MDE, insomnia, and hypersomnia. All comorbidity factor scores were significantly associated with psychosocial measures of adjustment (P<.001). They were positively related to psychological distress and suicidal ideation, but negatively related to adequate social support, self-confidence, and quality of life. CONCLUSIONS: This exploratory study identified 4 comorbidity factors in the e-PASS data and these factor scores significantly predicted 5 psychosocial adjustment measures. TRIAL REGISTRATION: Australian and New Zealand Clinical Trials Registry ACTRN121611000704998; http://www.anzctr.org.au/trial_view.aspx?ID=336143 (Archived by WebCite at http://www.webcitation.org/618r3wvOG).
Posttreatment attrition and its predictors, attrition bias, and treatment efficacy of the anxiety online programs
- Al-Asadi, Ali, Klein, Britt, Meyer, Denny
- Authors: Al-Asadi, Ali , Klein, Britt , Meyer, Denny
- Date: 2014
- Type: Text , Journal article
- Relation: Journal of Medical Internet Research Vol. 16, no. 10 (2014), p. e232
- Full Text:
- Reviewed:
- Description: Background: Although relatively new, the field of e-mental health is becoming more popular with more attention given to researching its various aspects. However, there are many areas that still need further research, especially identifying attrition predictors at various phases of assessment and treatment delivery. Objective: The present study identified the predictors of posttreatment assessment completers based on 24 pre- and posttreatment demographic and personal variables and 1 treatment variable, their impact on attrition bias, and the efficacy of the 5 fully automated self-help anxiety treatment programs for generalized anxiety disorder (GAD), social anxiety disorder (SAD), panic disorder with or without agoraphobia (PD/A), obsessive-compulsive disorder (OCD), and posttraumatic stress disorder (PTSD). Methods: A complex algorithm was used to diagnose participants' mental disorders based on the criteria of the Diagnostic and Statistical Manual of Mental Disorders (Fourth Edition, Text Revision; DSM-IV-TR). Those who received a primary or secondary diagnosis of 1 of 5 anxiety disorders were offered an online 12-week disorder-specific treatment program. A total of 3199 individuals did not formally drop out of the 12-week treatment cycle, whereas 142 individuals formally dropped out. However, only 347 participants who completed their treatment cycle also completed the posttreatment assessment measures. Based on these measures, predictors of attrition were identified and attrition bias was examined. The efficacy of the 5 treatment programs was assessed based on anxiety-specific severity scores and 5 additional treatment outcome measures. Results: On average, completers of posttreatment assessment measures were more likely to be seeking self-help online programs; have heard about the program from traditional media or from family and friends; were receiving mental health assistance; were more likely to learn best by reading, hearing and doing; had a lower pretreatment Kessler-6 total score; and were older in age. Predicted probabilities resulting from these attrition variables displayed no significant attrition bias using Heckman's method and thus allowing for the use of completer analysis. Six treatment outcome measures (Kessler-6 total score, number of diagnosed disorders, self-confidence in managing mental health issues, quality of life, and the corresponding pre- and posttreatment severity for each program-specific anxiety disorder and for major depressive episode) were used to assess the efficacy of the 5 anxiety treatment programs. Repeated measures MANOVA revealed a significant multivariate time effect for all treatment outcome measures for each treatment program. Follow-up repeated measures ANOVAs revealed significant improvements on all 6 treatment outcome measures for GAD and PTSD, 5 treatment outcome measures were significant for SAD and PD/A, and 4 treatment outcome measures were significant for OCD. Conclusions: Results identified predictors of posttreatment assessment completers and provided further support for the efficacy of self-help online treatment programs for the 5 anxiety disorders
- Authors: Al-Asadi, Ali , Klein, Britt , Meyer, Denny
- Date: 2014
- Type: Text , Journal article
- Relation: Journal of Medical Internet Research Vol. 16, no. 10 (2014), p. e232
- Full Text:
- Reviewed:
- Description: Background: Although relatively new, the field of e-mental health is becoming more popular with more attention given to researching its various aspects. However, there are many areas that still need further research, especially identifying attrition predictors at various phases of assessment and treatment delivery. Objective: The present study identified the predictors of posttreatment assessment completers based on 24 pre- and posttreatment demographic and personal variables and 1 treatment variable, their impact on attrition bias, and the efficacy of the 5 fully automated self-help anxiety treatment programs for generalized anxiety disorder (GAD), social anxiety disorder (SAD), panic disorder with or without agoraphobia (PD/A), obsessive-compulsive disorder (OCD), and posttraumatic stress disorder (PTSD). Methods: A complex algorithm was used to diagnose participants' mental disorders based on the criteria of the Diagnostic and Statistical Manual of Mental Disorders (Fourth Edition, Text Revision; DSM-IV-TR). Those who received a primary or secondary diagnosis of 1 of 5 anxiety disorders were offered an online 12-week disorder-specific treatment program. A total of 3199 individuals did not formally drop out of the 12-week treatment cycle, whereas 142 individuals formally dropped out. However, only 347 participants who completed their treatment cycle also completed the posttreatment assessment measures. Based on these measures, predictors of attrition were identified and attrition bias was examined. The efficacy of the 5 treatment programs was assessed based on anxiety-specific severity scores and 5 additional treatment outcome measures. Results: On average, completers of posttreatment assessment measures were more likely to be seeking self-help online programs; have heard about the program from traditional media or from family and friends; were receiving mental health assistance; were more likely to learn best by reading, hearing and doing; had a lower pretreatment Kessler-6 total score; and were older in age. Predicted probabilities resulting from these attrition variables displayed no significant attrition bias using Heckman's method and thus allowing for the use of completer analysis. Six treatment outcome measures (Kessler-6 total score, number of diagnosed disorders, self-confidence in managing mental health issues, quality of life, and the corresponding pre- and posttreatment severity for each program-specific anxiety disorder and for major depressive episode) were used to assess the efficacy of the 5 anxiety treatment programs. Repeated measures MANOVA revealed a significant multivariate time effect for all treatment outcome measures for each treatment program. Follow-up repeated measures ANOVAs revealed significant improvements on all 6 treatment outcome measures for GAD and PTSD, 5 treatment outcome measures were significant for SAD and PD/A, and 4 treatment outcome measures were significant for OCD. Conclusions: Results identified predictors of posttreatment assessment completers and provided further support for the efficacy of self-help online treatment programs for the 5 anxiety disorders
Predicting cardiac autonomic neuropathy category for diabetic data with missing values
- Abawajy, Jemal, Kelarev, Andrei, Chowdhury, Morshed, Stranieri, Andrew, Jelinek, Herbert
- Authors: Abawajy, Jemal , Kelarev, Andrei , Chowdhury, Morshed , Stranieri, Andrew , Jelinek, Herbert
- Date: 2013
- Type: Text , Journal article
- Relation: Computers in Biology and Medicine Vol. 43, no. 10 (2013), p. 1328-1333
- Full Text:
- Reviewed:
- Description: Cardiovascular autonomic neuropathy (CAN) is a serious and well known complication of diabetes. Previous articles circumvented the problem of missing values in CAN data by deleting all records and fields with missing values and applying classifiers trained on different sets of features that were complete. Most of them also added alternative features to compensate for the deleted ones. Here we introduce and investigate a new method for classifying CAN data with missing values. In contrast to all previous papers, our new method does not delete attributes with missing values, does not use classifiers, and does not add features. Instead it is based on regression and meta-regression combined with the Ewing formula for identifying the classes of CAN. This is the first article using the Ewing formula and regression to classify CAN. We carried out extensive experiments to determine the best combination of regression and meta-regression techniques for classifying CAN data with missing values. The best outcomes have been obtained by the additive regression meta-learner based on M5Rules and combined with the Ewing formula. It has achieved the best accuracy of 99.78% for two classes of CAN, and 98.98% for three classes of CAN. These outcomes are substantially better than previous results obtained in the literature by deleting all missing attributes and applying traditional classifiers to different sets of features without regression. Another advantage of our method is that it does not require practitioners to perform more tests collecting additional alternative features. © 2013 Elsevier Ltd.
- Description: C1
- Authors: Abawajy, Jemal , Kelarev, Andrei , Chowdhury, Morshed , Stranieri, Andrew , Jelinek, Herbert
- Date: 2013
- Type: Text , Journal article
- Relation: Computers in Biology and Medicine Vol. 43, no. 10 (2013), p. 1328-1333
- Full Text:
- Reviewed:
- Description: Cardiovascular autonomic neuropathy (CAN) is a serious and well known complication of diabetes. Previous articles circumvented the problem of missing values in CAN data by deleting all records and fields with missing values and applying classifiers trained on different sets of features that were complete. Most of them also added alternative features to compensate for the deleted ones. Here we introduce and investigate a new method for classifying CAN data with missing values. In contrast to all previous papers, our new method does not delete attributes with missing values, does not use classifiers, and does not add features. Instead it is based on regression and meta-regression combined with the Ewing formula for identifying the classes of CAN. This is the first article using the Ewing formula and regression to classify CAN. We carried out extensive experiments to determine the best combination of regression and meta-regression techniques for classifying CAN data with missing values. The best outcomes have been obtained by the additive regression meta-learner based on M5Rules and combined with the Ewing formula. It has achieved the best accuracy of 99.78% for two classes of CAN, and 98.98% for three classes of CAN. These outcomes are substantially better than previous results obtained in the literature by deleting all missing attributes and applying traditional classifiers to different sets of features without regression. Another advantage of our method is that it does not require practitioners to perform more tests collecting additional alternative features. © 2013 Elsevier Ltd.
- Description: C1
- «
- ‹
- 1
- ›
- »