A domain-agnostic approach for characterization of lifelong learning systems

Despite the advancement of machine learning techniques in recent years, state-of-the-art systems lack robustness to "real world" events, where the input distributions and tasks encountered by the deployed systems will not be limited to the original training context, and systems will instead need to adapt to novel distributions and tasks while deployed. This critical gap may be addressed through the development of "Lifelong Learning" systems that are capable of (1) Continuous Learning, (2) Transfer and Adaptation, and (3) Scalability. Unfortunately, efforts to improve these capabilities are typically treated as distinct areas of research that are assessed independently, without regard to the impact of each separate capability on other aspects of the system. We instead propose a holistic approach, using a suite of metrics and an evaluation framework to assess Lifelong Learning in a principled way that is agnostic to specific domains or system techniques. Through five case studies, we show that this suite of metrics can inform the development of varied and complex Lifelong Learning systems. We highlight how the proposed suite of metrics quantifies performance trade-offs present during Lifelong Learning system development - both the widely discussed Stability-Plasticity dilemma and the newly proposed relationship between Sample Efficient and Robust Learning. Further, we make recommendations for the formulation and use of metrics to guide the continuing development of Lifelong Learning systems and assess their progress in the future.

A Precision Environment-Wide Association Study of Hypertension via Supervised Cadre Models

We consider the problem in precision health of grouping people into subpopulations based on their degree of vulnerability to a risk factor. These subpopulations cannot be discovered with traditional clustering techniques because their quality is evaluated with a supervised metric: The ease of modeling a response variable for observations within them. Instead, we apply the more appropriate supervised cadre model (SCM). We extend the SCM formalism so that it may be applied to multivariate regression and binary classification problems and develop a way to use conditional entropy to assess the confidence in the process by which a subject is assigned their cadre. Using the SCM, we generalize the environment-wide association study (EWAS) to be able to model heterogeneity in population risk. In our EWAS, we consider more than 200 environmental exposure factors and find their association with diastolic blood pressure, systolic blood pressure, and hypertension. This requires adapting the SCM to be applicable to data generated by a complex survey design. After correcting for false positives, we found 25 exposure variables that had a significant association with at least one of our response variables. Eight of these were significant for a discovered subpopulation but not for the overall population. Some of these associations have been identified by previous researchers, whereas others appear to be novel. We examine discovered subpopulations in detail, finding that they are interpretable and suggestive of further research questions.

Influence of an interpositional spacer on the behaviour of the tibiofemoral joint: a finite element study

BACKGROUND

Interpositional arthroplasty is considered by many surgeons for the treatment of isolated medial compartment osteoarthritis of the knee. In this procedure, an interpositional spacer is inserted into the medial compartment of the joint with no bone resection and no mechanical fixation. Major problems such as implant dislocation, severe pain or need for revision have been reported post-operatively.

METHODS

In this study, the kinematics of a knee implanted with an interpositional spacer made of either polyurethane or cobalt-chrome during walking, stair ascent and squatting cycles have been predicted and compared to the normal knee using finite element analysis. In addition, articular cartilage stress histories have been examined to obtain distributions of cumulative stress, a measure of the likelihood of articular cartilage degeneration.

FINDINGS

The insertion of a polyurethane interpositional spacer in the medial side of the knee did not affect knee kinematics as compared to the normal knee, but caused an increase of articular cartilage cumulative contact stress exposures in the medial compartment of the joint. The knee implanted with the Co-Cr spacer exhibited similar trends in knee kinematics, however significantly different ranges of motion were observed during some periods of the activity cycles, specifically during the first half of the walking cycle where lower ranges of motion were predicted. In addition, higher articular cartilage cumulative contact stress exposures were observed in both compartments of the knee. In both cases, cumulative contact stress exposures of the tibial articular cartilage were more affected than those of the femoral articular cartilage.

INTERPRETATION

These results suggest implant material as an important parameter in the design phase of interpositional spacers.

Oxygen: kill or cure? Prehospital hyperoxia in the COPD patient

High concentration oxygen therapy has long been a mainstay of prehospital treatment. Guidelines for its administration have for many years also cautioned its use with patients with chronic obstructive pulmonary disease (COPD). Successive guidelines and prehospital textbooks have advocated the use of 28% oxygen masks and re-emphasised the importance of the dangers of hyperoxia, often drawing upon the classic theory of hypoxic drive. Despite this, the reality remains that ambulance crews have tended to overoxygenate such patients. One study demonstrated that 80% of patients sampled with acute exacerbation of their COPD received oxygen in excess of 28% from the ambulance crew. Is this a worrying development or a reassuring sign that prehospital providers are rightly more concerned about the dangers of hypoxia than hyperoxia? And if the guidelines are right, then how are the hearts and minds of ambulance paramedics and technicians won?

Quantitative measurement of the stresses induced during polymerisation of bone cement

When bone cement cures, residual stresses due to bulk and thermal shrinkage will result. Present finite element (FE) simulations of implanted constructs often do not account for these stresses as an initial condition; this may lead to overestimations of the fatigue life of the cement. In the present study, an instrumented stem equipped with strain gauges and a thermocouple was employed to experimentally quantify the residual stresses induced as a result of bone cement curing within a simulated bone/cement/stem construct. Residual stresses as high as 10 MPa were observed in the cement mantle. Residual stresses of this magnitude are potentially high enough to initiate damage within the cement mantle or at the stem/cement interface immediately post-implantation. The acoustic emission technique has demonstrated that cracking and sliding mechanisms are occurring during curing, resulting in partial relaxation of these stresses. The implications for FE simulations of the implanted construct are discussed.

Striatal size and relative glucose metabolic rate in schizotypal personality disorder and schizophrenia

BACKGROUND

Schizotypal personality disorder (SPD) shares social deficits and cognitive impairment with schizophrenia, but is not typically characterized by frank psychosis. Because striatal size and functional activity have both been shown to be associated with psychotic symptoms, we carried out the first study of SPD to assess the caudate and putamen for comparison with findings in schizophrenia.

METHODS

Patients with SPD (n = 16), schizophrenic patients (n = 42), and age- and sex-matched normal control subjects (n = 47) were assessed with magnetic resonance imaging. All of the patients with SPD and subsamples of the schizophrenic patients (n = 27) and control subjects (n = 32) were also assessed with positron emission tomography using fluorodeoxyglucose F-18.

RESULTS

The relative size of the putamen in controls was significantly larger than in patients with SPD and significantly smaller than in schizophrenic patients, while the relative size of the caudate was similar in all 3 groups. Compared with control values, relative glucose metabolic rate in the ventral putamen was significantly elevated in patients with SPD and reduced in schizophrenic patients. When subsamples of schizophrenic patients (n = 10) and patients with SPD (n = 10) both of whom never received medication were compared, this pattern was more marked, with the highest value for the putamen being found in patients with SPD for the ventral slice and the lowest value for the right dorsal putamen.

CONCLUSIONS

Patients with SPD showed reduced volume and elevated relative glucose metabolic rate of the putamen compared with both schizophrenic patients and controls. These alterations in volume and activity may be related to the sparing of patients with SPD from frank psychosis.

Impulsive aggression in borderline personality disorder

Impulsive aggressive behaviors that include physical aggression directed towards others, self-mutilation, suicide attempts, domestic violence, substance abuse, and property destruction account for a substantial portion of the morbidity and mortality associated with personality disorders, in particular borderline personality disorder (BPD). Recent genetic, neurobiologic, and diagnostic studies suggest a dimensional approach to BPD symptomatology with impulsive aggression as one of the core dimensions for the disorder. The underlying biologic basis for impulsive aggression is centered on the serotonin hypothesis; that central 5-HT function is inversely related to aggression and suicidality. More recent research refines the theory to include associated brain regions, receptor types and neuromodulators potentially involved in the etiology of aggressivity. Treatment utilizes this information with substantial progress in well-designed placebo-controlled studies of selective serotonin reuptake inhibitors such as fluoxetine, and open-label series of atypical neuroleptics, mood stabilizers, and opioid antagonists

D4 dopamine-receptor (DRD4) alleles and novelty seeking in substance-dependent, personality-disorder, and control subjects

Two reports have been published suggesting an association between the personality trait of novelty seeking and the DRD4*7R allele at the D4 dopamine-receptor locus (with heterozygotes or homozygotes for DRD4*7R having higher novelty seeking). We studied novelty seeking and four coding-sequence polymorphisms affecting protein structure in the D4 dopamine-receptor gene (DRD4) in a sample of 341 American subjects, of whom 224 are of primarily European ancestry and 117 are of primarily African ancestry. These subjects had diagnoses of substance dependence or personality disorder (PD) or were screened to exclude major psychiatric diagnosis. We found that, although the substance-dependent subjects had significantly higher novelty seeking than the control and PD subjects, they did not differ in DRD4*7R allele frequency. There was no association between any DRD4 polymorphism and novelty seeking in any population or diagnostic group, except for a significant association between the DRD4*7R allele and lower novelty seeking among European American females and African American substance abusers. The novelty seeking of subjects heterozygous for a null mutation did not differ from that of subjects with two functional alleles. We conclude that the most likely explanation of these results is that the DRD4 VNTR does not influence directly the trait of novelty seeking, in these samples.

Juvenile Graves disease: usefulness and limitations of thyrotropin receptor antibody determinations

Thyrotropin receptor antibodies (TRAb) were measured in serum from 49 patients with active and inactive juvenile Graves disease, and the results were compared with values from control subjects and patients with Hashimoto disease. With a thyrotropin binding inhibition immunoglobulin (TBII) assay, TRAb were found in serum from 25 (93%) of 27 patients with untreated, active Graves disease. The TRAb values remained positive in 20 (72%) of 29 patients during the first 6 months of antithyroid therapy and in 13 (54%) of 24 patients during the second 6 months. After discontinuation of antithyroid therapy, 15 patients experienced 18 episodes of relapse of thyrotoxicosis; during relapse TRAb values were positive in all but one patient. Among 19 patients who remained clinically and biochemically euthyroid after cessation of antithyroid therapy, TRAb were not detected in 28 (78%) of 36 serum specimens. Of the eight positive values from six patients, no antiidiotypic antibodies were found, and thyroid stimulating immunoglobulins (TSI) were not detected in four specimens. The TRAb determination correctly predicted the subsequent clinical course in 26 (72%) of 36 patients. Furthermore, TRAb values and results of triiodothyronine suppression tests were in agreement in 27 of 36 patients, or 75% of the time. TSI were present in serum from only 19 (73%) of 26 patients with active disease; however, TSI were negative in all patients with inactive Graves disease. During the management of Graves disease, TRAb measurements by TBII determinations are valuable in the diagnosis of active disease, assist in the decision to discontinue antithyroid drug therapy, and are useful as the T3 suppression test to predict the clinical course of the disease. The TSI measurement is most useful to determine the activity of the disease when TRAb values are positive in a euthyroid patient.

Behavioral skills in self-monitoring of blood glucose: relationship to accuracy

Sixty-two children and adolescents with IDDM were observed while performing self-monitoring of blood glucose (SMBG) to determine which of the behaviors involved in SMBG were most likely to be performed incorrectly and which errors had the greatest effect on the accuracy of SMBG readings. Behaviors related to cleanliness and timing were performed most poorly; only 60% of the subjects correctly timed the first minute, and 30-33% correctly timed the second interval. The duration of SMBG and frequency of monitoring were not related to proper performance of the behaviors involved in SMBG. Accuracy of SMBG was assessed by comparing subjects' readings to laboratory values obtained immediately afterward. The behavior that had the greatest effect on the accuracy of SMBG readings was that concerning whether the blood was adequately wiped from the Chemstrip bG. This behavior should receive more emphasis in SMBG training programs. The systematic observation procedure used in this study may help to identify errors made by patients while performing SMBG and may serve as the basis for training programs to improve SMBG accuracy.