Continual lifelong learning with neural networks: A review

Neural Networks, Год журнала: 2019, Номер 113, С. 54 - 71

Опубликована: Фев. 10, 2019

Humans and animals have the ability to continually acquire, fine-tune, transfer knowledge skills throughout their lifespan. This ability, referred as lifelong learning, is mediated by a rich set of neurocognitive mechanisms that together contribute development specialization our sensorimotor well long-term memory consolidation retrieval. Consequently, learning capabilities are crucial for computational systems autonomous agents interacting in real world processing continuous streams information. However, remains long-standing challenge machine neural network models since continual acquisition incrementally available information from non-stationary data distributions generally leads catastrophic forgetting or interference. limitation represents major drawback state-of-the-art deep typically learn representations stationary batches training data, thus without accounting situations which becomes over time. In this review, we critically summarize main challenges linked artificial compare existing approaches alleviate, different extents, forgetting. Although significant advances been made domain-specific with networks, extensive research efforts required robust on robots. We discuss well-established emerging motivated factors biological such structural plasticity, replay, curriculum intrinsic motivation, multisensory integration.

Язык: Английский

---

Critical period plasticity in local cortical circuits

Nature reviews. Neuroscience, Год журнала: 2005, Номер 6(11), С. 877 - 888

Опубликована: Ноя. 1, 2005

Язык: Английский

---

The gut microbiota influences blood-brain barrier permeability in mice

Science Translational Medicine, Год журнала: 2014, Номер 6(263)

Опубликована: Ноя. 19, 2014

The intestinal microbiota helps to maintain the integrity of blood-brain barrier in fetal and adult mice.

Язык: Английский

---

Attention-deficit/hyperactivity disorder is characterized by a delay in cortical maturation

Proceedings of the National Academy of Sciences, Год журнала: 2007, Номер 104(49), С. 19649 - 19654

Опубликована: Ноя. 17, 2007

There is controversy over the nature of disturbance in brain development that underpins attention-deficit/hyperactivity disorder (ADHD). In particular, it unclear whether results from a delay maturation or represents complete deviation template typical development. Using computational neuroanatomic techniques, we estimated cortical thickness at >40,000 cerebral points 824 magnetic resonance scans acquired prospectively on 223 children with ADHD and typically developing controls. With this sample size, could define growth trajectory each point, delineating phase childhood increase followed by adolescent decrease (a quadratic model). From these trajectories, age attaining peak was derived used as an index maturation. We found to progress similar manner regionally both without ADHD, primary sensory areas before polymodal, high-order association areas. However, there marked throughout most cerebrum: median which 50% attained for group 10.5 years (SE 0.01), significantly later than 7.5 0.02) controls (log rank test chi(1)(2) = 5,609, P < 1.0 x 10(-20)). The prominent prefrontal regions important control cognitive processes including attention motor planning. Neuroanatomic documentation regional has not been previously reported.

Язык: Английский

---

Neurodevelopmental Trajectories of the Human Cerebral Cortex

Journal of Neuroscience, Год журнала: 2008, Номер 28(14), С. 3586 - 3594

Опубликована: Апрель 2, 2008

Understanding the organization of cerebral cortex remains a central focus neuroscience. Cortical maps have relied almost exclusively on examination postmortem tissue to construct structural, architectonic maps. These invariably distinguished between areas with fewer discernable layers, which less complex overall pattern lamination and lack an internal granular layer, those more laminar architecture. The former includes several agranular limbic areas, latter homotypical association sensory cortex. Here, we relate these traditional developmental data from noninvasive neuroimaging. Changes in cortical thickness were determined in vivo 764 neuroanatomic magnetic resonance images acquired longitudinally 375 typically developing children young adults. We find differing levels complexity growth across cerebrum, align closely established regions simple architecture, including most predominantly show simpler trajectories. clearly identified homologues all mammalian brains thus likely evolved early mammals. In contrast, polysensory high-order cortex, terms their also Some are unique to, or dramatically expanded primates, lending evolutionary significance findings. Furthermore, by mapping key characteristic development trajectories (the age attaining peak thickness) document dynamic, heterochronous maturation through time lapse sequences (“movies”).

Язык: Английский

---

The connectomics of brain disorders

Nature reviews. Neuroscience, Год журнала: 2015, Номер 16(3), С. 159 - 172

Опубликована: Фев. 20, 2015

Язык: Английский

---

Intellectual ability and cortical development in children and adolescents

Nature, Год журнала: 2006, Номер 440(7084), С. 676 - 679

Опубликована: Март 1, 2006

Язык: Английский

---

Enrichment Effects on Adult Cognitive Development

Psychological Science in the Public Interest, Год журнала: 2008, Номер 9(1), С. 1 - 65

Опубликована: Окт. 1, 2008

In this monograph, we ask whether various kinds of intellectual, physical, and social activities produce cognitive enrichment effects-that is, they improve performance at different points the adult life span, with a particular emphasis on old age. We begin theoretical framework that emphasizes potential behavior to influence levels functioning. According framework, undeniable presence age-related decline in cognition does not invalidate view can enhance Instead, course normal aging shapes zone possible functioning, which reflects person-specific endowments constraints. Individuals function higher or lower ranges by engaging refraining from beneficial activities. From point view, for positive change, plasticity, is maintained cognition. It an argument supported newer research neuroscience showing neural plasticity aspects central nervous system neurochemistry, architecture. This human contrasts static conceptions age, according abilities fixed individuals cannot slow its course. Furthermore, any understanding as it occurs everyday must make distinction between basic mechanisms skills (such working-memory capacity) functional use achieve goals specific situations. practice, knowledge expertise are critical effective available evidence suggests older adults effectively employ gain new when required. conclude that, balance, favors hypothesis maintaining intellectually engaged physically active lifestyle promotes successful aging. First, cognitive-training studies have demonstrated functioning provided intensive training strategies promote thinking remembering. The early literature suggested little transfer specifically trained tasks; learning was highly processes targeted training. Recently, however, generation providing structured experience situations demanding executive coordination skills-such complex video games, task-switching paradigms, divided attention tasks-train strategic control over show task environments. These suggest there considerable reserve adults' be enhanced through Second, number indicate stimulating predicts better maintenance associated reduced risk developing Alzheimer's disease late life. Our review focuses longitudinal connection cognition, because such admits fewer rival explanations observed effects (or lack effects) than cross-sectional evidence. consistently shows later time. Other meaningful engagement also predictive findings open important explanations, but overall, postpone decline, attenuate provide prosthetic benefit face normative while same time indicating late-life changes result curtailment Given complexity dynamic reciprocal relationships additional will needed address extent validate causal Nevertheless, requires effort has long-term benefits least consistent data. intervention involves multimodal interventions focusing goal-directed action requiring reading children) interaction help enhances function. Third, parallel suggesting physical activity, aerobic exercise particular, Unlike lifestyle, already impressive array work humans animal populations substantial function, particularly fluid intelligence Recent topic indicates brain morphology representing plausible substrate other identifies areas where questions. For example, epidemiological stress chronic psychological distress negatively contrast, less known about how attributes, self-efficacy, sense control, meaning life, might contribute preservation well certain personality characteristics conscientiousness predict adherence regimen, do know these attributes relevant predicting compensation occurs. Likewise, more information factors encourage age elevated physiological mechanical wear tear body, incidence diseases disabling consequences, efforts maintain aging, both terms emotional well-being. discuss briefly some interesting issues society public policy regarding cognitive-enrichment effects. should included part general prevention model enhancing health vitality age? comment recent trend business marketing claimed build power prevent desirability direct back claims effectiveness products.

Язык: Английский

---

Reduced anxiety-like behavior and central neurochemical change in germ-free mice

Neurogastroenterology & Motility, Год журнала: 2010, Номер 23(3), С. 255 - e119

Опубликована: Ноя. 5, 2010

Background There is increasing interest in the gut-brain axis and role intestinal microbiota may play communication between these two systems. Acquisition of immediate postnatal period has a defining impact on development function gastrointestinal, immune, neuroendocrine metabolic For example, presence gut regulates set point for hypothalamic-pituitary-adrenal (HPA) activity. Methods We investigated basal behavior adult germ-free (GF), Swiss Webster female mice elevated plus maze (EPM) compared this to conventionally reared specific pathogen free (SPF) mice. Additionally, we measured brain mRNA expression genes implicated anxiety stress-reactivity. Key Results Germ-free mice, SPF exhibited EPM that can be interpreted as anxiolytic. Altered GF was accompanied by decrease N-methyl-D-aspartate receptor subunit NR2B central amygdala, increased brain-derived neurotrophic factor decreased serotonin 1A (5HT1A) dentate granule layer hippocampus. Conclusions & Inferences conclude or absence conventional influences behavior, neurochemical changes brain.

Язык: Английский

---

A Critical Period for Enhanced Synaptic Plasticity in Newly Generated Neurons of the Adult Brain

Neuron, Год журнала: 2007, Номер 54(4), С. 559 - 566

Опубликована: Май 1, 2007

Язык: Английский

---