吉本 潤一郎

Protein phosphorylation, a key regulator of cellular processes, plays a central role in brain function and is implicated in neurological disorders. Information on protein phosphorylation is expected to be a clue for understanding various neuropsychiatric disorders and developing therapeutic strategies. Nonetheless, existing databases lack a specific focus on phosphorylation events in the brain, which are crucial for investigating the downstream pathway regulated by neurotransmitters. To overcome the gap, we have developed a web-based database named “Kinase-Associated Neural PHOspho-Signaling (KANPHOS).” This paper presents the design concept, detailed features, and a series of improvements for KANPHOS. KANPHOS is designed to support data-driven research by fulfilling three key objectives: (1) enabling the search for protein kinases and their substrates related to extracellular signals or diseases; (2) facilitating a consolidated search for information encompassing phosphorylated substrate genes, proteins, mutant mice, diseases, and more; and (3) offering integrated functionalities to support pathway and network analysis. KANPHOS is also equipped with API functionality to interact with external databases and analysis tools, enhancing its utility in data-driven investigations. Those key features represent a critical step toward unraveling the complex landscape of protein phosphorylation in the brain, with implications for elucidating the molecular mechanisms underlying neurological disorders. KANPHOS is freely accessible to all researchers at https://kanphos.jp.

The unraveling of the regulatory mechanisms that govern neuronal excitability is a major challenge for neuroscientists worldwide. Neurotransmitters play a critical role in maintaining the balance between excitatory and inhibitory activity in the brain. The balance controls cognitive functions and emotional responses. Glutamate and γ-aminobutyric acid (GABA) are the primary excitatory and inhibitory neurotransmitters of the brain, respectively. Disruptions in the balance between excitatory and inhibitory transmission are implicated in several psychiatric disorders, including anxiety disorders, depression, and schizophrenia. Neuromodulators such as dopamine and acetylcholine control cognition and emotion by regulating the excitatory/inhibitory balance initiated by glutamate and GABA. Dopamine is closely associated with reward-related behaviors, while acetylcholine plays a role in aversive and attentional behaviors. Although the physiological roles of neuromodulators have been extensively studied neuroanatomically and electrophysiologically, few researchers have explored the interplay between neuronal excitability and cell signaling and the resulting impact on emotion regulation. This review provides an in-depth understanding of “cell signaling crosstalk” in the context of neuronal excitability and emotion regulation. It also anticipates that the next generation of neurochemical analyses, facilitated by integrated phosphorylation studies, will shed more light on this topic.

BACKGROUND AND PURPOSE: Multiple system atrophy (MSA) is a neurodegenerative disease with characteristic motor and autonomic symptoms. Impaired brain serotonergic innervation can be associated with various clinical indices of MSA; however, the relationship between clinical symptoms and cerebrospinal fluid (CSF) levels of 5-hydroxyindole acetic acid (5-HIAA), a main serotonin metabolite, has not been fully elucidated. METHODS: To compare CSF 5-HIAA levels between patients with MSA and healthy controls, we included 33 controls and 69 MSA patients with either predominant parkinsonian or cerebellar ataxia subtypes. CSF 5-HIAA levels were measured using high-performance liquid chromatography. Additionally, we investigated correlations between CSF 5-HIAA and various clinical indices in 34 MSA patients. RESULTS: CSF 5-HIAA levels were significantly lower in MSA patients than in controls (p < 0.0001). Probable MSA patients had lower CSF 5-HIAA levels than possible MSA patients (p < 0.001). In MSA patients, CSF 5-HIAA levels were inversely correlated with scores in Parts 1, 2, and 4 of the Unified Multiple System Atrophy Rating Scale, and with systolic and diastolic blood pressure in Part 3. Structural equation modeling revealed significant paths between serotonin and clinical symptoms, and significance was highest for activities of daily living, walking, and body sway. CONCLUSIONS: Serotonin dysfunction, as assessed by CSF 5-HIAA levels, may implicate greater MSA severity.

OBJECTIVE: Recent studies have revealed an association between Parkinson's disease (PD) and Fabry disease, a lysosomal storage disorder; however, the underlying mechanisms remain to be elucidated. This study aimed to investigate the enzymatic properties of serum alpha-galactosidase A (GLA) and compared them with the clinical parameters of PD. METHODS: The study participants consisted of 66 sporadic PD patients and 52 controls. We measured serum GLA activity and calculated the apparent Michaelis constant (Km ) and maximal velocity (Vmax ) by Lineweaver-Burk plot analysis. Serum GLA protein concentration was measured by enzyme-linked immunosorbent assay. We examined the potential correlations between serum GLA activity and GLA protein concentration and clinical features and the plasma neurofilament light chain (NfL) level. RESULTS: Compared to controls, PD patients showed significantly lower serum GLA activity (P < 0.0001) and apparent Vmax (P = 0.0131), but no change in the apparent Km value. Serum GLA protein concentration was lower in the PD group (P = 0.0168) and was positively associated with GLA activity. Serum GLA activity and GLA protein concentration in the PD group showed a negative correlation with age. Additionally, serum GLA activity was negatively correlated with the motor severity score and the level of plasma NfL, and was positively correlated with the score of frontal assessment battery. INTERPRETATION: This study highlights that the lower serum GLA activity in PD is the result of a quantitative decrement of GLA protein in the serum and that it may serve as a biomarker of disease severity.

Background Phenotyping analysis that includes time course is useful for understanding the mechanisms and clinical management of postoperative delirium. However, postoperative delirium has not been fully phenotyped. Hypothesis-free categorization of heterogeneous symptoms may be useful for understanding the mechanisms underlying delirium, although evidence is currently lacking. Therefore, we aimed to explore the phenotypes of postoperative delirium following invasive cancer surgery using a data-driven approach with minimal prior knowledge. Methods We recruited patients who underwent elective invasive cancer resection. After surgery, participants completed 5 consecutive days of delirium assessments using the Delirium Rating Scale-Revised-98 (DRS-R-98) severity scale. We categorized 65 (13 questionnaire items/day × 5 days) dimensional DRS-R-98 scores using unsupervised machine learning (K-means clustering) to derive a small set of grouped features representing distinct symptoms across all participants. We then reapplied K-means clustering to this set of grouped features to delineate multiple clusters of delirium symptoms. Results Participants were 286 patients, of whom 91 developed delirium defined according to Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition, criteria. Following the first K-means clustering, we derived four grouped symptom features: (1) mixed motor, (2) cognitive and higher-order thinking domain with perceptual disturbance and thought content abnormalities, (3) acute and temporal response, and (4) sleep–wake cycle disturbance. Subsequent K-means clustering permitted classification of participants into seven subgroups: (i) cognitive and higher-order thinking domain dominant delirium, (ii) prolonged delirium, (iii) acute and brief delirium, (iv) subsyndromal delirium-enriched, (v) subsyndromal delirium-enriched with insomnia, (vi) insomnia, and (vii) fit. Conclusion We found that patients who have undergone invasive cancer resection can be delineated using unsupervised machine learning into three delirium clusters, two subsyndromal delirium clusters, and an insomnia cluster. Validation of clusters and research into the pathophysiology underlying each cluster will help to elucidate the mechanisms of postoperative delirium after invasive cancer surgery.

The original version of this Article contained an error in Figure 3d. The label ‘ChRmine-eYFP’ was incorrectly shown in orange font instead of green font. This error has been corrected in the HTML and PDF versions of the Article.

AIM: Recently, a machine-learning (ML) technique has been used to create generalizable classifiers for psychiatric disorders based on information of functional connections (FCs) between brain regions at resting state. These classifiers predict diagnostic labels by a weighted linear sum (WLS) of the correlation values of a small number of selected FCs. We aimed to develop a generalizable classifier for gambling disorder (GD) from the information of FCs using the ML technique and examine relationships between WLS and clinical data. METHODS: As a training dataset for ML, data from 71 GD patients and 90 healthy controls (HCs) were obtained from two magnetic resonance imaging sites. We used an ML algorithm consisting of a cascade of an L1-regularized sparse canonical correlation analysis and a sparse logistic regression to create the classifier. The generalizability of the classifier was verified using an external dataset. This external dataset consisted of six GD patients and 14 HCs, and was collected at a different site from the sites of the training dataset. Correlations between WLS and South Oaks Gambling Screen (SOGS) and duration of illness were examined. RESULTS: The classifier distinguished between the GD patients and HCs with high accuracy in leave-one-out cross-validation (area under curve (AUC = 0.89)). This performance was confirmed in the external dataset (AUC = 0.81). There was no correlation between WLS, and SOGS and duration of illness in the GD patients. CONCLUSION: We developed a generalizable classifier for GD based on information of functional connections between brain regions at resting state.

Protein phosphorylation plays critical roles in a variety of intracellular signaling pathways and physiological functions that are controlled by neurotransmitters and neuromodulators in the brain. Dysregulation of these signaling pathways has been implicated in neurodevelopmental disorders, including autism spectrum disorder, attention deficit hyperactivity disorder and schizophrenia. While recent advances in mass spectrometry-based proteomics have allowed us to identify approximately 280,000 phosphorylation sites, it remains largely unknown which sites are phosphorylated by which kinases. To overcome this issue, previously, we developed methods for comprehensive screening of the target substrates of given kinases, such as PKA and Rho-kinase, upon stimulation by extracellular signals and identified many candidate substrates for specific kinases and their phosphorylation sites. Here, we developed a novel online database to provide information about the phosphorylation signals identified by our methods, as well as those previously reported in the literature. The “KANPHOS” (Kinase-Associated Neural Phospho-Signaling) database and its web portal were built based on a next-generation XooNIps neuroinformatics tool. To explore the functionality of the KANPHOS database, we obtained phosphoproteomics data for adenosine-A2A-receptor signaling and its downstream MAPK-mediated signaling in the striatum/nucleus accumbens, registered them in KANPHOS, and analyzed the related pathways.

<title>Abstract</title>Scintillators emit visible luminescence when irradiated with X-rays. Given the unlimited tissue penetration of X-rays, the employment of scintillators could enable remote optogenetic control of neural functions at any depth of the brain. Here we show that a yellow-emitting inorganic scintillator, Ce-doped Gd₃(Al,Ga)₅O₁₂ (Ce:GAGG), can effectively activate red-shifted excitatory and inhibitory opsins, ChRmine and GtACR1, respectively. Using injectable Ce:GAGG microparticles, we successfully activated and inhibited midbrain dopamine neurons in freely moving mice by X-ray irradiation, producing bidirectional modulation of place preference behavior. Ce:GAGG microparticles are non-cytotoxic and biocompatible, allowing for chronic implantation. Pulsed X-ray irradiation at a clinical dose level is sufficient to elicit behavioral changes without reducing the number of radiosensitive cells in the brain and bone marrow. Thus, scintillator-mediated optogenetics enables minimally invasive, wireless control of cellular functions at any tissue depth in living animals, expanding X-ray applications to functional studies of biology and medicine.

Our current understanding of melancholic depression is shaped by its position in the depression spectrum. The lack of consensus on how it should be treated—whether as a subtype of depression, or as a distinct disorder altogethe—interferes with the recovery of suffering patients. In this study, we analyzed brain state energy landscape models of melancholic depression, in contrast to healthy and non-melancholic energy landscapes. Our analyses showed significant group differences on basin energy, basin frequency, and transition dynamics in several functional brain networks such as basal ganglia, dorsal default mode, and left executive control networks. Furthermore, we found evidences suggesting the connection between energy landscape characteristics (basin characteristics) and depressive symptom scores (BDI-II and SHAPS). These results indicate that melancholic depression is distinguishable from its non-melancholic counterpart, not only in terms of depression severity, but also in brain dynamics.

<title>Abstract</title>Neurofeedback (NF) aptitude, which refers to an individual’s ability to change its brain activity through NF training, has been reported to vary significantly from person to person. The prediction of individual NF aptitudes is critical in clinical NF applications. In the present study, we extracted the resting-state functional brain connectivity (FC) markers of NF aptitude independent of NF-targeting brain regions. We combined the data in fMRI-NF studies targeting four different brain regions at two independent sites (obtained from 59 healthy adults and six patients with major depressive disorder) to collect the resting-state fMRI data associated with aptitude scores in subsequent fMRI-NF training. We then trained the regression models to predict the individual NF aptitude scores from the resting-state fMRI data using a discovery dataset from one site and identified six resting-state FCs that predicted NF aptitude. Next we validated the prediction model using independent test data from another site. The result showed that the posterior cingulate cortex was the functional hub among the brain regions and formed predictive resting-state FCs, suggesting NF aptitude may be involved in the attentional mode-orientation modulation system’s characteristics in task-free resting-state brain activity.

Recently, the dimensional approach has attracted much attention, bringing a paradigm shift to a continuum of understanding of different psychiatric disorders. In line with this new paradigm, we examined whether there was common functional connectivity related to various psychiatric disorders in an unsupervised manner without explicitly using diagnostic label information. To this end, we uniquely applied a newly developed network-based multiple clustering method to resting-state functional connectivity data, which allowed us to identify pairs of relevant brain subnetworks and subject cluster solutions accordingly. Thus, we identified four subject clusters, which were characterized as major depressive disorder (MDD), young healthy control (young HC), schizophrenia (SCZ)/bipolar disorder (BD), and autism spectrum disorder (ASD), respectively, with the relevant brain subnetwork represented by the cerebellum-thalamus-pallidum-temporal circuit. The clustering results were validated using independent datasets. This study is the first cross-disorder analysis in the framework of unsupervised learning of functional connectivity based on a data-driven brain subnetwork.

In neuroscience, the functional magnetic resonance imaging (fMRI) is a vital tool to non-invasively access brain activity. Using fMRI, the functional connectivity (FC) between brain regions can be inferred, which has contributed to a number of findings of the fundamental properties of the brain. As an important clinical application of FC, clustering of subjects based on FC recently draws much attention, which can potentially reveal important heterogeneity in subjects such as subtypes of psychiatric disorders. In particular, a multiple clustering method is a powerful analytical tool, which identifies clustering patterns of subjects depending on their FC in specific brain areas. However, when one applies an existing multiple clustering method to fMRI data, there is a need to simplify the data structure, independently dealing with elements in a FC matrix, i.e., vectorizing a correlation matrix. Such a simplification may distort the clustering results. To overcome this problem, we propose a novel multiple clustering method based on Wishart mixture models, which preserves the correlation matrix structure without vectorization. The uniqueness of this method is that the multiple clustering of subjects is based on particular networks of nodes (or regions of interest, ROIs), optimized in a data-driven manner. Hence, it can identify multiple underlying pairs of associations between a subject cluster solution and a ROI sub-network. The key assumption of the method is independence among sub-networks, which is effectively addressed by whitening correlation matrices. We applied the proposed method to synthetic and fMRI data, demonstrating the usefulness and power of the proposed method.

BACKGROUND: The relationship between depression and personality has long been suggested, however, biomarker investigations for depression have mostly overlooked this connection. METHODS: We collected personality traits from 100 drug-free patients with major depressive disorders (MDD) and 100 healthy controls based on the Five-Factor Model (FFM) such as Neuroticism (N) and Extraversion (E), and also obtained 63 plasma metabolites profiles by LCMS-based metabolome analysis. RESULTS: Partitional clustering analysis using the NEO-FFI data classified all subjects into three major clusters. Eighty-six subjects belonging to Cluster 1 (C1: less personality-biased group) constituted half of MDD patients and half of healthy controls. C2 constituted 50 subjects mainly MDD patients (N high + E low), and C3 constituted 64 subjects mainly healthy subjects (N low + E high). Using metabolome information, the machine learning model was optimized to discriminate MDD patients from healthy controls among all subjects and C1, respectively. The performance of the model for all subjects was moderate (AUC = 0. 715), while the performance was extremely improved when limited to C1 (AUC = 0. 907). Tryptophan-pathway plasma metabolites including tryptophan, serotonin and kynurenine were significantly lower in MDD patients especially among C1. We also validated metabolomic findings using a social-defeat mice model of stress-induced depression. LIMITATIONS: A case-control study design and sample size is not large. CONCLUSIONS: Our results suggest that personality classification enhances blood biomarker analysis for MDD patients and further translational investigations should be conducted to clarify the biological relationship between personality traits, stress and depression.

This study examined the psychological distress caused by non-coercive lockdown (mild lockdown) in Japan. An online survey was conducted with 11,333 people (52.4% females; mean age = 46.3 ± 14.6 years, range = 18-89 years) during the mild lockdown in the seven prefectures most affected by COVID-19 infection. Over one-third (36.6%) of participants experienced mild-to-moderate psychological distress (Kessler Psychological Distress Scale [K6] score 5-12), while 11.5% reported serious psychological distress (K6 score ≥ 13). The estimated prevalence of depression (Patient Health Questionnaire-9 score ≥ 10) was 17.9%. Regarding the distribution of K6 scores, the proportion of those with psychological distress in this study was significantly higher when compared with the previous national survey data from 2010, 2013, 2016, and 2019. Healthcare workers, those with a history of treatment for mental illness, and younger participants (aged 18-19 or 20-39 years) showed particularly high levels of psychological distress. Psychological distress severity was influenced by specific interactional structures of risk factors: high loneliness, poor interpersonal relationships, COVID-19-related sleeplessness and anxiety, deterioration of household economy, and work and academic difficulties. Even when non-coercive lockdowns are implemented, people's mental health should be considered, and policies to prevent mental health deterioration are needed. Cross-disciplinary public-private sector efforts tailored to each individual's problem structure are important to address the mental health issues arising from lockdown.

Human habenula studies are gradually advancing, primarily through the use of functional magnetic resonance imaging (fMRI) analysis of passive (Pavlovian) conditioning tasks as well as probabilistic reinforcement learning tasks. However, no studies have particularly targeted aversive prediction errors, despite the essential importance for the habenula in the field. Complicated learned strategies including contextual contents are involved in making aversive prediction errors during the learning process. Therefore, we examined habenula activation during a contextual learning task. We performed fMRI on a group of 19 healthy controls. We assessed the manually traced habenula during negative outcomes during the contextual learning task. The Beck Depression Inventory-Second Edition (BDI-II), the State-Trait-Anxiety Inventory (STAI), and the Temperament and Character Inventory (TCI) were also administered. The left and right habenula were activated during aversive outcomes and the activation was associated with aversive prediction errors. There was also a positive correlation between TCI reward dependence scores and habenula activation. Furthermore, dynamic causal modeling (DCM) analyses demonstrated the left and right habenula to the left and right hippocampus connections during the presentation of contextual stimuli. These findings serve to highlight the neural mechanisms that may be relevant to understanding the broader relationship between the habenula and learning processes.

Resting-state fMRI has the potential to help doctors detect abnormal behavior in brain activity and to diagnose patients with depression. However, resting-state fMRI has a bias depending on the scanner site, which makes it difficult to diagnose depression at a new site. In this paper, we propose methods to improve the performance of the diagnosis of major depressive disorder (MDD) at an independent site by reducing the site bias effects using regression. For this, we used a subgroup of healthy subjects of the independent site to regress out site bias. We further improved the classification performance of patients with depression by focusing on melancholic depressive disorder. Our proposed methods would be useful to apply depression classifiers to subjects at completely new sites.

Medium spiny neurons (MSNs) expressing dopamine D1 receptor (D1R) or D2 receptor (D2R) are major components of the striatum. Stimulation of D1R activates protein kinase A (PKA) through Golf to increase neuronal activity, while D2R stimulation inhibits PKA through Gi. Adenosine A2A receptor (A2AR) coupled to Golf is highly expressed in D2R-MSNs within the striatum. However, how dopamine and adenosine co-operatively regulate PKA activity remains largely unknown. Here, we measured Rap1gap serine 563 phosphorylation to monitor PKA activity and examined dopamine and adenosine signals in MSNs. We found that a D1R agonist increased Rap1gap phosphorylation in striatal slices and in D1R-MSNs in vivo. A2AR agonist CGS21680 increased Rap1gap phosphorylation, and pretreatment with the D2R agonist quinpirole blocked this effect in striatal slices. D2R antagonist eticlopride increased Rap1gap phosphorylation in D2R-MSNs in vivo, and the effect of eticlopride was blocked by the pretreatment with the A2AR antagonist SCH58261. These results suggest that adenosine positively regulates PKA in D2R-MSNs through A2AR, while this effect is blocked by basal dopamine in vivo. Incorporating computational model analysis, we propose that the shift from D1R-MSNs to D2R-MSNs or vice versa appears to depend predominantly on a change in dopamine concentration.

This article presents a review of computational methods for connectivity inference from neural activity data derived from multi-electrode recordings or fluorescence imaging. We first identify biophysical and technical challenges in connectivity inference along the data processing pipeline. We then review connectivity inference methods based on two major mathematical foundations, namely, descriptive model-free approaches and generative model-based approaches. We investigate representative studies in both categories and clarify which challenges have been addressed by which method. We further identify critical open issues and possible research directions.

We propose a novel method for multiple clustering, which is useful for analysis of high-dimensional data containing heterogeneous types of features. Our method is based on non-parametric Bayesian mixture models in which features are automatically partitioned (into views) for each clustering solution. This feature partition works as feature selection for a particular clustering solution, which screens out irrelevant features. To make our method applicable to high-dimensional data, a co-clustering structure is newly introduced for each view. Further, the outstanding novelty of our method is that we simultaneously model different distribution families, such as Gaussian, Poisson, and multinomial distributions in each cluster block, which widens areas of application to real data. We apply the proposed method to synthetic and real data, and show that our method outperforms other multiple clustering methods both in recovering true cluster structures and in computation time. Finally, we apply our method to a depression dataset with no true cluster structure available, from which useful inferences are drawn about possible clustering structures of the data.

In diagnostic applications of statistical machine learning methods to brain imaging data, common problems include data high-dimensionality and co-linearity, which often cause over-fitting and instability. To overcome these problems, we applied partial least squares (PLS) regression to resting-state functional magnetic resonance imaging (rs-fMRI) data, creating a low-dimensional representation that relates symptoms to brain activity and that predicts clinical measures. Our experimental results, based upon data from clinically depressed patients and healthy controls, demonstrated that PLS and its kernel variants provided significantly better prediction of clinical measures than ordinary linear regression. Subsequent classification using predicted clinical scores distinguished depressed patients from healthy controls with 80% accuracy. Moreover, loading vectors for latent variables enabled us to identify brain regions relevant to depression, including the default mode network, the right superior frontal gyrus, and the superior motor area.

Background: Advance in high-throughput technologies in genomics, transcriptomics, and metabolomics has created demand for bioinformatics tools to integrate high-dimensional data from different sources. Canonical correlation analysis (CCA) is a statistical tool for finding linear associations between different types of information. Previous extensions of CCA used to capture nonlinear associations, such as kernel CCA, did not allow feature selection or capturing of multiple canonical components. Here we propose a novel method, two-stage kernel CCA (TSKCCA) to select appropriate kernels in the framework of multiple kernel learning. Results: TSKCCA first selects relevant kernels based on the HSIC criterion in the multiple kernel learning framework. Weights are then derived by non-negative matrix decomposition with L1 regularization. Using artificial datasets and nutrigenomic datasets, we show that TSKCCA can extract multiple, nonlinear associations among high-dimensional data and multiplicative interactions among variables. Conclusions: TSKCCA can identify nonlinear associations among high-dimensional data more reliably than previous nonlinear CCA methods.

Dopamine signaling in the brain is a complex phenomenon that strongly contributes to emotional behaviors. Medium spiny neurons (MSNs) play a major role in dopamine signaling through dopamine D1 receptors (D1Rs) or dopamine D2 receptors (D2Rs) in the striatum. cAMP/protein kinase A (PKA) regulates phosphorylation signals downstream of D1Rs, which affects the excitability of MSNs, leading to reward-associated emotional expression and memory formation. A combination of phosphoproteomic approaches and the curated KANPHOS database can be used to elucidate the physiological and pathophysiological functions of dopamine signaling and other monoamines. Emerging evidence from these techniques suggests that the Rap1 pathway plays a crucial role in the excitability of MSNs, leading to the expression of emotional behaviors.

Humans can select actions by learning, planning, or retrieving motor memories. Reinforcement Learning (RL) associates these processes with three major classes of strategies for action selection: exploratory RL learns state-action values by exploration, model-based RL uses internal models to simulate future states reached by hypothetical actions, and motor-memory RL selects past successful state-action mapping. In order to investigate the neural substrates that implement these strategies, we conducted a functional magnetic resonance imaging (fMRI) experiment while humans performed a sequential action selection task under conditions that promoted the use of a specific RL strategy. The ventromedial prefrontal cortex and ventral striatum increased activity in the exploratory condition; the dorsolateral prefrontal cortex, dorsomedial striatum, and lateral cerebellum in the model-based condition; and the supplementary motor area, putamen, and anterior cerebellum in the motor-memory condition. These findings suggest that a distinct prefrontal-basal ganglia and cerebellar network implements the model-based RL action selection strategy.

Background: Functional connectivity analyses of multiple neurons provide a powerful bottom-up approach to reveal functions of local neuronal circuits by using simultaneous recording of neuronal activity. A statistical methodology, generalized linear modeling (GLM) of the spike response function, is one of the most promising methodologies to reduce false link discoveries arising from pseudo-correlation based on common inputs. Although recent advancement of fluorescent imaging techniques has increased the number of simultaneously recoded neurons up to the hundreds or thousands, the amount of information per pair of neurons has not correspondingly increased, partly because of the instruments' limitations, and partly because the number of neuron pairs increase in a quadratic manner. Consequently, the estimation of GLM suffers from large statistical uncertainty caused by the shortage in effective information. Results: In this study, we propose a new combination of GLM and empirical Bayesian testing for the estimation of spike response functions that enables both conservative false discovery control and powerful functional connectivity detection. We compared our proposed method's performance with those of sparse estimation of GLM and classical Granger causality testing. Our method achieved high detection performance of functional connectivity with conservative estimation of false discovery rate and q values in case of information shortage due to short observation time. We also showed that empirical Bayesian testing on arbitrary statistics in place of likelihood-ratio statistics reduce the computational cost without decreasing the detection performance. When our proposed method was applied to a functional multi-neuron calcium imaging dataset from the rat hippocampal region, we found significant functional connections that are possibly mediated by AMPA and NMDA receptors. Conclusions: The proposed empirical Bayesian testing framework with GLM is promising especially when the amount of information per a neuron pair is small because of growing size of observed network.

Dopamine (DA) type 1 receptor (D1R) signaling in the striatum presumably regulates neuronal excitability and reward-related behaviors through PKA. However, whether and how D1Rs and PKA regulate neuronal excitability and behavior remain largely unknown. Here, we developed a phosphoproteomic analysis method to identify known and novel PKA substrates downstream of the D1R and obtained more than 100 candidate substrates, including Rap1 GEF (Rasgrp2). We found that PKA phosphorylation of Rasgrp2 activated its guanine nucleotide-exchange activity on Rap1. Cocaine exposure activated Rap1 in the nucleus accumbens in mice. The expression of constitutively active PKA or Rap1 in accumbal D1R-expressing medium spiny neurons (D1R-MSNs) enhanced neuronal firing rates and behavioral responses to cocaine exposure through MAPK. Knockout of Rap1 in the accumbal D1R-MSNs was sufficient to decrease these phenotypes. These findings demonstrate a novel DA-PKA-Rap1-MAPK intracellular signaling mechanism in D1R-MSNs that increases neuronal excitability to enhance reward-related behaviors.

In this paper, we present a reinforcement learning model of the shepherding of a flock of sheep by a dog. The shepherding task, a heuristic model originally proposed by Strombom, et al., describes the dynamics of the sheep while being herded by a dog to a predefined target. This study recreates the proposed model using SARSA, an algorithm for learning the optimal policy in reinforcement learning. Results show that with a discretized state and action space, the dog is able to successfully herd a flock of a sheep to the target position by first learning to reach a subgoal. A reward is awarded when the dog reaches the neighbourhood of a subgoal, while a penalty is incurred for each time the shepherding task is not completed. The stochasticity of the interaction among sheep and dog, including the existence of multiple subgoals affect the learning time of the agent. Finally, we present an example of the learned shepherding task which shows the agent's continuous success after the 350th episode.

Diagnosis of psychiatric disorders based on brain imaging data is highly desirable in clinical applications. However, a common problem in applying machine learning algorithms is that the number of imaging data dimensions often greatly exceeds the number of available training samples. Furthermore, interpretability of the learned classifier with respect to brain function and anatomy is an important, but non-trivial issue. We propose the use of logistic regression with a least absolute shrinkage and selection operator (LASSO) to capture the most critical input features. In particular, we consider application of group LASSO to select brain areas relevant to diagnosis. An additional advantage of LASSO is its probabilistic output, which allows evaluation of diagnosis certainty. To verify our approach, we obtained semantic and phonological verbal fluency fMRI data from 31 depression patients and 31 control subjects, and compared the performances of group LASSO (gLASSO), and sparse group LASSO (sgLASSO) to those of standard LASSO (sLASSO), Support Vector Machine (SVM), and Random Forest. Over 90% classification accuracy was achieved with gLASSO, sgLASSO, as well as SVM; however, in contrast to SVM, LASSO approaches allow for identification of the most discriminative weights and estimation of prediction reliability. Semantic task data revealed contributions to the classification from left precuneus, left precentral gyrus, left inferior frontal cortex (pars triangularis), and left cerebellum (c rus1). Weights for the phonological task indicated contributions from left inferior frontal operculum, left post central gyrus, left insula, left middle frontal cortex, bilateral middle temporal cortices, bilateral precuneus, left inferior frontal cortex (pars triangularis), and left precentral gyrus. The distribution of normalized odds ratios further showed, that predictions with absolute odds ratios higher than 0.2 could be regarded as certain.

A theoretical framework of reinforcement learning plays an important role in understanding action selection in animals. Spiking neural networks provide a theoretically grounded means to test computational hypotheses on neurally plausible algorithms of reinforcement learning through numerical simulation. However, most of these models cannot handle observations which are noisy, or occurred in the past, even though these are inevitable and constraining features of learning in real environments. This class of problem is formally known as partially observable reinforcement learning (PORL) problems. It provides a generalization of reinforcement learning to partially observable domains. In addition, observations in the real world tend to be rich and high-dimensional. In this work, we use a spiking neural network model to approximate the free energy of a restricted Boltzmann machine and apply it to the solution of PORL problems with high-dimensional observations. Our spiking network model solves maze tasks with perceptually ambiguous high-dimensional observations without knowledge of the true environment. An extended model with working memory also solves history-dependent tasks. The way spiking neural networks handle PORL problems may provide a glimpse into the underlying laws of neural information processing which can only be discovered through such a top-down approach.

A single neuron gain function can predict the population activity of homogeneous neurons under strong limitations, such as the stationary state and balanced conditions of the total input. In this work, we propose a modification to the self-consistency model when balanced conditions are not fully satisfied. We present a scaling factor to modify the excitatory weights in a Brunel network. It allows using the self-consistency model in more realistic cases. The approach is used and analyzed for different network features.

Identification of functional connectivity between neurons is an important issue in computational neuroscience. Recently, the number of simultaneously recorded neurons is increasing, and computational complexity to estimate functional connectivity is exploding. In this study, we propose a two-stage algorithm to estimate spike response functions between neurons in a large scale network. We applied the proposed algorithm to various scales of neural networks and showed that the computational complexity is reduced without sacrificing estimation accuracy.