Spatially Arranged Sparse Recurrent Neural Networks for Energy Efficient Associative Memory

The development of hardware neural networks, including neuromorphic hardware, has been accelerated over the past few years. However, it is challenging to operate very large-scale neural networks with low-power hardware devices, partly due to signal transmissions through a massive number of interconnections. Our aim is to deal with the issue of communication cost from an algorithmic viewpoint and study learning algorithms for energy-efficient information processing. Here, we consider two approaches to finding spatially arranged sparse recurrent neural networks with the high cost-performance ratio for associative memory. In the first approach following classical methods, we focus on sparse modular network structures inspired by biological brain networks and examine their storage capacity under an iterative learning rule. We show that incorporating long-range intermodule connections into purely modular networks can enhance the cost-performance ratio. In the second approach, we formulate for the first time an optimization problem where the network sparsity is maximized under the constraints imposed by a pattern embedding condition. We show that there is a tradeoff between the interconnection cost and the computational performance in the optimized networks. We demonstrate that the optimized networks can achieve a better cost-performance ratio compared with those considered in the first approach. We show the effectiveness of the optimization approach mainly using binary patterns and apply it also to gray-scale image restoration. Our results suggest that the presented approaches are useful in seeking more sparse and less costly connectivity of neural networks for the enhancement of energy efficiency in hardware neural networks.

Recent advances in physical reservoir computing: A review

Reservoir computing is a computational framework suited for temporal/sequential data processing. It is derived from several recurrent neural network models, including echo state networks and liquid state machines. A reservoir computing system consists of a reservoir for mapping inputs into a high-dimensional space and a readout for pattern analysis from the high-dimensional states in the reservoir. The reservoir is fixed and only the readout is trained with a simple method such as linear regression and classification. Thus, the major advantage of reservoir computing compared to other recurrent neural networks is fast learning, resulting in low training cost. Another advantage is that the reservoir without adaptive updating is amenable to hardware implementation using a variety of physical systems, substrates, and devices. In fact, such physical reservoir computing has attracted increasing attention in diverse fields of research. The purpose of this review is to provide an overview of recent advances in physical reservoir computing by classifying them according to the type of the reservoir. We discuss the current issues and perspectives related to physical reservoir computing, in order to further expand its practical applications and develop next-generation machine learning systems.

Aberrant activation of the intrarenal renin-angiotensin system in the developing kidneys of type 2 diabetic rats

We have previously reported that intrarenal angiotensin II (Ang II) levels are increased long before diabetes becomes apparent in obese Otsuka-Long-Evans-Tokushima-Fatty (OLETF) rats, a model of type 2 diabetes. In this study, we examined the changes in intrarenal renin-angiotensin system (RAS) activity in the developing kidneys of OLETF rats. Ang II contents and mRNA levels of RAS components were measured in male OLETF and control Long-Evans Tokushima (LETO) rats at postnatal days (PND) 1, 5, and 15, and at 4-30 weeks of age. In both LETO and OLETF rats, kidney Ang II levels peaked at PND 1, then decreased during the pre- and post-weaning periods. However, Ang II levels and gene expression of RAS components, including angiotensinogen (AGT), renin, and angiotensin-converting enzyme (ACE), were not significantly different between LETO and OLETF rats. Intrarenal Ang IIcontents further decreased during puberty (from 7 to 11 weeks of age) in LETO rats, bur not in OLETF rats. At 11 weeks of age, kidney Ang II levels, urinary AGT excretion, and mRNA levels of AGT and renin were higher in OLETF rats than in LETO rats, while blood glucose levels were not significantly different between these groups of rats. These data indicate that continued intrarenal expression of Ang II during pubescence contributes to the increases in intrarenal Ang II levels in prediabetic OLETF rats, and is associated with increased intrarenal AGT and renin expression. Inappropriate activation of the intrarenal RAS in the prediabetic stage may facilitate the onset and development of diabetic nephropathy in later life.

Blockade of AT1 receptors protects the blood-brain barrier and improves cognition in Dahl salt-sensitive hypertensive rats

BACKGROUND

The present study tested the hypothesis that inappropriate activation of the brain renin-angiotensin system (RAS) contributes to the pathogenesis of blood-brain barrier (BBB) disruption and cognitive impairment during development of salt-dependent hypertension. Effects of an angiotensin II (AngII) type-1 receptor blocker (ARB), at a dose that did not reduce blood pressure, were also examined.

METHODS

Dahl salt-sensitive (DSS) rats at 6 weeks of age were assigned to three groups: low-salt diet (DSS/L; 0.3% NaCl), high-salt diet (DSS/H; 8% NaCl), and high-salt diet treated with ARB, olmesartan at 1 mg/kg.

RESULTS

DSS/H rats exhibited hypertension, leakage from brain microvessels in the hippocampus, and impaired cognitive functions, which were associated with increased brain AngII levels, as well as decreased mRNA levels of tight junctions (TJs) and collagen-IV in the hippocampus. In DSS/H rats, olmesartan treatment, at a dose that did not alter blood pressure, restored the cognitive decline, and ameliorated leakage from brain microvessels. Olmesartan also decreased brain AngII levels and restored mRNA expression of TJs and collagen-IV in DSS/H rats.

CONCLUSIONS

These results suggest that during development of salt-dependent hypertension, activation of the brain RAS contributes to BBB disruption and cognitive impairment. Treatment with an ARB could elicit neuroprotective effects in cognitive disorders by preventing BBB permeability, which is independent of blood pressure changes.

Synthesis of symmetrical polynitrohelicenes and their chiral recognition in the charge transfer complexation

Derivatives of optically active 1,12-dimethylbenzo[c]phenanthrene-5,8-dicarboxylic acid can be nitrated regioselectively, giving symmetrically polyfunctionalized helicenes. The dicarboxylic acid or its dimethyl ester is dinitrated with fuming nitric acid in acetic acid at the 4,9-positions. When the reaction is conducted in fuming nitric acid, a 2,4,9,11-tetranitrohelicene is obtained. Analogously, 1,12-dimethylbenzo[c]phenanthrene-5,8-dinitrile gives 2,11-dinitro- or 4,9-dinitrohelicene depending on the conditions, and the former compound is converted to a 2,4,9,11-tetranitrohelicene. The tetranitrohelicenes form charge-transfer (CT) complexes with an electron-rich chiral diaminohelicene in solution. The studies on the chiral recognition reveal that the combinations of the same configuration of the helicenes form more stable complexes than that of the enantiomeric helicenes.

[Effects of propiverine hydrochloride (propiverine) on isolated rat and dog urinary bladder]

Propiverine is a drug for the treatment of incontinence and pollakiuria. The effects of propiverine on isolated rat and dog urinary bladder were investigated. At doses of 10(-6)-3 x 10(-5) M, propiverine caused both a rightward shift and inhibition of the maximum response in the acetylcholine (ACh) dose-response curve. The pA2 values for rat and dog urinary bladder were 5.97 and 6.62, respectively. At doses of 10(-5)-10(-5) M, propiverine also dose-dependently inhibited KCl (100 mM)-induced contractions. The IC50 values for rat and dog urinary bladder were 3.9 x 10(-6) M and 3.8 x 10(-6) M, respectively. The pA2 value and the IC50 value of terodiline for rat urinary bladder were 6.08 and 6.6 x 10(-6) M, respectively. In contrast, the pA2 value and the IC50 value of oxybutynin for rat urinary bladder were 7.69 and 4.5 x 10(-6) M, respectively, suggesting that oxybutynin exerts an anti-muscarinic effect at doses at which no discernible anti-KCl effect was observed, whereas propiverine and terodiline exerted both effects at the same doses. The inhibitory effect of drugs on the contraction induced by electrical field stimulation was tested. At a dose of 10(-7) g/ml, tetrodotoxin inhibited the contraction of rat and dog urinary bladder by 76.6% and 92.6%, respectively. Propiverine and verapamil dose-dependently inhibited the contractile response induced by electrical field stimulation at doses of 10(-5) M or more and 3 x 10(-6) M or more, respectively. At these concentrations, a marked anti-KCl effect of the drugs on smooth muscle was observed. On the other hand, atropine caused no inhibition of the contractile response in rat urinary bladder at a dose of 3 x 10(-5) M, and it inhibited the contraction in dog urinary bladder by 14.9% at a dose of 10(-5) M. These findings suggest that although propiverine exhibits both anti-muscarinic and anti-KCl effects in isolated rat and dog urinary bladder, the inhibitory effects of propiverine on the atropine-resistant part of contraction may be mainly due to its anti-KCl effect.

[Effects of cadralazine on the respiration, circulation, kidney, autonomic nervous system, digestive system, blood and so on]

The general pharmacological effects of cadralazine and its major metabolite ISF 2405 were studied by comparing them with those of hydralazine. Cadralazine at 3.0 mg/kg, i.v., increased respiratory movement and heart rate and decreased blood pressure in cats. Cadralazine at 3.0 mg/kg, i.v., inhibited the hypertensive response induced by adrenaline, but showed little effect on the hypotensive response induced by acetylcholine in cats. Cadralazine and ISF 2405 at 10(-4) g/ml had negative chronotropic effects on isolated guinea-pig atria. The drug at 2.5 mg/kg, p.o., inhibited the passage of BaSO4 in the gastrointestinal tract in mice. The drug at 5.0 mg/kg, i.d. or more inhibited gastric secretion in rats. Cadralazine, except at higher doses, had little effect on spontaneous gastric motility and uterine spontaneous movement in rats. Cadralazine at 2.5 mg/kg, p.o., or more reduced or tended to reduce urine volume and urinary excretion of electrolytes. The drug showed little effect on coagulation and osmotic fragility in blood cell in rats nor on hemolysis and platelet aggregation in rabbits. ISF 2405, however, showed slight or moderate influence on hemolysis at concentrations as high as 0.01-1.0%. Cadralazine at 5.0 mg/kg, p.o. or more antagonized carrageenin-induced hind paw edema in rats. In conclusion, these effects of cadralazine were found to be qualitatively identical with those of hydralazine.

Histopathologic features of the skin of hairless newborn pigs with goiter

The skin of 15 hairless newborn pigs with parenchymatous goiter was studied histopathologically. Most of the lesions were in the hair follicles; follicles were scarce and reduced in size, contained slender hairs, and revealed a shortage of penetration into the hypodermis. Hair follicles in the immature stages, hair pegs, and germs also were recognized, with the thin epidermis lacking in keratinization. It was felt that these changes resulted from a retardation of cellular differentiation of the germinal layer. In view of these findings, skin lesions were regarded as hypoplasia of hair.