Loading...

Topological pattern selection in recurrent networks

Bahraini, A ; Sharif University of Technology | 2012

1185 Viewed
  1. Type of Document: Article
  2. DOI: 10.1016/j.neunet.2012.02.037
  3. Publisher: 2012
  4. Abstract:
  5. The impact of adding correlation to a population of neurons on the information and the activity of the population is one of the fundamental questions in recent system neuroscience. In this paper, we would like to introduce topology-based correlation at the level of storing patterns in a recurrent network. We then study the effects of topological patterns on the activity and memory capacity of the network. The general aim of the present work is to show how the repertoire of possible stored patterns is determined by the underlying network topology.Two topological probability rules for pattern selection in recurrent network are introduced. The first one selects patterns according to a Gibbs-type distribution. We start with a Hopfield-type dynamics on a ring model and then a Langevin model on a general random graph is treated. The phenomenon of phase transition in pattern selection motivated us to introduce an alternative topological rule for pattern selection. In a network of N neurons on a random d-regular graph, two asymptotic cases, d/N→ 0 and d/N→ 1, have been discussed for the new rule, and it is shown that capacity of the network grows considerably as d/. N→ 1. By introducing the notions of asymptotic eigenvector, we will be able to study the behaviour of the discrete model in the limit d/N→ 0. It will be proved that for degree d less than a critical value there is a positive role for noise, in which case increasing the number of patterns will improve the storage capacity
  6. Keywords:
  7. Hopfield model ; Random graph spectrum ; Critical value ; Discrete models ; Hopfield models ; Langevin models ; Memory capacity ; Pattern selection ; Probability rules ; Random D-regular graphs ; Random graphs ; Recurrent networks ; Ring model ; Signal-to-noise analysis ; Storage capacity ; Stored pattern ; Topological rules ; Underlying networks ; Artificial intelligence ; Cognitive systems ; Graph theory ; Artificial neural network ; Correlation analysis ; Information processing ; Mathematical analysis ; Mathematical model ; Noise ; Phase transition ; Priority journal ; Probability ; Neural Networks (Computer) ; Neurons ; Random Allocation ; Signal-To-Noise Ratio ; Time Factors
  8. Source: Neural Networks ; Volume 31 , 2012 , Pages 22-32 ; 08936080 (ISSN)
  9. URL: http://www.sciencedirect.com/science/article/pii/S0893608012000664