On the loss of learning capability inside an arrangement of neural networks: The bottleneck effect in black-holes

Ivan Arraut, Diana Diaz

Research output: Contribution to journalArticlepeer-review

Abstract

We analyze the loss of information and the loss of learning capability inside an arrangement of neural networks. Our method is based on the formulation of the Bogoliubov transformations in order to connect the information between different points of the arrangement. Similar methods translated to the physics of black-holes, reproduce the Hawking radiation effect. From this perspective we can conclude that the black-holes are objects reproducing naturally the bottleneck effect, which is fundamental in neural networks in order to perceive the useful information, eliminating in this way the noise.

Original languageEnglish
Article number1484
JournalSymmetry
Volume12
Issue number9
DOIs
Publication statusPublished - Sept 2020

Keywords

  • Black-holes
  • Bogoliubov transformations
  • Bottleneck effect
  • Hawking radiation
  • Learning capability
  • Neural networks
  • Sigmoid (Logistic) function
  • Stability

Fingerprint

Dive into the research topics of 'On the loss of learning capability inside an arrangement of neural networks: The bottleneck effect in black-holes'. Together they form a unique fingerprint.

Cite this