Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
NETWORK INFERENCE WITH HIDDEN UNITS
Stockholm University, Faculty of Science, Department of Mathematics.
Stockholm University, Nordic Institute for Theoretical Physics (Nordita). Niels Bohr Institute, Copenhagen, Denmark.
2014 (English)In: Mathematical Biosciences and Engineering, ISSN 1547-1063, E-ISSN 1551-0018, Vol. 11, no 1, 149-165 p.Article in journal (Refereed) Published
Abstract [en]

We derive learning rules for finding the connections between units in stochastic dynamical networks from the recorded history of a visible subset of the units. We consider two models. In both of them, the visible units are binary and stochastic. In one model the hidden units are continuous-valued, with sigmoidal activation functions, and in the other they are binary and stochastic like the visible ones. We derive exact learning rules for both cases. For the stochastic case, performing the exact calculation requires, in general, repeated summations over an number of configurations that grows exponentially with the size of the system and the data length, which is not feasible for large systems. We derive a mean field theory, based on a factorized ansatz for the distribution of hidden-unit states, which offers an attractive alternative for large systems. We present the results of some numerical calculations that illustrate key features of the two models and, for the stochastic case, the exact and approximate calculations.

Place, publisher, year, edition, pages
2014. Vol. 11, no 1, 149-165 p.
Keyword [en]
Network inference, latent variables, kinetic Ising models, mean field theory, hidden units
National Category
Mathematics Biological Sciences
Identifiers
URN: urn:nbn:se:su:diva-97633DOI: 10.3934/mbe.2014.11.149ISI: 000326979900011OAI: oai:DiVA.org:su-97633DiVA: diva2:680881
Conference
10th International Workshop on Neural Coding (NC), SEP 02-07, 2012, Prague, CZECH REPUBLIC
Note

AuthorCount:2;

Available from: 2013-12-18 Created: 2013-12-16 Last updated: 2017-12-06Bibliographically approved

Open Access in DiVA

No full text

Other links

Publisher's full text

Search in DiVA

By author/editor
Tyrcha, JoannaHertz, John
By organisation
Department of MathematicsNordic Institute for Theoretical Physics (Nordita)
In the same journal
Mathematical Biosciences and Engineering
MathematicsBiological Sciences

Search outside of DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 21 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf