Název:
Neural Networks Between Integer and Rational Weights
Autoři:
Šíma, Jiří Typ dokumentu: Výzkumné zprávy
Rok:
2016
Jazyk:
eng
Edice: Technical Report, svazek: V-1237
Abstrakt: The analysis of the computational power of neural networks with the weight parameters between integer and rational numbers is refined. We study an intermediate model of binary-state neural networks with integer weights, corresponding to finite automata, which is extended with an extra analog unit with rational weights, as already two additional analog units allow for Turing universality. We characterize the languages that are accepted by this model in terms of so-called cut languages which are combined in a certain way by usual string operations. We employ this characterization for proving that the languages accepted by neural networks with an analog unit are context-sensitive and we present an explicit example of such non-context-free languages. In addition, we formulate a sufficient condition when these networks accept only regular languages in terms of quasi-periodicity of parameters derived from their weights.
Klíčová slova:
analog unit; computational power; cut languages; neural networks; rational weight Číslo projektu: GBP202/12/G061 (CEP) Poskytovatel projektu: GA ČR
Práva: Dílo je chráněno podle autorského zákona č. 121/2000 Sb.