More resources in simplicity bias in FSTs

cosmos 11th April 2018 at 3:37pm

See Simplicity bias in finite-state transducers

Statistical properties of FSTs

The graph structure of a deterministic automaton chosen at random

See Random deterministic automata

Origin of bias ideas

Topological trace formula

Random matrix product

Entropy reduction

On the entropy of a hidden Markov process

On Grammars, Complexity, and Information Measures of Biological Macromolecules

Activities and Sensitivities in Boolean Network Models

Complexity

Complexity theoryDescriptional complexity

–>Entropy and complexity of finite sequences as fluctuating quantities

–>Lempel-Ziv complexity analysis of one dimensional cellular automata

Coding Theorems for Individual Sequences . His complexity measure looks very similar to the topological entropy defined here.

http://arxiv.org/pdf/1512.04270v2.pdf . ϵ\epsilon-machines reconstruction or computational mechanics, is a powerful tool in the analysis of complexity, which has been used in a wealth of different theoretical and practical situations.

Lempel-Ziv complexity

Network complexity


To look at

Entropy of Hidden Markov Processes and Connections to Dynamical Systems: Papers from the Banff International Research Station WorkshopCodes, Systems, and Graphical ModelsAn Introduction to Symbolic Dynamics and CodingFundamentals of Codes, Graphs, and Iterative DecodingTopological Entropy and Equivalence of Dynamical SystemsSymbolic Dynamics and Its ApplicationsErgodic Theory and Topological Dynamics of Group Actions on Homogeneous SpacesSubstitutions in Dynamics, Arithmetics and CombinatoricsCombinatorics on WordsFractal Geometry, Complex Dimensions and Zeta FunctionsDynamics and Randomness

Resolving Markov Chains Onto Bernoulli Shifts Via Positive Polynomials

Complexity of strings in the class of Markov sourcescitations

On the entropy of a hidden Markov processcitations

lempel ziv complexity finite state channel lempel ziv complexity markov model

Check what these are! epsilon machines

Random matrix product

Capacity of finite state channels based on Lyapunov exponents of random matrices

Basic properties of the projective product with application to products of column-allowable