Theory behind dMI
Model training
Model training
Theoretical formulation on the trajectory entropy
Theoretical formulation on the trajectory entropy
Theoretical formulation on the maximum dynamical mutual information
Theoretical formulation on the maximum dynamical mutual information
References
References
Jacquet, P., Seroussi, G., and Szpankowski, W. (2008). On the entropy of a hidden Markov process. Theor. Comput. Sci. 395, 203–219.
Seifert, U. (2005). Entropy Production along a Stochastic Trajectory and an Integral Fluctuation Theorem. Phys. Rev. Lett. 95, 040602.
Collet, P., and Leonardi, F. (2014). Loss of memory of hidden Markov models and Lyapunov exponents. Ann. Appl. Probab. 24, 422–446.
Cover, T.M., and Thomas, J.A. (2012). Elements of Information Theory (John Wiley & Sons).
Selimkhanov, J., Taylor, B., Yao, J., Pilko, A., Albeck, J., Hoffmann, A., Tsimring, L., and Wollman, R. (2014). Accurate information transmission through dynamic biochemical signaling networks. Science 346, 1370–1373.