From social animals to neuronal networks, collective behavior is ubiquitous in living systems. How are these behaviors encoded in interactions, and how do they drive biological functions? Recent insights from statistical physics applied to biological data have offer exciting new perspectives. However, previous research has mostly focused on the statics, i.e. the steady-state distributions of the collective behavior, without taking into consideration of time. In this talk, I will present two recent progresses tapping into the temporal domain. First, I will present a study of collective behavior in social mice from their co-localization patterns. To capture both static and dynamic features of the data, we developed a novel inference method termed the generalized Glauber dynamics that can tune the dynamics while keeping the steady state distribution fixed. The inferred interactions characterize sociability for different mice strains. In the second example, we studied information flow among neurons in the larval zebrafish hindbrain. By adapting the method of Granger causality to single cell calcium transient data, we were able to detect both a global information flow among neurons, as well as identifying brain regions that are key in locomotion. I will conclude with future directions, including developing inference methods for out-of-equilibrium dynamics.