Handbook

Many practical experiments involve repeated measurements made over a period of time, where the individuals or systems being observed are evolving during the study period. Examples of this kind of data arise in signal processing, financial modelling and mathematical biology. For experiments of this kind, standard statistical methods that assume data points are independent and identically distributed (iid) are of limited value, due to dependencies among measurements. This unit will introduce statistical methods for such processes.

Topics: Review of fundamental statistics: their distributions, properties and limitations; Stochastic processes: Markov, ARMA, Stationary and diffusion processes; Likelihood models, Graphical models, Bayesian models; Decision theory, Likelihood ratio tests, Bayesian model comparison; Sufficient statistics, Maximum likelihood estimation, Bayesian estimation; Exponential families; Convergence of random variables and measures; Properties of estimators: bias, consistency, efficiency; Laws of large numbers and ergodic theorems, Central limit theorems; Statistics for stationary processes; Statistics for ARMA processes; Statistics for diffusion processes