See Data transmission.
An information source is often modelled as a discrete-time stochastic process, so it is a sequence of Random variables, taking values in a set called the source alphabet.
An stationary information source is one corresponding to an stationary stochastic process, so that any {finite block of random variables} and {any of its time-shift versions} have exactly the same joint distribution
An important property of an information source is its Entropy rate