Stochastic processes in natural and social phenomena

Course Description: 
Course code: CNSC 6003
Level:  Doctoral or MA

Office hours: upon agreement

Course Description

Very few processes are completely deterministic – an element of randomness is almost always present. The adequate mathematical framework to treat this randomness  is the theory of stochastic processes. They are abundant in practically all aspects of nature and society. The theory of stochastic processes is part of the mathematical theory of probability, however, in this course the pragmatic approach will be taken that the basic laws will be introduced to the students through the analysis of natural and social phenomena.  Relatively limited mathematical prerequisites will be sufficient for attending the course (elementary calculus and some basic knowledge about differential equations). After a short overview of the fundamentals of probability theory we will discuss random processes from physics, population dynamics, epidemiology and finance. We will discuss the basic stochastic processes and the tools to handle them always in a heuristic, application-oriented manner.


WeekSession title
What are stochastic processes? Their abundance. Examples from physics, population dynamics, epidemics and finance.
2Probability theory: A brief summary
Random variables, distributions. Independent variables. Conditional probability. Averages and moment. Central limit theorem. Dependencies. Multivariate problems.
3Poisson process
Radioactivity, random queuing problem, birth-and-death processes. Waiting time distribution. Properties of the Poisson process.
4Renewal processes
Problems of insurance policy. Generalization of the Poisson process to arbitrary waiting time distributions. Waiting time paradox. Renewal equation.
5Markov processes
The Markov property. Brownian motion and random walk. Discrete random walk. Further examples (population dynamics, economics). Markov chains, transition matrix, representation as directed graphs.
6Branching processes
Examples: Genealogy, cascading. The tree topology. The problem of extinction. Tree-approximation to networks with loops.
7Master (rate) equation
Ergodicity. Continuous time Markov processes. Transition probabilities from empirical data. Stationary solution and relaxation to it.
8Fokker-Planck (forward Kolmogorov) equation
Diffusion and migration in space. Derivation of the FP equation, interpretation of the terms. Simple solutions.
9Extreme value statistics
Definition of the problem. Applications: reliability and financial risk estimation. The three basic cases and distributions. Consequences for stochastic processes.
10First passage time problems
Expected lifetimes of patients, the Gambler’s ruin problem. The problem of stability in a noisy environment. Relation to risk estimation. First passage time of the one-dimensional Brownian motion. Characteristic times in the limit order book.
11Stochastic differential equations
The Langevin equation of the Brownian particle. Types of noise, white noise. The Wiener and the Ornstein Uhlenbeck processes. Geometric Brownian motion and the Black-Scholes equation of option pricing.
12Non-Markovian processes
Colored noise, memory effects. Power spectrum, 1/fα noise. Water level fluctuations of the Nile, Hurst exponent. Fractional Brownian motion. White to colored noise transformation. ARCH-GARCH models of return fluctuations.
N.G. van Kampen: Stochastic Processes (North Holland, 1992)
W. Paul and J. Baschnagel: Stochastic Processes – From Physics to Finance (Springer, 1999)
Further literature will be suggested during the course.
Learning Outcomes: 
  • Students will learn, what stochastic processes are and will get acquainted with a broad set of examples from the fields of physics, population dynamics, epidemiology and finance;
  • They will learn the basics of the theory of stochastic processes;
  • They will be able to recognize the need of applying tools from the theory of stochastic processes in solving real world problems;
  • They will acquire skills to solve simple problems in the field of stochastic processes.

(1) Assessment 1 (20% of final grade): Students home works. Simple exercises to deepen understanding.

(2) Assessment 2 (35% of final grade): Midterm test.

(3) Assessment 3 (45% of final grade): Final test. Answering questions to account for understanding the basic concepts. Lecture notes can be used.


Elements of calculus, differential equations.