What is Saddle Point Stability? What is saddle point stability and what sorts of functions or systems of equations give rise to such a thing? 

For example, would we say that a two systems of stochastic difference equations that are interlinked give rise to an environment with saddle point stability?
"Saddle point stability" refers to dynamical systems, (usually systems of difference or differential equations), where the system has a fixed point, and there exists a single trajectory that leads to the fixed point.

It follows that from a mathematical point of view these systems are in reality unstable.

A 2 X 2 system is the standard example because one can construct intuitive two-dimensional phase diagrams to understand the properties and the behavior of the system over time.

For natural sciences, unstable systems are useless as models -the tiniest deviation, if not corrected, would lead to corner solution (elimination or explosion of the system).

But saddle-path stable systems have found important uses in economics, because this feature of theirs accommodates purposeful behavior. Assume that an economic system described by a set of difference equations was properly stable in the full mathematical sense. That would imply that no matter where we started, automatically the system would tend to its fixed point/long-run equilibrium. But this means that no matter what the economic agents did and how they interact, the system would settle in equilibrium... this does not sound very convincing once we accept that agents try to optimize their situation (in terms of utility, wealth, etc).

But if the system is "saddle-path stable", then agents track the trajectory followed, and if it appears to deviate from the one that leads to the fixed point, they purposefully change their own behavior in order to go back to the desired trajectory, since corner solutions are not optimal.

The standard example here is the basic growth model.