 Or perhaps it's something as simple as a very short-term change in the climate that led to a couple of bad summers and therefore poor plant growth. Any kind of small change in the environment when you have such a small population can easily topple it towards extinction.