 Japan has this problem in spades and has a massive government debt to GDP ratio. The whole financial system could come crashing down. And then eventually populations actually start declining. In the UK as a whole now, we probably have more deaths every year than births. Without immigration, our population would be declining. And that in itself, apart from all the practical issues, seems a great tragedy if societies, communities, cultures are going to start disappearing.