Prosopagnosia can be caused by lesions (damage or changes to body tissue) in the lower part of the brain. It can also be caused by damaging the nerves in the lower part of the brain, called 'acquired prosopagnosia'. It can be caused by birth defects, carbon monoxide poisoning, encephalitis (inflammation of the brain), Parkinson's disease, or Alzheimer's disease.