The joke is a play on words.  'Faults alarm' is intended to sound like 'false alarm' which means an alarm that was sounded when it was not needed.  A conscience is the internal moral actor within people, where one feels bad for doing bad things. If it was one's fault for doing something, their conscience would sound a sort of 'fault alarm' because they know they did something wrong.
Conscience is a faults alarm .