The joke is a pun.  When reading a decimal number out loud, the period is read as 'point' or 'dot', for example 'one point five'.  To say something 'has a point' means that it has some reason or meaning .
Decimals have a point .