 So how this pastor pays the IRS won't factor at all into Social Security's determination, but not paying estimated taxes quarterly could affect his total income tax obligation for the tax year, which is what his accountant should be able to tell him.