 Determining how much income tax to have withheld from your Social Security is something that is best discussed with a qualified tax advisor who has access to all of your income data. Your recommended tax withholding rate for income tax purposes depends upon your overall taxable income level and the tax rate which results from that income.