Claiming exempt from federal tax withholding on your W4 when you aren’t eligible isn’t illegal but it can have major consequences. You might receive a large tax bill and possible penalties after you file your tax return. What’s the difference between single and head of household?