Taxes are withheld with the assumption that you will make that amount the entire year. If taxes were withheld half the year and you had no income for the other half, you will get most, if not all of it back because your annual income will be half the rate the withholding was based on.