Unless you were paying into it out of taxed income (surely you had tax relief?) the "hefty wad" of tax you payed was only the tax you had avoided while saving for your travels. Anyway, tax works the other way too. If you still have cold feet about spending your own money you can live frugally for a couple of years and dump a big chunk of your earnings into a pension and get the tax back that way.