Perks says it's unfair for someone making minimum wage to get hit with some tax burden as a guy making a million dollars.