Minister vows to punish absentee workers