Yeah, there's no "get out of life free" card, so a non-believer has to put extra energy into making this world better. No virgins or well-oiled slaves for us in the afterlife, so we can't behave irresponsibly. We just have to suck it up, feed the hungry, clothe the poor, and smell the flowers. :)