[ Yes, Natsuno knows the fact he himself isn't picking up a pitchfork yet doesn't mean much, he just doesn't care. ]

Rest assured that from as much as I've seen, most of the villagers really don't care. At worst they might make some jokes about it.