Don't call utimes() on a dir that doesn't need its mtime changed.