Ignore errors from chmod when --preserve-perms/-p/-a are not set.