Don't recreate a device if just the permissions bits have changed