Set xfer_dirs when we set list_only.