Voice to Parliament: 'Yes' vote has many enemies