Labor’s permanent visas announcement leaves thousands behind