Who Left the Labor Force during the Pandemic and Great Recessions?