Don't take an exception trying to remove the file over and over.