Is there a place for released prisoners to "start over" a half way house, so they don't do anything illegal to support themselves until they can get on their feet again?

Yes, there are halfway houses that inmates are sent to before their actual release back into society. When your inmate gets closer to their out-date, they will meet with their counselor or case manager to discuss the upcoming steps for re-entry. This includes halfway house, finding a job and suitable living arrangements.