A Florida man who refused to sell his home to a developer now lives in the shadows