If you want a live Linux with persistence, pickings are slim. I couldn't get a persistent version of Ubuntu running. I don't think Knoppix does persistence. So I turned to a distro I first ran more than 10 years ago: Puppy Linux, which was built for persistence.