Cleaning with a cheap baby wipe and/or alcohol (hand sanitizer works well) will cause less swelling. I also put most of my stuff into a tupperware filled with plain salt and shake it around. That’ll take off most of the loose char.
There’s also something to be said for perfecting your settings so you get the least amount of char possible. If you’re changing materials frequently that may not be worth it, but if you tend to use the same it can save a lot of time in the long run!