You probably just wash it off with soap and water, maybe a glass scraper. Chalk paint is pretty much calcium-based stuff (chalk, crushed eggshells, etc) in a tinted acrylic paint. Unfrosted glass is not paint friendly and is probably happy for you to remove the skin.
2 Likes