It's been a while but I don't recall it being too difficult. That said, you are correct that the plastic is fragile. The tabs on the switches are 3000% stiffer than the thin plastic on the bezel they snap into. Can be a bit of a pain to push in to release.

- bezel.jpg (954.8 KiB) Viewed 232 times
Just be careful and avoid excessive force. Probably wise to bring the bezels indoors to transplant switches if it's cold out.