Doesn't matter if you're desperate or insecure or whatever--he married you in spite of your perceived flaws. It should not be that easy to cheat and leave a 20-year marriage unless it was already on it's way down.

Still though. Absolutely selfish on his part.