One reason is that many priests don't take your sins seriously, especially if they are of a venial nature.
I mean how many times can you confess the same lame little sin, with the priest telling you "not to worry" (and you know it's a sin) before you decide: never mind! Not worth the bother.
Catholics don't take confession seriously, because priests don't take confession seriously.