There is an easy remedy for this annoying problem, and it doesn’t involve deleting your account, or even your calendar. I’ve even made sure mine has nothing on it, so why it would keep syncing, I have no clue. You are left sometimes a five full minutes waiting for everything to finish syncing before you can even see any new emails. The Calendar aspect of Windows Live Mail isn’t necessary and an annoying time waster.
The problem with Windows Live Mail is it wastes a heck of a lot of time updating things that frankly you don’t need updated. But it can also be a pain if it’s the only thing you have. Windows Live Mail client can be a blessing when you don’t have another email client to use.