Personally, I don't mind a bit of it. As others have said, it does help visualize the character. But huge doses of it make the story hard to read.

Of course, you can have lots of fun with the accents!