There is nothing wrong with breast feeding, some discreation is needed.
My story

My very shy husband and I had just done a puppet show on the beach of a lake at a SCA event many years ago when this lady comes up with a 5 or 6 year old child, the woman isn't wearing much as it was. The little boy crawled into her lap and and took out the breast and began nursing all the while cuddling with her other breast. My hubby turned so red I thought he was about to pass out. He was mortified and the lady just kept chatting with him and all he wanted to do was run away, he's a gentleman and continued to listen to her talk as he looked anywhere but at her. I still giggle at his response. I still think breast feeding a child that has a full set of teeth is really pushing it, there is a time to wean them.