At what point do we become "sir" or "ma'am"?

I see this a lot! I'm only 17, but some very young kids have called me sir since I was 15. Recently, when I was still 16, a girl that looked about 12 or 13 called me "sir". I was in an authoritative position, though. So I was just wondering, at what point and in what situations is it appropriate?