"token worn to indicate the wearer's occupation, preference, etc.," especially "device worn by servants or followers to indicate their allegiance," from Anglo-French bage (mid-14c.) or Anglo-Latin bagis, plural of bagia "emblem," all of unknown origin. Figurative sense "mark or token" of anything is by 1520s.