1858, "defective or inferior because not of a natural or proper color," from off (prep.) + color (n.); originally used of gems; figurative extension to "not of the proper character, of questionable taste, risqué" is American English, 1867.
an off-color joke
off-color jokes
off-base
offbeat
off-Broadway
off-camera
off-chance
off-color
off-colour
off-duty
offence
offend
offender