"a remote chance," 1861, from off (prep.) + chance (n.).
off-and-on
off-base
offbeat
off-Broadway
off-camera
off-chance
off-color
off-colour
off-duty
offence
offend