1890, from Harlem + -ite (1).
harem
hark
harken
Harleian
Harlem
Harlemite
harlequin
Harley
harlot
harlotry
harm