whitey (n.)

"'white' person, person of European descent," 1828, also whity, from white (adj.) + -y (2) and -y (3). Earlier as an adjective, and Whitey-brown was a 19c. descriptive color name, used to describe, among other things, mulatto skin.

Negro troops doing provost duty in Norfolk; keeping the white people in order. On a visit to Norfolk one can see white Southerners, arrested for sundry misdemeanors, working on the public streets, under negro guards. ... It is quite a change to see, in Norfolk, negroes forcing white men to work, at the point of the bayonet; calling out to them: "No loaf'n dar!" "Move quicker, Sah!" "Hurry up dar, Old Whitey!" and similar orders. Tables turned! [diary of Lieut. S. Millett Thompson, 13th New Hampshire Volunteer regiment, U.S. Army, Jan. 25, 1864; diary published 1888 by Houghton, Mifflin & Co.]