"buttocks, hinder part of an animal," Old English ærs "tail, rump," from Proto-Germanic *arsoz (source also of Old Saxon, Old High German, Old Norse ars, Middle Dutch ærs, German Arsch "buttock"), from PIE root *ors- "buttock, backside" (source also of Greek orros "tail, rump, base of the spine," Hittite arrash, Armenian or "buttock," Old Irish err "tail").
To hang the arse "be reluctant or tardy" is from 1630s. Middle English had arse-winning "money obtained by prostitution" (late 14c.). To turn arse over tip is attested by 1884, along with the alternative arse over tit.