mid-16c., piece of brick (half or less) used as a missile, from brick (n.) + bat (n.1) in the sense "a lump, piece." Figurative use, of comments, insults, etc., is from 1640s.
Briareus
bribe
bribery
bric-a-brac
brick
brickbat
brickette
bricklayer
brickwork
brickyard
bricolage