1828, from ultra- "beyond" + conservative (adj.).
ultimate
ultimatum
ultimo
ultra-
ultra vires
ultra-conservative
ultralight
ultramarine
ultramontane
ultranationalism
ultrasonic