Unifying neural representations by infusing invariances