Obviously, we want to set it to the label's allocated height. Also simplifies the size allocation code.