Skip addresses with a space in is_host_with_port()

Addresses with a space shouldn't be treated as a valid host with port. Just exit early.

Fixes: #1418 (closed)