Add initial tests for the CLI

This allows the tracker command to be run from the source tree, and adds a new 'cli' test which tests runs CLI commands.

Depends on !186 (merged)