Tempest currently is very much designed to be run out of a git checked out writable tree. This has a number of challenges. It means we don't resolve dependencies at install time, and instead a test time. It means running different sets of tests with tox create different venvs. It also means we don't have a real CLI. Tempest instead should actually have a real UI, should be installable, and have a solid entry point. Some of the CLI work here has been started, but getting us to 'pip install tempest && tempest -h' should be a liberty goal.
