__init__.py files are required for unittest autodiscovery to work. We should have a small unittest that verifies that all test_*.py files have the required __init__.py files present.