[Concept] [PATCH v2 25/29] test/py: Handle a failure during configuration