1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77
|
@issue
Feature: Issue #46 Behave returns 0 (SUCCESS) even in case of test failures
As I behave user
I want to detect test success or test failures
By using the process return value, 0 (SUCCESS) and non-zero for failure.
Background: Test Setup
Given a new working directory
Given a file named "features/steps/steps.py" with:
"""
from behave import given
@given(u'passing')
def step(context):
pass
@given(u'failing')
def step(context):
assert False, "failing"
"""
Scenario: Successful Execution
Given a file named "features/passing.feature" with:
"""
Feature: Passing
Scenario: Passing Scenario Example
Given passing
"""
When I run "behave -c -q features/passing.feature"
Then it should pass with:
"""
1 feature passed, 0 failed, 0 skipped
1 scenario passed, 0 failed, 0 skipped
1 step passed, 0 failed, 0 skipped, 0 undefined
"""
Scenario: Failing Execution
Given a file named "features/failing.feature" with:
"""
Feature: Failing
Scenario: Failing Scenario Example
Given failing
"""
When I run "behave -c -q features/failing.feature"
Then it should fail with:
"""
0 features passed, 1 failed, 0 skipped
0 scenarios passed, 1 failed, 0 skipped
0 steps passed, 1 failed, 0 skipped, 0 undefined
"""
Scenario: Passing and Failing Execution
Given a file named "features/passing_and_failing.feature" with:
"""
Feature: Passing and Failing
Scenario: Passing Scenario Example
Given passing
Scenario: Failing Scenario Example
Given failing
"""
When I run "behave -c -q features/passing_and_failing.feature"
Then it should fail with:
"""
0 features passed, 1 failed, 0 skipped
1 scenario passed, 1 failed, 0 skipped
1 step passed, 1 failed, 0 skipped, 0 undefined
"""
And the command output should contain:
"""
Feature: Passing and Failing
Scenario: Passing Scenario Example
Given passing
Scenario: Failing Scenario Example
Given failing
Assertion Failed: failing
"""
|