Acceptance & Integration Testing With Behat (PBC11)

Acceptance &
Integration
Testing Using
Behat
Ben Waine
Email: ben@ben-waine.co.uk
Twitter: @bwaine

Saturday, 29 October 11

Pair Programming

Say hello to the person next to you....


Set Up

USB Stick


Set Up
For instant set up:

1) Copy code into a new vhost with the web root
pointing at the ‘public’ folder.

2) Uncomment line 13 in:
tests/acceptance/features/bootstrap/UIContext.php

3) Install Sahi from the misc folder.


Set Up
Goto: tests/acceptance/

If setting up today run the Behat command using
behat.phar
eg: php behat.phar --tags demo1

If you have previously set up, run the
behat command
eg: behat --tags demo1


Me
Software Engineer
PHP Developer

Sky Bet
PHP / MySQL Stack
PHPUnit / Selenium / Behat


Roadmap
•Intro To Behaviour Driven Development
•Introducing Behat
•Gherkin & Steps
•API / Service Layer Testing
•UI Testing
•Phabric - Dynamic Fixture Creation


joind.in

http://joind.in/talk/view/4328


What Marco Said......


Stories


What is BDD?


Introducing Behat....


Resistance is futile.......

Origins in Rubys cucumber

What Does It Test?

Scripts
API’s
Web Pages
Models


Integration Testing
!=
Unit Testing


Anatomy Of A Behat Test



Describes the behaviour in a story
Human Readable
Samples Later


PHP that maps to lines of the gherkin.
Behat parses gherkin and runs the associated
steps.

Writing Behat Tests

$ben > cd /path/to/projects/tests
$ben > behat --init


Bootstrap Behat. Provides you with a structure

Writing Behat Tests


Feature Files

Feature: Home Page
When visiting the PHPCon site
As a site visitor
I need to be able to see what
` conferences are coming up


Name of test
Description of test

Scenarios
Scenario: Get all conferences
Given there is conference data in the database
When I go to the homepage
Then I should see three conferences in a table


Scenario.
Multiple scenarios in a single feature ﬁle

Scenarios
Given
(Some Context)

When
(Some Event)

Then
(The Outcome)


Keywords.
Always follow the same formula

Given
(Some Context)


Sets up some state or context

When
(Some Event)
When I go to the homepage

When I use the findConferences method
When I am on "/index.php"

When I fill in "search-text" with "PHP"


Executes whatever it is your testing.
A http call, a method invocation, a page load

Then
(The Outcome)
Then I should see three conferences in a table

Then I should get a array of three conferences

Then I should see "PHPNW"


An assertion.
Has it worked?
Are we seeing what we expect to see.

ConferenceService.feature

Feature: ConferenceService Class
In order to display conferences on
PHPCon site
As a developer
I need to be able to retrieve conferences

Scenario: Get all conferences
When I use the findConferences method
Then I should get a array of three conferences
AND it should contain the conference “PHPNW”


Written By our TESTERS - Fed In From BAs
How is this feature executed?
Each step is reusable!
MENTION PHP METHODS + ANNOTATIONS!!!!

Class Methods & Annotations


Written By our TESTERS - Fed In From BAs
How is this feature executed?
Each step is reusable!
MENTION PHP METHODS + ANNOTATIONS!!!!

/ Everybody Stand Back /
Behat Knows Regular Expressions


PHP Annotations used to map steps to lines
Behat supplies regex.

Demo One

Behat’s - Regex Fu


Introducing.......
The Sample Domain


My Amazing PHP Conference
Website


Service Layers


Demo One


Fill in the Feature Context File
public function __construct(array $parameters)
{
$params = array(
'user' => $parameters['database']['username'],
'password' => $parameters['database']['password'],
'driver' => $parameters['database']['driver'],
'path' => $parameters['database']['dbPath'],
);

$con = DoctrineDBALDriverManager::getConnection($params);

$confMapper = new PHPConConferenceMapper($con);
$confService = new PHPConConferenceService($confMapper);

$this->service = $confService;
}


The Feature context ﬁle
- Ever feature gets a instance. Set up some
resources.
- Set up the object to test - similar to PHPUnit’s set
up method.


/**
* @Given /^there is conference data in the database$/
*/
public function thereIsConferneceDataInTheDatabase()
{
$fileName = self::$dataDir .
'sample-conf-session-data.sql';
self::executeQueriesInFile($fileName);
}


Remember - Given sets the state.
Loads an sql ﬁxture to the DB.


/**
* @When /^I use the findConferences method$/
*/
public function iUseTheFindConferencesMethod()
{
$this->result = $this->service->findConferences();

}


Remember - When executes the thing you want to
test.

/**
*@Then /Î should get an array of (d+) conferences$/
*/
public function iShouldGetAnArrayOfConferences
($numberOfCons)
{
assertInternalType('array', $this->result);
assertEquals($numberOfCons, count($this->result));
}


Remember - This verifies the output
Also - identified a number. Passes the number into
the method.

/**
* @Then /^it should contain the
* conference "([^"]*)"$/
*/
public function itShouldContainTheConference
($confName)
{
$names = array();

foreach($this->result as $conf)
{
$names[$conf->getName()] = true;
}

if(!array_key_exists($confName, $names))
{
throw new Exception("Conference "
. $confName . " not found");
}
}


Exceptions == Test Failures


Demo Two

Passing Behat Test


Exercise One

Testing a service layer with Behat.


Exercise One

Open the PDF in the misc folder.
Read through Section One.
Start Coding :)


Failing Test


If exceptions are encountered .....

Passing Test!


What about the UI?


We’ve covered testing a service class. But how do you test the UI?

Mink


Part of the Behat Project.
A abstraction over a number of different browser testing tools.

Mink

Goutte Sahi

Zombie.js


Goutte - headless browser
Sahi - like selenium
Zombie.js -

Extend Mink Context

Includes predeﬁned steps

Use Bundled steps to create
higher level abstractions.


Back To:
My Amazing PHP Conference
Website!


We need a UI to test
introducing.....

Example

Using Minks Bundled Steps

Scenario: View all conferences on the homepage
When I am on "/index.php"
Then I should see "PHPNW" in the ".conferences" element
And I should see "PHPUK" in the ".conferences" element
And I should see "PBC11" in the ".conferences" element


This is ok - but ties the feature to your implementation.

Link
FeatureContext.php
to
UIContext.php



class FeatureContext

public function __construct(array $parameters)
{
$this->useContext('subcontext_alias',
new UIContext($parameters));

! // REST OF FEATURE CONSTRUCTOR

}

# features/bootstrap/UIContext.php

use BehatBehatContextClosuredContextInterface,
BehatBehatContextBehatContext,
BehatBehatExceptionPendingException;

use BehatGherkinNodePyStringNode,
BehatGherkinNodeTableNode;

require_once 'mink/autoload.php';

class UIContext extends BehatMinkBehatContextMinkContext
{

}


1) Linking feature ﬁles
2) All steps included ‘out the box’

Demo Three

A Behat UI Test (Using Mink + Goutte)



Exercise Two

Testing the UI with Mink and
the headless browser Goutte.


Exercise Two

Open the PDF in the sources folder.
Read through Section Two.
Start Coding :)


Abstracting your scenario

Scenario: View all conferences on the homepage
When I am on the "home" page
Then I should see "PHPNW" in the "conferences table”
And I should see "PHPUK" in the "conferences table”
And I should see "PBC11" in the "conferences table”


Mink Feature Context

class UIContext extends BehatMinkBehatContext
MinkContext
{
protected $pageList = array(
"home" => '/index.php');
protected $elementList = array(
"conferences table" => '.conferences');


A simple abstraction that makes a map of pages >
urls and elements > css selectors.
Example of step delegation.
Now you never change the feature ﬁle. Just steps.

/**
* @When /^I am on the "([^"]*)" page$/
*/
public function iAmOnThePage($pageName) {

if(!isset($this->pageList[$pageName])) {
throw new Exception(
'Page Name: not in page list');
}

$page = $this->pageList[$pageName];

return new When("I am on "$page"");
}



/**
* @Then /^I should see "([^"]*)" in the "([^"]*)"$/
*/
public function iShouldSeeInThe($text, $element) {
if(!isset($this->elementList[$element])) {
throw new Exception(
'Element: ' . $element . ‘not in element list');
}
$element = $this->elementList[$element];

return
new Then("I should see "$text" in the
"$element" element");
}



Demo Four

A Behat UI Test (Using Mink + Goutte)
UI implementation abstracted away from Gherkin.



Exercise Three

Abstracting the UI implementation away from the
Gherkin.


Exercise Three

Read through Section Three.
Start Coding :)


Javascript Testing with
Sahi


Example
@javascript
Scenario: Use autocomplete functionality to
complete a input field
Given there is conference data in the
database
And I wait for the suggestion box to appear


Mention @tags
SO you need to test java script.
Headless browser isn’t suitable.

Great Reuse

@javascript
Scenario: Use autocomplete functionality to
complete a input field
Given there is conference data in the
database
And I wait for the suggestion box to appear


These are supplied by Mink. Woohoo!
REUSE

// In the UIContext class
/**
* @Given /^I wait for the suggestion box to appear$/
*/
public function iWaitForTheSuggestionBoxToAppear()
{
$this->getSession()->wait(5000,
"$('.suggestions-results').children().length > 0"
);
}


Get session - gets you mink
Wait,
Then execute jquery!

Demo Five

UI Testing With Sahi



Exercise Four

UI Testing With Sahi


Exercise Four

Read through Section Four.
Start Coding :)


Data


How do you supply your data?

SQL Fixture


Can be difficult to maintain.
Hides Data in a ﬁxture NOT in your scenarios.

Phabric


Demo Five

Dynamic ﬁxture creation with Phabric.



Case Study:
Behat at Sky Bet


Whats the problem we are solving.
Three elements of the team.
Delivering the product ﬁrst time. Correctly.

The Problem



The Business
Analyst

BA / Product owner has all the knowledge
Write stories

The Tester


Testers test implementation vs the story

The
Developer

Dev - write the code
Automate the process of testing if code meets the
requirements of a story

BDD - Skybet Workﬂow

BA’s Write Stories

Testers Write Gherkin

Developers Write Steps + Code



BDD - Skybet Workﬂow

Less Defects

Fewer times through this cycle



The Place Of Acceptance &
Integration Tests



Balance.


Jason Huggins
The place of acceptance and integration tests

A whole world of trouble.


Takes a long time to run,
Harder to implement, when they break you have to do this again!
not as reassuring!

Questions?


Links
Behat Github Page: https://github.com/Behat/Behat

Mink On Github: https://github.com/Behat/Mink

Website: http://behat.org/

Phabric On Github: https://github.com/benwaine/
Phabric


Acceptance & Integration Testing With Behat (PBC11)

Recommended

Recommended

More Related Content

What's hot

What's hot (15)

Viewers also liked

Viewers also liked (6)

Similar to Acceptance & Integration Testing With Behat (PBC11)

Similar to Acceptance & Integration Testing With Behat (PBC11) (20)

More from benwaine

More from benwaine (9)

Recently uploaded

Recently uploaded (20)

Acceptance & Integration Testing With Behat (PBC11)