You cannot select more than 25 topics
Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
466 lines
18 KiB
XML
466 lines
18 KiB
XML
<?xml version="1.0"?>
|
|
<page title="Simple Test for PHP" here="SimpleTest">
|
|
<long_title>
|
|
Download the Simple Test testing framework -
|
|
Unit tests and mock objects for PHP
|
|
</long_title>
|
|
<content>
|
|
<news>
|
|
1.0.1 release cycle started.
|
|
Features include include file upload, better PHP5 support for
|
|
mock objects, and HTML label support.
|
|
There is also a big clean up of method names and some internals
|
|
refactoring.
|
|
</news>
|
|
<introduction>
|
|
<p>
|
|
The following assumes that you are familiar with the concept
|
|
of unit testing as well as the PHP web development language.
|
|
It is a guide for the impatient new user of
|
|
<a href="https://sourceforge.net/project/showfiles.php?group_id=76550">SimpleTest</a>.
|
|
For fuller documentation, especially if you are new
|
|
to unit testing see the ongoing
|
|
<a local="unit_test_documentation">documentation</a>, and for
|
|
example test cases see the
|
|
<a href="http://www.lastcraft.com/first_test_tutorial.php">unit testing tutorial</a>.
|
|
</p>
|
|
</introduction>
|
|
<section name="unit" title="Using the tester quickly">
|
|
<p>
|
|
Amongst software testing tools, a unit tester is the one
|
|
closest to the developer.
|
|
In the context of agile development the test code sits right
|
|
next to the source code as both are written simultaneously.
|
|
In this context SimpleTest aims to be a complete PHP developer
|
|
test solution and is called "Simple" because it
|
|
should be easy to use and extend.
|
|
It wasn't a good choice of name really.
|
|
It includes all of the typical functions you would expect from
|
|
<a href="http://www.junit.org/">JUnit</a> and the
|
|
<a href="http://sourceforge.net/projects/phpunit/">PHPUnit</a>
|
|
ports, but also adds
|
|
<a href="http://www.mockobjects.com">mock objects</a>.
|
|
It has some <a href="http://sourceforge.net/projects/jwebunit/">JWebUnit</a>
|
|
functionality as well.
|
|
This includes web page navigation, cookie testing and form submission.
|
|
</p>
|
|
<p>
|
|
The quickest way to demonstrate is with an example.
|
|
</p>
|
|
<p>
|
|
Let us suppose we are testing a simple file logging class called
|
|
<code>Log</code> in <em>classes/log.php</em>.
|
|
We start by creating a test script which we will call
|
|
<em>tests/log_test.php</em> and populate it as follows...
|
|
<php><![CDATA[
|
|
<?php<strong>
|
|
require_once('simpletest/unit_tester.php');
|
|
require_once('simpletest/reporter.php');
|
|
require_once('../classes/log.php');
|
|
|
|
class TestOfLogging extends UnitTestCase {
|
|
}</strong>
|
|
?>
|
|
]]></php>
|
|
Here the <em>simpletest</em> folder is either local or in the path.
|
|
You would have to edit these locations depending on where you
|
|
placed the toolset.
|
|
The <code>TestOfLogging</code> is our frst test case and it's
|
|
currently empty.
|
|
</p>
|
|
<p>
|
|
Now we have five lines of scaffolding code and still no tests.
|
|
However from this part on we get return on our investment very quickly.
|
|
We'll assume that the <code>Log</code> class
|
|
takes the file name to write to in the constructor and we have
|
|
a temporary folder in which to place this file...
|
|
<php><![CDATA[
|
|
<?php
|
|
require_once('simpletest/unit_tester.php');
|
|
require_once('simpletest/reporter.php');
|
|
require_once('../classes/log.php');
|
|
|
|
class TestOfLogging extends UnitTestCase {
|
|
<strong>
|
|
function testCreatingNewFile() {
|
|
@unlink('/temp/test.log');
|
|
$log = new Log('/temp/test.log');
|
|
$this->assertFalse(file_exists('/temp/test.log'));
|
|
$log->message('Should write this to a file');
|
|
$this->assertTrue(file_exists('/temp/test.log'));
|
|
}</strong>
|
|
}
|
|
?>
|
|
]]></php>
|
|
When a test case runs it will search for any method that
|
|
starts with the string <code>test</code>
|
|
and execute that method.
|
|
We would normally have more than one test method of course.
|
|
Assertions within the test methods trigger messages to the
|
|
test framework which displays the result immediately.
|
|
This immediate response is important, not just in the event
|
|
of the code causing a crash, but also so that
|
|
<code>print</code> statements can display
|
|
their content right next to the test case concerned.
|
|
</p>
|
|
<p>
|
|
To see these results we have to actually run the tests.
|
|
If this is the only test case we wish to run we can achieve
|
|
it with...
|
|
<php><![CDATA[
|
|
<?php
|
|
require_once('simpletest/unit_tester.php');
|
|
require_once('simpletest/reporter.php');
|
|
require_once('../classes/log.php');
|
|
|
|
class TestOfLogging extends UnitTestCase {
|
|
|
|
function testCreatingNewFile() {
|
|
@unlink('/temp/test.log');
|
|
$log = new Log('/temp/test.log');
|
|
$this->assertFalse(file_exists('/temp/test.log'));
|
|
$log->message('Should write this to a file');
|
|
$this->assertTrue(file_exists('/temp/test.log'));
|
|
}
|
|
}
|
|
<strong>
|
|
$test = &new TestOfLogging();
|
|
$test->run(new HtmlReporter());</strong>
|
|
?>
|
|
]]></php>
|
|
</p>
|
|
<p>
|
|
On failure the display looks like this...
|
|
<div class="demo">
|
|
<h1>testoflogging</h1>
|
|
<span class="fail">Fail</span>: testcreatingnewfile->True assertion failed.<br />
|
|
<div style="padding: 8px; margin-top: 1em; background-color: red; color: white;">1/1 test cases complete.
|
|
<strong>1</strong> passes and <strong>1</strong> fails.</div>
|
|
</div>
|
|
...and if it passes like this...
|
|
<div class="demo">
|
|
<h1>testoflogging</h1>
|
|
<div style="padding: 8px; margin-top: 1em; background-color: green; color: white;">1/1 test cases complete.
|
|
<strong>2</strong> passes and <strong>0</strong> fails.</div>
|
|
</div>
|
|
And if you get this...
|
|
<div class="demo">
|
|
<b>Fatal error</b>: Failed opening required '../classes/log.php' (include_path='') in <b>/home/marcus/projects/lastcraft/tutorial_tests/Log/tests/log_test.php</b> on line <b>7</b>
|
|
</div>
|
|
it means you're missing the <em>classes/Log.php</em> file that could look like...
|
|
<php><![CDATA[
|
|
<?php
|
|
class Log {
|
|
|
|
function Log($file_path) {
|
|
}
|
|
|
|
function message() {
|
|
}
|
|
}
|
|
?>;
|
|
]]></php>
|
|
</p>
|
|
</section>
|
|
<section name="group" title="Building group tests">
|
|
<p>
|
|
It is unlikely in a real application that we will only ever run
|
|
one test case.
|
|
This means that we need a way of grouping cases into a test
|
|
script that can, if need be, run every test in the application.
|
|
</p>
|
|
<p>
|
|
Our first step is to strip the includes and to undo our
|
|
previous hack...
|
|
<php><![CDATA[
|
|
<?php<strong>
|
|
require_once('../classes/log.php');</strong>
|
|
|
|
class TestOfLogging extends UnitTestCase {
|
|
|
|
function testCreatingNewFile() {
|
|
@unlink('/temp/test.log');
|
|
$log = new Log('/temp/test.log');
|
|
$this->assertFalse(file_exists('/temp/test.log'));
|
|
$log->message('Should write this to a file');
|
|
$this->assertTrue(file_exists('/temp/test.log'));<strong>
|
|
}
|
|
}
|
|
?></strong>
|
|
]]></php>
|
|
Next we create a new file called <em>tests/all_tests.php</em>
|
|
and insert the following code...
|
|
<php><![CDATA[
|
|
<strong><?php
|
|
require_once('simpletest/unit_tester.php');
|
|
require_once('simpletest/reporter.php');
|
|
|
|
$test = &new TestSuite('All tests');
|
|
$test->addTestFile('log_test.php');
|
|
$test->run(new HtmlReporter());
|
|
?></strong>
|
|
]]></php>
|
|
The method <code>TestSuite::addTestFile()</code>
|
|
will include the test case file and read any new classes created
|
|
that are descended from <code>SimpleTestCase</code>, of which
|
|
<code>UnitTestCase</code> is one example.
|
|
Just the class names are stored for now, so that the test runner
|
|
can instantiate the class when it works its way
|
|
through your test suite.
|
|
</p>
|
|
<p>
|
|
For this to work properly the test case file should not blindly include
|
|
any other test case extensions that do not actually run tests.
|
|
This could result in extra test cases being counted during the test
|
|
run.
|
|
Hardly a major problem, but to avoid this inconvenience simply add
|
|
a <code>SimpleTestOptions::ignore()</code> directive
|
|
somewhere in the test case file.
|
|
Also the test case file should not have been included
|
|
elsewhere or no cases will be added to this group test.
|
|
This would be a more serious error as if the test case classes are
|
|
already loaded by PHP the <code>TestSuite::addTestFile()</code>
|
|
method will not detect them.
|
|
</p>
|
|
<p>
|
|
To display the results it is necessary only to invoke
|
|
<em>tests/all_tests.php</em> from the web server.
|
|
</p>
|
|
</section>
|
|
<section name="mock" title="Using mock objects">
|
|
<p>
|
|
Let's move further into the future.
|
|
</p>
|
|
<p>
|
|
Assume that our logging class is tested and completed.
|
|
Assume also that we are testing another class that is
|
|
required to write log messages, say a
|
|
<code>SessionPool</code>.
|
|
We want to test a method that will probably end up looking
|
|
like this...
|
|
<php><![CDATA[<strong>
|
|
class SessionPool {
|
|
...
|
|
function logIn($username) {
|
|
...
|
|
$this->_log->message("User $username logged in.");
|
|
...
|
|
}
|
|
...
|
|
}
|
|
</strong>
|
|
]]></php>
|
|
In the spirit of reuse we are using our
|
|
<code>Log</code> class.
|
|
A conventional test case might look like this...
|
|
<php><![CDATA[<strong>
|
|
<?php
|
|
require_once('../classes/log.php');
|
|
require_once('../classes/session_pool.php');
|
|
|
|
class TestOfSessionLogging extends UnitTestCase {
|
|
|
|
function setUp() {
|
|
@unlink('/temp/test.log');
|
|
}
|
|
|
|
function tearDown() {
|
|
@unlink('/temp/test.log');
|
|
}
|
|
|
|
function testLogInIsLogged() {
|
|
$log = new Log('/temp/test.log');
|
|
$session_pool = &new SessionPool($log);
|
|
$session_pool->logIn('fred');
|
|
$messages = file('/temp/test.log');
|
|
$this->assertEqual($messages[0], "User fred logged in.\n");
|
|
}
|
|
}
|
|
?></strong>
|
|
]]></php>
|
|
This test case design is not all bad, but it could be improved.
|
|
We are spending time fiddling with log files which are
|
|
not part of our test. Worse, we have created close ties
|
|
with the <code>Log</code> class and
|
|
this test.
|
|
What if we don't use files any more, but use ths
|
|
<em>syslog</em> library instead?
|
|
Did you notice the extra carriage return in the message?
|
|
Was that added by the logger?
|
|
What if it also added a time stamp or other data?
|
|
</p>
|
|
<p>
|
|
The only part that we really want to test is that a particular
|
|
message was sent to the logger.
|
|
We reduce coupling if we can pass in a fake logging class
|
|
that simply records the message calls for testing, but
|
|
takes no action.
|
|
It would have to look exactly like our original though.
|
|
</p>
|
|
<p>
|
|
If the fake object doesn't write to a file then we save on deleting
|
|
the file before and after each test. We could save even more
|
|
test code if the fake object would kindly run the assertion for us.
|
|
<p>
|
|
</p>
|
|
Too good to be true?
|
|
Luckily we can create such an object easily...
|
|
<php><![CDATA[
|
|
<?php
|
|
require_once('../classes/log.php');
|
|
require_once('../classes/session_pool.php');<strong>
|
|
Mock::generate('Log');</strong>
|
|
|
|
class TestOfSessionLogging extends UnitTestCase {
|
|
|
|
function testLogInIsLogged() {<strong>
|
|
$log = &new MockLog();
|
|
$log->expectOnce('message', array('User fred logged in.'));</strong>
|
|
$session_pool = &new SessionPool($log);
|
|
$session_pool->logIn('fred');
|
|
}
|
|
}
|
|
?>
|
|
]]></php>
|
|
The test will be triggered when the call to
|
|
<code>message()</code> is invoked on the
|
|
<code>MockLog</code> object.
|
|
The mock call will trigger a parameter comparison and then send the
|
|
resulting pass or fail event to the test display.
|
|
Wildcards can be included here too so as to prevent tests
|
|
becoming too specific.
|
|
</p>
|
|
<p>
|
|
If the mock reaches the end of the test case without the
|
|
method being called, the <code>expectOnce()</code>
|
|
expectation will trigger a test failure.
|
|
In other words the mocks can detect the absence of
|
|
behaviour as well as the presence.
|
|
</p>
|
|
<p>
|
|
The mock objects in the SimpleTest suite can have arbitrary
|
|
return values set, sequences of returns, return values
|
|
selected according to the incoming arguments, sequences of
|
|
parameter expectations and limits on the number of times
|
|
a method is to be invoked.
|
|
</p>
|
|
<p>
|
|
For this test to run the mock objects library must have been
|
|
included in the test suite, say in <em>all_tests.php</em>.
|
|
</p>
|
|
</section>
|
|
<section name="web" title="Web page testing">
|
|
<p>
|
|
One of the requirements of web sites is that they produce web
|
|
pages.
|
|
If you are building a project top-down and you want to fully
|
|
integrate testing along the way then you will want a way of
|
|
automatically navigating a site and examining output for
|
|
correctness.
|
|
This is the job of a web tester.
|
|
</p>
|
|
<p>
|
|
The web testing in SimpleTest is fairly primitive, there is
|
|
no JavaScript for example.
|
|
To give an idea here is a trivial example where a home
|
|
page is fetched, from which we navigate to an "about"
|
|
page and then test some client determined content.
|
|
<php><![CDATA[
|
|
<?php<strong>
|
|
require_once('simpletest/web_tester.php');</strong>
|
|
require_once('simpletest/reporter.php');
|
|
<strong>
|
|
class TestOfAbout extends WebTestCase {
|
|
|
|
function setUp() {
|
|
$this->get('http://test-server/index.php');
|
|
$this->click('About');
|
|
}
|
|
|
|
function testSearchEngineOptimisations() {
|
|
$this->assertTitle('A long title about us for search engines');
|
|
$this->assertPattern('/a popular keyphrase/i');
|
|
}
|
|
}</strong>
|
|
$test = &new TestOfAbout();
|
|
$test->run(new HtmlReporter());
|
|
?>
|
|
]]></php>
|
|
With this code as an acceptance test you can ensure that
|
|
the content always meets the specifications of both the
|
|
developers and the other project stakeholders.
|
|
</p>
|
|
<p>
|
|
<a href="http://sourceforge.net/projects/simpletest/"><img src="http://sourceforge.net/sflogo.php?group_id=76550&type=5" width="210" height="62" border="0" alt="SourceForge.net Logo"/></a>
|
|
</p>
|
|
</section>
|
|
</content>
|
|
<internal>
|
|
<link>
|
|
<a href="#unit">Using unit tester</a>
|
|
with an example.
|
|
</link>
|
|
<link>
|
|
<a href="#group">Grouping tests</a>
|
|
for testing with one click.
|
|
</link>
|
|
<link>
|
|
<a href="#mock">Using mock objects</a>
|
|
to ease testing and gain tighter control.
|
|
</link>
|
|
<link>
|
|
<a href="#web">Testing web pages</a>
|
|
at the browser level.
|
|
</link>
|
|
</internal>
|
|
<external>
|
|
<link>
|
|
<a href="https://sourceforge.net/project/showfiles.php?group_id=76550&release_id=153280">Download PHP Simple Test</a>
|
|
from <a href="http://sourceforge.net/projects/simpletest/">SourceForge</a>.
|
|
</link>
|
|
<link>
|
|
The <a href="http://simpletest.sourceforge.net/">developer's API for SimpleTest</a>
|
|
gives full detail on the classes and assertions available.
|
|
</link>
|
|
</external>
|
|
<meta>
|
|
<keywords>
|
|
software development,
|
|
php programming,
|
|
programming php,
|
|
software development tools,
|
|
php tutorial,
|
|
free php scripts,
|
|
architecture,
|
|
php resources,
|
|
mock objects,
|
|
junit,
|
|
php testing,
|
|
php unit,
|
|
methodology,
|
|
test first,
|
|
sourceforge,
|
|
open source,
|
|
unit test,
|
|
web tester,
|
|
web testing,
|
|
html testing tools,
|
|
testing web pages,
|
|
php mock objects,
|
|
navigating websites automatically,
|
|
automated testing,
|
|
web scripting,
|
|
wget,
|
|
curl testing,
|
|
jmock for php,
|
|
jwebunit,
|
|
phpunit,
|
|
php unit testing,
|
|
php web testing,
|
|
jason sweat,
|
|
marcus baker,
|
|
topstyle plug in,
|
|
phpedit plug in
|
|
</keywords>
|
|
</meta>
|
|
</page> |