1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
|
/*
* Robot Testing Framework
*
* Copyright (C) 2015-2019 Istituto Italiano di Tecnologia (IIT)
*
* This library is free software; you can redistribute it and/or
* modify it under the terms of the GNU Lesser General Public
* License as published by the Free Software Foundation; either
* version 2.1 of the License, or (at your option) any later version.
*
* This library is distributed in the hope that it will be useful,
* but WITHOUT ANY WARRANTY; without even the implied warranty of
* MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU
* Lesser General Public License for more details.
*
* You should have received a copy of the GNU Lesser General Public
* License along with this library; if not, write to the Free Software
* Foundation, Inc., 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301 USA
*/
/**
@page robottestingframework_lua_plugin_example Using Lua to develop test cases
\author Ali Paikan
<br>
\section lua-desc Description
Test cases can be written using Lua scripting language (e.g., .lua) to be loaded
and executed as separate plug-ins.
This allows to have a simple test runner which loads and run the tests at run
time without any needs to recompile the test runner.
Using a simple example, we show how this can be done.
\note The source code of the tutorial can be also found in the
\c 'examples/lua-plugin' folder within the Robot Testing Framework project
directory.
<br>
\section lua-req Requirements
You need the Lua development library to use the plug-ins.
On most of the Linux distribution it can be easily installed using the package
manager (e.g., ` $ sudo apt-get install liblua5.1-0-dev`).
If you use Windows, try
<a href="https://code.google.com/p/luaforwindows/">Lua for Windows</a>, an
easy-to-use distribution of Lua packed with several useful libraries.
OSX users can also uses Lua binaries from http://lua-users.org/wiki/LuaBinaries.
After installing the Lua development package, you need to enable the Lua plug-in
system in the Robot Testing Framework and recompile it:
\verbatim
$ cd robot-testing-framework/build
$ cmake ../ -DENABLE_LUA_PLUGIN=ON
\endverbatim
<br>
\section lua-write Writing the test case in Lua
Writing test cases in Lua is simple. All you need is to declare the
`TestCase.run()` function and implement you test body.
The `TestCase.setup` and `TestCase.tearDown` can be also optionally defined to
setup or tear down the user defined fixture.
It is also a good practice to provide a name for the test case using
`TestCase.setName()`.
\htmlonly
<!-- HTML generated using hilite.me --><div style="background: #ffffff; overflow:auto;width:auto;border:solid gray;border-width:.1em .1em .1em .8em;padding:.2em .6em;"><pre style="margin: 0; line-height: 125%"><span style="color: #888888">--</span>
<span style="color: #888888">-- TestCase table is used by the lua plugin loader</span>
<span style="color: #888888">-- to invoke the corresponding methods:</span>
<span style="color: #888888">--</span>
<span style="color: #888888">-- TestCase.setup = function(parameter) ... return true end</span>
<span style="color: #888888">-- TestCase.run = function() ... end </span>
<span style="color: #888888">-- TestCase.tearDown = function() ... end </span>
<span style="color: #888888">--</span>
<span style="color: #888888">-- The following methods are for reporting, failure or assertions: </span>
<span style="color: #888888">--</span>
<span style="color: #888888">-- robottestingframework.setName(name) : sets the test name</span>
<span style="color: #888888">-- robottestingframework.testReport(msg) : reports a informative message</span>
<span style="color: #888888">-- robottestingframework.testCheck(condition, msg) : reports the test message and marks the test as failed if condition is false</span>
<span style="color: #888888">-- robottestingframework.assertError(msg) : throws an error exception with message</span>
<span style="color: #888888">-- robottestingframework.asserFail(msg) : throws a failure exception with message</span>
<span style="color: #888888">--</span>
<span style="color: #888888">--</span>
<span style="color: #888888">-- setup is called before the test run to setup </span>
<span style="color: #888888">-- user defined fixture</span>
<span style="color: #888888">-- @return Boolean (true/false uppon success or failure)</span>
<span style="color: #888888">--</span>
TestCase.setup = <span style="color: #008800; font-weight: bold">function</span>(parameter)
robottestingframework.setName(<span style="color: #dd2200; background-color: #fff0f0">"MyTest"</span>)
robottestingframework.testReport(<span style="color: #dd2200; background-color: #fff0f0">"Preparing setup..."</span>)
<span style="color: #008800; font-weight: bold">return</span> <span style="color: #008800; font-weight: bold">true</span>;
<span style="color: #008800; font-weight: bold">end</span>
<span style="color: #888888">--</span>
<span style="color: #888888">-- The implementation of the test goes here</span>
<span style="color: #888888">-- @return Boolean</span>
<span style="color: #888888">--</span>
TestCase.run = <span style="color: #008800; font-weight: bold">function</span>()
robottestingframework.testCheck(<span style="color: #0000DD; font-weight: bold">5</span>><span style="color: #0000DD; font-weight: bold">3</span>, <span style="color: #dd2200; background-color: #fff0f0">"5 is bigger than 3."</span>)
robottestingframework.testCheck(<span style="color: #0000DD; font-weight: bold">5</span><<span style="color: #0000DD; font-weight: bold">3</span>, <span style="color: #dd2200; background-color: #fff0f0">"5 is smaller than 3."</span>)
<span style="color: #008800; font-weight: bold">end</span>
<span style="color: #888888">--</span>
<span style="color: #888888">-- tearDown is called after the test run to tear down</span>
<span style="color: #888888">-- user defined fixture</span>
<span style="color: #888888">--</span>
TestCase.tearDown = <span style="color: #008800; font-weight: bold">function</span>()
robottestingframework.testReport(<span style="color: #dd2200; background-color: #fff0f0">"Tearing down..."</span>)
<span style="color: #008800; font-weight: bold">end</span>
</pre></div>
\endhtmlonly
<br>
\section lua-runner Writing the test runner
\note Basically you do not need to develop a test runner.
There is the \c robottestingframework-testrunner utility (see
\ref robottestingframework-testrunner) already implemented in
Robot Testing Framework which does the job for you.
However, the following example is just for your reference and to understand
better how a Lua test plug-ing can be loaded and executed from the code.
Your plug-in is ready and can be compiled and built.
Before doing, that we show how to use \c robottestingframework::LuaPluginLoader
to develop a simple test runner for loading the plug-in and running the test.
It is quite simple. First create an instance of
\c robottestingframework::plugin::LuaPluginLoader class and call its \c open()
method with the plug-in library (i.e., .lua) filename as its paramter.
The \c robottestingframework::plugin::LuaPluginLoader loads the library and
returns a pointer to the \c robottestingframework::TestCase implemented into the
plug-in.
If the Lua plug-in cannot be loaded or it is not a Robot Testing Framework
plug-in file, the \c robottestingframework::plugin::LuaPluginLoader::open()
returns a null pointer and the error message can be gotten using
\c robottestingframework::plugin::LuaPluginLoader::getLastError().
When you have an instance of your test case, it can be used to run the test as
usual (see \ref robottestingframework_examples if you are not familiar with
running a test case). In the following example we use a
\c robottestingframework::TestRunner to execute our test:
\include lua-plugin/run.cpp
<br>
\section lua-build Building the test runner and run the test
Now you can compile and build the the runner. There is a CMake file in the
\c examples/lua-plugin folder which helps you to compile and build your simple
test runner.
Make sure that \c RobotTestingFramework_DIR environment variable is correctly
set to point your Robot Testing Framework build or installed directory so that
CMake can find the required modules to configure the project.
\include lua-plugin/CMakeLists.txt
<br>
Now you can build and run the test as follows:
\verbatim
$ cd examples/lua-plugin; mkdir build
$ cd build; cmake ../; make;
$ ./simple_run ../mytest.lua
Loading the plugin...
Starting test runner.
Test case started...
[INFO] (mytest.lua) reports: Preparing setup...
[INFO] (mytest.lua) checks: 5 is bigger than 3
[FAIL] (mytest.lua) checks: 5 is less than 3
[INFO] (mytest.lua) reports: Tearing down...
Test case MyTest failed!
Ending test runner.
\endverbatim
*/
|
