summaryrefslogtreecommitdiff
path: root/automated/README
diff options
context:
space:
mode:
authorChase Qi <chase.qi@linaro.org>2016-08-18 13:18:50 +0800
committerMilosz Wasilewski <milosz.wasilewski@linaro.org>2016-08-25 10:06:18 +0000
commit09edc7f6fcaf627eee88ab4447c749c55ee2100c (patch)
tree40a54061560828e3c78c9270ed70717f6c1ab893 /automated/README
parent706092ca46da3f87ebd6ad70907ea24cbbd3b1ef (diff)
v2: initial commit
- Added utils, bin, and lib folders and related tools - Added Linux smoke test case as an example - Added test plan example that used to test test-runner Change-Id: I73693108db219cb67afc99525d80cab93f1eb9ea Signed-off-by: Chase Qi <chase.qi@linaro.org>
Diffstat (limited to 'automated/README')
-rw-r--r--automated/README56
1 files changed, 56 insertions, 0 deletions
diff --git a/automated/README b/automated/README
new file mode 100644
index 0000000..26636f8
--- /dev/null
+++ b/automated/README
@@ -0,0 +1,56 @@
+Getting started
+===============
+ git clone https://git.linaro.org/qa/test-definitions.git
+ cd ./test-definitions
+ . ./automated/bin/setenv.sh
+ test-runner -h
+
+Running test
+============
+Both test script and corresponding test definition files provided in the same
+folder that named with the test case name.
+
+Test script can be run independently, you may need to specify parameters
+manually as needed.
+
+Test definition file in YAML format created for each test to
+ - Define default test parameters
+ - Run test with local test-runner, which supports to run a set of tests
+ defined in agenda file, customized parameters are supported as well.
+ - Run test in LAVA(Linaro Automation and Validation Architecture)
+
+Running test script
+------------------
+linux:
+ cd ./automated/linux/smoke/
+ ./smoke.sh
+ # skip package installation.
+ ./smoke.sh -s true
+
+android:
+ cd ./automated/android/dd-wr-speed/
+ ./dd-wr-speed.sh
+ # Specify SN when more than one device connected.
+ ./dd-wr-speed.sh -s "serial_no"
+ # Specify other params.
+ ./dd-wr-speed.sh -i "10" -p "/dev/block/mmcblk1p1"
+
+Using test-runner
+----------------
+single test run:
+ test-runner -d ./automated/linux/smoke/smoke.yaml
+ # skip package install
+ test-runner -d ./automated/linux/smoke/smoke.yaml -s
+
+running test plan:
+ # Run a set of tests defined in agenda file.
+ test-runner -a ./plans/linux-example.yaml
+
+Collecting result
+=================
+Please find test results in the following locations.
+ - ${OUTPUT} and ${RESULT_FILE} for each test are defined in the test case.
+ - test-runner parse stdout.log and save result to ${test_path}
+ - test-runner combines results of executed tests and save them in
+ ${OUTPUT}/results.csv,
+ - ${OUTPUT} path of test-runner can be modified with '-o'