diff options
author | Chase Qi <chase.qi@linaro.org> | 2016-08-18 13:18:50 +0800 |
---|---|---|
committer | Milosz Wasilewski <milosz.wasilewski@linaro.org> | 2016-08-25 10:06:18 +0000 |
commit | 09edc7f6fcaf627eee88ab4447c749c55ee2100c (patch) | |
tree | 40a54061560828e3c78c9270ed70717f6c1ab893 /automated/README | |
parent | 706092ca46da3f87ebd6ad70907ea24cbbd3b1ef (diff) |
v2: initial commit
- Added utils, bin, and lib folders and related tools
- Added Linux smoke test case as an example
- Added test plan example that used to test test-runner
Change-Id: I73693108db219cb67afc99525d80cab93f1eb9ea
Signed-off-by: Chase Qi <chase.qi@linaro.org>
Diffstat (limited to 'automated/README')
-rw-r--r-- | automated/README | 56 |
1 files changed, 56 insertions, 0 deletions
diff --git a/automated/README b/automated/README new file mode 100644 index 0000000..26636f8 --- /dev/null +++ b/automated/README @@ -0,0 +1,56 @@ +Getting started +=============== + git clone https://git.linaro.org/qa/test-definitions.git + cd ./test-definitions + . ./automated/bin/setenv.sh + test-runner -h + +Running test +============ +Both test script and corresponding test definition files provided in the same +folder that named with the test case name. + +Test script can be run independently, you may need to specify parameters +manually as needed. + +Test definition file in YAML format created for each test to + - Define default test parameters + - Run test with local test-runner, which supports to run a set of tests + defined in agenda file, customized parameters are supported as well. + - Run test in LAVA(Linaro Automation and Validation Architecture) + +Running test script +------------------ +linux: + cd ./automated/linux/smoke/ + ./smoke.sh + # skip package installation. + ./smoke.sh -s true + +android: + cd ./automated/android/dd-wr-speed/ + ./dd-wr-speed.sh + # Specify SN when more than one device connected. + ./dd-wr-speed.sh -s "serial_no" + # Specify other params. + ./dd-wr-speed.sh -i "10" -p "/dev/block/mmcblk1p1" + +Using test-runner +---------------- +single test run: + test-runner -d ./automated/linux/smoke/smoke.yaml + # skip package install + test-runner -d ./automated/linux/smoke/smoke.yaml -s + +running test plan: + # Run a set of tests defined in agenda file. + test-runner -a ./plans/linux-example.yaml + +Collecting result +================= +Please find test results in the following locations. + - ${OUTPUT} and ${RESULT_FILE} for each test are defined in the test case. + - test-runner parse stdout.log and save result to ${test_path} + - test-runner combines results of executed tests and save them in + ${OUTPUT}/results.csv, + - ${OUTPUT} path of test-runner can be modified with '-o' |