summaryrefslogtreecommitdiff
path: root/automated
AgeCommit message (Collapse)Author
2017-03-29automated: android: add meminfo testChase Qi
Change-Id: Ifaa744ea67ef3a4985f8afbbb2659c6ce5dcc3e9 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-03-27android-test-lib: add parse_common_args()Chase Qi
Moving the parsing for common args to android-test-lib can avoid code duplication. On the other hand, except the common args, if the test script support additional args, IMO, we should put them together and do the paring in the script. Actually, with the capability to handle illegal input, I don't see an easy way to split the args. And make the code easy to read also is a priority. Change-Id: I6ea7ac4a624f6accb509aaf4e735cd8e190fcc36 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-03-27automated: android: add tjbench testChase Qi
Change-Id: I2cf263408730e9ab59ff8e1d2cf9b1e497636b81 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-03-27automated: android: add libc-bench testChase Qi
Change-Id: I97fd652fa88f70a873433012ff34618c400b3769 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-03-27android-test-lib: run 'adb shell which' with root permissionChase Qi
Root permission is required to locate some commands. For example: T440 test-definitions # adb shell which tee-supplicant T440 test-definitions # adb shell "echo which tee-supplicant | su" /system/bin/tee-supplicant T440 test-definitions # adb shell ls -l /system/bin/tee-supplicant ls: /system/bin/tee-supplicant: Permission denied Change-Id: I129d55d12b081ad4e5cf4c4fd72d1f905223b9a4 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-03-27automated: android: add optee xtestChase Qi
Change-Id: Ib542b90c1866edc7dfae6a1091ffb4b88230e32a Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-03-27android: bionic-benchmarks: fix folder and file pathsChase Qi
Change-Id: I7ef59cd3f97627fd4a7bf53d56452ae87909b3b2 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-03-27automated: android: add stringbench testChase Qi
Change-Id: Iadb21d6f75c5b40a614d5f29d697933286e78808 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-03-23automated: android: only set permission on the folder/file pushedChase Qi
'chmod -R 755 ${remote}' will change other files located under the same ${remote} folder, not just the folder/file pushed by test script. The current patch get the exact path to the folder/file and set permission on it only. Change-Id: Iaaba46e64b320101eedb4f4a9d8db7f64a63b744 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-03-22automated: android-test-lib: add adb_shell_which()Chase Qi
Change-Id: Ieec3d241a33c5d9a645a2e5ca2c1aeab96cc955d Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-03-22automated: android: set and use environmental variable ANDROID_SERIALChase Qi
When ANDROID_SERIAL set, we don't need to use '-s' to specify device serial no. any more. Change-Id: Ide4951c6ab68806a6241b38c3bf001e2e4e15eab Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-03-22libhugetlbfs: version not required on pre-built testsNaresh Kamboju
When libhugetlbfs test suite pre-built and pre-installed on images like Open Embedded, versioning is not required in this case. Change-Id: I4faf4d8ee8d1af198be92b21c767a05440ed4bcb Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2017-03-21automated: android: add busybox smoke testChase Qi
Change-Id: I4ea462ff2e643d9016c9f2a25d85e14a6deb6fe7 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-03-21automated: android: add linaro android kernel testsChase Qi
Change-Id: I2957d29e2172d8342bfe7a8a6aba22097601d5fb Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-03-17automated: test-runner: encapsulate the TestRun object into TestDefNicolas Dechesne
There is no need to create an additional object in main(). Instead we can create the 'runner' object in the TestDef init() and directly invoke the run() and check_result() function. Also rename TestDefinition.run() function as TestDefinition.mkrun(). This function really generates the run script, calling it run() is confusing, as this is not where the test runs. Change-Id: I4348e1e834e7083174aa60a8f4533747e49c3757 Signed-off-by: Nicolas Dechesne <nicolas.dechesne@linaro.org>
2017-03-17automated: test-runner: mark test run as fail when no result foundChase Qi
Change-Id: I6cfc6f192a2392d8da13b788caaba97d08b50227 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-03-17test-runner: add remote execution featureMilosz Wasilewski
Test can be executed remotely using ssh. It is assumed that ssh communication is performed without passwords and public key is already added to authorized_keys. Most tests require root access to be executed, so there is a silent assumption that remote test execution is done using 'root' account. The account name might be different, but should be granted the same level of privileges. Change-Id: I41f1d32d20f15ac6cfa8fc9e99f527fe61d4743d Signed-off-by: Milosz Wasilewski <milosz.wasilewski@linaro.org>
2017-03-16automated: android: improve dd speed testChase Qi
Change-Id: Ia8f6e0336b7d141e1079c7b8f1e26b51acfb4e5c Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-03-16automated: add bionic-libc testsDaniel Díaz
Change-Id: I3dcac7741c0f9aaeb76a9d0eadbc21d5cbf98cfe Signed-off-by: Daniel Díaz <daniel.diaz@linaro.org>
2017-03-15cleanup: adjust permissions on YAML filesDaniel Díaz
YAML files need not be executable. Change-Id: Ibddd8f8737edb33082f0c39aed78a8bcfbecab45 Signed-off-by: Daniel Díaz <daniel.diaz@linaro.org>
2017-03-14test-runner: set PATH before running the testsNicolas Dechesne
Set PATH to a known value before starting test execution, to avoid PATH being polluted by the user environment. Change-Id: Ia7861932cd56f363d2d6cfa50ffd54c8acb1ea21 Signed-off-by: Nicolas Dechesne <nicolas.dechesne@linaro.org>
2017-03-07automated: android: handle failed cts test runChase Qi
Change-Id: I907b91ee0670087551f5f61d8ea03a882e3c2208 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-03-06automated: add bionic-benchmarks testDaniel Díaz
Change-Id: Ic2714900764a4d0a13864f5feb4a85c8ef54afc0 Signed-off-by: Daniel Díaz <daniel.diaz@linaro.org>
2017-03-02nginx-odp-dpdk.yaml: use sh-test-lib functionsJosep Puigdemont
We will now use the add_key and add_repo functions provided by sh-test-lib, also the repository used can be specified as one of the test parameters. Installation of release-specific packages has been removed. Any extra packages from other repositories than the ones under test (currently jessie-backports) will have to be installed by the calling LAVA job. This way this test definition will work on newer versions of the distribution without having to change anything. See this lava job for an example: https://lng.validation.linaro.org/scheduler/job/17262/multinode_definition Change-Id: I6119b451c4921afde861f8b3473cdfdca140d3f5 Signed-off-by: Josep Puigdemont <josep.puigdemont@linaro.org>
2017-03-02automated: android: cts: use adb from official platform-tools-latestChase Qi
Change-Id: I4c4ee2bf5709edb6b0e2c8c6fdbb8099e2916db2 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-03-02automated: android-test-lib: add install_latest_adb() and adb_root() functionsChase Qi
Change-Id: If83af404a7b819eecf5eb6359821e42cfbbfa029 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-02-28automated: utils: improve upload-to-artifactorial.shChase Qi
* Only do attachment uploading in LAVA * Use basename of "${ATTACHMENT}" in case it includes a path Change-Id: I4893da2b16766a64152804be47ee8853a162534a Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-02-27automated: doc: fix typo in filenameChase Qi
Change-Id: Iaa4119406790c36215cbb84f108903342f8b3e11 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-02-24Merge "automated/android: add CTS result 'pre-parser'"Milosz Wasilewski
2017-02-23nginx-odp-dpdk.yaml: do not install kernel headersJosep Puigdemont
Until now the test installed kernel headers from a hardcoded source. We should require the job calling his test to install the kernel headers, whether they come from a hw-pack, a private repo, or somewhere else. At the same time define configurable parameters for the test. Change-Id: I28dbaa55d71683c23b4d59b188fcebf5fd302a6e Signed-off-by: Josep Puigdemont <josep.puigdemont@linaro.org>
2017-02-23nginx-server: remove dependency on private repoJosep Puigdemont
To work around some limitation on the current port of NGiNX to OFP, a private repo with specially built OFP and NGiNX was used by the test script. This is not desirable in the long run, so we will resort to installing the packages provided by LNG at deb.opendataplane.org, and add the limitation that NGiNX for OFP will only be tested with one worker for now. When support for more workers is available, the limitation should be removed. Change-Id: I0f2d5f1c4efe9efb53c77270c0bebaeb03c709b6 Signed-off-by: Josep Puigdemont <josep.puigdemont@linaro.org>
2017-02-23automated/android: add CTS result 'pre-parser'Milosz Wasilewski
CTS xml result file might contain invalid XML characters. For this reason the ElementTree parser fails to read the result file. The invalid characters are now removed before the result is passed to ET parser. Change-Id: I1a88627090aaad493a63dca86b4ecee8f13b45fd Signed-off-by: Milosz Wasilewski <milosz.wasilewski@linaro.org>
2017-02-23automated: android: cts: skip adding backports repo on Debian sidChase Qi
Change-Id: I167868f60463b8138115e89a0a2d397a4beb853a Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-02-22automated: improve android-test-libChase Qi
Change-Id: I6b7eafea28b6bea74a75c31cbb60f6dba2012795 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-02-20libhugetlbfs: Detect pre-builts tests on targetNaresh Kamboju
libhugetlbfs test definitions modified to detect pre-built tests on target. if not found then, download, build and run tests. Change-Id: If25d54df68f8f2abc1c67ddfa5f1a4a0ed1954fe Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2017-02-20automated: android: add cts testChase Qi
Change-Id: I75eb65bc7de03cbe612b33c4ee69d50cfdc6608d Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-02-18automated: use create_out_dir where appropriateDaniel Díaz
Change-Id: I10181a7d1ebc53491085d80d67f0cd8f9e43071d Signed-off-by: Daniel Díaz <daniel.diaz@linaro.org>
2017-02-17cleanup: fix a few shellcheck errors in automated/Daniel Díaz
Change-Id: If34415c681906aefc6b5b42401ed995e5cdeda11 Signed-off-by: Daniel Díaz <daniel.diaz@linaro.org>
2017-02-17automated: utils: add upload-to-artifactorial.shChase Qi
Change-Id: I969b285e1b3e092acbee0ca425f5bb1f81a97354 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-02-17automated: sh-test-lib: add create_out_dir()Daniel Díaz
Some error checking and renaming can happen here for all other scripts to peruse. Change-Id: I7286cf2909c59fc41935658d0a970b9c4b7ec795 Signed-off-by: Daniel Díaz <daniel.diaz@linaro.org> Signed-off-by: Milosz Wasilewski <milosz.wasilewski@linaro.org>
2017-02-07automated: linux: add lshw testChase Qi
Change-Id: Iec4efd0a4d4e9dede50505b7284d6221b83a7433 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-02-06automated: linux: support sysbench compiling on oe-rpbChase Qi
Change-Id: Ibc1e125dc56c4a5b6b73da368b668bafc2c9fb97 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-02-06automated: use '*' instead of 'unknown' for unsupported distrosChase Qi
When dist_name() fails to detect distribution ID, it sets ${dist} to 'unknown'. install_deps() doesn't support 'unknown' distros, and it doesn't support some known distros like oe-rpb either. Using wildcard able to cover these two cases. Change-Id: I619e06d9dbc911c9629d6d6a7f1622c40ed1f234 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-02-03automated: smoke: no need to be rootNicolas Dechesne
This test case works without root privileges, so let's remove this check. Running as standard user , with this patch, I am getting: --- Printing result.csv --- name,test_case_id,result,measurement,units,test_params smoke-tests-basic,pwd,pass,,,SKIP_INSTALL=False smoke-tests-basic,lsb_release,pass,,,SKIP_INSTALL=False smoke-tests-basic,uname,pass,,,SKIP_INSTALL=False smoke-tests-basic,ip,pass,,,SKIP_INSTALL=False smoke-tests-basic,lscpu,pass,,,SKIP_INSTALL=False smoke-tests-basic,vmstat,pass,,,SKIP_INSTALL=False smoke-tests-basic,lsblk,pass,,,SKIP_INSTALL=False Change-Id: I3dfce348eadf9a9a4a4dfa8321af080984cd4447 Signed-off-by: Nicolas Dechesne <nicolas.dechesne@linaro.org>
2017-01-26automated: sh-test-lib: add check_root() when neededNicolas Dechesne
In a few lib functions , we are running commands which require root. so let's call check_root() whenever it's needed, to avoid adding the check in the test scripts themselves. For example , in many test case we use check_root() mostly because we want to install packages with install_deps(). Let's add a call to check_root() in install_deps() directly, since installing packages *always* require root. Then we can remove un-needed checks from the test case themselves. Change-Id: Ifd76dacf85f21825f2e47cd224a3725c69eba899 Signed-off-by: Nicolas Dechesne <nicolas.dechesne@linaro.org>
2017-01-26automated: use pattern matching for rpbFathi Boudra
avoid to hardcode the rpb variants. use "oe-rpb" as a distribution value instead of "oe-based". Change-Id: I8f1ccf35a1b82718f662bd79480cb2c7dc41c1b8 Signed-off-by: Fathi Boudra <fathi.boudra@linaro.org>
2017-01-26Merge "automated: always convert dist to lower case"Fathi Boudra
2017-01-25automated/openjdk: fixed shellcheck warningsMilosz Wasilewski
Change-Id: I52acc71b65f6bbb635f498c9b8453a5676afe9b8 Signed-off-by: Milosz Wasilewski <milosz.wasilewski@linaro.org>
2017-01-25automated: always convert dist to lower caseFathi Boudra
Change-Id: I5ab1e600776e83a56167e22b35b0e0520f85214a Signed-off-by: Fathi Boudra <fathi.boudra@linaro.org>
2017-01-25automated: switch to using ID field for distroNicolas Dechesne
Let's standardadize all test cases to use lowercase distro ID field from /etc/os-release, instead of the 'pretty' (capitalized) name that we used so far. This is an invasive change, all test scripts were modified with this command: $ sed -i -e 's|Debian\(.*\))|debian\1)|g' \ -e 's|Ubuntu\(.*\))|ubuntu\1)|g' \ -e 's|CentOS\(.*\))|centos\1)|g' \ -e 's|Fedora\(.*\))|fedora\1)|g' \ -e 's|Unknown\(.*\))|unknown\1)|g' And the remaining instances were fixed manually. dist_name() function was updated to always report lowercase distro name. Also when /etc/os-release is not available and that we use lsb_release output, we convert the old capitalized name into the new lowercase ones. Change-Id: I1f1ce0932ab04476567f0338e902656470267a74 Signed-off-by: Nicolas Dechesne <nicolas.dechesne@linaro.org>
generated by cgit v1.2.3 (git 2.25.1) at 2024-05-23 01:28:04 +0000