summaryrefslogtreecommitdiff
path: root/automated
AgeCommit message (Collapse)Author
2017-04-28automated: android: add refactored apk-automationMilosz Wasilewski
Change-Id: I5a81b3c4317dc56f90df37c5a8f83d2547542fab Signed-off-by: Milosz Wasilewski <milosz.wasilewski@linaro.org>
2017-04-27automated: android: add monkey test caseerin.liu
Change-Id: I3eeabe9bdeb74cc90d9f49d18359a4d7a304388e Signed-off-by: erin.liu <erin.liu@linaro.org>
2017-04-21kselftest: fix results parserNaresh Kamboju
Change-Id: I591c4c3e7a6c1850d6160654418092f1cd96286a Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2017-04-20automated: doc: Added section on using test-runnerMilosz Wasilewski
The paragraph on test-runner was contributed by Nicolas Dechesne. The section was mostly copied from: https://github.com/96boards/documentation/blob/master/ConsumerEdition/DragonBoard-410c/Guides/Testing.md Change-Id: I217d33f2259ae16b924c6a0a8fec8c7690bcb65b Signed-off-by: Milosz Wasilewski <milosz.wasilewski@linaro.org>
2017-04-19automated: android: added disable_suspend functionMilosz Wasilewski
The function unlocks the device and sets it to be awake all the time Change-Id: I53e39a047e8983e2d08c53b650df9251a793e7ab Signed-off-by: Milosz Wasilewski <milosz.wasilewski@linaro.org>
2017-04-19nginx-server: add odp-dpdk-git testsJosep Puigdemont
Change-Id: I8d262f9e9ba0d29b902c15f6dad3e75df3b0d75c Signed-off-by: Josep Puigdemont <josep.puigdemont@linaro.org>
2017-04-19nginx-server: use configuration files and callbaksJosep Puigdemont
NGiNX can be installed in different places, and can be implemented using different IP stacks (Linux IP stack, OFP, ANS...). The nginx-server.sh script was meant to be used independently of he NGiNX version in use. Due to this it contains several initialization and configuration functions for each of the currently supported implementations. This could grow a bit too large for one single file, so we've opted for creating files with a set of required functions for each implementation. The file is sourced and it should define some functions used for the tests. The name of the file should be that of the CONFIG_TYPE defined for the test definition, plus the .sh suffix. The functions required to be implemented in the files are: - do_configure_system(): used to initialize the tests. Here any configuration required for the test, like NIC configuration, kernel module loading, etc, should be done. It is called once before any test starts. - do_start_nginx(): this function is used to start NGiNX. - do_stop_nginx(): this function is used to stop NGiNX. It may be called even if NGiNX is not running. - do_write_nginx_config(): this function is called before starting NGiNX, and it is meant to write a proper nginx.conf file for the current number of cores. - do_pre_test_cb(): this function is called before starting NGiNX, it can be used for anything deemed appropriate. - do_post_test_cb(): this function is called right after the test has finished, and before NGiNX is stopped. It can be used for anything deemed appropriate. All functions are called with the following parameters in this order: - cores: number of cores of the current test. For configure_sytem, this is the total number of physical cores available. - interface: this is the interface that NGiNX is expected to use. - IP: the IP that the web server is expected to use. The return value of the functions is not checked. Change-Id: I0321697509f9ac628e705c69285a7478dd993ace Signed-off-by: Josep Puigdemont <josep.puigdemont@linaro.org>
2017-04-19Rename test directory for disk partitioning testChase Qi
Change-Id: Idcd83a16e0f2f938f31eb312eccaa344b634512c Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-04-13utils: add support for LAVA's secrets featureChase Qi
* Use token from LAVA's secrets file if defined. * Renamed URL and TOKEN variables with ARTIFACTORIAL_ as prefix to make them more meaningful. Change-Id: I80775d0bf7492275a3f2ca73d54640ea488f4a35 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-04-13automated: linux: migrate pm-qa testChase Qi
Change-Id: Ic23d1690d871b8cf292f1b3c22d49b19326c3f00 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-04-12Don't run adb root if adbd is already run as rootVishal Bhoj
if adbd is already running as root, it will not restart adbd server when we call adb root. This will cause lxc-device-wait-add to be blocked on usb event. Here are problematic jobs: https://staging.validation.linaro.org/scheduler/job/169678#L2308 https://staging.validation.linaro.org/scheduler/job/169679 Change-Id: Iefc65d6241898877b7b26bd8f5826c16e1247f7b Signed-off-by: Vishal Bhoj <vishal.bhoj@linaro.org>
2017-04-11automated: android: migrate boottime2Chase Qi
Migrated from android/boottime2. Most of the code in device-script.sh remain as it was. To keep consistence and cope with v2 structure: * Removed lava-specific steps from test script. * Copied the required functions from android/script/common.sh to device-script.sh Change-Id: I3560fe5dd863a1d32ced14806e852170494ea293 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-04-11automated: android: add media codecs functional testsChase Qi
Change-Id: I7f0a8f2696d09c9c278bacb5d9f7baa9b1918f37 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-04-11microbenchmarks: Pass gerrit id details to post-build-reportVishal Bhoj
Change-Id: I71f4c6b0deb9acc53f2aca426e0dac639532e568 Signed-off-by: Vishal Bhoj <vishal.bhoj@linaro.org>
2017-04-10fix adb root issueVishal Bhoj
Based on inputs from LAVA team, the right sequence of calls is: lava-lxc-device-wait-add lava-lxc-device-add adb wait-for-device Change-Id: I345aa85910ee68c79cf87b3447104b31d26d936f Signed-off-by: Vishal Bhoj <vishal.bhoj@linaro.org>
2017-04-10add microbenchmarks definitionVishal Bhoj
This job runs ART microbenchmarks scripts hosted here: https://android-git.linaro.org/linaro-art/art-build-scripts.git/tree/benchmarks/benchmarks_run_target.sh The job uses adb from latest sdk since the latest adb from master doesn't work well inside container Change-Id: I4f0ed4e7be50306502650b47c9aee670877e71e1 Signed-off-by: Vishal Bhoj <vishal.bhoj@linaro.org>
2017-04-06test-runner: set test case relative path for remoet exec onlyChase Qi
'tc_relative_dir' is used for partial file copy to target. It splits realpath to yaml file by test kind parameter and assumes tests are from 'automated' or 'manual' folder. Local exec copy the whole repo. It doesn't have the above assumption. Moving the 'tc_relative_dir' related lines to remote exec only. Change-Id: I95415fa93a94ddf654681ada704e4b2a5c12f061 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-04-04automated: linux: add kselftest testNaresh Kamboju
Kselftest test definitions detects pre-built tests on target rootfs. if not found then, download kselftest and run tests. Change-Id: Ie88860d79aef7cf7aa526f95f1f4803e30a4b899 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2017-03-30Merge "automated: android: migrate piglit-shader-runner"Milosz Wasilewski
2017-03-30Merge "automated: android: migrate piglit-gles3"Milosz Wasilewski
2017-03-30Merge "test-runner: run 'run.sh' under 'set -x'"Milosz Wasilewski
2017-03-30automated: android: migrate piglit-glslparserChase Qi
Change-Id: I481093354cdaeff06779eeb6accf7d8396cebdfc Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-03-30automated: android: migrate piglit-gles2Chase Qi
Change-Id: I052b4f6b955b3f11a1835ee204acb15a8b45f480 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-03-29automated: android: add ping testChase Qi
Change-Id: I97485048d10f78fd64c76c6a1aee89c87e2cab48 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-03-29test-runner: run 'run.sh' under 'set -x'Chase Qi
When converting testdef to 'run.sh', LAVA has shell '-x' argument enabled. It can be useful for debugging. Change-Id: I1d1070b716713238e213b7140eb44526cdbcd7e1 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-03-29automated: android: add meminfo testChase Qi
Change-Id: Ifaa744ea67ef3a4985f8afbbb2659c6ce5dcc3e9 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-03-29automated: android: migrate piglit-shader-runnerChase Qi
Change-Id: Iff4db263a782e1f8a1fdd373a3b8aed04580bae3 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-03-29automated: android: migrate piglit-gles3Chase Qi
Change-Id: Ic5c54730504baaa83547bd3c29e27b6e8da14011 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-03-27android-test-lib: add parse_common_args()Chase Qi
Moving the parsing for common args to android-test-lib can avoid code duplication. On the other hand, except the common args, if the test script support additional args, IMO, we should put them together and do the paring in the script. Actually, with the capability to handle illegal input, I don't see an easy way to split the args. And make the code easy to read also is a priority. Change-Id: I6ea7ac4a624f6accb509aaf4e735cd8e190fcc36 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-03-27automated: android: add tjbench testChase Qi
Change-Id: I2cf263408730e9ab59ff8e1d2cf9b1e497636b81 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-03-27automated: android: add libc-bench testChase Qi
Change-Id: I97fd652fa88f70a873433012ff34618c400b3769 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-03-27android-test-lib: run 'adb shell which' with root permissionChase Qi
Root permission is required to locate some commands. For example: T440 test-definitions # adb shell which tee-supplicant T440 test-definitions # adb shell "echo which tee-supplicant | su" /system/bin/tee-supplicant T440 test-definitions # adb shell ls -l /system/bin/tee-supplicant ls: /system/bin/tee-supplicant: Permission denied Change-Id: I129d55d12b081ad4e5cf4c4fd72d1f905223b9a4 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-03-27automated: android: add optee xtestChase Qi
Change-Id: Ib542b90c1866edc7dfae6a1091ffb4b88230e32a Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-03-27android: bionic-benchmarks: fix folder and file pathsChase Qi
Change-Id: I7ef59cd3f97627fd4a7bf53d56452ae87909b3b2 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-03-27automated: android: add stringbench testChase Qi
Change-Id: Iadb21d6f75c5b40a614d5f29d697933286e78808 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-03-23automated: android: only set permission on the folder/file pushedChase Qi
'chmod -R 755 ${remote}' will change other files located under the same ${remote} folder, not just the folder/file pushed by test script. The current patch get the exact path to the folder/file and set permission on it only. Change-Id: Iaaba46e64b320101eedb4f4a9d8db7f64a63b744 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-03-22automated: android-test-lib: add adb_shell_which()Chase Qi
Change-Id: Ieec3d241a33c5d9a645a2e5ca2c1aeab96cc955d Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-03-22automated: android: set and use environmental variable ANDROID_SERIALChase Qi
When ANDROID_SERIAL set, we don't need to use '-s' to specify device serial no. any more. Change-Id: Ide4951c6ab68806a6241b38c3bf001e2e4e15eab Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-03-22libhugetlbfs: version not required on pre-built testsNaresh Kamboju
When libhugetlbfs test suite pre-built and pre-installed on images like Open Embedded, versioning is not required in this case. Change-Id: I4faf4d8ee8d1af198be92b21c767a05440ed4bcb Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2017-03-21automated: android: add busybox smoke testChase Qi
Change-Id: I4ea462ff2e643d9016c9f2a25d85e14a6deb6fe7 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-03-21automated: android: add linaro android kernel testsChase Qi
Change-Id: I2957d29e2172d8342bfe7a8a6aba22097601d5fb Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-03-17automated: test-runner: encapsulate the TestRun object into TestDefNicolas Dechesne
There is no need to create an additional object in main(). Instead we can create the 'runner' object in the TestDef init() and directly invoke the run() and check_result() function. Also rename TestDefinition.run() function as TestDefinition.mkrun(). This function really generates the run script, calling it run() is confusing, as this is not where the test runs. Change-Id: I4348e1e834e7083174aa60a8f4533747e49c3757 Signed-off-by: Nicolas Dechesne <nicolas.dechesne@linaro.org>
2017-03-17automated: test-runner: mark test run as fail when no result foundChase Qi
Change-Id: I6cfc6f192a2392d8da13b788caaba97d08b50227 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-03-17test-runner: add remote execution featureMilosz Wasilewski
Test can be executed remotely using ssh. It is assumed that ssh communication is performed without passwords and public key is already added to authorized_keys. Most tests require root access to be executed, so there is a silent assumption that remote test execution is done using 'root' account. The account name might be different, but should be granted the same level of privileges. Change-Id: I41f1d32d20f15ac6cfa8fc9e99f527fe61d4743d Signed-off-by: Milosz Wasilewski <milosz.wasilewski@linaro.org>
2017-03-16automated: android: improve dd speed testChase Qi
Change-Id: Ia8f6e0336b7d141e1079c7b8f1e26b51acfb4e5c Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-03-16automated: add bionic-libc testsDaniel Díaz
Change-Id: I3dcac7741c0f9aaeb76a9d0eadbc21d5cbf98cfe Signed-off-by: Daniel Díaz <daniel.diaz@linaro.org>
2017-03-15cleanup: adjust permissions on YAML filesDaniel Díaz
YAML files need not be executable. Change-Id: Ibddd8f8737edb33082f0c39aed78a8bcfbecab45 Signed-off-by: Daniel Díaz <daniel.diaz@linaro.org>
2017-03-14test-runner: set PATH before running the testsNicolas Dechesne
Set PATH to a known value before starting test execution, to avoid PATH being polluted by the user environment. Change-Id: Ia7861932cd56f363d2d6cfa50ffd54c8acb1ea21 Signed-off-by: Nicolas Dechesne <nicolas.dechesne@linaro.org>
2017-03-07automated: android: handle failed cts test runChase Qi
Change-Id: I907b91ee0670087551f5f61d8ea03a882e3c2208 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-03-06automated: add bionic-benchmarks testDaniel Díaz
Change-Id: Ic2714900764a4d0a13864f5feb4a85c8ef54afc0 Signed-off-by: Daniel Díaz <daniel.diaz@linaro.org>
generated by cgit v1.2.3 (git 2.25.1) at 2024-04-19 00:58:01 +0000