summaryrefslogtreecommitdiff
AgeCommit message (Collapse)Author
2017-11-10automated/linux: Add OpenEmbedded ptest test definitionAníbal Limón
The OpenEmbedded ptests enables the support to run package tests (gcc, zlib, bzip2, etc) on the target device. Change-Id: Ie126e6e55d03cc683afe920836c7f829e5534aae Signed-off-by: Aníbal Limón <anibal.limon@linaro.org>
2017-11-10android tjbench/stringbench/libc-bench: do not report fail when only 32bit existYongqin Liu
On 32bit android, 64bit command does not exist, should not report failures for such cases Change-Id: I7639d9c297d20d5daaa92d345b6713a07ebb399f Signed-off-by: Yongqin Liu <yongqin.liu@linaro.org>
2017-11-09LTP: Stop systemd-timesyncd if runningDan Rue
systemd-timesyncd interferes with the leapsec_timer test. Disable it. Change-Id: I616b74d6ea4aa07ad973e548dfa7664c4b03f6e8 Signed-off-by: Dan Rue <dan.rue@linaro.org>
2017-11-08automated: ltp: add getrandom02 to skipfileMilosz Wasilewski
getrandom sometimes fails because of SIGKILL. Bug reported: https://bugs.linaro.org/show_bug.cgi?id=3401 Change-Id: I86b56467594c5b8b468646ad3ad8e9a764a52b90 Signed-off-by: Milosz Wasilewski <milosz.wasilewski@linaro.org>
2017-11-08android glbenchmark25: download benchmark app apk file tooYongqin Liu
Since the comment setUp function is not called in the glbenchmark25's setUp function, the app apk file won't be downloaded. This change is to fix that problem. Also add the call of self.set_performance_governor() which is called in the super setUp function Change-Id: I253486e5d273a1a892d926bd44ee6dd74a92cae7 Signed-off-by: Yongqin Liu <yongqin.liu@linaro.org>
2017-11-07automated: ltp: add leapsec_timer to LTP skiplistMilosz Wasilewski
leapsec_timer ocassionaly fails because some other process updates the clock during testing. Change-Id: I46629786b6206c7324e95df2cee9115848021626 Signed-off-by: Milosz Wasilewski <milosz.wasilewski@linaro.org>
2017-11-06LTP: Add package 'acl' for acl_test01Dan Rue
Add package 'acl' in both debian and redhat based distros. It is required by acl_test01 (which uses setfacl). Change-Id: I7b9bd72b8e3945b3ad8bf93491dd0db0f2782230 Signed-off-by: Dan Rue <dan.rue@linaro.org>
2017-11-06android boottime: some improvementsYongqin Liu
1. support to analyze the first boot time information 2. move install of usbutils to others together 3. remove the cat of logfiles so that the job could be finished quickly use sync to make sure all files stored on storage 4. set to install_deps skipped by default, so that we don't need to specify when run manually Change-Id: Ie95c4b7fef89c16a078d159e4dc1b6d364aea438 Signed-off-by: Yongqin Liu <yongqin.liu@linaro.org>
2017-11-03android geekbench3: add unit for test measurementYongqin Liu
Change-Id: I975c172fbed2ba6be88ddc18b697356efc56ce25 Signed-off-by: Yongqin Liu <yongqin.liu@linaro.org>
2017-11-02automated: workload-automation: allow extra WA modulesMilosz Wasilewski
Add support for WA_EXTENSION_PATHS variable to allow extra modules. The modules have to be available in the system before workload-automation.sh is executed. Change-Id: I045e5c5095a582000676214ad838e917d79dece4 Signed-off-by: Milosz Wasilewski <milosz.wasilewski@linaro.org>
2017-11-02LTP: Add automake package dependencyDan Rue
Needed for building LTP. Not sure why this wasn't already listed - perhaps most systems already have it incidentally. Change-Id: If6d9e41c9e84f40d65a6ebb1f82fc8f716259a7f Signed-off-by: Dan Rue <dan.rue@linaro.org>
2017-11-01automated/android/wa: Update dependencies to remove obsolete packagesLisa Nguyen
Update the list of dependencies needed to run Workload Automation on Android, so we do not run into errors such as: "E: Unable to locate package libstdc++6 E: Couldn't find any package by regex 'libstdc++6' E: Package 'libgcc1:i386' has no installation candidate E: Package 'zlib1g:i386' has no installation candidate E: Package 'libncurses5:i386' has no installation candidate" Change-Id: I3b1322966ee55b8f860f15120477470be9c66967 Signed-off-by: Lisa Nguyen <lisa.nguyen@linaro.org>
2017-11-01automated: linux: ltp: skip utimensat01 on junoNaresh Kamboju
utimensat01 should have skipped by LTP but it got failed when using NFS rootfs. till NFS issues resolved this test will be under skip list for juno. LKFT: linux-mainline: Juno: LTP utimensat01 failed due to NFS mounted rootfs https://bugs.linaro.org/show_bug.cgi?id=3398 Ref: mainline kernel tests baselining https://projects.linaro.org/projects/CTT/queues/issue/CTT-585 Change-Id: I46c1828e9093d10573f2d5d01852aa5515b283bf Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2017-11-01automated: ltp: skip linkat01 on x86Naresh Kamboju
Due to NFS file system on x86 the LTP test case linkat01 failed so skip it. Ref: mainline kernel tests baselining https://projects.linaro.org/browse/CTT-585 Change-Id: Ia615315d7259e2aa24e1c12376f57519580410dd Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2017-11-01Merge "device-read-perf: add "openembedded" to the os support list"Chase Qi
2017-11-01device-read-perf: add "openembedded" to the os support listLei Yang
I had validated it worked on yocto based os Change-Id: Ifa6dce10ff340010efa27f77892d39d6e2d0ef20 Signed-off-by: Lei Yang <Lei.Yang@windriver.com>
2017-11-01dd-wr-speed: add "openembedded" to the os support listLei Yang
I had validated it worked on yocto based os Change-Id: Ie54aabf97d5f63870fcf40422fac422e5f47d35f Signed-off-by: Lei Yang <Lei.Yang@windriver.com>
2017-11-01automated: ltp: prevent failing LAVA job if rm TMP_DIR failsMilosz Wasilewski
Change-Id: I0f116bdfa49442bcddc2edc537e388c09ea566a7 Signed-off-by: Milosz Wasilewski <milosz.wasilewski@linaro.org>
2017-10-31Merge "rcutorture.yaml: use "space" instead of "tab""Chase Qi
2017-10-31lmbench: add "openembedded" to os support listLei Yang
I have validated it works on yocto based os Change-Id: I5b7754361b2c712373ef046101e6660f3d8af31a Signed-off-by: Lei Yang <Lei.Yang@windriver.com>
2017-10-31rcutorture.yaml: use "space" instead of "tab"Lei Yang
Change-Id: I5467c29dae9f0b1c22bf882ad26569632fd2907d Signed-off-by: Lei Yang <Lei.Yang@windriver.com>
2017-10-31lmbench: add lmbench binaries for x86Lei Yang
Signed-off-by: Lei Yang <Lei.Yang@windriver.com>
2017-10-31rcutorture.yaml: add required kernel config in the descriptionLei Yang
CONFIG_RCU_TORTURE_TEST=m is required Signed-off-by: Lei Yang <Lei.Yang@windriver.com>
2017-10-30LTP: Skip flaky LTP tests on x15Dan Rue
Change-Id: I3dfdccc7b3893872a14ea8d5436ab0edfb7ddd11 Signed-off-by: Dan Rue <dan.rue@linaro.org>
2017-10-25plans/qcomlt/smoke.yaml: Add WLAN and HCI smoke testsAníbal Limón
Recently added and tested by Nicolas Dechesne [1]. [1] https://staging.validation.linaro.org/results/194938 Change-Id: Iea28180352678322bfac7382fa03bca3f17107da Signed-off-by: Aníbal Limón <anibal.limon@linaro.org>
2017-10-25plans/qcomlt: Fix dragonboard410c device nameAníbal Limón
Change-Id: Ifca5c7ecaf82106980a9058f157fbf00a7da6c39 Signed-off-by: Aníbal Limón <anibal.limon@linaro.org>
2017-10-24automated: ltp: skip quota_remount_test01 on hikey and junoNaresh Kamboju
Till this bug resolved quota_remount_test01 will be skipped Reference: ltp-fs-tests/quota_remount_test01 https://bugs.linaro.org/show_bug.cgi?id=3354 mainline kernel tests baselining https://projects.linaro.org/projects/CTT/queues/issue/CTT-585 Change-Id: I7f53182962fab7f03ffe394e6c4d6e2834409267 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2017-10-24Merge "android tradefed: workaround for chown testuser home directory"Chase Qi
2017-10-24android tradefed: workaround for chown testuser home directoryYongqin Liu
This change is to workaround the problem happened here: https://staging.validation.linaro.org/scheduler/job/194317#L5332 With adding more debug information, found that the problem is caused by command of "chown testuser.testuser /home/testuser", not sure why yet, but changing to create the home directory with the useradd command could help to workaround that problem. Also deleting that testuser before creating to make sure the useradd command executed successfully, and delete that testuser after the test finished. Change-Id: Icfd0dd1aa931a31d411e5e562c457d8c3ab007a7 Signed-off-by: Yongqin Liu <yongqin.liu@linaro.org>
2017-10-24hackbench.yaml: add "openembedded" to os support listLei Yang
I had validated that it can be excuted on openembedded based os. Change-Id: Idac21c601417400aff574a82fbf1cd0ea7b0e12e Signed-off-by: Lei Yang <Lei.Yang@windriver.com>
2017-10-24fio-test.yaml: add "openembedded" to os support listLei Yang
I had validated that it can be excuted on openembedded based os. Change-Id: Ic6cec6e971ea705b675486b1663f7e27031633bf Signed-off-by: Lei Yang <Lei.Yang@windriver.com>
2017-10-24fio-test: use pre-installed binary if already installedLei Yang
Change-Id: Idac895e3c60da06befefa21457a30f9146d4b118 Signed-off-by: Lei Yang <Lei.Yang@windriver.com>
2017-10-24Merge "automated: wlan-smoke: add new test"Chase Qi
2017-10-24automated: wlan-smoke: add new testNicolas Dechesne
WLAN smoke test. This initial set of tests only verify the state of the WLAN $DEVICE at boot (on or off) and test if the $DEVICE can be enabled and disabled. There is no WLAN transmission/connection. == Example of test execution with test-runner on DB410c, running OE RPB: name,test_case_id,result,measurement,units,test_params wlan-smoke,ip-link,pass,,,DEVICE=wlan0;BOOT=enabled wlan-smoke,wlan-boot,pass,,,DEVICE=wlan0;BOOT=enabled wlan-smoke,wlan-down,pass,,,DEVICE=wlan0;BOOT=enabled wlan-smoke,wlan-up,pass,,,DEVICE=wlan0;BOOT=enabled == Static code analysis $ python3 validate.py -s SC1091 -g * SHELLCHECK: [PASSED]: automated/linux/wlan-smoke/wlan-smoke-test.sh * YAMLVALID: [PASSED]: automated/linux/wlan-smoke/wlan-smoke.yaml * METADATA [PASSED]: automated/linux/wlan-smoke/wlan-smoke.yaml Change-Id: I2be32c0975b7997492e4467a7d5585438669315d Signed-off-by: Nicolas Dechesne <nicolas.dechesne@linaro.org>
2017-10-24Merge "automated: hci-smoke: add new test"Chase Qi
2017-10-24Merge "test-runner: ResultParser: handle custom params from command line"Chase Qi
2017-10-23automated: hci-smoke: add new testNicolas Dechesne
Bluetooth HCI smoke test. This initial set of tests only verify the state of the bluetooth $DEVICE at boot (on or off) and test if the $DEVICE can be enabled and disabled. There is no BT transmission/connection. == Example of test execution with test-runner on DB410c, running OE RPB: name,test_case_id,result,measurement,units,test_params hci-smoke,hciconfig,pass,,,DEVICE=hci0;BOOT=enabled hci-smoke,hciconfig-boot,pass,,,DEVICE=hci0;BOOT=enabled hci-smoke,hciconfig-down,pass,,,DEVICE=hci0;BOOT=enabled hci-smoke,hciconfig-up,pass,,,DEVICE=hci0;BOOT=enabled == Static code analysis $ python3 validate.py -s SC1091 -g * SHELLCHECK: [PASSED]: automated/linux/hci-smoke/hci-smoke-test.sh * YAMLVALID: [PASSED]: automated/linux/hci-smoke/hci-smoke.yaml * METADATA [PASSED]: automated/linux/hci-smoke/hci-smoke.yaml Change-Id: I7818fc9e904b8da6a378dbb63bfd660e8f6ee4da Signed-off-by: Nicolas Dechesne <nicolas.dechesne@linaro.org>
2017-10-23Merge "validate.py: fix the case when file were deleted"Dan Rue
2017-10-23hackbench: use pre-installed binary if already installedLei Yang
Change-Id: Iaaabf2034d4ad44bd64c507e3abe4231cc61f7dc Signed-off-by: Lei Yang <Lei.Yang@windriver.com>
2017-10-23pi-stress: use pre-installed binary if already installedLei Yang
Change-Id: I1b644142e43a3a05b4001d347e02e4d97a2bc260 Signed-off-by: Lei Yang <Lei.Yang@windriver.com>
2017-10-23iperf.sh: "check_root" is redundant, which is done by "install_deps"Lei Yang
First, for "debian|ubuntu|fedora", "install_deps" function has already handled if the user is root or not, if not root, installation process will exit immediately. Second, for "centos" package installation, "install_deps" is the first function to run. So it doesn't need "check_root" function before "make install" process. Change-Id: I86090cd10554d50283fac2f72725bfa831f0faa2 Signed-off-by: Lei Yang <Lei.Yang@windriver.com>
2017-10-23rt-migrate-test: use pre-installed binary if already installedLei Yang
Change-Id: Ia764778dc41839653da489bcdf8890a1d535d865 Signed-off-by: Lei Yang <Lei.Yang@windriver.com>
2017-10-23signaltest: use pre-installed binary if already installedLei Yang
Change-Id: If60edbd469fd19635671a619df6f80a6a3a639e7 Signed-off-by: Lei Yang <Lei.Yang@windriver.com>
2017-10-23pmqtest: use pre-installed binary if being already installedLei Yang
Change-Id: I7ea4afd744a0ff9d656142a9a23a9cc6c9ec1386 Signed-off-by: Lei Yang <Lei.Yang@windriver.com>
2017-10-23test-runner: ResultParser: handle custom params from command lineNicolas Dechesne
When setting test params on the command line with -r, they are correctly passed down into run.sh script, however at the end of the test run when we print the result, the custom params from command line are ignored, and we incorrectly print the test params from the .yaml file. e.g. $ test-runner -d automated/linux/wlan-smoke/wlan-smoke.yaml -e -r BOOT=disabled incorrectly prints the following: name,test_case_id,result,measurement,units,test_params wlan-smoke,ip-link,pass,,,DEVICE=wlan0;BOOT=enabled wlan-smoke,wlan-boot,fail,,,DEVICE=wlan0;BOOT=enabled wlan-smoke,wlan-down,pass,,,DEVICE=wlan0;BOOT=enabled wlan-smoke,wlan-up,pass,,,DEVICE=wlan0;BOOT=enabled When parsing the result, we need to override the test params with any param from the command line. After this patch, the same command produces: name,test_case_id,result,measurement,units,test_params wlan-smoke,ip-link,pass,,,DEVICE=wlan0;BOOT=disabled wlan-smoke,wlan-boot,fail,,,DEVICE=wlan0;BOOT=disabled wlan-smoke,wlan-down,pass,,,DEVICE=wlan0;BOOT=disabled wlan-smoke,wlan-up,pass,,,DEVICE=wlan0;BOOT=disabled And for fun: $ test-runner -d automated/linux/wlan-smoke/wlan-smoke.yaml -e -r BOOT=disabled THEBUGISGONE=yes name,test_case_id,result,measurement,units,test_params wlan-smoke,ip-link,pass,,,DEVICE=wlan0;THEBUGISGONE=yes;BOOT=disabled wlan-smoke,wlan-boot,fail,,,DEVICE=wlan0;THEBUGISGONE=yes;BOOT=disabled wlan-smoke,wlan-down,pass,,,DEVICE=wlan0;THEBUGISGONE=yes;BOOT=disabled wlan-smoke,wlan-up,pass,,,DEVICE=wlan0;THEBUGISGONE=yes;BOOT=disabled Change-Id: Ib561620f73e868d53653aa158f35e7804d7e13f3 Signed-off-by: Nicolas Dechesne <nicolas.dechesne@linaro.org>
2017-10-22validate.py: fix the case when file were deletedMilosz Wasilewski
Change-Id: I718ebedffffd57383d81131732ff7df764f0752e Signed-off-by: Milosz Wasilewski <milosz.wasilewski@linaro.org>
2017-10-21automated: ltp: skip ltp containers Network Namespaces testsNaresh Kamboju
skip ltp containers Network Namespaces tests hikey, juno, x15 and x86. skip failed 17 test cases on x15 and x86. skip failed 5 test cases on hikey and juno. Reference: mainline kernel tests baselining https://projects.linaro.org/projects/CTT/queues/issue/CTT-585 LKFT: linux-mainline: HiKey and Juno: ltp-containers Network Namespaces tests failed https://bugs.linaro.org/show_bug.cgi?id=3327 Change-Id: Iaf369a25d7d0ab24736ff3d64554b48c8aa60ad7 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2017-10-20automated: ltp: skip quotactl01 test on hikey juno and x15Naresh Kamboju
Skip quotactl01 test on hikey juno and x15. Reference: mainline kernel tests baselining https://projects.linaro.org/projects/CTT/queues/issue/CTT-585 Change-Id: I588c41934b8b1d27d3dcda4bae1a2d614243dd7f Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2017-10-20automated: ltp: skip NFS not supported ltp syscalls tests on x86 and junoNaresh Kamboju
Skip NFS not supported LTP syscalls tests on x86 and juno when test setup using NFS file system on x86 and Juno device. Reference: mainline kernel tests baselining https://projects.linaro.org/projects/CTT/queues/issue/CTT-585 Change-Id: I4dc45b2a157d4cb08a4be78267d5ea436a37bf7b Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2017-10-20plan: erp: remove sysbench percpu subtestChase Qi
percpu run sysbench cpu test for each processor, it is mainly designed for big-little arch, which isn't the case on ERP platforms. Change-Id: I2a4e916aa200129a49d73cad860320cf2043855e Signed-off-by: Chase Qi <chase.qi@linaro.org>
generated by cgit v1.2.3 (git 2.25.1) at 2024-06-11 04:37:07 +0000