summaryrefslogtreecommitdiff
AgeCommit message (Collapse)Author
2017-12-05LTP: Juno: stop skipping NFS failed test casesHEADmasterNaresh Kamboju
Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2017-12-05android: vts: save logs in vts_run_details.txtChase Qi
For each test/module, VTS creates a temporary log file like: /tmp/vts-runner-log<some-id>/VtsKernelLtp/latest/test_run_details.txt This patch uses monitor-runner-output.py provided by vts to monitor real-time test progress and save logs in vts_run_details.txt. Change-Id: Icaa06bba9e44becb6a7e2e84348293c64100113f Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-12-05android: stop the lava job if device is not presentVishal Bhoj
Change-Id: Ia2e69c4e480c8e461792022e55568c387a350fab Signed-off-by: Vishal Bhoj <vishal.bhoj@linaro.org>
2017-12-04automated/linux: Add piglit test definitionAníbal Limón
Change-Id: I8856ff4eb9063437fe85eef1e9dd3d2ee9d82d36 Signed-off-by: Aníbal Limón <anibal.limon@linaro.org>
2017-12-04automated: kselftest: ignore comment lines in skipfileMilosz Wasilewski
All lines starting with # in skipfile are ignored. This allows to preserve comments in the skipfiles Change-Id: I01f877511895ee634cddd91160dbdb5dc86e2d1d Signed-off-by: Milosz Wasilewski <milosz.wasilewski@linaro.org>
2017-11-30plans: erp: add test plan overlaysChase Qi
Add test plan overlay for each board to customize test plan. Change-Id: Ib650dd1d5cb8f2ed60dc60b5440a038aac54437b Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-11-29automated/utils/test-runner.py: Compile the pattern regex before useAníbal Limón
If a pattern regex is specified is used many times to parse the stdout log to get results so is better to do a previous compile to speed up parsing. Change-Id: I9b37f35b4eded276144508b8ec255938fad19618 Signed-off-by: Aníbal Limón <anibal.limon@linaro.org>
2017-11-29kselftest: skip mpx-mini-test_64 on x86_64Naresh Kamboju
skip mpx-mini-test_64 on x86_64 on all builds Ref: ---- LKFT: 4.4-rc 4.9-rc 4.13-rc 4.14-rc: x86: kselftest mpx-mini-test_64 - no MPX support - failed - 3869 Aborted (core dumped) https://bugs.linaro.org/show_bug.cgi?id=3497 Change-Id: I5bf721eea328405ab52eb8340415562a91724025 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2017-11-29kselftest: skip raw_skew on x15 and junoNaresh Kamboju
LKFT: 4.9.58-rc1 : kselftest : raw_skew regression on X15 https://bugs.linaro.org/show_bug.cgi?id=3376 Change-Id: I9f8e9f40f6b97fb5b9d33f672196a60a7e1caee8 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2017-11-29automated/utils/test-runner.py: Only use fixup dict if exists a map entryAníbal Limón
If no mapping exists in the fixup dictionary use the original result, sometimes you only need to map certain result values. There is the same logic in lava-dispatcher [1]. [1] https://git.linaro.org/lava/lava-dispatcher.git/tree/lava_dispatcher/connection.py#n85 Change-Id: Iafd47ebd672fb27213e20727e3f4a099429c824e Signed-off-by: Aníbal Limón <anibal.limon@linaro.org>
2017-11-29android: tradefed: fix stable vts execution failureVishal Bhoj
This is needed for 8.0-vts release else we will get this error: Error: Could not find or load main class com.android.compatibility.common.tradefed.command.CompatibilityConsole Change-Id: I45f22231467bf1aca4b6300f651daaf833481228 Signed-off-by: Vishal Bhoj <vishal.bhoj@linaro.org>
2017-11-28Merge "test-runner: add support for test plan overlay"Dan Rue
2017-11-28test-runner: add support for test plan overlayChase Qi
On ERP testing, we need to skip disk partitioning test on boards that don't have the second hard drive installed. We may also need to amend test parameters or add new tests in the future. This patch add support for test plan overlay to: * skip tests. * amend test parameters. * add new tests. Change-Id: I9143b313b32f0c541fb08bacce80f371b1cf15e6 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-11-27plans: introduce linaro test plan v2Chase Qi
* Simplify test plan format. * Update test-runner for the change in test plan. * Update existing test plans to v2. Change-Id: Ic10e6eb3d17cbf54140831d0e030dcbbb95c75db Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-11-24android apk-automation: add some improvementsYongqin Liu
1. print trace information as well when exception raised in module implementation 2. add sleep before calling of self.vc.dump() in dump_always, since dump_always might be called in while loop in the module implementation, and call dump_always immediately without sleep would cause failures 3. add sleep after the "am start" command as a workaround for the -W option, in the new tag r34, this -W option seems not work as expected which makes the am start commnd only return after the activity displayed completely. sometimes this command will return before the activity displayed completely. but this should be just a workaround for better fault tolerance 4. improved some module implementation for better fault tolerance Change-Id: I1f9c6f0a3c40447de53b1b1d558c1dbc2e3164db Signed-off-by: Yongqin Liu <yongqin.liu@linaro.org>
2017-11-24kselftest: skip run_afpackettests on 4.4Naresh Kamboju
kselftest run_afpackettests test case do not support on 4.4 lets skip it. Ref: LKFT: android-hikey-linaro-4.4: WARNING: at net/packet/af_packet.c:4104 packet_set_ring - Tx-ring is not supported on Linux-4.4 https://bugs.linaro.org/show_bug.cgi?id=3141 Change-Id: Ie30d843b3a8364db3210e1a989524835d869d89a Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2017-11-22android: microbenchmarks: set gitconfig colorizeVishal Bhoj
Without this, repo init will show option to select color and lava job won't complete like this: https://validation.linaro.org/scheduler/job/1654540 Change-Id: Ic07e17dfcb920f037a3a274404cb14da797a415e Signed-off-by: Vishal Bhoj <vishal.bhoj@linaro.org>
2017-11-21LTP: Skip msgctl10 which fails on QDF2400Dan Rue
Not only does it fail, it also does not seem to finish cleanly and cause other tests to fail inconsistently, and all of LTP to exit early (as observed by the number of test results) https://bugs.linaro.org/show_bug.cgi?id=3487 Change-Id: Id991d961d58475ed956259c1554b978deab83bf5 Signed-off-by: Dan Rue <dan.rue@linaro.org>
2017-11-21kselftests: Adding skipfiles for dragonboard-410cNaresh Kamboju
Kselftests skiplist not yet identified for dragonboard-410c board so created softlinks from hikey device. Once we identify skiplist on dragonboard-410c we revert this patch. Change-Id: Ic870d85bec421c6c32dcbe8309ce3f9b51fd3ff6 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2017-11-21kselftest: skipfiles list created as skiplist_${DEVICE_TYPE}_${KERNEL_VERSION}Naresh Kamboju
Kselftest skipfiles list created as skiplist_${DEVICE_TYPE}_${KERNEL_VERSION} Ref: LKFT: move kselftest skiplists to git https://projects.linaro.org/browse/QA-1759 Change-Id: I23f511c5d9c2c980292446249513ae72d84bf360 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2017-11-20Merge "linux: network-basic: cover multiple subnets"Dan Rue
2017-11-20linux: network-basic: cover multiple subnetsChase Qi
On system uses multiple subnets, there is more then one gateway in route table. For example: Kernel IP routing table Destination Gateway Genmask Flags Metric Ref Use Iface default 192.168.11.1 0.0.0.0 UG 100 0 0 enp0s25 default 192.168.0.1 0.0.0.0 UG 600 0 0 wlp3s0 This patch: * Test the top default interface by default as it is the default interface for all traffics. * Obtain gateway by interface under test. Change-Id: I42328fcdf592ea2cb0ad35a43daa12833a60e415 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-11-20linux: ltp: skip min_free_kbytes on RPKChase Qi
By default, Debian installer will set the size of swap partition to the size of memory capacity. min_free_kbytes needs to occupy both memory and swap spaces. When memory size is large, this test takes hours to finish. For example, on D05 that 128G memory installed, this test takes more then 3 hours. It can be finished, but just too slow. It is possbile to customize partitioning steps to reduce swap partition size for this single test, but that is probably not wanted. Change-Id: I99e397f5277e49c9e01f7d73f34f126f5a8e3764 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-11-20LTP: Skip keyctl03 in RPKNaresh Kamboju
This test fails when run under automation but passes when run manually. Reported in https://bugs.linaro.org/show_bug.cgi?id=3451 Change-Id: I5a1781a8a967de7d457017ed5ee91d59d735f07b Signed-off-by: Dan Rue <dan.rue@linaro.org>
2017-11-17LTP: Skip netns ipv6 tests in RPKDan Rue
Known timing issue in test https://bugs.linaro.org/show_bug.cgi?id=3420 Change-Id: Ibe91acb3e1aade7914356ace2c35d269802ba75b Signed-off-by: Dan Rue <dan.rue@linaro.org>
2017-11-18kselftest: juno: skip intermittent failure raw_skew on mainlineNaresh Kamboju
raw_skew test failed on juno running mainline kernel so adding to skipfile Ref: LKFT: 4.9.58-rc1 : kselftest : raw_skew regression on X15 https://bugs.linaro.org/show_bug.cgi?id=3376 Change-Id: I14447a9ed14d0dc361db32d286eee3aa8436f472 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2017-11-17Merge "LTP: skip intermittent failure perf_event_open02"Dan Rue
2017-11-17Merge "kselftest: skipfiles: skipfiles soft links created for next, ↵Dan Rue
stable_rc_4.4 and stable_rc_4.9"
2017-11-17Merge "kselftest: x15: skip rtctest on x15"Dan Rue
2017-11-17kselftest: skip inconsistency-check on Hikey-4.4 and Hikey-4.9Naresh Kamboju
Skip the kselftest inconsistency-check on Hikey-4.4 and Hikey-4.9 Ref: LKFT: timer: inconsistency-check failed on Hikey https://bugs.linaro.org/show_bug.cgi?id=2950 Change-Id: I03eea7621a6fe52a9e78d1cad566f70ba0446365 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2017-11-17LTP: skip intermittent failure perf_event_open02Naresh Kamboju
skip LTP syscalls (intermittent failure) perf_event_open02 test case. Ref: LKFT: 4.9-rc: x86: LTP: perf_event_open02.c:333: test failed (ratio was greater than ) - intermittent failure https://bugs.linaro.org/show_bug.cgi?id=3382 Change-Id: If7a7640758ecd59a041c8f10173cdfab1b0145e5 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2017-11-17kselftest: x15: skip rtctest on x15Naresh Kamboju
Skip kselftest rtctest on x15 which fails intermittently. Ref: LKFT: linux-mainline: x15: rtctest - PIE delta error: 0.018197 should be close to 0.015625 https://bugs.linaro.org/show_bug.cgi?id=3402 Change-Id: I21b9842878fb2a9ea21203d170493827cb006020 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2017-11-17kselftest: skipfiles: skipfiles soft links created for next, stable_rc_4.4 ↵Naresh Kamboju
and stable_rc_4.9 next skipfiles created from mainline stable_rc_4.4 skipfiles created from stable_4.4 stable_rc_4.9 skipfiles created from stable_4.9 Change-Id: Id5b421f3f4bec0085a40d64d18e06744d02704bd Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2017-11-16linux: network-basic: test the default interface by defaultChase Qi
* Enabled verbose shell output. * Test the default interface when interface not specified. Change-Id: I6ca76c250a7560756a88e279f889c0ed69b6b43d Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-11-16LTP: skip ioctl03 on all devicesNaresh Kamboju
Skip LTP test case ioctl03 on all devices. Ref: LKFT: linux-mainline: Hikey and x15: LTP ioctl03: TFAIL: ioctl03.c:114: (UNKNOWN 0x30) https://bugs.linaro.org/show_bug.cgi?id=3470 Change-Id: Ied681edb3ea5d213cc2f2c6a5e38fcd472ed48eb Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2017-11-16LTP: x86: skip intermittent failure readahead02Naresh Kamboju
LTP test case readahead02 failed intermittently on x86 running stable-4.4. Ref: LKFT: 4.4: LTP readahead02 fails on x86 https://bugs.linaro.org/show_bug.cgi?id=3457 Change-Id: Id0c4f86bd4b62cc1dc97f8e33cc0bad6f1084e02 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2017-11-16automated: android-test-lib: don't return 1 when 'find' failsMilosz Wasilewski
Change-Id: I144d9ff5e061c1555e767708cb3d4b48834bf99a Signed-off-by: Milosz Wasilewski <milosz.wasilewski@linaro.org>
2017-11-16android tradefed: set the current dir owner to testuserYongqin Liu
so that files could be saved there, to avoid the problems here: https://staging.validation.linaro.org/scheduler/job/200421#L5256 Change-Id: I54b979c0c95dfb0614df9d00a7fb2e5e9f91ae53 Signed-off-by: Yongqin Liu <yongqin.liu@linaro.org>
2017-11-15Merge "LTP: Juno: skipfile-lkft-juno soft link created from skipfile-lsk-juno"Dan Rue
2017-11-15Merge "kselftest: add more known failures to skiplist_x86_stable_4.4"Dan Rue
2017-11-15Merge "linux: kselftest skipfiles for linux stable 4.9"Dan Rue
2017-11-15Merge "kselftest: skipfiles: skip rtctest on x15"Dan Rue
2017-11-15linux: kselftest skipfiles for linux stable 4.9Naresh Kamboju
Adding kselftest skipfiles of linux stable 4.9 for Hikey, Juno, x15 and x86. Ref: LKFT: Baseline LTP and Kselftest results on LTS 4.9 kernel https://projects.linaro.org/browse/CTT-618 Change-Id: I9378c0d189e07f210936884aa374f563c737338b Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2017-11-15kselftest: skipfiles: skip rtctest on x15Naresh Kamboju
Change-Id: I4d2953799acd37a295734e276017800d4003de6a Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2017-11-15LTP: Adding known LTP failures to skipfileNaresh Kamboju
Adding known fail test cases to Hikey, Juno, x15 and x86. Reference bug id and ticket ids are updated inside each skipfile. Change-Id: Iecf7a088286a9d290476625a47f37d513d493b78 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2017-11-15kselftest: add more known failures to skiplist_x86_stable_4.4Naresh Kamboju
Addding more known kselftest failures to skiplist Ref: LKFT: Baseline LTP and Kselftest results on LTS 4.4 kernel https://projects.linaro.org/browse/CTT-617 Change-Id: Ib5a50534250c6d9fdc550e2b2b1f1477f33bbd09 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2017-11-15LTP: Juno: skipfile-lkft-juno soft link created from skipfile-lsk-junoNaresh Kamboju
Change-Id: I1ef3e6d5bd6b6d92526729d8c8ce7fd63a42d722 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2017-11-14linux: kselftest skipfiles for linux stable 4.4Naresh Kamboju
Adding kselftest skipfiles of linux stable 4.4 for Hikey, Juno, x15 and x86. Ref: LKFT: Baseline LTP and Kselftest results on LTS 4.4 kernel https://projects.linaro.org/browse/CTT-617 Change-Id: If56dd95317c8058d5f283124db9c43d7f441789d Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2017-11-14ltp: hikey: skip fcntl35Naresh Kamboju
skip these two test cases on Hikey running linux-4.4 fcntl35 fcntl35 fcntl35_64 fcntl35_64 LKFT: 4.4: Hikey: LTP: fcntl35.c:98: FAIL: an unprivileged user init the capacity of a pipe to 65536 unexpectedly, expected 4096 https://bugs.linaro.org/show_bug.cgi?id=3378 Change-Id: I0d82a0a3dee0266db8de01a978efce0459897147 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2017-11-14LTP: Enable kernel.unprivileged_userns_cloneDan Rue
Test 'userns07' verifies that the kernel imposes a limit of at least 32 nested levels on user namespaces. However, user namespaces are disabled by default in debian. If user namespaces are disabled, enable them. Change-Id: I223a8f974905ae8f0373adc71c3bab2ef10c98ff Signed-off-by: Dan Rue <dan.rue@linaro.org>