aboutsummaryrefslogtreecommitdiff
AgeCommit message (Collapse)Author
2019-01-10Merge pull request #3 from chase-qi/codeownerChase Qi
Add CODEOWNERS
2019-01-10Merge pull request #4 from chase-qi/travisChase Qi
Add Travis CI
2019-01-10Merge pull request #5 from chase-qi/devChase Qi
Remove .gitreview
2019-01-09Remove .gitreviewChase Qi
Signed-off-by: Chase Qi <chase.qi@linaro.org>
2019-01-09Add Travis CIChase Qi
Signed-off-by: Chase Qi <chase.qi@linaro.org>
2019-01-09Add CODEOWNERSChase Qi
Add code owners so that we receive notifications on any changes. Signed-off-by: Chase Qi <chase.qi@linaro.org>
2019-01-09Merge pull request #2 from liuyq/masterChase Qi
android-test-lib adb_join_wifi: uninstall the package
2019-01-09android-test-lib adb_join_wifi: uninstall the packageYongqin Liu
after ran the wifi join command to avoid the effect on test result like reported here: https://bugs.linaro.org/show_bug.cgi?id=4236 Change-Id: I15e9710635beddc964456e18e06e8a361d5fae78 Signed-off-by: Yongqin Liu <yongqin.liu@linaro.org>
2019-01-09Merge pull request #1 from chase-qi/migrationChase Qi
Add README.md
2019-01-09Add README.mdChase Qi
- Update automated/README using markdown syntax - Move the file out as repo README Signed-off-by: Chase Qi <chase.qi@linaro.org>
2019-01-08lkft skipfiles: Add 4.20; rm 4.18, 4.16Dan Rue
Update list of stable branches where applicable. Change-Id: Ib13184907555dd094fa3567fec3e3734e13b5369 Signed-off-by: Dan Rue <dan.rue@linaro.org>
2019-01-08automated: android: optee: add 32-bit gtest for..Victor Chong
..gatekeeper and keymaster Change-Id: Ib998b465c85d2805542c0f0875536b1b69c150fd Signed-off-by: Victor Chong <victor.chong@linaro.org> Reviewed-by: Chase Qi <chase.qi@linaro.org>
2018-12-19automated/linux/ptest/ptest.py: Set unicode decode to replaceAníbal Limón
In order to don't fail when trying to decode non-unicode value. See [1]: ... UnicodeDecodeError: 'utf-8' codec can't decode byte 0xc3 in position 3 ... [1] https://lava.automotivelinux.org/scheduler/job/2254#L2718 Change-Id: Icfd10e9a43599789fc7859b9dbe425582e2e15a4 Signed-off-by: Aníbal Limón <anibal.limon@linaro.org>
2018-12-18network-basic: download short file to save download timeNaresh Kamboju
Change-Id: I566e946d23673e19c7d402c153e51083decec7b6 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2018-12-17Add utility yaml files to facilitate waiting for device availabilityKarsten Tausche
These yaml files simplify waiting for a specific device state in a test submission before running an actual test job. Change-Id: I0f6631afc1a73358e80220f6fc51789b0c4ec296 Depends-On: Icd68e9de5a349880c52ec06229cd3f8bcb8eeecc Signed-off-by: Karsten Tausche <karsten@fairphone.com>
2018-12-17Add network related Android library functionsKarsten Tausche
Allow getting the device IP address (if connected) and waiting until a device is connected to a network. Change-Id: Icd68e9de5a349880c52ec06229cd3f8bcb8eeecc Signed-off-by: Karsten Tausche <karsten@fairphone.com>
2018-12-17Merge "Hide shell variables in local function scope"Milosz Wasilewski
2018-12-14Hide shell variables in local function scopeKarsten Tausche
This prevents unexpected side effects due to commonly used variable names, e.g., when shell functions call each other. Also make sure `install_deps` optional parameter `skip_install` is initialized. Change-Id: I0baa1c66221cc32bfe7c6da276db72f092283f81 Signed-off-by: Karsten Tausche <karsten@fairphone.com>
2018-12-14automated/android/tradefed: fix pep8 warningsMilosz Wasilewski
Change-Id: I94bd9dc5f50274a2a4ece1d9513fd896fce9bae0 Signed-off-by: Milosz Wasilewski <milosz.wasilewski@linaro.org>
2018-12-14automated/android/tradefed: define class constantsMilosz Wasilewski
In order to avoid typing mistakes parser class defines two constant values that can be used with options and 'if' statements. Change-Id: I73eb6360b9f1d9bfa7c5b5eca8dc7fb94a3cfadc Signed-off-by: Milosz Wasilewski <milosz.wasilewski@linaro.org>
2018-12-14Merge "Extract result_parser.py from tradefed-runner.py"Milosz Wasilewski
2018-12-14Merge "automated/linux/ptest: Analyze each test in package tests"Milosz Wasilewski
2018-12-14Merge "Add sanity-check.sh"Milosz Wasilewski
2018-12-14Add sanity-check.shChase Qi
* Add sanity-check.sh to unify test run on Jenkins and local. * Fix shellcheck '-e' usage in validate.py After the file added, I will patch Jenkins job to run the script directly. Change-Id: I21c9ed41218b82650863d41e05c9d2900d3c0a43 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2018-12-14Merge "Don't track compiled Python files"Milosz Wasilewski
2018-12-14Merge "automated: android: optee: add gtest for.."Chase Qi
2018-12-14automated: android: optee: add gtest for..Victor Chong
..gatekeeper and keymaster Change-Id: I24481cbfd27fc7a725abbf1e69840e28de1782f0 Signed-off-by: Victor Chong <victor.chong@linaro.org> Signed-off-by: Chase Qi <chase.qi@linaro.org>
2018-12-14Don't track compiled Python filesChase Qi
Change-Id: Ic9e73187b1e195bc8475cd5721c1bc9c941af048 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2018-12-13automated/linux/ptest: Analyze each test in package testsOleksandr Terentiev
Currently ptest.py analyze only exit code of each package test to decide if it passed or not. However, ptest-runner can return success code even though some tests failed. So we need to parse test output and analyze it. It also quite useful to see exactly which tests failed. So results are recorded for each particular test, and lava-test-set feature is used to distinguish packages. Test results, https://validation.linaro.org/results/1900356 automated/utils/send-to-lava.sh: Add support to send lava-test-set results Change-Id: Id1c2e8190b9cce5cfa9f08e64322667f8e1a0c28 Signed-off-by: Oleksandr Terentiev <oterenti@cisco.com> Signed-off-by: Aníbal Limón <anibal.limon@linaro.org>
2018-12-13Extract result_parser.py from tradefed-runner.pyKarsten Tausche
A first step to make the runner code more reusable by other implementations. Code from the previous result_parser() function and related constants were moved to result_parser.py to provide the parser code in a self-contained file. Additionally, the two printing approaches (aggregated, atomic) are now in dedicated functions to make the code more readable. Change-Id: I638d6a2cf44a5569569703308172e3056030783f Signed-off-by: Karsten Tausche <karsten@fairphone.com>
2018-12-13upload-to-artifactorial.sh: Allow to check for failures and to print debug ↵Karsten Tausche
information Change-Id: Ie011cb2cd899dac938066ca4eee7652b83ac38d4 Signed-off-by: Karsten Tausche <karsten@fairphone.com>
2018-12-13android-test-lib: Use svc command to disable suspend without root accessKarsten Tausche
Change-Id: I912ab5168bbe1b4fc0a3a8112db5cbc94a812b7c Signed-off-by: Karsten Tausche <karsten@fairphone.com>
2018-12-13Merge "linaro-android-kernel-tests: disable selinux for test"Chase Qi
2018-12-12v4l2-compliance: Use 'which' instead of 'command'Arthur She
Replace 'command' by 'which', because Busbox doesn't have 'command' Change-Id: Iee50356babe8973ebe358cef606b560a3afedcb9
2018-12-12linaro-android-kernel-tests: disable selinux for testYongqin Liu
since this test is kernel related test, it might need premissions that not supported by default. It's not good to add rules for test purpose, which might affect other tests that, so we set it to permissve mode before we run this kernel test, and set it back to Enforce mode if it was before Change-Id: Ic02eb085bdbaeb37f0fd27339f1dd3939489aaab Signed-off-by: Yongqin Liu <yongqin.liu@linaro.org>
2018-12-11Merge "android/tradefed: add ANDROID_VERSION parameter to test definition file"Milosz Wasilewski
2018-12-11android/tradefed: add ANDROID_VERSION parameter to test definition fileChase Qi
setup.sh uses the variable implicitly to determine which JDK version to install. Lets add the parameter to test definition file so that test planner knowns it is customizable when they look at the yaml file. Change-Id: I23cc60a58d5ec07ff120d0c6ecf0fe2f85a8e66b Signed-off-by: Chase Qi <chase.qi@linaro.org>
2018-12-11noninteractive-tradefed/setup.sh: fix the change for ANDROID_VERSIONYongqin Liu
we need to escape the dot sign '.' for 'grep -e' command. otherwise we will got wrong result like following: 12:12:24 liuyq: configs$ echo "aosp-master-2018-12-10"|grep -e "8.1\|O" aosp-master-2018-12-10 12:12:29 liuyq: configs$ which caused the cts/vts failure like here: https://lkft.validation.linaro.org/scheduler/job/542931#L2112 Change-Id: Id5a6df48259a050763dc52c9fb4e87218f03f596 Signed-off-by: Yongqin Liu <yongqin.liu@linaro.org>
2018-12-07android: tradefed: remove bash extensionVishal Bhoj
Sadly previous patch doesn't work. the variables from setup.sh like ANDROID_SERIAL is used through out the job. Change-Id: I7f8eee80fd9de4dd648a7cd689a616f87845269b Signed-off-by: Vishal Bhoj <vishal.bhoj@linaro.org>
2018-12-06android: tradefed: fix java installation for OreoVishal Bhoj
Change-Id: Ia774de85db768d711256c7ce17dd4da147d67ed5 Signed-off-by: Vishal Bhoj <vishal.bhoj@linaro.org>
2018-12-05noninteractive-tradefed: only install jdk8 for Oreo buildsYongqin Liu
and change to use jdk9 by default. Normally we will specify ANDROID_VERSION to aosp-master to install jdk9, and specify nothing to install jdk8, here we change to install jdk8 when ANDROID_VERSION is specified to O or nothing specified, and install jdk9 when other value is specified. And this implementation should be only used after Oreo builds, so there should be no regression for this change. Change-Id: I8d84abc0c9647d4527869f6758e35de371b5edb3 Signed-off-by: Yongqin Liu <yongqin.liu@linaro.org>
2018-11-30noninteractive-tradefed/tradefed.yaml: drop the use of [[Yongqin Liu
Change to use [ to workaround [[ not found problem like reported here: https://validation.linaro.org/scheduler/job/1899056#L3522 Tested with following jobs on lava: https://validation.linaro.org/scheduler/job/1899148 Change-Id: I1d7bb4debe0acf9b576d0e0f64fa90b9bbcb544d Signed-off-by: Yongqin Liu <yongqin.liu@linaro.org>
2018-11-30Merge "glbenchmark25.py: workaround to run with Pie build"Chase Qi
2018-11-28glbenchmark25.py: workaround to run with Pie buildYongqin Liu
Change-Id: I702aad1b2e20b9ec099cf9fee5698a01e96fa539 Signed-off-by: Yongqin Liu <yongqin.liu@linaro.org>
2018-11-28Merge "linux/ipref: add support for test run against remote server"Milosz Wasilewski
2018-11-28linux/ipref: add support for test run against remote serverChase Qi
* Enable shell xtrace * Support to specify iperf server from yaml * Support test run with LAVA multinode job * Fix typos Single node job example: https://validation.linaro.org/scheduler/job/1898957 Multiple node job example: https://validation.linaro.org/scheduler/job/1898958 Change-Id: I69a5c3a2c704a1ee11be27a356cc92eb4f69b3f9 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2018-11-28geekbench4.py: updated to 4.3.0Yongqin Liu
apk files uploaded here: http://testdata.linaro.org/apks/geekbench-3-4-3-0.apk Change-Id: If95e3e0ece33120a06c31533eec2d03097408433 Signed-off-by: Yongqin Liu <yongqin.liu@linaro.org>
2018-11-27android/tradefed: pass JAVA_OPTIONS to the tradefed.shMilosz Wasilewski
Change-Id: I7b76dbd8f0cce3dc3a1ee24793447987cd947f06 Signed-off-by: Milosz Wasilewski <milosz.wasilewski@linaro.org>
2018-11-27Merge "tradefed: enable java options configurations"Chase Qi
2018-11-26linux: Adding spectre meltdown checker test suiteNaresh Kamboju
Spectre & Meltdown Checker description, A shell script to tell if your system is vulnerable against the several "speculative execution" CVEs that were made public in 2018. CVE-2017-5753 [bounds check bypass] aka 'Spectre Variant 1' CVE-2017-5715 [branch target injection] aka 'Spectre Variant 2' CVE-2017-5754 [rogue data cache load] aka 'Meltdown' aka 'Variant 3' CVE-2018-3640 [rogue system register read] aka 'Variant 3a' CVE-2018-3639 [speculative store bypass] aka 'Variant 4' CVE-2018-3615 [L1 terminal fault] aka 'Foreshadow (SGX)' CVE-2018-3620 [L1 terminal fault] aka 'Foreshadow-NG (OS)' CVE-2018-3646 [L1 terminal fault] aka 'Foreshadow-NG (VMM)' Ref: Add spectre-meltdown-checker to LKFT https://projects.linaro.org/browse/KV-125 Change-Id: I1fdc3120cc575bf37bcea7f2cf0b02c3ad30e38a Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>