summaryrefslogtreecommitdiff
AgeCommit message (Collapse)Author
2016-12-08plans: added support for generatig CSV from test plansMilosz Wasilewski
Change-Id: If3066f32d52e6c6e253832faa3911629ccaa54c7 Signed-off-by: Milosz Wasilewski <milosz.wasilewski@linaro.org>
2016-12-08test-runner: fixed result parsing regexpMilosz Wasilewski
Change-Id: I59f130777f01f038899041d2647de7ba0d3d004b Signed-off-by: Milosz Wasilewski <milosz.wasilewski@linaro.org>
2016-12-08manual: openssh/openssl install yum-utilsNaresh Kamboju
Change-Id: I69a7408000304e7887a05a13c6cfaa02a23591b1 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2016-12-08manual: openssh-centos: fix build issueNaresh Kamboju
Change-Id: I95f6d37975567cf899ab48846e7e025fc01b7823 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2016-12-07plans: rpb_ee: fixed test plan namesMilosz Wasilewski
Test plan names were colliding. Changed the names to be different. Change-Id: I78951c635f8ffce8fbf5bf6cb80c322e3cd36915 Signed-off-by: Milosz Wasilewski <milosz.wasilewski@linaro.org>
2016-12-07linux: ethernet: fix ping and get default routeNaresh Kamboju
Change-Id: Ie3b4dbc0e09078da9e9de6805e3bf5511a606c3c Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2016-12-07linux: ltp: add net-tools packageNaresh Kamboju
Change-Id: I78080931b6406fcd193eab24b16c4424e8b15778 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2016-12-06Merge "automated: test-runner: Added support for complex test names"Naresh Kamboju
2016-12-06automated: linux: kernel-compilation: install wgetChase Qi
Change-Id: I5ea518268065d3bb4161e0c7b97f97407e390558 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2016-12-05automated: test-runner: Added support for complex test namesMilosz Wasilewski
Test names can contain '=' now. The parsing is based on regex rather than simple line split with '=' as delimiter. This adresses libhugetlbfs test parsing problem. Change-Id: I1b6e03960456abf437a2720f6e5177556c766f5a Signed-off-by: Milosz Wasilewski <milosz.wasilewski@linaro.org>
2016-12-05automated: libhugetlbfs fix for running on distro kernelMilosz Wasilewski
Config file for distro kernel is located in /boot rather than in /proc. This patch adds support for both options Change-Id: Ie516fba4e3e37d58508f013e9287964cf5a362e3 Signed-off-by: Milosz Wasilewski <milosz.wasilewski@linaro.org>
2016-12-05android bootchart: attach bootchart.tgz only after generatedYongqin Liu
add condition for bootchart.tgz attaching that only attach bootchart for stop operation since there is no bootchart.tgz during the start operation Change-Id: I090fc02d28564a7bf190c8b6e6e548ec4eaeba97 Signed-off-by: Yongqin Liu <yongqin.liu@linaro.org>
2016-12-02plans: added RPB EE test planMilosz Wasilewski
Reference Platform EE test plan is based on not yet approved requirements. This version will be used for testing 16.12 release Change-Id: I5160aeeabacda0bfea0b7fbfdfe8b0b8b13f743b Signed-off-by: Milosz Wasilewski <milosz.wasilewski@linaro.org>
2016-12-02manual: kvm: fix typoNaresh Kamboju
Change-Id: I1c96eab22faae4f4abc9e4f40de81a95bf9a3e79 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2016-12-02manual: fix kvm test file download linkChase Qi
Change-Id: I44b44fe1b99570d28ca1cbba4039ea90e604cab9 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2016-12-02automated: linux: enable ltp skipfile parameterChase Qi
Change-Id: I4923d5ff672d7248d66f6ae8b7151dac89cd6fdb Signed-off-by: Chase Qi <chase.qi@linaro.org>
2016-12-02test-runner: fix version check for manual testChase Qi
When '-k manual' specified, test-runner only copy 'manual' folder to output directory, which isn't a valid git repo. From there, 'git checkout' or 'git rev-parse HEAD' fails. Change-Id: I005501efacb46fb49729995d112f8498164d8ad0 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2016-12-01test-runner: save test case name to result filesChase Qi
Change-Id: If4d6e28a05e886e6036916b36749b231cd916c34 Signed-off-by: Chase Qi <chase.qi@linaro.org> Signed-off-by: Milosz Wasilewski <milosz.wasilewski@linaro.org>
2016-11-30automated: linux: docker: fix package installation on CentOSChase Qi
On CentOS/Fedora, the package name is 'docker'. Change-Id: I1d2cfc8bd74df8481583a50f8d1b1804b9267b7b Signed-off-by: Chase Qi <chase.qi@linaro.org>
2016-11-29test-runner: record default parametersMilosz Wasilewski
Default parameters from test definition are now recorded in the result Change-Id: Id8d0fc88c694d158f6406586f5c79dcc3a83c164 Signed-off-by: Milosz Wasilewski <milosz.wasilewski@linaro.org>
2016-11-29Merge "test-runner: added support for test version"Chase Qi
2016-11-29test-runner: added support for test versionMilosz Wasilewski
Change-Id: Idc255ad3e01c5ab95f259221fc901b93c2362862 Signed-off-by: Milosz Wasilewski <milosz.wasilewski@linaro.org>
2016-11-28automated: added Linux libhugetlbfs testNaresh Kamboju
Change-Id: I9e8e75d22a99c79dae92663a384da197625e85d8 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2016-11-28automated: linux: unify mysql password for LAMP and LEMP testsChase Qi
Change-Id: I1a6d2dd4b16d1a7d2fff88af4c7e98d4e06d2636 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2016-11-28automated: linux: lamp: stop nginx to avoid port conflictChase Qi
When nginx is running, apache startup will fail as they use the same port. Change-Id: I36322ed587614b570880e27eadc67d592a683abc Signed-off-by: Chase Qi <chase.qi@linaro.org>
2016-11-26android boottime2: improvement on avoiding bad caseYongqin Liu
there are the cases that service like bootanim or surfaceflinger was started more than once, and this case will make confusion for getting average information, so check this case first, and report error when found such cases Change-Id: I23f158847c371dae56155d53affbf298c43e41a4 Signed-off-by: Yongqin Liu <yongqin.liu@linaro.org>
2016-11-24automated: added Linux Kernel compilation testChase Qi
Change-Id: I5d0b6423b8d6267bfc9c558eb7637335541a5055 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2016-11-23automated: test-runner: added support for 'parameters' in result parserChase Qi
In test plan, we can use 'params' or 'parameters'. In result parser, 'params' is already supported, adding support for 'parameters' now. Change-Id: I999565eafb72ca8cb9c56a8072fbd53e9f8e0fdd Signed-off-by: Chase Qi <chase.qi@linaro.org>
2016-11-23automated: linux: fix disk partitioning testChase Qi
Change-Id: I407b65bc0d1d6e388dbe91725e7d9407d90a8823 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2016-11-23automated: linux: lamp: bug fixesChase Qi
* During the second run, mysql root password cannot be changed as it was already changed in the first run, so throw the error to /dev/null. * Delete the database table created by test case for a clean exit. Change-Id: I383370e5a01bb0457699c5a3db5bd5ea85f0a458 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2016-11-23manual: enterprise: added bigdata hive testNaresh Kamboju
Change-Id: Iff23a3d5ae3c2ea72c2963e6fef21f683fd15cf6 Signed-off-by: Ganesh Raju <ganesh.raju@linaro.org> Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org> Signed-off-by: Milosz Wasilewski <milosz.wasilewski@linaro.org>
2016-11-23manual: enterprise: added bigdata spark sparkpi testMilosz Wasilewski
Change-Id: I662f86e453707937ef9b7f5310ab72f86a186881 Signed-off-by: Milosz Wasilewski <milosz.wasilewski@linaro.org> Signed-off-by: Ganesh Raju <ganesh.raju@linaro.org>
2016-11-23manual: added Linux software RAID testChase Qi
Change-Id: I6250e84a65a0d8023fd6e3b38d4c63c94bd93414 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2016-11-23automated: linux: added iperf testChase Qi
Change-Id: Ibf8bebfe78d60028ed7805f5f62080a194a2e660 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2016-11-22manual: enterprise: added bigdata hadoop terasort testNaresh Kamboju
Change-Id: Ibb739b938cbd5a6cda54ee985959b85e0c41801a Signed-off-by: Ganesh Raju <ganesh.raju@linaro.org> Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2016-11-22validate.py: Fixed condition for checking metadataMilosz Wasilewski
When the YAML file is invalid there is no point in checking metadata. The condition was updated and metadata is only checked on valid YAML files. Change-Id: I12c110f0353b03f46bc7e4b0c943caca8463a6b7 Signed-off-by: Milosz Wasilewski <milosz.wasilewski@linaro.org>
2016-11-22android boottime2: suppport to collect data from multiple bootYongqin Liu
since the the boottime optimization work is very hard, and boottime reduced will not be obvious compare to the 20s around value, so use average from multiple time is important for the boottime optimization check Change-Id: I9786dbdf5be3109eedf57a0ce0731184f5ab7826 Signed-off-by: Yongqin Liu <yongqin.liu@linaro.org>
2016-11-22manual: fix IP forward test case nameChase Qi
Only the first string will be used if the strings in test case name not quoted or connected. Change-Id: Ic25bae4a978812f7c1a01f923e2e0a50d253c0ba Signed-off-by: Chase Qi <chase.qi@linaro.org>
2016-11-22automated: Linux network basic: improvementsNaresh Kamboju
Network basic tests improved, - Install net-tools package - Get default gateway at run time - Removed variables from test_case_id - Rename 'test' to 'test_case' Change-Id: I27347cf2bd0627dbb7708742c507f27b78787ffe Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2016-11-18Merge "automated: test-runner: added option to record manual results"Chase Qi
2016-11-18automated: test-runner: added option to record manual resultsMilosz Wasilewski
Manual test cases can now be executed using test runner. The results are recorded the same way as for automated tests. Change-Id: Ifacbc7591f81bc4468c4dbe6550be0ba1ec3fd61 Signed-off-by: Milosz Wasilewski <milosz.wasilewski@linaro.org>
2016-11-18automated: linux: Adding pointer-tagging-testsNaresh Kamboju
Change-Id: I86a865f301727281dbff81924e349daff86eb7ce Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2016-11-18lib: Adding new function exit_on_skipNaresh Kamboju
exit_on_skip "testcase-name" "reason for skip" Change-Id: I361f8282c1201362cd89afb4961012d02c8b2bbe Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org> Signed-off-by: Milosz Wasilewski <milosz.wasilewski@linaro.org>
2016-11-18automated: Linux dd: improvements and bug fixesChase Qi
* enable sh argument '-e' * stop using partition and filesystem type variables in test case ID * use convert_to_mb for result calculation which support floating point * cope with shellcheck Change-Id: I8f87c296280299d103eeb6f686b3fd8fecd62eb6 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2016-11-18lib: sh-test-lib: remove non POSIX 'local' keywordNaresh Kamboju
To cope with shellcheck - Non-POSIX keyword 'local' removed - variable name and keyword 'test' renamed to 'test_case' Change-Id: Idb1b4064bb82ec219c9b4fed39fd6d07d5cc9249 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2016-11-16manual: Add PXE boot testNaresh Kamboju
Change-Id: Ib27dd18ad01cd52149564967443def57320c2575 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org> Signed-off-by: Milosz Wasilewski <milosz.wasilewski@linaro.org>
2016-11-16httperf-runner.py: a script to test http performanceJosep Puigdemont
This script will try to find the "best" replies/s rate for a target http server. It uses httperf and a trial-and-error method to find the best rate. Change-Id: I5f76d04ae5db710869038b700d8d9e99efad5d5f Signed-off-by: Josep Puigdemont <josep.puigdemont@linaro.org>
2016-11-16Merge "automated: added Linux dsdbench test"Milosz Wasilewski
2016-11-16automated: added Linux dsdbench testChase Qi
dsdbench runs benchmarks and tests for storage driver configurations to help figure out how the configuration will perform and which known issues the daemon may be affected by in this configuration. Test suite source https://github.com/dmcgowan/dsdbench Change-Id: I68a46cb6354fbcaa880b81bb564e761f61309b6d Signed-off-by: Chase Qi <chase.qi@linaro.org>
2016-11-16automated: added Linux ethernet testNaresh Kamboju
Ethernet test to validate given network interface, * check interface state is up * ping to default Gateway Change-Id: I55bd54367e98aba150c01cd957fb8ca90c3a0d10 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>