Age | Commit message (Collapse) | Author |
|
|
|
Change-Id: I52acc71b65f6bbb635f498c9b8453a5676afe9b8
Signed-off-by: Milosz Wasilewski <milosz.wasilewski@linaro.org>
|
|
Change-Id: I5ab1e600776e83a56167e22b35b0e0520f85214a
Signed-off-by: Fathi Boudra <fathi.boudra@linaro.org>
|
|
Let's standardadize all test cases to use lowercase distro ID field from
/etc/os-release, instead of the 'pretty' (capitalized) name that we used so far.
This is an invasive change, all test scripts were modified with this command:
$ sed -i -e 's|Debian\(.*\))|debian\1)|g' \
-e 's|Ubuntu\(.*\))|ubuntu\1)|g' \
-e 's|CentOS\(.*\))|centos\1)|g' \
-e 's|Fedora\(.*\))|fedora\1)|g' \
-e 's|Unknown\(.*\))|unknown\1)|g'
And the remaining instances were fixed manually.
dist_name() function was updated to always report lowercase distro name. Also
when /etc/os-release is not available and that we use lsb_release output, we
convert the old capitalized name into the new lowercase ones.
Change-Id: I1f1ce0932ab04476567f0338e902656470267a74
Signed-off-by: Nicolas Dechesne <nicolas.dechesne@linaro.org>
|
|
/etc/os-release is a standard file in most distro now, [1] and [2].
Let's use it as the default mechanism to detect the distro at run time, and keep
the old mechanisms as fallback.
Also
* defines 'oe-based' name for any known OE based releases, so that we can
adapt test cases accordingly.
* convert the ID name found in /etc/os-release into the one we used to have in
lsb_release (e.g. Ubuntu vs ubuntu, ... ).
[1] https://www.freedesktop.org/software/systemd/man/os-release.html
[2] http://0pointer.de/blog/projects/os-release.html
Change-Id: I1c9e11b449f8532450c8343bc29eb0aeec58c229
Signed-off-by: Nicolas Dechesne <nicolas.dechesne@linaro.org>
|
|
Change-Id: I1db92f144f8b6ae3b3453278365416af0bcd8a89
Signed-off-by: Nicolas Dechesne <nicolas.dechesne@linaro.org>
|
|
If /etc/lsb-release file exists , then it will be sourced in dist_name() so any
variable defined in this file will override/pollute our existing
environment. Since dist_name() is called in the context of the test script, we
might end up polluting our test environment with unneeded variable, or even
worse we might override variables that we have set in our test scripts...
Instead of sourcing the file in the current env, let's do it in a subshell.
Change-Id: I99ff9b7bb498f47f01adfe0d21f9b1cce0ebf2cc
Signed-off-by: Nicolas Dechesne <nicolas.dechesne@linaro.org>
|
|
LTP realtime tests is an open-source testsuite for testing real-time Linux.
The testsuite contains some functional tests and a few performance and
latency measurement tests.
Change-Id: I0488cdb639b5bc349b7b25f85d43339417eafeb8
Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
|
|
Change-Id: I03da01b64b5cded668c86feab952e9d5731d30da
Signed-off-by: Chase Qi <chase.qi@linaro.org>
|
|
Avoid hardcoding '/root', and use $HOME instead. A nice side effect is that it
allows to use test-runner on the PC as standard user for local debug..
Change-Id: I2003565f9a9aa432dcf5e02cc49f7e87fe8ed946
Signed-off-by: Nicolas Dechesne <nicolas.dechesne@linaro.org>
|
|
|
|
when trying the current test plan , it failed with:
Traceback (most recent call last):
File "/work/linaro/test-definitions/automated/bin/test-runner", line 592, in <module>
main()
File "/work/linaro/test-definitions/automated/bin/test-runner", line 559, in main
test_list = test_plan.test_list(args.kind)
File "/work/linaro/test-definitions/automated/bin/test-runner", line 59, in test_list
if 'tests' in requirement.keys():
AttributeError: 'str' object has no attribute 'keys'
The YAML file is not properly written, so fix it.
Change-Id: I7b3173f775f5a0bc479c2ecfa8943ef87da8c06a
Signed-off-by: Nicolas Dechesne <nicolas.dechesne@linaro.org>
|
|
Change-Id: I4caa10b60609da218f4c825c4f166c9dbc8497d4
Signed-off-by: Chase Qi <chase.qi@linaro.org>
|
|
error_msg exit with non-zero, it will kill the 'run.sh' generated by
lava-dispatcher or local test-runner as the file has '-e' enabled.
To print a warning message for step skipping, use warn_msg instead
of error_msg.
Change-Id: I20f32de217761fab8261cfa625841737cca48288
Signed-off-by: Chase Qi <chase.qi@linaro.org>
|
|
MMC is the "multi-media card" bus protocol.
The MultiMediaCard (MMC) is a memory card standard used for solid-state storage.
MMC test will check kernel configuration and list connected mmc and emmc devices.
CONFIG_MMC=y
CONFIG_MMC_SDHCI=y
Change-Id: I40150d11233f23b4cf615a43bb25186e982dd680
Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
|
|
It is possible to report measurements with no specific units, however the helper
functions currently require the unit to be specified. This patch allows test
case to provide only the measurement in add_metric() , effectively making the
last arg (unit) optional.
When processing the output , we then need to ensure whether or not the unit was
specified in the first place.
I needed this when porting sysbench test case onto 'automated' method
(e.g. sysbench reports 'count of events'). With this change I can get the
following test results from sysbench:
<TEST_CASE_ID=total-time-2-threads RESULT=pass UNITS=s MEASUREMENT=4.0010>
<TEST_CASE_ID=total-number-of-events-2-threads RESULT=pass UNITS= MEASUREMENT=8827>
<TEST_CASE_ID=total-time-taken-by-event-execution-2-threads RESULT=pass UNITS= MEASUREMENT=7.9996>
<TEST_CASE_ID=min-2-threads RESULT=pass UNITS=ms MEASUREMENT=0.90>
<TEST_CASE_ID=avg-2-threads RESULT=pass UNITS=ms MEASUREMENT=0.91>
<TEST_CASE_ID=max-2-threads RESULT=pass UNITS=ms MEASUREMENT=3.38>
<TEST_CASE_ID=approx.-95-percentile-2-threads RESULT=pass UNITS=ms MEASUREMENT=0.93>
<ENDRUN sysbench 9ce36643-e7e9-481e-a45a-464cd07d8cd9>
2017-01-19 15:45:57,557 - RUNNER.ResultParser: INFO: Result files saved to: /home/ndec/output/sysbench_9ce36643-e7e9-481e-a45a-464cd07d8cd9
--- Printing result.csv ---
name,test_case_id,result,measurement,units,test_params
sysbench,total-time-2-threads,pass,4.0010,s,DURATION=4;MAX_REQUESTS=50000;SKIP_INSTALL=False;TEST=cpu;FILE_TEST_MODE=seqrewr;TIMES=1
sysbench,total-number-of-events-2-threads,pass,8827,,DURATION=4;MAX_REQUESTS=50000;SKIP_INSTALL=False;TEST=cpu;FILE_TEST_MODE=seqrewr;TIMES=1
sysbench,total-time-taken-by-event-execution-2-threads,pass,7.9996,,DURATION=4;MAX_REQUESTS=50000;SKIP_INSTALL=False;TEST=cpu;FILE_TEST_MODE=seqrewr;TIMES=1
sysbench,min-2-threads,pass,0.90,ms,DURATION=4;MAX_REQUESTS=50000;SKIP_INSTALL=False;TEST=cpu;FILE_TEST_MODE=seqrewr;TIMES=1
sysbench,avg-2-threads,pass,0.91,ms,DURATION=4;MAX_REQUESTS=50000;SKIP_INSTALL=False;TEST=cpu;FILE_TEST_MODE=seqrewr;TIMES=1
sysbench,max-2-threads,pass,3.38,ms,DURATION=4;MAX_REQUESTS=50000;SKIP_INSTALL=False;TEST=cpu;FILE_TEST_MODE=seqrewr;TIMES=1
sysbench,approx.-95-percentile-2-threads,pass,0.93,ms,DURATION=4;MAX_REQUESTS=50000;SKIP_INSTALL=False;TEST=cpu;FILE_TEST_MODE=seqrewr;TIMES=1
Change-Id: Id41207c3237f597bc3db83a5d7d54ee35f6974e3
Signed-off-by: Nicolas Dechesne <nicolas.dechesne@linaro.org>
|
|
Change-Id: Ie5416e687b8f8b6fad95b24fec5abfe94d4d0424
Signed-off-by: Fathi Boudra <fathi.boudra@linaro.org>
Signed-off-by: Milosz Wasilewski <milosz.wasilewski@linaro.org>
|
|
LTP test definitions improved to support non package manager distributions.
pipe0_status () function being used for runltp and get return status.
Stop adding total number of test cases in LAVA results summary.
Fixed shellcheck issues.
Change-Id: I8eaeaddbb7ad113604144ee563868f6e256515fb
Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
|
|
Change-Id: I47c8b55f9ae6f1ab21ba5f7c46532d8784be12ee
Signed-off-by: Chase Qi <chase.qi@linaro.org>
|
|
Change-Id: Ie6d3a7e0a7095d1602bc9648ed4fac9e4a539bdb
Signed-off-by: Chase Qi <chase.qi@linaro.org>
|
|
Change-Id: Ia09a192f011124902b76523bed81acbdfb250e6c
Signed-off-by: Chase Qi <chase.qi@linaro.org>
|
|
Change-Id: Ifa9e27e06396d61e4e32b26755129364f09a7c8d
Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
|
|
Change-Id: I2a81ff35db40935fe57d25bc35685cf6b54c1fe6
Signed-off-by: Chase Qi <chase.qi@linaro.org>
|
|
LAVA uses '-e' in run.sh. I though we should try to save as many results
as possible by always exiting with zero so that the following
'send-to-lava.sh' step will be executed even when test script exit with
non-zero.
However, in this way, LAVA will record test run as pass even something
went wrong and there is no result at all.
Always exit with non-zero when error occurs should be the right
approach, at least for error_msg() function. In the abnormally exiting
cases, we will need to investigate test log in any way.
Change-Id: Iaaa5d141878734dea3cd9860dd6779e5d09e10b1
Signed-off-by: Chase Qi <chase.qi@linaro.org>
|
|
Change-Id: I5d887f97943b92ab84baa315b745bbaf63eee2b3
Signed-off-by: Chase Qi <chase.qi@linaro.org>
|
|
Verify that an application is isolated and that the kernel configuraion
is sane for the applcation to be run without interference from user/kernel
space tasks.
Change-Id: Ie1c267b6d50026a080f6a0d6d25d518f2ad6f4ab
Signed-off-by: Ravineet Singh <ravineet.singh@linaro.org>
|
|
Change-Id: I182c3ec136ab83407367a20a358ad15070c76b98
Signed-off-by: Chase Qi <chase.qi@linaro.org>
|
|
|
|
Change-Id: I91da729db10c08827f285f65bc525948747797b6
Signed-off-by: Chase Qi <chase.qi@linaro.org>
|
|
Change-Id: Id05395fb8d323dff07c23c0de5d13dac7c79a5f6
Signed-off-by: Chase Qi <chase.qi@linaro.org>
|
|
The nginx-server.sh script implements the same protocol as the
httperf-client.sh script, namely:
client server
| |
|<----------- num_cores ---------| # server indicates num cores
|---------- client_ready ------->| # server is configured for 1 core
|<-- server_num_cores_1_ready ---| # client runs tests for 1 core
|--- client_num_cores_1_done --->| # client is finished testing
| | # server reconfigures for 2 cores
|<-- server_num_cores_2_ready ---| # client runs tests for 2 cores
|--- client_num_cores_2_done --->| # client is finished testing
| | # repeated until num_cores in
| | # increments of 2 (1, 2, 4, 6...)
...
Currently it supports testing NGiNX on plain linux IP stack, and a
special version of NGiNX compiled for OFP and ODP-DPDK, however the
latter is not too portable at the moment and will require further work.
Whether one or the other is tested is configured by the CONFIG_TYPE
environment variable in the test definition: linux-ip or odp-dpdk,
respectively.
Also the maximum amount of cores for which to test can be limited by
setting the MAX_CORES environment variable (0 meaning all cores).
This relies completely on VLAND and lava-{send,wait} for
synchronization.
Change-Id: I775083f7183895039064141b51172a3280249848
Signed-off-by: Josep Puigdemont <josep.puigdemont@linaro.org>
Signed-off-by: Milosz Wasilewski <milosz.wasilewski@linaro.org>
|
|
Script and YAML file to setup the host to run httperf against an http
server. The tests measure the performance of the server depending on the
number of cores.
This script is meant to run in a multi-node configuration, where it will
coordinate with a server side of the test in order to determine when the
tests can start, and when they are done.
Change-Id: I3af563086a8fba64f1b0f32c0878761997d21158
Signed-off-by: Josep Puigdemont <josep.puigdemont@linaro.org>
|
|
Change-Id: If0ac3a702528d97f536513e35a1f65be43f15a27
Signed-off-by: Josep Puigdemont <josep.puigdemont@linaro.org>
|
|
|
|
report error when there is boot timeout problem in logcat
Change-Id: Ic5edecfa75f2bf04b921b82dcc0cdcaec8d23094
Signed-off-by: Yongqin Liu <yongqin.liu@linaro.org>
|
|
Because of this bug https://bugs.linaro.org/show_bug.cgi?id=2694, the
error message destroys the structure of logfile, and causes parser not
working.
Change-Id: I76b7b0b71f5427da53e1778e0abc69ac2f180c17
Signed-off-by: Chase Qi <chase.qi@linaro.org>
|
|
We don't need to run the tests since it's run as part of the package
itself.
Change-Id: Iddd7a1f2bcfcc1c2e72a6a51aba66acc6f78d78a
Signed-off-by: Fathi Boudra <fathi.boudra@linaro.org>
|
|
Change-Id: If3066f32d52e6c6e253832faa3911629ccaa54c7
Signed-off-by: Milosz Wasilewski <milosz.wasilewski@linaro.org>
|
|
Change-Id: I59f130777f01f038899041d2647de7ba0d3d004b
Signed-off-by: Milosz Wasilewski <milosz.wasilewski@linaro.org>
|
|
Change-Id: I69a7408000304e7887a05a13c6cfaa02a23591b1
Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
|
|
Change-Id: I95f6d37975567cf899ab48846e7e025fc01b7823
Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
|
|
Test plan names were colliding. Changed the names to be different.
Change-Id: I78951c635f8ffce8fbf5bf6cb80c322e3cd36915
Signed-off-by: Milosz Wasilewski <milosz.wasilewski@linaro.org>
|
|
Change-Id: Ie3b4dbc0e09078da9e9de6805e3bf5511a606c3c
Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
|
|
Change-Id: I78080931b6406fcd193eab24b16c4424e8b15778
Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
|
|
|
|
Change-Id: I5ea518268065d3bb4161e0c7b97f97407e390558
Signed-off-by: Chase Qi <chase.qi@linaro.org>
|
|
Test names can contain '=' now. The parsing is based on regex rather
than simple line split with '=' as delimiter. This adresses libhugetlbfs
test parsing problem.
Change-Id: I1b6e03960456abf437a2720f6e5177556c766f5a
Signed-off-by: Milosz Wasilewski <milosz.wasilewski@linaro.org>
|
|
Config file for distro kernel is located in /boot rather than in /proc.
This patch adds support for both options
Change-Id: Ie516fba4e3e37d58508f013e9287964cf5a362e3
Signed-off-by: Milosz Wasilewski <milosz.wasilewski@linaro.org>
|
|
add condition for bootchart.tgz attaching that only attach
bootchart for stop operation
since there is no bootchart.tgz during the start operation
Change-Id: I090fc02d28564a7bf190c8b6e6e548ec4eaeba97
Signed-off-by: Yongqin Liu <yongqin.liu@linaro.org>
|
|
Reference Platform EE test plan is based on not yet approved
requirements. This version will be used for testing 16.12 release
Change-Id: I5160aeeabacda0bfea0b7fbfdfe8b0b8b13f743b
Signed-off-by: Milosz Wasilewski <milosz.wasilewski@linaro.org>
|