Age | Commit message (Collapse) | Author |
|
Change-Id: I67b1d174fd1a679fd90dee85710c10a8975e2ea0
Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
|
|
Change-Id: I757fa6baf40d8bab674d1d931c17e9c8fab63fa3
Signed-off-by: Chase Qi <chase.qi@linaro.org>
|
|
On multi core platforms, running 'sysbench --test=cpu' is not deterministic,
since we cannot guarantee on which CPU the test is being run. It is even more
problematic on big little platforms.
In order for sysbench to be useful, we need to run sysbench 'cpu' benchmarks in
the following conditions:
1. with --num-thread=<number of cpu>
2. with --num-thread=1 , for each cpu , using task affinity
So that we can benchmark the platform as a whole, and each CPU individually.
This patch adds a specific 'percpu' mode that takes care of #2 above. For #1, I
would be in favor of removing NUMBER_THREADS as a params, or at least set it to
<number of CPU> by default, but this is not done in this patch.
A tweak in general_parser() was needed to add the cpu ID to the test name, running
the test with 'percpu cpu' as PARAMS gives the following output:
sysbench,percpu0-total-time,pass,9.2697,s,NUM_THREADS=1;TESTS=percpu cpu;SKIP_INSTALL=false
sysbench,percpu0-total-number-of-events,pass,10000,times,NUM_THREADS=1;TESTS=percpu cpu;SKIP_INSTALL=false
sysbench,percpu0-total-time-taken-by-event-execution,pass,9.2674,s,NUM_THREADS=1;TESTS=percpu cpu;SKIP_INSTALL=false
sysbench,percpu0-response-time-min,pass,0.84,ms,NUM_THREADS=1;TESTS=percpu cpu;SKIP_INSTALL=false
sysbench,percpu0-response-time-avg,pass,0.93,ms,NUM_THREADS=1;TESTS=percpu cpu;SKIP_INSTALL=false
sysbench,percpu0-response-time-max,pass,6.10,ms,NUM_THREADS=1;TESTS=percpu cpu;SKIP_INSTALL=false
sysbench,percpu0-response-time-approx,pass,1.12,ms,NUM_THREADS=1;TESTS=percpu cpu;SKIP_INSTALL=false
sysbench,percpu0-events-avg/stddev,pass,10000.0000/0.00,times,NUM_THREADS=1;TESTS=percpu cpu;SKIP_INSTALL=false
sysbench,percpu0-execution-time-avg/stddev,pass,9.2674/0.00,s,NUM_THREADS=1;TESTS=percpu cpu;SKIP_INSTALL=false
sysbench,percpu1-total-time,pass,9.9461,s,NUM_THREADS=1;TESTS=percpu cpu;SKIP_INSTALL=false
sysbench,percpu1-total-number-of-events,pass,10000,times,NUM_THREADS=1;TESTS=percpu cpu;SKIP_INSTALL=false
sysbench,percpu1-total-time-taken-by-event-execution,pass,9.9425,s,NUM_THREADS=1;TESTS=percpu cpu;SKIP_INSTALL=false
sysbench,percpu1-response-time-min,pass,0.84,ms,NUM_THREADS=1;TESTS=percpu cpu;SKIP_INSTALL=false
sysbench,percpu1-response-time-avg,pass,0.99,ms,NUM_THREADS=1;TESTS=percpu cpu;SKIP_INSTALL=false
sysbench,percpu1-response-time-max,pass,4.46,ms,NUM_THREADS=1;TESTS=percpu cpu;SKIP_INSTALL=false
sysbench,percpu1-response-time-approx,pass,1.23,ms,NUM_THREADS=1;TESTS=percpu cpu;SKIP_INSTALL=false
sysbench,percpu1-events-avg/stddev,pass,10000.0000/0.00,times,NUM_THREADS=1;TESTS=percpu cpu;SKIP_INSTALL=false
sysbench,percpu1-execution-time-avg/stddev,pass,9.9425/0.00,s,NUM_THREADS=1;TESTS=percpu cpu;SKIP_INSTALL=false
sysbench,percpu2-total-time,pass,9.4700,s,NUM_THREADS=1;TESTS=percpu cpu;SKIP_INSTALL=false
sysbench,percpu2-total-number-of-events,pass,10000,times,NUM_THREADS=1;TESTS=percpu cpu;SKIP_INSTALL=false
sysbench,percpu2-total-time-taken-by-event-execution,pass,9.4663,s,NUM_THREADS=1;TESTS=percpu cpu;SKIP_INSTALL=false
sysbench,percpu2-response-time-min,pass,0.84,ms,NUM_THREADS=1;TESTS=percpu cpu;SKIP_INSTALL=false
sysbench,percpu2-response-time-avg,pass,0.95,ms,NUM_THREADS=1;TESTS=percpu cpu;SKIP_INSTALL=false
sysbench,percpu2-response-time-max,pass,1.78,ms,NUM_THREADS=1;TESTS=percpu cpu;SKIP_INSTALL=false
sysbench,percpu2-response-time-approx,pass,1.12,ms,NUM_THREADS=1;TESTS=percpu cpu;SKIP_INSTALL=false
sysbench,percpu2-events-avg/stddev,pass,10000.0000/0.00,times,NUM_THREADS=1;TESTS=percpu cpu;SKIP_INSTALL=false
sysbench,percpu2-execution-time-avg/stddev,pass,9.4663/0.00,s,NUM_THREADS=1;TESTS=percpu cpu;SKIP_INSTALL=false
sysbench,percpu3-total-time,pass,9.4429,s,NUM_THREADS=1;TESTS=percpu cpu;SKIP_INSTALL=false
sysbench,percpu3-total-number-of-events,pass,10000,times,NUM_THREADS=1;TESTS=percpu cpu;SKIP_INSTALL=false
sysbench,percpu3-total-time-taken-by-event-execution,pass,9.4406,s,NUM_THREADS=1;TESTS=percpu cpu;SKIP_INSTALL=false
sysbench,percpu3-response-time-min,pass,0.84,ms,NUM_THREADS=1;TESTS=percpu cpu;SKIP_INSTALL=false
sysbench,percpu3-response-time-avg,pass,0.94,ms,NUM_THREADS=1;TESTS=percpu cpu;SKIP_INSTALL=false
sysbench,percpu3-response-time-max,pass,3.67,ms,NUM_THREADS=1;TESTS=percpu cpu;SKIP_INSTALL=false
sysbench,percpu3-response-time-approx,pass,1.09,ms,NUM_THREADS=1;TESTS=percpu cpu;SKIP_INSTALL=false
sysbench,percpu3-events-avg/stddev,pass,10000.0000/0.00,times,NUM_THREADS=1;TESTS=percpu cpu;SKIP_INSTALL=false
sysbench,percpu3-execution-time-avg/stddev,pass,9.4406/0.00,s,NUM_THREADS=1;TESTS=percpu cpu;SKIP_INSTALL=false
sysbench,cpu-total-time,pass,9.8187,s,NUM_THREADS=1;TESTS=percpu cpu;SKIP_INSTALL=false
sysbench,cpu-total-number-of-events,pass,10000,times,NUM_THREADS=1;TESTS=percpu cpu;SKIP_INSTALL=false
sysbench,cpu-total-time-taken-by-event-execution,pass,9.8148,s,NUM_THREADS=1;TESTS=percpu cpu;SKIP_INSTALL=false
sysbench,cpu-response-time-min,pass,0.84,ms,NUM_THREADS=1;TESTS=percpu cpu;SKIP_INSTALL=false
sysbench,cpu-response-time-avg,pass,0.98,ms,NUM_THREADS=1;TESTS=percpu cpu;SKIP_INSTALL=false
sysbench,cpu-response-time-max,pass,8.63,ms,NUM_THREADS=1;TESTS=percpu cpu;SKIP_INSTALL=false
sysbench,cpu-response-time-approx,pass,1.16,ms,NUM_THREADS=1;TESTS=percpu cpu;SKIP_INSTALL=false
sysbench,cpu-events-avg/stddev,pass,10000.0000/0.00,times,NUM_THREADS=1;TESTS=percpu cpu;SKIP_INSTALL=false
sysbench,cpu-execution-time-avg/stddev,pass,9.8148/0.00,s,NUM_THREADS=1;TESTS=percpu cpu;SKIP_INSTALL=false
Change-Id: I25b10f0b5f1f5083e82b813b10e9ddd0ae184033
Signed-off-by: Nicolas Dechesne <nicolas.dechesne@linaro.org>
|
|
Unless speficically requested, download aarch64 copy
when running on aarch64.
Change-Id: I816b27ee9d4e501c3c37964d6ce1b64a5a719772
Signed-off-by: Riku Voipio <riku.voipio@linaro.org>
|
|
- move to automated dir
- start qemu with pidfile
- call shutdown with 1m timeout in guest for clean poweroff
- wait for qemu process recorded in pidfile to exit to
avoid primary lava connection to poweroff the machine before
guest has finished
Change-Id: I105ec3bbe3246a05552b3d13123ef4a3c7ea4c82
Signed-off-by: Riku Voipio <riku.voipio@linaro.org>
|
|
Change-Id: I636b0c0f5aeee5cbb600a1ece81328cddb0ba5a9
Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
|
|
LAVA v2 is able to parse results as they come. This way timeouts and
crashes don't prevent all results to be registered in LAVA.
Change-Id: I75e1b9af8a5159844ae20ab97e3e1f5e89e3473d
Signed-off-by: Milosz Wasilewski <milosz.wasilewski@linaro.org>
|
|
Change-Id: Idc1506e2025e26a6c6f361f78037a55c0672c974
Signed-off-by: Chase Qi <chase.qi@linaro.org>
|
|
Change-Id: I1386f165df1c446f94b22be4253b919cd8540e0b
Signed-off-by: Chase Qi <chase.qi@linaro.org>
|
|
Other tests from rt-tests already have this tag. With this patch, we
will be able to filter them easily.
Change-Id: Ic1e62ffe4680a09da73f5e62d136e82a79b5d37e
Signed-off-by: Chase Qi <chase.qi@linaro.org>
|
|
Change-Id: I591c4c3e7a6c1850d6160654418092f1cd96286a
Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
|
|
Change-Id: I8d262f9e9ba0d29b902c15f6dad3e75df3b0d75c
Signed-off-by: Josep Puigdemont <josep.puigdemont@linaro.org>
|
|
NGiNX can be installed in different places, and can be implemented using
different IP stacks (Linux IP stack, OFP, ANS...).
The nginx-server.sh script was meant to be used independently of he
NGiNX version in use. Due to this it contains several initialization and
configuration functions for each of the currently supported
implementations. This could grow a bit too large for one single file, so
we've opted for creating files with a set of required functions for each
implementation. The file is sourced and it should define some functions
used for the tests. The name of the file should be that of the
CONFIG_TYPE defined for the test definition, plus the .sh suffix.
The functions required to be implemented in the files are:
- do_configure_system(): used to initialize the tests. Here any
configuration required for the test, like NIC configuration,
kernel module loading, etc, should be done. It is called once
before any test starts.
- do_start_nginx(): this function is used to start NGiNX.
- do_stop_nginx(): this function is used to stop NGiNX. It may be
called even if NGiNX is not running.
- do_write_nginx_config(): this function is called before starting
NGiNX, and it is meant to write a proper nginx.conf file for the
current number of cores.
- do_pre_test_cb(): this function is called before starting NGiNX,
it can be used for anything deemed appropriate.
- do_post_test_cb(): this function is called right after the test
has finished, and before NGiNX is stopped. It can be used for
anything deemed appropriate.
All functions are called with the following parameters in this order:
- cores: number of cores of the current test. For
configure_sytem, this is the total number of physical cores
available.
- interface: this is the interface that NGiNX is expected to use.
- IP: the IP that the web server is expected to use.
The return value of the functions is not checked.
Change-Id: I0321697509f9ac628e705c69285a7478dd993ace
Signed-off-by: Josep Puigdemont <josep.puigdemont@linaro.org>
|
|
Change-Id: Idcd83a16e0f2f938f31eb312eccaa344b634512c
Signed-off-by: Chase Qi <chase.qi@linaro.org>
|
|
Change-Id: Ic23d1690d871b8cf292f1b3c22d49b19326c3f00
Signed-off-by: Chase Qi <chase.qi@linaro.org>
|
|
Kselftest test definitions detects pre-built tests on target rootfs.
if not found then, download kselftest and run tests.
Change-Id: Ie88860d79aef7cf7aa526f95f1f4803e30a4b899
Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
|
|
When libhugetlbfs test suite pre-built and pre-installed on images like
Open Embedded, versioning is not required in this case.
Change-Id: I4faf4d8ee8d1af198be92b21c767a05440ed4bcb
Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
|
|
YAML files need not be executable.
Change-Id: Ibddd8f8737edb33082f0c39aed78a8bcfbecab45
Signed-off-by: Daniel Díaz <daniel.diaz@linaro.org>
|
|
We will now use the add_key and add_repo functions provided by
sh-test-lib, also the repository used can be specified as one of the
test parameters.
Installation of release-specific packages has been removed. Any extra
packages from other repositories than the ones under test (currently
jessie-backports) will have to be installed by the calling LAVA job.
This way this test definition will work on newer versions of the
distribution without having to change anything.
See this lava job for an example:
https://lng.validation.linaro.org/scheduler/job/17262/multinode_definition
Change-Id: I6119b451c4921afde861f8b3473cdfdca140d3f5
Signed-off-by: Josep Puigdemont <josep.puigdemont@linaro.org>
|
|
Until now the test installed kernel headers from a hardcoded source. We
should require the job calling his test to install the kernel headers,
whether they come from a hw-pack, a private repo, or somewhere else.
At the same time define configurable parameters for the test.
Change-Id: I28dbaa55d71683c23b4d59b188fcebf5fd302a6e
Signed-off-by: Josep Puigdemont <josep.puigdemont@linaro.org>
|
|
To work around some limitation on the current port of NGiNX to OFP,
a private repo with specially built OFP and NGiNX was used by the test
script. This is not desirable in the long run, so we will resort to
installing the packages provided by LNG at deb.opendataplane.org, and
add the limitation that NGiNX for OFP will only be tested with one
worker for now.
When support for more workers is available, the limitation should be
removed.
Change-Id: I0f2d5f1c4efe9efb53c77270c0bebaeb03c709b6
Signed-off-by: Josep Puigdemont <josep.puigdemont@linaro.org>
|
|
libhugetlbfs test definitions modified to detect pre-built tests
on target. if not found then, download, build and run tests.
Change-Id: If25d54df68f8f2abc1c67ddfa5f1a4a0ed1954fe
Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
|
|
Change-Id: I10181a7d1ebc53491085d80d67f0cd8f9e43071d
Signed-off-by: Daniel Díaz <daniel.diaz@linaro.org>
|
|
Change-Id: If34415c681906aefc6b5b42401ed995e5cdeda11
Signed-off-by: Daniel Díaz <daniel.diaz@linaro.org>
|
|
Change-Id: Iec4efd0a4d4e9dede50505b7284d6221b83a7433
Signed-off-by: Chase Qi <chase.qi@linaro.org>
|
|
Change-Id: Ibc1e125dc56c4a5b6b73da368b668bafc2c9fb97
Signed-off-by: Chase Qi <chase.qi@linaro.org>
|
|
This test case works without root privileges, so let's remove this
check. Running as standard user , with this patch, I am getting:
--- Printing result.csv ---
name,test_case_id,result,measurement,units,test_params
smoke-tests-basic,pwd,pass,,,SKIP_INSTALL=False
smoke-tests-basic,lsb_release,pass,,,SKIP_INSTALL=False
smoke-tests-basic,uname,pass,,,SKIP_INSTALL=False
smoke-tests-basic,ip,pass,,,SKIP_INSTALL=False
smoke-tests-basic,lscpu,pass,,,SKIP_INSTALL=False
smoke-tests-basic,vmstat,pass,,,SKIP_INSTALL=False
smoke-tests-basic,lsblk,pass,,,SKIP_INSTALL=False
Change-Id: I3dfce348eadf9a9a4a4dfa8321af080984cd4447
Signed-off-by: Nicolas Dechesne <nicolas.dechesne@linaro.org>
|
|
Change-Id: I52acc71b65f6bbb635f498c9b8453a5676afe9b8
Signed-off-by: Milosz Wasilewski <milosz.wasilewski@linaro.org>
|
|
Let's standardadize all test cases to use lowercase distro ID field from
/etc/os-release, instead of the 'pretty' (capitalized) name that we used so far.
This is an invasive change, all test scripts were modified with this command:
$ sed -i -e 's|Debian\(.*\))|debian\1)|g' \
-e 's|Ubuntu\(.*\))|ubuntu\1)|g' \
-e 's|CentOS\(.*\))|centos\1)|g' \
-e 's|Fedora\(.*\))|fedora\1)|g' \
-e 's|Unknown\(.*\))|unknown\1)|g'
And the remaining instances were fixed manually.
dist_name() function was updated to always report lowercase distro name. Also
when /etc/os-release is not available and that we use lsb_release output, we
convert the old capitalized name into the new lowercase ones.
Change-Id: I1f1ce0932ab04476567f0338e902656470267a74
Signed-off-by: Nicolas Dechesne <nicolas.dechesne@linaro.org>
|
|
LTP realtime tests is an open-source testsuite for testing real-time Linux.
The testsuite contains some functional tests and a few performance and
latency measurement tests.
Change-Id: I0488cdb639b5bc349b7b25f85d43339417eafeb8
Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
|
|
Change-Id: I03da01b64b5cded668c86feab952e9d5731d30da
Signed-off-by: Chase Qi <chase.qi@linaro.org>
|
|
Change-Id: I4caa10b60609da218f4c825c4f166c9dbc8497d4
Signed-off-by: Chase Qi <chase.qi@linaro.org>
|
|
MMC is the "multi-media card" bus protocol.
The MultiMediaCard (MMC) is a memory card standard used for solid-state storage.
MMC test will check kernel configuration and list connected mmc and emmc devices.
CONFIG_MMC=y
CONFIG_MMC_SDHCI=y
Change-Id: I40150d11233f23b4cf615a43bb25186e982dd680
Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
|
|
Change-Id: Ie5416e687b8f8b6fad95b24fec5abfe94d4d0424
Signed-off-by: Fathi Boudra <fathi.boudra@linaro.org>
Signed-off-by: Milosz Wasilewski <milosz.wasilewski@linaro.org>
|
|
LTP test definitions improved to support non package manager distributions.
pipe0_status () function being used for runltp and get return status.
Stop adding total number of test cases in LAVA results summary.
Fixed shellcheck issues.
Change-Id: I8eaeaddbb7ad113604144ee563868f6e256515fb
Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
|
|
Change-Id: I47c8b55f9ae6f1ab21ba5f7c46532d8784be12ee
Signed-off-by: Chase Qi <chase.qi@linaro.org>
|
|
Change-Id: Ie6d3a7e0a7095d1602bc9648ed4fac9e4a539bdb
Signed-off-by: Chase Qi <chase.qi@linaro.org>
|
|
Change-Id: Ia09a192f011124902b76523bed81acbdfb250e6c
Signed-off-by: Chase Qi <chase.qi@linaro.org>
|
|
Change-Id: Ifa9e27e06396d61e4e32b26755129364f09a7c8d
Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
|
|
Change-Id: I2a81ff35db40935fe57d25bc35685cf6b54c1fe6
Signed-off-by: Chase Qi <chase.qi@linaro.org>
|
|
Change-Id: I5d887f97943b92ab84baa315b745bbaf63eee2b3
Signed-off-by: Chase Qi <chase.qi@linaro.org>
|
|
Verify that an application is isolated and that the kernel configuraion
is sane for the applcation to be run without interference from user/kernel
space tasks.
Change-Id: Ie1c267b6d50026a080f6a0d6d25d518f2ad6f4ab
Signed-off-by: Ravineet Singh <ravineet.singh@linaro.org>
|
|
Change-Id: I182c3ec136ab83407367a20a358ad15070c76b98
Signed-off-by: Chase Qi <chase.qi@linaro.org>
|
|
Change-Id: I91da729db10c08827f285f65bc525948747797b6
Signed-off-by: Chase Qi <chase.qi@linaro.org>
|
|
The nginx-server.sh script implements the same protocol as the
httperf-client.sh script, namely:
client server
| |
|<----------- num_cores ---------| # server indicates num cores
|---------- client_ready ------->| # server is configured for 1 core
|<-- server_num_cores_1_ready ---| # client runs tests for 1 core
|--- client_num_cores_1_done --->| # client is finished testing
| | # server reconfigures for 2 cores
|<-- server_num_cores_2_ready ---| # client runs tests for 2 cores
|--- client_num_cores_2_done --->| # client is finished testing
| | # repeated until num_cores in
| | # increments of 2 (1, 2, 4, 6...)
...
Currently it supports testing NGiNX on plain linux IP stack, and a
special version of NGiNX compiled for OFP and ODP-DPDK, however the
latter is not too portable at the moment and will require further work.
Whether one or the other is tested is configured by the CONFIG_TYPE
environment variable in the test definition: linux-ip or odp-dpdk,
respectively.
Also the maximum amount of cores for which to test can be limited by
setting the MAX_CORES environment variable (0 meaning all cores).
This relies completely on VLAND and lava-{send,wait} for
synchronization.
Change-Id: I775083f7183895039064141b51172a3280249848
Signed-off-by: Josep Puigdemont <josep.puigdemont@linaro.org>
Signed-off-by: Milosz Wasilewski <milosz.wasilewski@linaro.org>
|
|
Script and YAML file to setup the host to run httperf against an http
server. The tests measure the performance of the server depending on the
number of cores.
This script is meant to run in a multi-node configuration, where it will
coordinate with a server side of the test in order to determine when the
tests can start, and when they are done.
Change-Id: I3af563086a8fba64f1b0f32c0878761997d21158
Signed-off-by: Josep Puigdemont <josep.puigdemont@linaro.org>
|
|
Because of this bug https://bugs.linaro.org/show_bug.cgi?id=2694, the
error message destroys the structure of logfile, and causes parser not
working.
Change-Id: I76b7b0b71f5427da53e1778e0abc69ac2f180c17
Signed-off-by: Chase Qi <chase.qi@linaro.org>
|
|
Change-Id: Ie3b4dbc0e09078da9e9de6805e3bf5511a606c3c
Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
|
|
Change-Id: I78080931b6406fcd193eab24b16c4424e8b15778
Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
|
|
Change-Id: I5ea518268065d3bb4161e0c7b97f97407e390558
Signed-off-by: Chase Qi <chase.qi@linaro.org>
|