diff options
| author | Naresh Kamboju <naresh.kamboju@linaro.org> | 2015-02-04 02:28:16 +0530 |
|---|---|---|
| committer | Naresh Kamboju <naresh.kamboju@linaro.org> | 2015-02-04 02:28:16 +0530 |
| commit | de084d24e0212f894cbd3da82c81844d17df1cc5 (patch) | |
| tree | ecd546a45265985e22749165aadf0607aacdb6fb | |
all in one commit
Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
160 files changed, 5979 insertions, 0 deletions
@@ -0,0 +1,180 @@ +Workload Automation v2 in LAVA (WAv2) +************************************* +This directory contains test definitnions and supporting files to run Workload Automation in LAVA. It needs to be noted that some setup in LAVA is required prior to running WAv2 as an automated test. + +Job Construction +================ +Coordination of the workload automation *host* and the Versatile Express TC2 *target* is done through a multi-node job definition (wav2multi.json). The actions in the JSON file are assigned to specific roles (host & target). The roles are then invoked using lava ACTIONs and in these jobs, the roles execute respective lava-test-shell tests defined in YAML (wa2host.yaml) and wa2target.yaml). The two devices coordinate their execution using synchronization API functions within the lava-test-shell tests. In this test there are 3 api calls used. + +* **lava-wait** (waits for data from **lava-send**) +* **lava-sync** (waits for all devices) + +Parameter description for wa2host.yaml, wa2target.yaml and wa2host_postprocessing.yaml + +* wa2host.yaml + + * **AGENDA** - name of the agenda file to run specific workload on TC2. Agenda files are stored in this repository in templates directory. + + * **JOB_NAME** - name that identifies job or set of jobs that aggregate results in a single database + + * **MODE** - mp (HMP mode booting to A7 cluster), iks (In Kernel Switcher), a7only (only A7 cluster online), a15only (only A15 cluster online) + + * **SIGNAL_PREFIX** - identifies the host-target pair of lava-test-shells + +* wa2target.yaml + + * **SIGNAL_PREFIX** - identifies the host-target pair of lava-test-shells + +* wa2host_postprocessing.yaml + + * **JOB_NAME** - name that identifies job or set of jobs that aggregate results in a single database. Postprocessing YAML uses this database + + * **DELETE_DB** - if set to true, database is deleted after postprocessing is done. Default: false + +More information on multi-node can be found in the LAVA documentation: + +* Documentation: https://validation.linaro.org/static/docs/writing-multinode.html +* API: https://validation.linaro.org/static/docs/multinodeapi.html?highlight=multinode + +Data postprocessing +=================== +To simplify the post processing of data from multiple lava actions and possibly multiple lava test runs, the test uses an external sqlite database (hosted on the Xen KVM) and the WAv2 options to store the results until they are ready to be processed (after the entire WAv2 run). Database schema and contents are created by WAv2. Database is located in /root/db_results/ directory. Database name is defined in wa2host.yaml as a parameter JOB_NAME. The parameter has to have the same value for all the jobs running on the same build in order to store the results in the same database. + +Database data postprocessing is done using separate YAML definition - wa2host_postprocessing.yaml. It takes one parameter that defines the name of the database to use. The parameter name is the same as for testing jobs: JOB_NAME + +Overview of LAVA Architecture & Security +======================================== +Due to licensing, WAv2-in-LAVA uses capabilities that restrict access to a specific user or group in LAVA. + +Job submission security +----------------------- +Only authorized users are allowed to submit jobs onto the protected device. For the WAv2 testing, the protected device in LAVA is an SSH connection onto a Xen server in the lab that contains the workload automation secure repository, see diagram below. + +Results security +---------------- +The test jobs we execute in LAVA submit results into private bundle streams with restricted access controls. + +Security block diagram +---------------------- +:: + + wa2multi.json + +---------------------------------------------------------+ + | wa2host.yaml wa2target.yaml | + | +-----------------------+ +----------------------+ | + | |host: dummy-ssh | |target: vexpress-tc2 | | + | | Xen server | |deploy: android (lsk) | | + | | +WAv2 Repository | IP | | | + | | |<-----| | | + | |restricted to NDA list | | | | + | +----|------------------+ +----------------------+ | + +------|--------------------------------------------------+ + v + +---------------------+ + | Xen Server | + | + WAv2 Repository | + +---------------------+ + +Xen Server Configuration +======================== +The Xen server is a Linux server with the licensed WAv2 repository installed. LAVA connects to the Xen server over an SSH connection using a dummy-ssh device-type in LAVA[1]. + +The Xen server is a *persistent* device under control in LAVA, which means that data is persistent over multiple test runs and that only 1 LAVA test can run at a time to prevent accidental access collisions. In an environment that has multiple WAv2 setups, you would need to scale up your WAv2 *host* architecture. + +Filesystem & software Requirements: + +* /root/templates - contents + + WAv2-in-LAVA uses adb over ethernet. WAv2 supports adb over ethernet since version 2.1.4. In order to point WAv2 to correct device config.py file needs to have correct contents. Since config.py is a part of WAv2 and is restricted by the license, it is not available as a part of this git repository. config.py template has to be located in /root/templates/ directory. The template has to have entry for adb_name as $ipaddr. The template is copied to the job directory when LAVA job is started on host and $ipaddr is replaced with correct value of targer IP address. + +Install WAv2 on dummy-ssh +========================= +Get Workload Automation sources from below link. (check for access permission to below repo before you clone):: + + git clone ssh://user-name@linaro-private.git.linaro.org/srv/landing-teams.git.linaro.org/arm-wa2/wa2 + +this clone downloads a file called "wlauto-2.1.4dev-external.sh":: + + $ sudo sh wlauto-2.1.4dev-external.sh + +Accept agreement and follow the instruction from RELEASE_README:: + + $ pip install wlauto-2.1.4dev.tar.gz + +Quick-view: +----------- +- Install SDK build-tools under /usr/ + + Android expects aapt to be installed under /usr/build-tools/<Android-version>/aapt + +- Install latest adb + + Workload Automation connects target device via adb over ethernet. So latest adb is required. + +Install pre-requirements +------------------------ + +- apt-get install python-pip + +- apt-get install python-dev + +- apt-get install python-pexpect (possibly don't need this) + +- apt-get install python-serial + +- apt-get install python-imaging + +- apt-get install libc6:i386 + +- apt-get install zlib1g:i386 + +- apt-get install libstdc++6:i386 + +- Install bbench, Audio and third-party benchmarks + + Workload automation expects packages to be available on dummy-ssh server. please refer "APK Files" section + +:: + + $ ls .workload_automation/dependencies/bbench/ + bbench.js exit.html forms.js index.html index_noinput.html mich_engin.png results.html sites + + $ ls .workload_automation/dependencies/Canon_in_D_Piano.mp3 + .workload_automation/dependencies/Canon_in_D_Piano.mp3 + + $ find /usr/local/lib/python2.7/dist-packages/wlauto/workloads/* | grep apk + /usr/local/lib/python2.7/dist-packages/wlauto/workloads/andebench/andebench-release.apk + /usr/local/lib/python2.7/dist-packages/wlauto/workloads/antutu/antutu_benchmark_4.0.3.apk + /usr/local/lib/python2.7/dist-packages/wlauto/workloads/benchmarkpi/gr.androiddev.BenchmarkPi-1.apk + /usr/local/lib/python2.7/dist-packages/wlauto/workloads/caffeinemark/com.flexycore.caffeinemark_9.apk + /usr/local/lib/python2.7/dist-packages/wlauto/workloads/cfbench/eu.chainfire.cfbench.apk + /usr/local/lib/python2.7/dist-packages/wlauto/workloads/geekbench/com.primatelabs.geekbench3.apk + /usr/local/lib/python2.7/dist-packages/wlauto/workloads/linpack/com.greenecomputing.linpackpro-1.apk + /usr/local/lib/python2.7/dist-packages/wlauto/workloads/quadrant/com.aurorasoftworks.quadrant.ui.professional-1.apk + /usr/local/lib/python2.7/dist-packages/wlauto/workloads/smartbench/com.smartbench.twelve-1.apk + /usr/local/lib/python2.7/dist-packages/wlauto/workloads/sqlite/com.redlicense.benchmark.sqlite-1.apk + /usr/local/lib/python2.7/dist-packages/wlauto/workloads/vellamo/com.quicinc.vellamo.apk + +Run WAv2 on dummy-ssh +===================== +Running workload automation will be taken care by run-workload.sh files + +**Note:** config.py is having reboot policy as never. Because rebooting of target will be taken care by LAVA. + +**Note:** Default config.py is available under ~/.workload_automation/config.py + +Debug mode:: + + $ run_workloads some-agenda-file.yaml -v -d output_dir -c config.py + +Please refer example agenda:: + + /usr/local/lib/python2.7/dist-packages/wlauto/agenda_example.yaml + +* other? TODO + +WAv2 uses the LAVA dummy-ssh device-type, an SSH connection to an external device that can be controlled by LAVA. +For more information, see the documentation at: + +* dummy-ssh: https://validation.linaro.org/static/docs/dummy-deploy.html#configuration-dummy-ssh + diff --git a/create-jobs-juno.py b/create-jobs-juno.py new file mode 100644 index 0000000..67d0a22 --- /dev/null +++ b/create-jobs-juno.py @@ -0,0 +1,215 @@ +import json +from copy import deepcopy +from pprint import pprint + +SIGNAL_PREFIX = "SIGNAL_PREFIX" +MODE = "MODE" +JOB_NAME = "JOB_NAME" +AGENDA = "AGENDA" +PARAMETERS = "parameters" +TESTDEF_REPOS = "testdef_repos" +ACTIONS = "actions" + +HOST_SHELL = { + "command": "lava_test_shell", + "parameters": { + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "testdef": "wa2host.yaml", + "parameters": { + "AGENDA": "$WA2_AGENDA", + "JOB_NAME": "$WA2_JOB_NAME", + "MODE": "$WA2_MODE", + "SIGNAL_PREFIX": "$WA2_PREFIX" + } + } + ], + "timeout": 4200, + "role": "host" + } + } + +TARGET_SHELL = { + "command": "lava_test_shell", + "parameters": { + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "testdef": "wa2target.yaml", + "parameters": { + "SIGNAL_PREFIX": "$WA2_PREFIX" + } + + } + ], + "timeout": 2400, + "role": "target" + } + } + +JSON_TEMPLATE = { + "logging_level": "INFO", + "timeout": 1800, + "job_name": "$JOB_NAME", + "device_group": [ + { + "role": "host", + "count": 1, + "device_type": "dummy-ssh" + }, + { + "role": "target", + "count": 1, + "device_type": "$DUT_TYPE" + } + ], + "actions": [ + { + "command": "dummy_deploy", + "parameters": { + "target_type": "ubuntu" + } + }, + { + "command": "deploy_linaro_android_image", + "metadata": { + "android.build": "$ANDROID_META_BUILD", + "android.name": "$ANDROID_META_NAME", + "android.url": "$ANDROID_META_URL" + }, + "parameters": { + "boot": "$ANDROID_BOOT", + "data": "$ANDROID_DATA", + "system": "$ANDROID_SYSTEM", + "role": "target" + } + } + ] +} + +SUBMIT_RESULTS = { + "command": "submit_results_on_host", + "parameters": { + "stream": "$BUNDLE_STREAM", + "server": "http://validation.linaro.org/RPC2/" + } + } + +POSTPROCESSING = { + "command": "lava_test_shell", + "parameters": { + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "testdef": "wa2host_postprocessing.yaml", + "parameters": { + "JOB_NAME": "$JOB_NAME" + } + } + ], + "timeout": 4200, + "role": "host" + } + } + +modes = [ + "hmp", + "a57_only", + "a53_only", +] + +agenda_hmp_workloads = [ + "hmp_only_audio.yaml", + "hmp_only_bbench_audio.yaml", +] + +agenda_hmp_benchmarks = [ + "hmp_juno_andbench_t1.yaml", + "hmp_juno_andbench_t5.yaml", + "hmp_juno_antutu_4.0.3.yaml", + "hmp_juno_benchmarkpi.yaml", + "hmp_juno_caffeinemark.yaml", + "hmp_juno_cfbench.yaml", + "hmp_juno_geekbench3.yaml", + "hmp_juno_linpack.yaml", + "hmp_juno_quadrant.yaml", + "hmp_juno_smartbench.yaml", + "hmp_juno_sqlite.yaml", + "hmp_juno_vellamo.yaml", +] + +agenda_a57_only_workloads = [ + "a57_only_audio.yaml", + "a57_only_bbench_audio.yaml", +] + +agenda_a53_only_workloads = [ + "a53_only_audio.yaml", + "a53_only_bbench_audio.yaml", +] + +agenda_a53_only_benchmarks = [ + "a53_only_andbench_t1.yaml", + "a53_only_andbench_t5.yaml", + "a53_only_antutu_4.0.3.yaml", + "a53_only_benchmarkpi.yaml", + "a53_only_caffeinemark.yaml", + "a53_only_cfbench.yaml", + "a53_only_geekbench3.yaml", + "a53_only_linpack.yaml", + "a53_only_quadrant.yaml", + "a53_only_smartbench.yaml", + "a53_only_sqlite.yaml", + "a53_only_vellamo.yaml", +] + +agenda_a57_only_benchmarks = [ + "a57_only_andbench_t1.yaml", + "a57_only_andbench_t5.yaml", + "a57_only_antutu_4.0.3.yaml", + "a57_only_benchmarkpi.yaml", + "a57_only_caffeinemark.yaml", + "a57_only_cfbench.yaml", + "a57_only_geekbench3.yaml", + "a57_only_linpack.yaml", + "a57_only_quadrant.yaml", + "a57_only_smartbench.yaml", + "a57_only_sqlite.yaml", + "a57_only_vellamo.yaml", +] + +for mode in modes: + if mode.split("_")[1] == "workloads": + for benchmark in globals()["agenda_" + mode]: + test_case = deepcopy(JSON_TEMPLATE) + for iteration in range(1,6): + hostshell = deepcopy(HOST_SHELL) + hostshell[PARAMETERS][TESTDEF_REPOS][0][PARAMETERS][AGENDA] = benchmark + hostshell[PARAMETERS][TESTDEF_REPOS][0][PARAMETERS][MODE] = mode.split("_")[0] + hostshell[PARAMETERS][TESTDEF_REPOS][0][PARAMETERS][SIGNAL_PREFIX] = benchmark.split(".")[0] + "-iter" + str(iteration) + targetshell = deepcopy(TARGET_SHELL) + targetshell[PARAMETERS][TESTDEF_REPOS][0][PARAMETERS][SIGNAL_PREFIX] = benchmark.split(".")[0] + "-iter" + str(iteration) + test_case[ACTIONS].append(hostshell) + test_case[ACTIONS].append(targetshell) + #pprint(test_case) + test_case[ACTIONS].append(deepcopy(SUBMIT_RESULTS)) + f = open("wa2_%s.json" % benchmark.split(".")[0], "w") + f.write(json.dumps(test_case, sort_keys=True, indent=4)) + f.close() + else: + for benchmark in globals()["agenda_" + mode]: + test_case = deepcopy(JSON_TEMPLATE) + hostshell = deepcopy(HOST_SHELL) + hostshell[PARAMETERS][TESTDEF_REPOS][0][PARAMETERS][AGENDA] = benchmark + hostshell[PARAMETERS][TESTDEF_REPOS][0][PARAMETERS][MODE] = mode.split("_")[0] + hostshell[PARAMETERS][TESTDEF_REPOS][0][PARAMETERS][SIGNAL_PREFIX] = benchmark.split(".")[0] + targetshell = deepcopy(TARGET_SHELL) + targetshell[PARAMETERS][TESTDEF_REPOS][0][PARAMETERS][SIGNAL_PREFIX] = benchmark.split(".")[0] + test_case[ACTIONS].append(hostshell) + test_case[ACTIONS].append(targetshell) + test_case[ACTIONS].append(deepcopy(SUBMIT_RESULTS)) + #pprint(test_case) + f = open("wa2_%s.json" % benchmark.split(".")[0], "w") + f.write(json.dumps(test_case, sort_keys=True, indent=4)) + f.close() diff --git a/create-jobs.py b/create-jobs.py new file mode 100644 index 0000000..70da207 --- /dev/null +++ b/create-jobs.py @@ -0,0 +1,200 @@ +import json +from copy import deepcopy +from pprint import pprint + +SIGNAL_PREFIX = "SIGNAL_PREFIX" +MODE = "MODE" +JOB_NAME = "JOB_NAME" +AGENDA = "AGENDA" +PARAMETERS = "parameters" +TESTDEF_REPOS = "testdef_repos" +ACTIONS = "actions" + +HOST_SHELL = { + "command": "lava_test_shell", + "parameters": { + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "testdef": "wa2host.yaml", + "parameters": { + "AGENDA": "$WA2_AGENDA", + "JOB_NAME": "$WA2_JOB_NAME", + "MODE": "$WA2_MODE", + "SIGNAL_PREFIX": "$WA2_PREFIX" + } + } + ], + "timeout": 4200, + "role": "host" + } + } + +TARGET_SHELL = { + "command": "lava_test_shell", + "parameters": { + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "testdef": "wa2target.yaml", + "parameters": { + "SIGNAL_PREFIX": "$WA2_PREFIX" + } + + } + ], + "timeout": 2400, + "role": "target" + } + } + +JSON_TEMPLATE = { + "logging_level": "INFO", + "timeout": 1800, + "job_name": "$JOB_NAME", + "device_group": [ + { + "role": "host", + "count": 1, + "device_type": "dummy-ssh" + }, + { + "role": "target", + "count": 1, + "device_type": "$DUT_TYPE" + } + ], + "actions": [ + { + "command": "dummy_deploy", + "parameters": { + "target_type": "ubuntu" + } + }, + { + "command": "deploy_linaro_android_image", + "metadata": { + "android.build": "$ANDROID_META_BUILD", + "android.name": "$ANDROID_META_NAME", + "android.url": "$ANDROID_META_URL" + }, + "parameters": { + "boot": "$ANDROID_BOOT", + "data": "$ANDROID_DATA", + "system": "$ANDROID_SYSTEM", + "role": "target" + } + } + ] +} + +SUBMIT_RESULTS = { + "command": "submit_results_on_host", + "parameters": { + "stream": "$BUNDLE_STREAM", + "server": "http://validation.linaro.org/RPC2/" + } + } + +POSTPROCESSING = { + "command": "lava_test_shell", + "parameters": { + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "testdef": "wa2host_postprocessing.yaml", + "parameters": { + "JOB_NAME": "$JOB_NAME" + } + } + ], + "timeout": 4200, + "role": "host" + } + } + +modes = [ + "hmp", + "a7only", + "a15only", +] + +agenda_hmp_workloads = [ + "hmp_audio.yaml", + "hmp_bbench_audio.yaml", +] + +agenda_hmp_benchmarks = [ + "hmp_andbench_t1.yaml", + "hmp_andbench_t5.yaml", + "hmp_antutu_4.0.3.yaml", + "hmp_benchmarkpi.yaml", + "hmp_caffeinemark.yaml", + "hmp_cfbench.yaml", + "hmp_geekbench3.yaml", + "hmp_linpack.yaml", + "hmp_quadrant.yaml", + "hmp_smartbench.yaml", + "hmp_sqlite.yaml", + "hmp_vellamo.yaml", +] + +agenda_a7only_workloads = [ + "a7only_audio.yaml", + "a7only_bbench_audio.yaml", +] + +agenda_a15only_workloads = [ + "a15only_audio.yaml", + "a15only_bbench_audio.yaml", +] + +agenda_a15only_benchmarks = [ + "a15only_andbench_t1.yaml", + "a15only_andbench_t5.yaml", + "a15only_antutu_4.0.3.yaml", + "a15only_benchmarkpi.yaml", + "a15only_caffeinemark.yaml", + "a15only_cfbench.yaml", + "a15only_geekbench3.yaml", + "a15only_linpack.yaml", + "a15only_quadrant.yaml", + "a15only_smartbench.yaml", + "a15only_sqlite.yaml", + "a15only_vellamo.yaml", +] + +for mode in modes: + if mode.split("_")[1] == "workloads": + for benchmark in globals()["agenda_" + mode]: + test_case = deepcopy(JSON_TEMPLATE) + for iteration in range(1,6): + hostshell = deepcopy(HOST_SHELL) + hostshell[PARAMETERS][TESTDEF_REPOS][0][PARAMETERS][AGENDA] = benchmark + hostshell[PARAMETERS][TESTDEF_REPOS][0][PARAMETERS][MODE] = mode.split("_")[0] + hostshell[PARAMETERS][TESTDEF_REPOS][0][PARAMETERS][SIGNAL_PREFIX] = benchmark.split(".")[0] + "-iter" + str(iteration) + targetshell = deepcopy(TARGET_SHELL) + targetshell[PARAMETERS][TESTDEF_REPOS][0][PARAMETERS][SIGNAL_PREFIX] = benchmark.split(".")[0] + "-iter" + str(iteration) + test_case[ACTIONS].append(hostshell) + test_case[ACTIONS].append(targetshell) + #pprint(test_case) + test_case[ACTIONS].append(deepcopy(SUBMIT_RESULTS)) + f = open("wa2_%s.json" % benchmark.split(".")[0], "w") + f.write(json.dumps(test_case, sort_keys=True, indent=4)) + f.close() + else: + for benchmark in globals()["agenda_" + mode]: + test_case = deepcopy(JSON_TEMPLATE) + hostshell = deepcopy(HOST_SHELL) + hostshell[PARAMETERS][TESTDEF_REPOS][0][PARAMETERS][AGENDA] = benchmark + hostshell[PARAMETERS][TESTDEF_REPOS][0][PARAMETERS][MODE] = mode.split("_")[0] + hostshell[PARAMETERS][TESTDEF_REPOS][0][PARAMETERS][SIGNAL_PREFIX] = benchmark.split(".")[0] + targetshell = deepcopy(TARGET_SHELL) + targetshell[PARAMETERS][TESTDEF_REPOS][0][PARAMETERS][SIGNAL_PREFIX] = benchmark.split(".")[0] + test_case[ACTIONS].append(hostshell) + test_case[ACTIONS].append(targetshell) + test_case[ACTIONS].append(deepcopy(SUBMIT_RESULTS)) + #pprint(test_case) + f = open("wa2_%s.json" % benchmark.split(".")[0], "w") + f.write(json.dumps(test_case, sort_keys=True, indent=4)) + f.close() diff --git a/examples/wa2_a15only_andbench_t1.json b/examples/wa2_a15only_andbench_t1.json new file mode 100644 index 0000000..f7117e7 --- /dev/null +++ b/examples/wa2_a15only_andbench_t1.json @@ -0,0 +1,81 @@ +{ + "actions": [ + { + "command": "dummy_deploy", + "parameters": { + "target_type": "ubuntu" + } + }, + { + "command": "deploy_linaro_android_image", + "metadata": { + "android.build": "$ANDROID_META_BUILD", + "android.name": "$ANDROID_META_NAME", + "android.url": "$ANDROID_META_URL" + }, + "parameters": { + "boot": "$ANDROID_BOOT", + "data": "$ANDROID_DATA", + "role": "target", + "system": "$ANDROID_SYSTEM" + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "host", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "AGENDA": "a15only_andbench_t1.yaml", + "JOB_NAME": "$WA2_JOB_NAME", + "MODE": "a15only", + "SIGNAL_PREFIX": "a15only_andbench_t1" + }, + "testdef": "wa2host.yaml" + } + ], + "timeout": 4200 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "target", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "SIGNAL_PREFIX": "a15only_andbench_t1" + }, + "testdef": "wa2target.yaml" + } + ], + "timeout": 2400 + } + }, + { + "command": "submit_results_on_host", + "parameters": { + "server": "http://validation.linaro.org/RPC2/", + "stream": "$BUNDLE_STREAM" + } + } + ], + "device_group": [ + { + "count": 1, + "device_type": "dummy-ssh", + "role": "host" + }, + { + "count": 1, + "device_type": "$DUT_TYPE", + "role": "target" + } + ], + "job_name": "$JOB_NAME", + "logging_level": "INFO", + "timeout": 1800 +}
\ No newline at end of file diff --git a/examples/wa2_a15only_andbench_t5.json b/examples/wa2_a15only_andbench_t5.json new file mode 100644 index 0000000..e07881f --- /dev/null +++ b/examples/wa2_a15only_andbench_t5.json @@ -0,0 +1,81 @@ +{ + "actions": [ + { + "command": "dummy_deploy", + "parameters": { + "target_type": "ubuntu" + } + }, + { + "command": "deploy_linaro_android_image", + "metadata": { + "android.build": "$ANDROID_META_BUILD", + "android.name": "$ANDROID_META_NAME", + "android.url": "$ANDROID_META_URL" + }, + "parameters": { + "boot": "$ANDROID_BOOT", + "data": "$ANDROID_DATA", + "role": "target", + "system": "$ANDROID_SYSTEM" + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "host", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "AGENDA": "a15only_andbench_t5.yaml", + "JOB_NAME": "$WA2_JOB_NAME", + "MODE": "a15only", + "SIGNAL_PREFIX": "a15only_andbench_t5" + }, + "testdef": "wa2host.yaml" + } + ], + "timeout": 4200 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "target", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "SIGNAL_PREFIX": "a15only_andbench_t5" + }, + "testdef": "wa2target.yaml" + } + ], + "timeout": 2400 + } + }, + { + "command": "submit_results_on_host", + "parameters": { + "server": "http://validation.linaro.org/RPC2/", + "stream": "$BUNDLE_STREAM" + } + } + ], + "device_group": [ + { + "count": 1, + "device_type": "dummy-ssh", + "role": "host" + }, + { + "count": 1, + "device_type": "$DUT_TYPE", + "role": "target" + } + ], + "job_name": "$JOB_NAME", + "logging_level": "INFO", + "timeout": 1800 +}
\ No newline at end of file diff --git a/examples/wa2_a15only_antutu_4.json b/examples/wa2_a15only_antutu_4.json new file mode 100644 index 0000000..5fecd1e --- /dev/null +++ b/examples/wa2_a15only_antutu_4.json @@ -0,0 +1,81 @@ +{ + "actions": [ + { + "command": "dummy_deploy", + "parameters": { + "target_type": "ubuntu" + } + }, + { + "command": "deploy_linaro_android_image", + "metadata": { + "android.build": "$ANDROID_META_BUILD", + "android.name": "$ANDROID_META_NAME", + "android.url": "$ANDROID_META_URL" + }, + "parameters": { + "boot": "$ANDROID_BOOT", + "data": "$ANDROID_DATA", + "role": "target", + "system": "$ANDROID_SYSTEM" + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "host", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "AGENDA": "a15only_antutu_4.0.3.yaml", + "JOB_NAME": "$WA2_JOB_NAME", + "MODE": "a15only", + "SIGNAL_PREFIX": "a15only_antutu_4" + }, + "testdef": "wa2host.yaml" + } + ], + "timeout": 4200 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "target", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "SIGNAL_PREFIX": "a15only_antutu_4" + }, + "testdef": "wa2target.yaml" + } + ], + "timeout": 2400 + } + }, + { + "command": "submit_results_on_host", + "parameters": { + "server": "http://validation.linaro.org/RPC2/", + "stream": "$BUNDLE_STREAM" + } + } + ], + "device_group": [ + { + "count": 1, + "device_type": "dummy-ssh", + "role": "host" + }, + { + "count": 1, + "device_type": "$DUT_TYPE", + "role": "target" + } + ], + "job_name": "$JOB_NAME", + "logging_level": "INFO", + "timeout": 1800 +}
\ No newline at end of file diff --git a/examples/wa2_a15only_audio.json b/examples/wa2_a15only_audio.json new file mode 100644 index 0000000..d7c9570 --- /dev/null +++ b/examples/wa2_a15only_audio.json @@ -0,0 +1,221 @@ +{ + "actions": [ + { + "command": "dummy_deploy", + "parameters": { + "target_type": "ubuntu" + } + }, + { + "command": "deploy_linaro_android_image", + "metadata": { + "android.build": "$ANDROID_META_BUILD", + "android.name": "$ANDROID_META_NAME", + "android.url": "$ANDROID_META_URL" + }, + "parameters": { + "boot": "$ANDROID_BOOT", + "data": "$ANDROID_DATA", + "role": "target", + "system": "$ANDROID_SYSTEM" + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "host", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "AGENDA": "a15only_audio.yaml", + "JOB_NAME": "$WA2_JOB_NAME", + "MODE": "a15only", + "SIGNAL_PREFIX": "a15only_audio-iter1" + }, + "testdef": "wa2host.yaml" + } + ], + "timeout": 4200 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "target", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "SIGNAL_PREFIX": "a15only_audio-iter1" + }, + "testdef": "wa2target.yaml" + } + ], + "timeout": 2400 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "host", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "AGENDA": "a15only_audio.yaml", + "JOB_NAME": "$WA2_JOB_NAME", + "MODE": "a15only", + "SIGNAL_PREFIX": "a15only_audio-iter2" + }, + "testdef": "wa2host.yaml" + } + ], + "timeout": 4200 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "target", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "SIGNAL_PREFIX": "a15only_audio-iter2" + }, + "testdef": "wa2target.yaml" + } + ], + "timeout": 2400 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "host", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "AGENDA": "a15only_audio.yaml", + "JOB_NAME": "$WA2_JOB_NAME", + "MODE": "a15only", + "SIGNAL_PREFIX": "a15only_audio-iter3" + }, + "testdef": "wa2host.yaml" + } + ], + "timeout": 4200 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "target", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "SIGNAL_PREFIX": "a15only_audio-iter3" + }, + "testdef": "wa2target.yaml" + } + ], + "timeout": 2400 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "host", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "AGENDA": "a15only_audio.yaml", + "JOB_NAME": "$WA2_JOB_NAME", + "MODE": "a15only", + "SIGNAL_PREFIX": "a15only_audio-iter4" + }, + "testdef": "wa2host.yaml" + } + ], + "timeout": 4200 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "target", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "SIGNAL_PREFIX": "a15only_audio-iter4" + }, + "testdef": "wa2target.yaml" + } + ], + "timeout": 2400 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "host", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "AGENDA": "a15only_audio.yaml", + "JOB_NAME": "$WA2_JOB_NAME", + "MODE": "a15only", + "SIGNAL_PREFIX": "a15only_audio-iter5" + }, + "testdef": "wa2host.yaml" + } + ], + "timeout": 4200 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "target", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "SIGNAL_PREFIX": "a15only_audio-iter5" + }, + "testdef": "wa2target.yaml" + } + ], + "timeout": 2400 + } + }, + { + "command": "submit_results_on_host", + "parameters": { + "server": "http://validation.linaro.org/RPC2/", + "stream": "$BUNDLE_STREAM" + } + } + ], + "device_group": [ + { + "count": 1, + "device_type": "dummy-ssh", + "role": "host" + }, + { + "count": 1, + "device_type": "$DUT_TYPE", + "role": "target" + } + ], + "job_name": "$JOB_NAME", + "logging_level": "INFO", + "timeout": 1800 +}
\ No newline at end of file diff --git a/examples/wa2_a15only_bbench_audio.json b/examples/wa2_a15only_bbench_audio.json new file mode 100644 index 0000000..c4f9ac7 --- /dev/null +++ b/examples/wa2_a15only_bbench_audio.json @@ -0,0 +1,221 @@ +{ + "actions": [ + { + "command": "dummy_deploy", + "parameters": { + "target_type": "ubuntu" + } + }, + { + "command": "deploy_linaro_android_image", + "metadata": { + "android.build": "$ANDROID_META_BUILD", + "android.name": "$ANDROID_META_NAME", + "android.url": "$ANDROID_META_URL" + }, + "parameters": { + "boot": "$ANDROID_BOOT", + "data": "$ANDROID_DATA", + "role": "target", + "system": "$ANDROID_SYSTEM" + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "host", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "AGENDA": "a15only_bbench_audio.yaml", + "JOB_NAME": "$WA2_JOB_NAME", + "MODE": "a15only", + "SIGNAL_PREFIX": "a15only_bbench_audio-iter1" + }, + "testdef": "wa2host.yaml" + } + ], + "timeout": 4200 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "target", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "SIGNAL_PREFIX": "a15only_bbench_audio-iter1" + }, + "testdef": "wa2target.yaml" + } + ], + "timeout": 2400 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "host", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "AGENDA": "a15only_bbench_audio.yaml", + "JOB_NAME": "$WA2_JOB_NAME", + "MODE": "a15only", + "SIGNAL_PREFIX": "a15only_bbench_audio-iter2" + }, + "testdef": "wa2host.yaml" + } + ], + "timeout": 4200 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "target", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "SIGNAL_PREFIX": "a15only_bbench_audio-iter2" + }, + "testdef": "wa2target.yaml" + } + ], + "timeout": 2400 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "host", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "AGENDA": "a15only_bbench_audio.yaml", + "JOB_NAME": "$WA2_JOB_NAME", + "MODE": "a15only", + "SIGNAL_PREFIX": "a15only_bbench_audio-iter3" + }, + "testdef": "wa2host.yaml" + } + ], + "timeout": 4200 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "target", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "SIGNAL_PREFIX": "a15only_bbench_audio-iter3" + }, + "testdef": "wa2target.yaml" + } + ], + "timeout": 2400 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "host", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "AGENDA": "a15only_bbench_audio.yaml", + "JOB_NAME": "$WA2_JOB_NAME", + "MODE": "a15only", + "SIGNAL_PREFIX": "a15only_bbench_audio-iter4" + }, + "testdef": "wa2host.yaml" + } + ], + "timeout": 4200 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "target", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "SIGNAL_PREFIX": "a15only_bbench_audio-iter4" + }, + "testdef": "wa2target.yaml" + } + ], + "timeout": 2400 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "host", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "AGENDA": "a15only_bbench_audio.yaml", + "JOB_NAME": "$WA2_JOB_NAME", + "MODE": "a15only", + "SIGNAL_PREFIX": "a15only_bbench_audio-iter5" + }, + "testdef": "wa2host.yaml" + } + ], + "timeout": 4200 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "target", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "SIGNAL_PREFIX": "a15only_bbench_audio-iter5" + }, + "testdef": "wa2target.yaml" + } + ], + "timeout": 2400 + } + }, + { + "command": "submit_results_on_host", + "parameters": { + "server": "http://validation.linaro.org/RPC2/", + "stream": "$BUNDLE_STREAM" + } + } + ], + "device_group": [ + { + "count": 1, + "device_type": "dummy-ssh", + "role": "host" + }, + { + "count": 1, + "device_type": "$DUT_TYPE", + "role": "target" + } + ], + "job_name": "$JOB_NAME", + "logging_level": "INFO", + "timeout": 1800 +}
\ No newline at end of file diff --git a/examples/wa2_a15only_benchmarkpi.json b/examples/wa2_a15only_benchmarkpi.json new file mode 100644 index 0000000..abf8e73 --- /dev/null +++ b/examples/wa2_a15only_benchmarkpi.json @@ -0,0 +1,81 @@ +{ + "actions": [ + { + "command": "dummy_deploy", + "parameters": { + "target_type": "ubuntu" + } + }, + { + "command": "deploy_linaro_android_image", + "metadata": { + "android.build": "$ANDROID_META_BUILD", + "android.name": "$ANDROID_META_NAME", + "android.url": "$ANDROID_META_URL" + }, + "parameters": { + "boot": "$ANDROID_BOOT", + "data": "$ANDROID_DATA", + "role": "target", + "system": "$ANDROID_SYSTEM" + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "host", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "AGENDA": "a15only_benchmarkpi.yaml", + "JOB_NAME": "$WA2_JOB_NAME", + "MODE": "a15only", + "SIGNAL_PREFIX": "a15only_benchmarkpi" + }, + "testdef": "wa2host.yaml" + } + ], + "timeout": 4200 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "target", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "SIGNAL_PREFIX": "a15only_benchmarkpi" + }, + "testdef": "wa2target.yaml" + } + ], + "timeout": 2400 + } + }, + { + "command": "submit_results_on_host", + "parameters": { + "server": "http://validation.linaro.org/RPC2/", + "stream": "$BUNDLE_STREAM" + } + } + ], + "device_group": [ + { + "count": 1, + "device_type": "dummy-ssh", + "role": "host" + }, + { + "count": 1, + "device_type": "$DUT_TYPE", + "role": "target" + } + ], + "job_name": "$JOB_NAME", + "logging_level": "INFO", + "timeout": 1800 +}
\ No newline at end of file diff --git a/examples/wa2_a15only_caffeinemark.json b/examples/wa2_a15only_caffeinemark.json new file mode 100644 index 0000000..6b1cb07 --- /dev/null +++ b/examples/wa2_a15only_caffeinemark.json @@ -0,0 +1,81 @@ +{ + "actions": [ + { + "command": "dummy_deploy", + "parameters": { + "target_type": "ubuntu" + } + }, + { + "command": "deploy_linaro_android_image", + "metadata": { + "android.build": "$ANDROID_META_BUILD", + "android.name": "$ANDROID_META_NAME", + "android.url": "$ANDROID_META_URL" + }, + "parameters": { + "boot": "$ANDROID_BOOT", + "data": "$ANDROID_DATA", + "role": "target", + "system": "$ANDROID_SYSTEM" + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "host", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "AGENDA": "a15only_caffeinemark.yaml", + "JOB_NAME": "$WA2_JOB_NAME", + "MODE": "a15only", + "SIGNAL_PREFIX": "a15only_caffeinemark" + }, + "testdef": "wa2host.yaml" + } + ], + "timeout": 4200 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "target", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "SIGNAL_PREFIX": "a15only_caffeinemark" + }, + "testdef": "wa2target.yaml" + } + ], + "timeout": 2400 + } + }, + { + "command": "submit_results_on_host", + "parameters": { + "server": "http://validation.linaro.org/RPC2/", + "stream": "$BUNDLE_STREAM" + } + } + ], + "device_group": [ + { + "count": 1, + "device_type": "dummy-ssh", + "role": "host" + }, + { + "count": 1, + "device_type": "$DUT_TYPE", + "role": "target" + } + ], + "job_name": "$JOB_NAME", + "logging_level": "INFO", + "timeout": 1800 +}
\ No newline at end of file diff --git a/examples/wa2_a15only_cfbench.json b/examples/wa2_a15only_cfbench.json new file mode 100644 index 0000000..f1c6ee0 --- /dev/null +++ b/examples/wa2_a15only_cfbench.json @@ -0,0 +1,81 @@ +{ + "actions": [ + { + "command": "dummy_deploy", + "parameters": { + "target_type": "ubuntu" + } + }, + { + "command": "deploy_linaro_android_image", + "metadata": { + "android.build": "$ANDROID_META_BUILD", + "android.name": "$ANDROID_META_NAME", + "android.url": "$ANDROID_META_URL" + }, + "parameters": { + "boot": "$ANDROID_BOOT", + "data": "$ANDROID_DATA", + "role": "target", + "system": "$ANDROID_SYSTEM" + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "host", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "AGENDA": "a15only_cfbench.yaml", + "JOB_NAME": "$WA2_JOB_NAME", + "MODE": "a15only", + "SIGNAL_PREFIX": "a15only_cfbench" + }, + "testdef": "wa2host.yaml" + } + ], + "timeout": 4200 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "target", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "SIGNAL_PREFIX": "a15only_cfbench" + }, + "testdef": "wa2target.yaml" + } + ], + "timeout": 2400 + } + }, + { + "command": "submit_results_on_host", + "parameters": { + "server": "http://validation.linaro.org/RPC2/", + "stream": "$BUNDLE_STREAM" + } + } + ], + "device_group": [ + { + "count": 1, + "device_type": "dummy-ssh", + "role": "host" + }, + { + "count": 1, + "device_type": "$DUT_TYPE", + "role": "target" + } + ], + "job_name": "$JOB_NAME", + "logging_level": "INFO", + "timeout": 1800 +}
\ No newline at end of file diff --git a/examples/wa2_a15only_geekbench3.json b/examples/wa2_a15only_geekbench3.json new file mode 100644 index 0000000..0dc685c --- /dev/null +++ b/examples/wa2_a15only_geekbench3.json @@ -0,0 +1,81 @@ +{ + "actions": [ + { + "command": "dummy_deploy", + "parameters": { + "target_type": "ubuntu" + } + }, + { + "command": "deploy_linaro_android_image", + "metadata": { + "android.build": "$ANDROID_META_BUILD", + "android.name": "$ANDROID_META_NAME", + "android.url": "$ANDROID_META_URL" + }, + "parameters": { + "boot": "$ANDROID_BOOT", + "data": "$ANDROID_DATA", + "role": "target", + "system": "$ANDROID_SYSTEM" + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "host", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "AGENDA": "a15only_geekbench3.yaml", + "JOB_NAME": "$WA2_JOB_NAME", + "MODE": "a15only", + "SIGNAL_PREFIX": "a15only_geekbench3" + }, + "testdef": "wa2host.yaml" + } + ], + "timeout": 4200 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "target", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "SIGNAL_PREFIX": "a15only_geekbench3" + }, + "testdef": "wa2target.yaml" + } + ], + "timeout": 2400 + } + }, + { + "command": "submit_results_on_host", + "parameters": { + "server": "http://validation.linaro.org/RPC2/", + "stream": "$BUNDLE_STREAM" + } + } + ], + "device_group": [ + { + "count": 1, + "device_type": "dummy-ssh", + "role": "host" + }, + { + "count": 1, + "device_type": "$DUT_TYPE", + "role": "target" + } + ], + "job_name": "$JOB_NAME", + "logging_level": "INFO", + "timeout": 1800 +}
\ No newline at end of file diff --git a/examples/wa2_a15only_linpack.json b/examples/wa2_a15only_linpack.json new file mode 100644 index 0000000..d086a66 --- /dev/null +++ b/examples/wa2_a15only_linpack.json @@ -0,0 +1,81 @@ +{ + "actions": [ + { + "command": "dummy_deploy", + "parameters": { + "target_type": "ubuntu" + } + }, + { + "command": "deploy_linaro_android_image", + "metadata": { + "android.build": "$ANDROID_META_BUILD", + "android.name": "$ANDROID_META_NAME", + "android.url": "$ANDROID_META_URL" + }, + "parameters": { + "boot": "$ANDROID_BOOT", + "data": "$ANDROID_DATA", + "role": "target", + "system": "$ANDROID_SYSTEM" + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "host", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "AGENDA": "a15only_linpack.yaml", + "JOB_NAME": "$WA2_JOB_NAME", + "MODE": "a15only", + "SIGNAL_PREFIX": "a15only_linpack" + }, + "testdef": "wa2host.yaml" + } + ], + "timeout": 4200 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "target", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "SIGNAL_PREFIX": "a15only_linpack" + }, + "testdef": "wa2target.yaml" + } + ], + "timeout": 2400 + } + }, + { + "command": "submit_results_on_host", + "parameters": { + "server": "http://validation.linaro.org/RPC2/", + "stream": "$BUNDLE_STREAM" + } + } + ], + "device_group": [ + { + "count": 1, + "device_type": "dummy-ssh", + "role": "host" + }, + { + "count": 1, + "device_type": "$DUT_TYPE", + "role": "target" + } + ], + "job_name": "$JOB_NAME", + "logging_level": "INFO", + "timeout": 1800 +} diff --git a/examples/wa2_a15only_quadrant.json b/examples/wa2_a15only_quadrant.json new file mode 100644 index 0000000..cfed00d --- /dev/null +++ b/examples/wa2_a15only_quadrant.json @@ -0,0 +1,81 @@ +{ + "actions": [ + { + "command": "dummy_deploy", + "parameters": { + "target_type": "ubuntu" + } + }, + { + "command": "deploy_linaro_android_image", + "metadata": { + "android.build": "$ANDROID_META_BUILD", + "android.name": "$ANDROID_META_NAME", + "android.url": "$ANDROID_META_URL" + }, + "parameters": { + "boot": "$ANDROID_BOOT", + "data": "$ANDROID_DATA", + "role": "target", + "system": "$ANDROID_SYSTEM" + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "host", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "AGENDA": "a15only_quadrant.yaml", + "JOB_NAME": "$WA2_JOB_NAME", + "MODE": "a15only", + "SIGNAL_PREFIX": "a15only_quadrant" + }, + "testdef": "wa2host.yaml" + } + ], + "timeout": 4200 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "target", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "SIGNAL_PREFIX": "a15only_quadrant" + }, + "testdef": "wa2target.yaml" + } + ], + "timeout": 2400 + } + }, + { + "command": "submit_results_on_host", + "parameters": { + "server": "http://validation.linaro.org/RPC2/", + "stream": "$BUNDLE_STREAM" + } + } + ], + "device_group": [ + { + "count": 1, + "device_type": "dummy-ssh", + "role": "host" + }, + { + "count": 1, + "device_type": "$DUT_TYPE", + "role": "target" + } + ], + "job_name": "$JOB_NAME", + "logging_level": "INFO", + "timeout": 1800 +}
\ No newline at end of file diff --git a/examples/wa2_a15only_smartbench.json b/examples/wa2_a15only_smartbench.json new file mode 100644 index 0000000..81b77d4 --- /dev/null +++ b/examples/wa2_a15only_smartbench.json @@ -0,0 +1,81 @@ +{ + "actions": [ + { + "command": "dummy_deploy", + "parameters": { + "target_type": "ubuntu" + } + }, + { + "command": "deploy_linaro_android_image", + "metadata": { + "android.build": "$ANDROID_META_BUILD", + "android.name": "$ANDROID_META_NAME", + "android.url": "$ANDROID_META_URL" + }, + "parameters": { + "boot": "$ANDROID_BOOT", + "data": "$ANDROID_DATA", + "role": "target", + "system": "$ANDROID_SYSTEM" + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "host", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "AGENDA": "a15only_smartbench.yaml", + "JOB_NAME": "$WA2_JOB_NAME", + "MODE": "a15only", + "SIGNAL_PREFIX": "a15only_smartbench" + }, + "testdef": "wa2host.yaml" + } + ], + "timeout": 4200 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "target", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "SIGNAL_PREFIX": "a15only_smartbench" + }, + "testdef": "wa2target.yaml" + } + ], + "timeout": 2400 + } + }, + { + "command": "submit_results_on_host", + "parameters": { + "server": "http://validation.linaro.org/RPC2/", + "stream": "$BUNDLE_STREAM" + } + } + ], + "device_group": [ + { + "count": 1, + "device_type": "dummy-ssh", + "role": "host" + }, + { + "count": 1, + "device_type": "$DUT_TYPE", + "role": "target" + } + ], + "job_name": "$JOB_NAME", + "logging_level": "INFO", + "timeout": 1800 +}
\ No newline at end of file diff --git a/examples/wa2_a15only_sqlite.json b/examples/wa2_a15only_sqlite.json new file mode 100644 index 0000000..a2b1b5b --- /dev/null +++ b/examples/wa2_a15only_sqlite.json @@ -0,0 +1,81 @@ +{ + "actions": [ + { + "command": "dummy_deploy", + "parameters": { + "target_type": "ubuntu" + } + }, + { + "command": "deploy_linaro_android_image", + "metadata": { + "android.build": "$ANDROID_META_BUILD", + "android.name": "$ANDROID_META_NAME", + "android.url": "$ANDROID_META_URL" + }, + "parameters": { + "boot": "$ANDROID_BOOT", + "data": "$ANDROID_DATA", + "role": "target", + "system": "$ANDROID_SYSTEM" + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "host", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "AGENDA": "a15only_sqlite.yaml", + "JOB_NAME": "$WA2_JOB_NAME", + "MODE": "a15only", + "SIGNAL_PREFIX": "a15only_sqlite" + }, + "testdef": "wa2host.yaml" + } + ], + "timeout": 4200 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "target", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "SIGNAL_PREFIX": "a15only_sqlite" + }, + "testdef": "wa2target.yaml" + } + ], + "timeout": 2400 + } + }, + { + "command": "submit_results_on_host", + "parameters": { + "server": "http://validation.linaro.org/RPC2/", + "stream": "$BUNDLE_STREAM" + } + } + ], + "device_group": [ + { + "count": 1, + "device_type": "dummy-ssh", + "role": "host" + }, + { + "count": 1, + "device_type": "$DUT_TYPE", + "role": "target" + } + ], + "job_name": "$JOB_NAME", + "logging_level": "INFO", + "timeout": 1800 +}
\ No newline at end of file diff --git a/examples/wa2_a15only_vellamo.json b/examples/wa2_a15only_vellamo.json new file mode 100644 index 0000000..e92d799 --- /dev/null +++ b/examples/wa2_a15only_vellamo.json @@ -0,0 +1,81 @@ +{ + "actions": [ + { + "command": "dummy_deploy", + "parameters": { + "target_type": "ubuntu" + } + }, + { + "command": "deploy_linaro_android_image", + "metadata": { + "android.build": "$ANDROID_META_BUILD", + "android.name": "$ANDROID_META_NAME", + "android.url": "$ANDROID_META_URL" + }, + "parameters": { + "boot": "$ANDROID_BOOT", + "data": "$ANDROID_DATA", + "role": "target", + "system": "$ANDROID_SYSTEM" + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "host", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "AGENDA": "a15only_vellamo.yaml", + "JOB_NAME": "$WA2_JOB_NAME", + "MODE": "a15only", + "SIGNAL_PREFIX": "a15only_vellamo" + }, + "testdef": "wa2host.yaml" + } + ], + "timeout": 4200 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "target", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "SIGNAL_PREFIX": "a15only_vellamo" + }, + "testdef": "wa2target.yaml" + } + ], + "timeout": 2400 + } + }, + { + "command": "submit_results_on_host", + "parameters": { + "server": "http://validation.linaro.org/RPC2/", + "stream": "$BUNDLE_STREAM" + } + } + ], + "device_group": [ + { + "count": 1, + "device_type": "dummy-ssh", + "role": "host" + }, + { + "count": 1, + "device_type": "$DUT_TYPE", + "role": "target" + } + ], + "job_name": "$JOB_NAME", + "logging_level": "INFO", + "timeout": 1800 +}
\ No newline at end of file diff --git a/examples/wa2_a7only_audio.json b/examples/wa2_a7only_audio.json new file mode 100644 index 0000000..446a554 --- /dev/null +++ b/examples/wa2_a7only_audio.json @@ -0,0 +1,221 @@ +{ + "actions": [ + { + "command": "dummy_deploy", + "parameters": { + "target_type": "ubuntu" + } + }, + { + "command": "deploy_linaro_android_image", + "metadata": { + "android.build": "$ANDROID_META_BUILD", + "android.name": "$ANDROID_META_NAME", + "android.url": "$ANDROID_META_URL" + }, + "parameters": { + "boot": "$ANDROID_BOOT", + "data": "$ANDROID_DATA", + "role": "target", + "system": "$ANDROID_SYSTEM" + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "host", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "AGENDA": "a7only_audio.yaml", + "JOB_NAME": "$WA2_JOB_NAME", + "MODE": "a7only", + "SIGNAL_PREFIX": "a7only_audio-iter1" + }, + "testdef": "wa2host.yaml" + } + ], + "timeout": 4200 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "target", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "SIGNAL_PREFIX": "a7only_audio-iter1" + }, + "testdef": "wa2target.yaml" + } + ], + "timeout": 2400 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "host", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "AGENDA": "a7only_audio.yaml", + "JOB_NAME": "$WA2_JOB_NAME", + "MODE": "a7only", + "SIGNAL_PREFIX": "a7only_audio-iter2" + }, + "testdef": "wa2host.yaml" + } + ], + "timeout": 4200 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "target", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "SIGNAL_PREFIX": "a7only_audio-iter2" + }, + "testdef": "wa2target.yaml" + } + ], + "timeout": 2400 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "host", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "AGENDA": "a7only_audio.yaml", + "JOB_NAME": "$WA2_JOB_NAME", + "MODE": "a7only", + "SIGNAL_PREFIX": "a7only_audio-iter3" + }, + "testdef": "wa2host.yaml" + } + ], + "timeout": 4200 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "target", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "SIGNAL_PREFIX": "a7only_audio-iter3" + }, + "testdef": "wa2target.yaml" + } + ], + "timeout": 2400 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "host", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "AGENDA": "a7only_audio.yaml", + "JOB_NAME": "$WA2_JOB_NAME", + "MODE": "a7only", + "SIGNAL_PREFIX": "a7only_audio-iter4" + }, + "testdef": "wa2host.yaml" + } + ], + "timeout": 4200 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "target", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "SIGNAL_PREFIX": "a7only_audio-iter4" + }, + "testdef": "wa2target.yaml" + } + ], + "timeout": 2400 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "host", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "AGENDA": "a7only_audio.yaml", + "JOB_NAME": "$WA2_JOB_NAME", + "MODE": "a7only", + "SIGNAL_PREFIX": "a7only_audio-iter5" + }, + "testdef": "wa2host.yaml" + } + ], + "timeout": 4200 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "target", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "SIGNAL_PREFIX": "a7only_audio-iter5" + }, + "testdef": "wa2target.yaml" + } + ], + "timeout": 2400 + } + }, + { + "command": "submit_results_on_host", + "parameters": { + "server": "http://validation.linaro.org/RPC2/", + "stream": "$BUNDLE_STREAM" + } + } + ], + "device_group": [ + { + "count": 1, + "device_type": "dummy-ssh", + "role": "host" + }, + { + "count": 1, + "device_type": "$DUT_TYPE", + "role": "target" + } + ], + "job_name": "$JOB_NAME", + "logging_level": "INFO", + "timeout": 1800 +}
\ No newline at end of file diff --git a/examples/wa2_a7only_bbench_audio.json b/examples/wa2_a7only_bbench_audio.json new file mode 100644 index 0000000..d149ce6 --- /dev/null +++ b/examples/wa2_a7only_bbench_audio.json @@ -0,0 +1,221 @@ +{ + "actions": [ + { + "command": "dummy_deploy", + "parameters": { + "target_type": "ubuntu" + } + }, + { + "command": "deploy_linaro_android_image", + "metadata": { + "android.build": "$ANDROID_META_BUILD", + "android.name": "$ANDROID_META_NAME", + "android.url": "$ANDROID_META_URL" + }, + "parameters": { + "boot": "$ANDROID_BOOT", + "data": "$ANDROID_DATA", + "role": "target", + "system": "$ANDROID_SYSTEM" + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "host", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "AGENDA": "a7only_bbench_audio.yaml", + "JOB_NAME": "$WA2_JOB_NAME", + "MODE": "a7only", + "SIGNAL_PREFIX": "a7only_bbench_audio-iter1" + }, + "testdef": "wa2host.yaml" + } + ], + "timeout": 4200 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "target", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "SIGNAL_PREFIX": "a7only_bbench_audio-iter1" + }, + "testdef": "wa2target.yaml" + } + ], + "timeout": 2400 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "host", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "AGENDA": "a7only_bbench_audio.yaml", + "JOB_NAME": "$WA2_JOB_NAME", + "MODE": "a7only", + "SIGNAL_PREFIX": "a7only_bbench_audio-iter2" + }, + "testdef": "wa2host.yaml" + } + ], + "timeout": 4200 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "target", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "SIGNAL_PREFIX": "a7only_bbench_audio-iter2" + }, + "testdef": "wa2target.yaml" + } + ], + "timeout": 2400 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "host", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "AGENDA": "a7only_bbench_audio.yaml", + "JOB_NAME": "$WA2_JOB_NAME", + "MODE": "a7only", + "SIGNAL_PREFIX": "a7only_bbench_audio-iter3" + }, + "testdef": "wa2host.yaml" + } + ], + "timeout": 4200 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "target", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "SIGNAL_PREFIX": "a7only_bbench_audio-iter3" + }, + "testdef": "wa2target.yaml" + } + ], + "timeout": 2400 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "host", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "AGENDA": "a7only_bbench_audio.yaml", + "JOB_NAME": "$WA2_JOB_NAME", + "MODE": "a7only", + "SIGNAL_PREFIX": "a7only_bbench_audio-iter4" + }, + "testdef": "wa2host.yaml" + } + ], + "timeout": 4200 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "target", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "SIGNAL_PREFIX": "a7only_bbench_audio-iter4" + }, + "testdef": "wa2target.yaml" + } + ], + "timeout": 2400 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "host", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "AGENDA": "a7only_bbench_audio.yaml", + "JOB_NAME": "$WA2_JOB_NAME", + "MODE": "a7only", + "SIGNAL_PREFIX": "a7only_bbench_audio-iter5" + }, + "testdef": "wa2host.yaml" + } + ], + "timeout": 4200 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "target", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "SIGNAL_PREFIX": "a7only_bbench_audio-iter5" + }, + "testdef": "wa2target.yaml" + } + ], + "timeout": 2400 + } + }, + { + "command": "submit_results_on_host", + "parameters": { + "server": "http://validation.linaro.org/RPC2/", + "stream": "$BUNDLE_STREAM" + } + } + ], + "device_group": [ + { + "count": 1, + "device_type": "dummy-ssh", + "role": "host" + }, + { + "count": 1, + "device_type": "$DUT_TYPE", + "role": "target" + } + ], + "job_name": "$JOB_NAME", + "logging_level": "INFO", + "timeout": 1800 +}
\ No newline at end of file diff --git a/examples/wa2_hmp_a15_a7_bbench_audio.json b/examples/wa2_hmp_a15_a7_bbench_audio.json new file mode 100644 index 0000000..26fae87 --- /dev/null +++ b/examples/wa2_hmp_a15_a7_bbench_audio.json @@ -0,0 +1,447 @@ +{ + "actions": [ + { + "command": "dummy_deploy", + "parameters": { + "target_type": "ubuntu" + } + }, + { + "command": "deploy_linaro_android_image", + "metadata": { + "android.build": "$ANDROID_META_BUILD", + "android.name": "$ANDROID_META_NAME", + "android.url": "$ANDROID_META_URL" + }, + "parameters": { + "boot": "$ANDROID_BOOT", + "data": "$ANDROID_DATA", + "role": "target", + "system": "$ANDROID_SYSTEM" + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "host", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "AGENDA": "hmp_bbench_audio.yaml", + "JOB_NAME": "$WA2_JOB_NAME", + "MODE": "mp", + "SIGNAL_PREFIX": "hmp_bbench_audio" + }, + "testdef": "wa2host.yaml" + } + ], + "timeout": 4200 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "target", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "SIGNAL_PREFIX": "hmp_bbench_audio" + }, + "testdef": "wa2target.yaml" + } + ], + "timeout": 2400 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "host", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "AGENDA": "a15only_bbench_audio.yaml", + "JOB_NAME": "$WA2_JOB_NAME", + "MODE": "a15only", + "SIGNAL_PREFIX": "a15only_bbench_audio-iter1" + }, + "testdef": "wa2host.yaml" + } + ], + "timeout": 4200 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "target", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "SIGNAL_PREFIX": "a15only_bbench_audio-iter1" + }, + "testdef": "wa2target.yaml" + } + ], + "timeout": 2400 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "host", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "AGENDA": "a15only_bbench_audio.yaml", + "JOB_NAME": "$WA2_JOB_NAME", + "MODE": "a15only", + "SIGNAL_PREFIX": "a15only_bbench_audio-iter2" + }, + "testdef": "wa2host.yaml" + } + ], + "timeout": 4200 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "target", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "SIGNAL_PREFIX": "a15only_bbench_audio-iter2" + }, + "testdef": "wa2target.yaml" + } + ], + "timeout": 2400 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "host", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "AGENDA": "a15only_bbench_audio.yaml", + "JOB_NAME": "$WA2_JOB_NAME", + "MODE": "a15only", + "SIGNAL_PREFIX": "a15only_bbench_audio-iter3" + }, + "testdef": "wa2host.yaml" + } + ], + "timeout": 4200 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "target", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "SIGNAL_PREFIX": "a15only_bbench_audio-iter3" + }, + "testdef": "wa2target.yaml" + } + ], + "timeout": 2400 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "host", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "AGENDA": "a15only_bbench_audio.yaml", + "JOB_NAME": "$WA2_JOB_NAME", + "MODE": "a15only", + "SIGNAL_PREFIX": "a15only_bbench_audio-iter4" + }, + "testdef": "wa2host.yaml" + } + ], + "timeout": 4200 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "target", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "SIGNAL_PREFIX": "a15only_bbench_audio-iter4" + }, + "testdef": "wa2target.yaml" + } + ], + "timeout": 2400 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "host", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "AGENDA": "a15only_bbench_audio.yaml", + "JOB_NAME": "$WA2_JOB_NAME", + "MODE": "a15only", + "SIGNAL_PREFIX": "a15only_bbench_audio-iter5" + }, + "testdef": "wa2host.yaml" + } + ], + "timeout": 4200 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "target", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "SIGNAL_PREFIX": "a15only_bbench_audio-iter5" + }, + "testdef": "wa2target.yaml" + } + ], + "timeout": 2400 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "host", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "AGENDA": "a7only_bbench_audio.yaml", + "JOB_NAME": "$WA2_JOB_NAME", + "MODE": "a7only", + "SIGNAL_PREFIX": "a7only_bbench_audio-iter1" + }, + "testdef": "wa2host.yaml" + } + ], + "timeout": 4200 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "target", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "SIGNAL_PREFIX": "a7only_bbench_audio-iter1" + }, + "testdef": "wa2target.yaml" + } + ], + "timeout": 2400 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "host", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "AGENDA": "a7only_bbench_audio.yaml", + "JOB_NAME": "$WA2_JOB_NAME", + "MODE": "a7only", + "SIGNAL_PREFIX": "a7only_bbench_audio-iter2" + }, + "testdef": "wa2host.yaml" + } + ], + "timeout": 4200 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "target", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "SIGNAL_PREFIX": "a7only_bbench_audio-iter2" + }, + "testdef": "wa2target.yaml" + } + ], + "timeout": 2400 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "host", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "AGENDA": "a7only_bbench_audio.yaml", + "JOB_NAME": "$WA2_JOB_NAME", + "MODE": "a7only", + "SIGNAL_PREFIX": "a7only_bbench_audio-iter3" + }, + "testdef": "wa2host.yaml" + } + ], + "timeout": 4200 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "target", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "SIGNAL_PREFIX": "a7only_bbench_audio-iter3" + }, + "testdef": "wa2target.yaml" + } + ], + "timeout": 2400 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "host", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "AGENDA": "a7only_bbench_audio.yaml", + "JOB_NAME": "$WA2_JOB_NAME", + "MODE": "a7only", + "SIGNAL_PREFIX": "a7only_bbench_audio-iter4" + }, + "testdef": "wa2host.yaml" + } + ], + "timeout": 4200 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "target", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "SIGNAL_PREFIX": "a7only_bbench_audio-iter4" + }, + "testdef": "wa2target.yaml" + } + ], + "timeout": 2400 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "host", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "AGENDA": "a7only_bbench_audio.yaml", + "JOB_NAME": "$WA2_JOB_NAME", + "MODE": "a7only", + "SIGNAL_PREFIX": "a7only_bbench_audio-iter5" + }, + "testdef": "wa2host.yaml" + } + ], + "timeout": 4200 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "target", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "SIGNAL_PREFIX": "a7only_bbench_audio-iter5" + }, + "testdef": "wa2target.yaml" + } + ], + "timeout": 2400 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/people/milosz.wasilewski/wa2-lava.git", + "testdef": "wa2host_postprocessing.yaml", + "parameters": { + "JOB_NAME": "$WA2_JOB_NAME" + } + } + ], + "timeout": 4200, + "role": "host" + } + }, + { + "command": "submit_results_on_host", + "parameters": { + "server": "http://validation.linaro.org/RPC2/", + "stream": "$BUNDLE_STREAM" + } + } + ], + "device_group": [ + { + "count": 1, + "device_type": "dummy-ssh", + "role": "host" + }, + { + "count": 1, + "device_type": "$DUT_TYPE", + "role": "target" + } + ], + "job_name": "$JOB_NAME", + "logging_level": "INFO", + "timeout": 1800 +} diff --git a/examples/wa2_hmp_andbench_t1.json b/examples/wa2_hmp_andbench_t1.json new file mode 100644 index 0000000..45340ff --- /dev/null +++ b/examples/wa2_hmp_andbench_t1.json @@ -0,0 +1,81 @@ +{ + "actions": [ + { + "command": "dummy_deploy", + "parameters": { + "target_type": "ubuntu" + } + }, + { + "command": "deploy_linaro_android_image", + "metadata": { + "android.build": "$ANDROID_META_BUILD", + "android.name": "$ANDROID_META_NAME", + "android.url": "$ANDROID_META_URL" + }, + "parameters": { + "boot": "$ANDROID_BOOT", + "data": "$ANDROID_DATA", + "role": "target", + "system": "$ANDROID_SYSTEM" + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "host", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "AGENDA": "hmp_andbench_t1.yaml", + "JOB_NAME": "$WA2_JOB_NAME", + "MODE": "mp", + "SIGNAL_PREFIX": "hmp_andbench_t1" + }, + "testdef": "wa2host.yaml" + } + ], + "timeout": 4200 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "target", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "SIGNAL_PREFIX": "hmp_andbench_t1" + }, + "testdef": "wa2target.yaml" + } + ], + "timeout": 2400 + } + }, + { + "command": "submit_results_on_host", + "parameters": { + "server": "http://validation.linaro.org/RPC2/", + "stream": "$BUNDLE_STREAM" + } + } + ], + "device_group": [ + { + "count": 1, + "device_type": "dummy-ssh", + "role": "host" + }, + { + "count": 1, + "device_type": "$DUT_TYPE", + "role": "target" + } + ], + "job_name": "$JOB_NAME", + "logging_level": "INFO", + "timeout": 1800 +}
\ No newline at end of file diff --git a/examples/wa2_hmp_andbench_t5.json b/examples/wa2_hmp_andbench_t5.json new file mode 100644 index 0000000..1d8f80c --- /dev/null +++ b/examples/wa2_hmp_andbench_t5.json @@ -0,0 +1,81 @@ +{ + "actions": [ + { + "command": "dummy_deploy", + "parameters": { + "target_type": "ubuntu" + } + }, + { + "command": "deploy_linaro_android_image", + "metadata": { + "android.build": "$ANDROID_META_BUILD", + "android.name": "$ANDROID_META_NAME", + "android.url": "$ANDROID_META_URL" + }, + "parameters": { + "boot": "$ANDROID_BOOT", + "data": "$ANDROID_DATA", + "role": "target", + "system": "$ANDROID_SYSTEM" + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "host", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "AGENDA": "hmp_andbench_t5.yaml", + "JOB_NAME": "$WA2_JOB_NAME", + "MODE": "mp", + "SIGNAL_PREFIX": "hmp_andbench_t5" + }, + "testdef": "wa2host.yaml" + } + ], + "timeout": 4200 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "target", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "SIGNAL_PREFIX": "hmp_andbench_t5" + }, + "testdef": "wa2target.yaml" + } + ], + "timeout": 2400 + } + }, + { + "command": "submit_results_on_host", + "parameters": { + "server": "http://validation.linaro.org/RPC2/", + "stream": "$BUNDLE_STREAM" + } + } + ], + "device_group": [ + { + "count": 1, + "device_type": "dummy-ssh", + "role": "host" + }, + { + "count": 1, + "device_type": "$DUT_TYPE", + "role": "target" + } + ], + "job_name": "$JOB_NAME", + "logging_level": "INFO", + "timeout": 1800 +}
\ No newline at end of file diff --git a/examples/wa2_hmp_antutu_4.json b/examples/wa2_hmp_antutu_4.json new file mode 100644 index 0000000..9495e27 --- /dev/null +++ b/examples/wa2_hmp_antutu_4.json @@ -0,0 +1,81 @@ +{ + "actions": [ + { + "command": "dummy_deploy", + "parameters": { + "target_type": "ubuntu" + } + }, + { + "command": "deploy_linaro_android_image", + "metadata": { + "android.build": "$ANDROID_META_BUILD", + "android.name": "$ANDROID_META_NAME", + "android.url": "$ANDROID_META_URL" + }, + "parameters": { + "boot": "$ANDROID_BOOT", + "data": "$ANDROID_DATA", + "role": "target", + "system": "$ANDROID_SYSTEM" + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "host", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "AGENDA": "hmp_antutu_4.0.3.yaml", + "JOB_NAME": "$WA2_JOB_NAME", + "MODE": "mp", + "SIGNAL_PREFIX": "hmp_antutu_4" + }, + "testdef": "wa2host.yaml" + } + ], + "timeout": 4200 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "target", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "SIGNAL_PREFIX": "hmp_antutu_4" + }, + "testdef": "wa2target.yaml" + } + ], + "timeout": 2400 + } + }, + { + "command": "submit_results_on_host", + "parameters": { + "server": "http://validation.linaro.org/RPC2/", + "stream": "$BUNDLE_STREAM" + } + } + ], + "device_group": [ + { + "count": 1, + "device_type": "dummy-ssh", + "role": "host" + }, + { + "count": 1, + "device_type": "$DUT_TYPE", + "role": "target" + } + ], + "job_name": "$JOB_NAME", + "logging_level": "INFO", + "timeout": 1800 +}
\ No newline at end of file diff --git a/examples/wa2_hmp_audio.json b/examples/wa2_hmp_audio.json new file mode 100644 index 0000000..889a206 --- /dev/null +++ b/examples/wa2_hmp_audio.json @@ -0,0 +1,81 @@ +{ + "actions": [ + { + "command": "dummy_deploy", + "parameters": { + "target_type": "ubuntu" + } + }, + { + "command": "deploy_linaro_android_image", + "metadata": { + "android.build": "$ANDROID_META_BUILD", + "android.name": "$ANDROID_META_NAME", + "android.url": "$ANDROID_META_URL" + }, + "parameters": { + "boot": "$ANDROID_BOOT", + "data": "$ANDROID_DATA", + "role": "target", + "system": "$ANDROID_SYSTEM" + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "host", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "AGENDA": "hmp_audio.yaml", + "JOB_NAME": "$WA2_JOB_NAME", + "MODE": "mp", + "SIGNAL_PREFIX": "hmp_audio" + }, + "testdef": "wa2host.yaml" + } + ], + "timeout": 4200 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "target", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "SIGNAL_PREFIX": "hmp_audio" + }, + "testdef": "wa2target.yaml" + } + ], + "timeout": 2400 + } + }, + { + "command": "submit_results_on_host", + "parameters": { + "server": "http://validation.linaro.org/RPC2/", + "stream": "$BUNDLE_STREAM" + } + } + ], + "device_group": [ + { + "count": 1, + "device_type": "dummy-ssh", + "role": "host" + }, + { + "count": 1, + "device_type": "$DUT_TYPE", + "role": "target" + } + ], + "job_name": "$JOB_NAME", + "logging_level": "INFO", + "timeout": 1800 +}
\ No newline at end of file diff --git a/examples/wa2_hmp_bbench_audio.json b/examples/wa2_hmp_bbench_audio.json new file mode 100644 index 0000000..94bcbe9 --- /dev/null +++ b/examples/wa2_hmp_bbench_audio.json @@ -0,0 +1,81 @@ +{ + "actions": [ + { + "command": "dummy_deploy", + "parameters": { + "target_type": "ubuntu" + } + }, + { + "command": "deploy_linaro_android_image", + "metadata": { + "android.build": "$ANDROID_META_BUILD", + "android.name": "$ANDROID_META_NAME", + "android.url": "$ANDROID_META_URL" + }, + "parameters": { + "boot": "$ANDROID_BOOT", + "data": "$ANDROID_DATA", + "role": "target", + "system": "$ANDROID_SYSTEM" + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "host", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "AGENDA": "hmp_bbench_audio.yaml", + "JOB_NAME": "$WA2_JOB_NAME", + "MODE": "mp", + "SIGNAL_PREFIX": "hmp_bbench_audio" + }, + "testdef": "wa2host.yaml" + } + ], + "timeout": 4200 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "target", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "SIGNAL_PREFIX": "hmp_bbench_audio" + }, + "testdef": "wa2target.yaml" + } + ], + "timeout": 2400 + } + }, + { + "command": "submit_results_on_host", + "parameters": { + "server": "http://validation.linaro.org/RPC2/", + "stream": "$BUNDLE_STREAM" + } + } + ], + "device_group": [ + { + "count": 1, + "device_type": "dummy-ssh", + "role": "host" + }, + { + "count": 1, + "device_type": "$DUT_TYPE", + "role": "target" + } + ], + "job_name": "$JOB_NAME", + "logging_level": "INFO", + "timeout": 1800 +}
\ No newline at end of file diff --git a/examples/wa2_hmp_benchmarkpi.json b/examples/wa2_hmp_benchmarkpi.json new file mode 100644 index 0000000..0e0d8bc --- /dev/null +++ b/examples/wa2_hmp_benchmarkpi.json @@ -0,0 +1,81 @@ +{ + "actions": [ + { + "command": "dummy_deploy", + "parameters": { + "target_type": "ubuntu" + } + }, + { + "command": "deploy_linaro_android_image", + "metadata": { + "android.build": "$ANDROID_META_BUILD", + "android.name": "$ANDROID_META_NAME", + "android.url": "$ANDROID_META_URL" + }, + "parameters": { + "boot": "$ANDROID_BOOT", + "data": "$ANDROID_DATA", + "role": "target", + "system": "$ANDROID_SYSTEM" + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "host", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "AGENDA": "hmp_benchmarkpi.yaml", + "JOB_NAME": "$WA2_JOB_NAME", + "MODE": "mp", + "SIGNAL_PREFIX": "hmp_benchmarkpi" + }, + "testdef": "wa2host.yaml" + } + ], + "timeout": 4200 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "target", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "SIGNAL_PREFIX": "hmp_benchmarkpi" + }, + "testdef": "wa2target.yaml" + } + ], + "timeout": 2400 + } + }, + { + "command": "submit_results_on_host", + "parameters": { + "server": "http://validation.linaro.org/RPC2/", + "stream": "$BUNDLE_STREAM" + } + } + ], + "device_group": [ + { + "count": 1, + "device_type": "dummy-ssh", + "role": "host" + }, + { + "count": 1, + "device_type": "$DUT_TYPE", + "role": "target" + } + ], + "job_name": "$JOB_NAME", + "logging_level": "INFO", + "timeout": 1800 +}
\ No newline at end of file diff --git a/examples/wa2_hmp_caffeinemark.json b/examples/wa2_hmp_caffeinemark.json new file mode 100644 index 0000000..500afb0 --- /dev/null +++ b/examples/wa2_hmp_caffeinemark.json @@ -0,0 +1,81 @@ +{ + "actions": [ + { + "command": "dummy_deploy", + "parameters": { + "target_type": "ubuntu" + } + }, + { + "command": "deploy_linaro_android_image", + "metadata": { + "android.build": "$ANDROID_META_BUILD", + "android.name": "$ANDROID_META_NAME", + "android.url": "$ANDROID_META_URL" + }, + "parameters": { + "boot": "$ANDROID_BOOT", + "data": "$ANDROID_DATA", + "role": "target", + "system": "$ANDROID_SYSTEM" + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "host", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "AGENDA": "hmp_caffeinemark.yaml", + "JOB_NAME": "$WA2_JOB_NAME", + "MODE": "mp", + "SIGNAL_PREFIX": "hmp_caffeinemark" + }, + "testdef": "wa2host.yaml" + } + ], + "timeout": 4200 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "target", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "SIGNAL_PREFIX": "hmp_caffeinemark" + }, + "testdef": "wa2target.yaml" + } + ], + "timeout": 2400 + } + }, + { + "command": "submit_results_on_host", + "parameters": { + "server": "http://validation.linaro.org/RPC2/", + "stream": "$BUNDLE_STREAM" + } + } + ], + "device_group": [ + { + "count": 1, + "device_type": "dummy-ssh", + "role": "host" + }, + { + "count": 1, + "device_type": "$DUT_TYPE", + "role": "target" + } + ], + "job_name": "$JOB_NAME", + "logging_level": "INFO", + "timeout": 1800 +}
\ No newline at end of file diff --git a/examples/wa2_hmp_cfbench.json b/examples/wa2_hmp_cfbench.json new file mode 100644 index 0000000..9e5d371 --- /dev/null +++ b/examples/wa2_hmp_cfbench.json @@ -0,0 +1,81 @@ +{ + "actions": [ + { + "command": "dummy_deploy", + "parameters": { + "target_type": "ubuntu" + } + }, + { + "command": "deploy_linaro_android_image", + "metadata": { + "android.build": "$ANDROID_META_BUILD", + "android.name": "$ANDROID_META_NAME", + "android.url": "$ANDROID_META_URL" + }, + "parameters": { + "boot": "$ANDROID_BOOT", + "data": "$ANDROID_DATA", + "role": "target", + "system": "$ANDROID_SYSTEM" + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "host", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "AGENDA": "hmp_cfbench.yaml", + "JOB_NAME": "$WA2_JOB_NAME", + "MODE": "mp", + "SIGNAL_PREFIX": "hmp_cfbench" + }, + "testdef": "wa2host.yaml" + } + ], + "timeout": 4200 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "target", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "SIGNAL_PREFIX": "hmp_cfbench" + }, + "testdef": "wa2target.yaml" + } + ], + "timeout": 2400 + } + }, + { + "command": "submit_results_on_host", + "parameters": { + "server": "http://validation.linaro.org/RPC2/", + "stream": "$BUNDLE_STREAM" + } + } + ], + "device_group": [ + { + "count": 1, + "device_type": "dummy-ssh", + "role": "host" + }, + { + "count": 1, + "device_type": "$DUT_TYPE", + "role": "target" + } + ], + "job_name": "$JOB_NAME", + "logging_level": "INFO", + "timeout": 1800 +}
\ No newline at end of file diff --git a/examples/wa2_hmp_geekbench3.json b/examples/wa2_hmp_geekbench3.json new file mode 100644 index 0000000..4e1e28c --- /dev/null +++ b/examples/wa2_hmp_geekbench3.json @@ -0,0 +1,81 @@ +{ + "actions": [ + { + "command": "dummy_deploy", + "parameters": { + "target_type": "ubuntu" + } + }, + { + "command": "deploy_linaro_android_image", + "metadata": { + "android.build": "$ANDROID_META_BUILD", + "android.name": "$ANDROID_META_NAME", + "android.url": "$ANDROID_META_URL" + }, + "parameters": { + "boot": "$ANDROID_BOOT", + "data": "$ANDROID_DATA", + "role": "target", + "system": "$ANDROID_SYSTEM" + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "host", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "AGENDA": "hmp_geekbench3.yaml", + "JOB_NAME": "$WA2_JOB_NAME", + "MODE": "mp", + "SIGNAL_PREFIX": "hmp_geekbench3" + }, + "testdef": "wa2host.yaml" + } + ], + "timeout": 4200 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "target", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "SIGNAL_PREFIX": "hmp_geekbench3" + }, + "testdef": "wa2target.yaml" + } + ], + "timeout": 2400 + } + }, + { + "command": "submit_results_on_host", + "parameters": { + "server": "http://validation.linaro.org/RPC2/", + "stream": "$BUNDLE_STREAM" + } + } + ], + "device_group": [ + { + "count": 1, + "device_type": "dummy-ssh", + "role": "host" + }, + { + "count": 1, + "device_type": "$DUT_TYPE", + "role": "target" + } + ], + "job_name": "$JOB_NAME", + "logging_level": "INFO", + "timeout": 1800 +}
\ No newline at end of file diff --git a/examples/wa2_hmp_linpack.json b/examples/wa2_hmp_linpack.json new file mode 100644 index 0000000..ce5a102 --- /dev/null +++ b/examples/wa2_hmp_linpack.json @@ -0,0 +1,81 @@ +{ + "actions": [ + { + "command": "dummy_deploy", + "parameters": { + "target_type": "ubuntu" + } + }, + { + "command": "deploy_linaro_android_image", + "metadata": { + "android.build": "$ANDROID_META_BUILD", + "android.name": "$ANDROID_META_NAME", + "android.url": "$ANDROID_META_URL" + }, + "parameters": { + "boot": "$ANDROID_BOOT", + "data": "$ANDROID_DATA", + "role": "target", + "system": "$ANDROID_SYSTEM" + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "host", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "AGENDA": "hmp_linpack.yaml", + "JOB_NAME": "$WA2_JOB_NAME", + "MODE": "mp", + "SIGNAL_PREFIX": "hmp_linpack" + }, + "testdef": "wa2host.yaml" + } + ], + "timeout": 4200 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "target", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "SIGNAL_PREFIX": "hmp_linpack" + }, + "testdef": "wa2target.yaml" + } + ], + "timeout": 2400 + } + }, + { + "command": "submit_results_on_host", + "parameters": { + "server": "http://validation.linaro.org/RPC2/", + "stream": "$BUNDLE_STREAM" + } + } + ], + "device_group": [ + { + "count": 1, + "device_type": "dummy-ssh", + "role": "host" + }, + { + "count": 1, + "device_type": "$DUT_TYPE", + "role": "target" + } + ], + "job_name": "$JOB_NAME", + "logging_level": "INFO", + "timeout": 1800 +}
\ No newline at end of file diff --git a/examples/wa2_hmp_quadrant.json b/examples/wa2_hmp_quadrant.json new file mode 100644 index 0000000..5131a9f --- /dev/null +++ b/examples/wa2_hmp_quadrant.json @@ -0,0 +1,81 @@ +{ + "actions": [ + { + "command": "dummy_deploy", + "parameters": { + "target_type": "ubuntu" + } + }, + { + "command": "deploy_linaro_android_image", + "metadata": { + "android.build": "$ANDROID_META_BUILD", + "android.name": "$ANDROID_META_NAME", + "android.url": "$ANDROID_META_URL" + }, + "parameters": { + "boot": "$ANDROID_BOOT", + "data": "$ANDROID_DATA", + "role": "target", + "system": "$ANDROID_SYSTEM" + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "host", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "AGENDA": "hmp_quadrant.yaml", + "JOB_NAME": "$WA2_JOB_NAME", + "MODE": "mp", + "SIGNAL_PREFIX": "hmp_quadrant" + }, + "testdef": "wa2host.yaml" + } + ], + "timeout": 4200 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "target", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "SIGNAL_PREFIX": "hmp_quadrant" + }, + "testdef": "wa2target.yaml" + } + ], + "timeout": 2400 + } + }, + { + "command": "submit_results_on_host", + "parameters": { + "server": "http://validation.linaro.org/RPC2/", + "stream": "$BUNDLE_STREAM" + } + } + ], + "device_group": [ + { + "count": 1, + "device_type": "dummy-ssh", + "role": "host" + }, + { + "count": 1, + "device_type": "$DUT_TYPE", + "role": "target" + } + ], + "job_name": "$JOB_NAME", + "logging_level": "INFO", + "timeout": 1800 +}
\ No newline at end of file diff --git a/examples/wa2_hmp_smartbench.json b/examples/wa2_hmp_smartbench.json new file mode 100644 index 0000000..8839ac5 --- /dev/null +++ b/examples/wa2_hmp_smartbench.json @@ -0,0 +1,81 @@ +{ + "actions": [ + { + "command": "dummy_deploy", + "parameters": { + "target_type": "ubuntu" + } + }, + { + "command": "deploy_linaro_android_image", + "metadata": { + "android.build": "$ANDROID_META_BUILD", + "android.name": "$ANDROID_META_NAME", + "android.url": "$ANDROID_META_URL" + }, + "parameters": { + "boot": "$ANDROID_BOOT", + "data": "$ANDROID_DATA", + "role": "target", + "system": "$ANDROID_SYSTEM" + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "host", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "AGENDA": "hmp_smartbench.yaml", + "JOB_NAME": "$WA2_JOB_NAME", + "MODE": "mp", + "SIGNAL_PREFIX": "hmp_smartbench" + }, + "testdef": "wa2host.yaml" + } + ], + "timeout": 4200 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "target", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "SIGNAL_PREFIX": "hmp_smartbench" + }, + "testdef": "wa2target.yaml" + } + ], + "timeout": 2400 + } + }, + { + "command": "submit_results_on_host", + "parameters": { + "server": "http://validation.linaro.org/RPC2/", + "stream": "$BUNDLE_STREAM" + } + } + ], + "device_group": [ + { + "count": 1, + "device_type": "dummy-ssh", + "role": "host" + }, + { + "count": 1, + "device_type": "$DUT_TYPE", + "role": "target" + } + ], + "job_name": "$JOB_NAME", + "logging_level": "INFO", + "timeout": 1800 +}
\ No newline at end of file diff --git a/examples/wa2_hmp_sqlite.json b/examples/wa2_hmp_sqlite.json new file mode 100644 index 0000000..a5f4b45 --- /dev/null +++ b/examples/wa2_hmp_sqlite.json @@ -0,0 +1,81 @@ +{ + "actions": [ + { + "command": "dummy_deploy", + "parameters": { + "target_type": "ubuntu" + } + }, + { + "command": "deploy_linaro_android_image", + "metadata": { + "android.build": "$ANDROID_META_BUILD", + "android.name": "$ANDROID_META_NAME", + "android.url": "$ANDROID_META_URL" + }, + "parameters": { + "boot": "$ANDROID_BOOT", + "data": "$ANDROID_DATA", + "role": "target", + "system": "$ANDROID_SYSTEM" + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "host", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "AGENDA": "hmp_sqlite.yaml", + "JOB_NAME": "$WA2_JOB_NAME", + "MODE": "mp", + "SIGNAL_PREFIX": "hmp_sqlite" + }, + "testdef": "wa2host.yaml" + } + ], + "timeout": 4200 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "target", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "SIGNAL_PREFIX": "hmp_sqlite" + }, + "testdef": "wa2target.yaml" + } + ], + "timeout": 2400 + } + }, + { + "command": "submit_results_on_host", + "parameters": { + "server": "http://validation.linaro.org/RPC2/", + "stream": "$BUNDLE_STREAM" + } + } + ], + "device_group": [ + { + "count": 1, + "device_type": "dummy-ssh", + "role": "host" + }, + { + "count": 1, + "device_type": "$DUT_TYPE", + "role": "target" + } + ], + "job_name": "$JOB_NAME", + "logging_level": "INFO", + "timeout": 1800 +}
\ No newline at end of file diff --git a/examples/wa2_hmp_vellamo.json b/examples/wa2_hmp_vellamo.json new file mode 100644 index 0000000..e3f5453 --- /dev/null +++ b/examples/wa2_hmp_vellamo.json @@ -0,0 +1,81 @@ +{ + "actions": [ + { + "command": "dummy_deploy", + "parameters": { + "target_type": "ubuntu" + } + }, + { + "command": "deploy_linaro_android_image", + "metadata": { + "android.build": "$ANDROID_META_BUILD", + "android.name": "$ANDROID_META_NAME", + "android.url": "$ANDROID_META_URL" + }, + "parameters": { + "boot": "$ANDROID_BOOT", + "data": "$ANDROID_DATA", + "role": "target", + "system": "$ANDROID_SYSTEM" + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "host", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "AGENDA": "hmp_vellamo.yaml", + "JOB_NAME": "$WA2_JOB_NAME", + "MODE": "mp", + "SIGNAL_PREFIX": "hmp_vellamo" + }, + "testdef": "wa2host.yaml" + } + ], + "timeout": 4200 + } + }, + { + "command": "lava_test_shell", + "parameters": { + "role": "target", + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "parameters": { + "SIGNAL_PREFIX": "hmp_vellamo" + }, + "testdef": "wa2target.yaml" + } + ], + "timeout": 2400 + } + }, + { + "command": "submit_results_on_host", + "parameters": { + "server": "http://validation.linaro.org/RPC2/", + "stream": "$BUNDLE_STREAM" + } + } + ], + "device_group": [ + { + "count": 1, + "device_type": "dummy-ssh", + "role": "host" + }, + { + "count": 1, + "device_type": "$DUT_TYPE", + "role": "target" + } + ], + "job_name": "$JOB_NAME", + "logging_level": "INFO", + "timeout": 1800 +}
\ No newline at end of file diff --git a/examples/wa2_postprocessing.json b/examples/wa2_postprocessing.json new file mode 100644 index 0000000..2a2f3b0 --- /dev/null +++ b/examples/wa2_postprocessing.json @@ -0,0 +1,37 @@ +{ + "logging_level": "INFO", + "timeout": 1800, + "job_name": "$JOB_NAME", + "device_type": "dummy-ssh", + "actions": [ + { + "command": "dummy_deploy", + "parameters": { + "target_type": "ubuntu" + } + }, + { + "command": "lava_test_shell", + "parameters": { + "testdef_repos": [ + { + "git-repo": "git://git.linaro.org/qa/wa2-lava.git", + "testdef": "wa2host_postprocessing.yaml", + "parameters": { + "JOB_NAME": "$WA2_JOB_NAME" + } + } + ], + "timeout": 4200, + "role": "host" + } + }, + { + "command": "submit_results_on_host", + "parameters": { + "stream": "$BUNDLE_STREAM", + "server": "http://validation.linaro.org/RPC2/" + } + } + ] +} diff --git a/postprocessing.py b/postprocessing.py new file mode 100755 index 0000000..713e0b3 --- /dev/null +++ b/postprocessing.py @@ -0,0 +1,79 @@ +#!/usr/bin/env python +# +# Workload Automation v2 for LAVA +# +# Copyright (C) 2014, Linaro Limited. +# +# This program is free software; you can redistribute it and/or +# modify it under the terms of the GNU General Public License +# as published by the Free Software Foundation; either version 2 +# of the License, or (at your option) any later version. +# +# This program is distributed in the hope that it will be useful, +# but WITHOUT ANY WARRANTY; without even the implied warranty of +# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the +# GNU General Public License for more details. +# +# You should have received a copy of the GNU General Public License +# along with this program; if not, write to the Free Software +# Foundation, Inc., 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301, USA. +# +# Author: Milosz Wasilewski <milosz.wasilewski@linaro.org> +# + +import sqlite3 +from copy import deepcopy +from numpy import array, mean +from optparse import OptionParser + +SQLITE_DB_GLOBAL_PATH = "/root/db_results/" +VALUE = 'value' +UNIT = 'unit' + +modes_prepares_statement = "select distinct(id) from workload_specs;" +metric_prepared_statement = """ +SELECT label as workload, metric, value, units, wsr.spec_id +FROM metrics AS m INNER JOIN ( +SELECT ws.OID as spec_oid, ws.id as spec_id, uuid, label +FROM workload_specs AS ws INNER JOIN runs AS r ON ws.run_oid = r.OID +) AS wsr ON wsr.spec_oid = m.spec_oid +WHERE spec_id = ?;""" + +if __name__ == '__main__': + + usage = "usage: %prog [OPTIONS]" + parser = OptionParser(usage=usage) + parser.add_option("-n", "--job-name", dest="job_name", + help="Job name to be used as db name in agenda file") + (options, args) = parser.parse_args() + + if not options.job_name: + parser.error("Job name missing") + + conn = sqlite3.connect(SQLITE_DB_GLOBAL_PATH + options.job_name + ".db") + modes_cursor = conn.cursor() + metrics = {} + for mode_row in modes_cursor.execute(modes_prepares_statement): + metric_cursor = conn.cursor() + metrics[mode_row[0]] = {} + for metric_row in metric_cursor.execute( + metric_prepared_statement, + (mode_row[0], )): + print metric_row + if metric_row[1] in metrics[mode_row[0]]: + metrics[mode_row[0]][metric_row[1]][VALUE].append( + float(metric_row[2])) + else: + metrics[mode_row[0]][metric_row[1]] = { + VALUE: [float(metric_row[2])], + UNIT: metric_row[3]} + metric_cursor.close() + modes_cursor.close() + conn.close() + for key in metrics.iterkeys(): + for metric in metrics[key].iterkeys(): + print "%s_%s Measurement:%s Units:%s Result:pass" % ( + key, + metric.replace(" ", "_").replace(",", "_"), + mean(array(metrics[key][metric][VALUE])), + metrics[key][metric][UNIT]) diff --git a/prepare-agenda.py b/prepare-agenda.py new file mode 100755 index 0000000..061be7f --- /dev/null +++ b/prepare-agenda.py @@ -0,0 +1,52 @@ +#!/usr/bin/env python +# +# Workload Automation v2 for LAVA +# +# Copyright (C) 2014, Linaro Limited. +# +# This program is free software; you can redistribute it and/or +# modify it under the terms of the GNU General Public License +# as published by the Free Software Foundation; either version 2 +# of the License, or (at your option) any later version. +# +# This program is distributed in the hope that it will be useful, +# but WITHOUT ANY WARRANTY; without even the implied warranty of +# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the +# GNU General Public License for more details. +# +# You should have received a copy of the GNU General Public License +# along with this program; if not, write to the Free Software +# Foundation, Inc., 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301, USA. +# +# Author: Milosz Wasilewski <milosz.wasilewski@linaro.org> +# + +import yaml +from optparse import OptionParser + +TEMPLATE_PATH = "templates/" +SQLITE_DB_GLOBAL_PATH = "/root/db_results/" +SQLITE_DB = 'sqlite_database' +CONFIG = 'config' + +if __name__ == '__main__': + + usage = "usage: %prog [OPTIONS]" + parser = OptionParser(usage=usage) + parser.add_option("-a", "--agenda", dest="agenda", + help="Agenda file template to be used") + parser.add_option("-n", "--job-name", dest="job_name", + help="Job name to be used as db name in agenda file") + (options, args) = parser.parse_args() + + if not options.agenda: + parser.error("Agenda name missing") + if not options.job_name: + parser.error("Job name missing") + + agenda = open(TEMPLATE_PATH + options.agenda, "r") + agenda_yaml = yaml.load(agenda) + agenda_yaml[CONFIG][SQLITE_DB] = SQLITE_DB_GLOBAL_PATH + options.job_name + ".db" + agenda.close() + with open(options.agenda, 'w') as outfile: + outfile.write( yaml.dump(agenda_yaml, default_flow_style=True) ) diff --git a/prepare-config.py b/prepare-config.py new file mode 100755 index 0000000..397c7f5 --- /dev/null +++ b/prepare-config.py @@ -0,0 +1,66 @@ +#!/usr/bin/env python +# +# Workload Automation v2 for LAVA +# +# Copyright (C) 2014, Linaro Limited. +# +# This program is free software; you can redistribute it and/or +# modify it under the terms of the GNU General Public License +# as published by the Free Software Foundation; either version 2 +# of the License, or (at your option) any later version. +# +# This program is distributed in the hope that it will be useful, +# but WITHOUT ANY WARRANTY; without even the implied warranty of +# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the +# GNU General Public License for more details. +# +# You should have received a copy of the GNU General Public License +# along with this program; if not, write to the Free Software +# Foundation, Inc., 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301, USA. +# +# Author: Milosz Wasilewski <milosz.wasilewski@linaro.org> +# + +import re +import sys +from string import Template +from optparse import OptionParser + +TEMPLATE_PATH = "templates/" +CONFIG_NAME = "config.py" +CONFIG_PATH = TEMPLATE_PATH + CONFIG_NAME +LAVA_CACHE_PATH = "/tmp/lava_multi_node_cache.txt" +IPADDR_FILE = "IPADDR" +IPADDR = "-ipaddr" + +if __name__ == '__main__': + usage = "usage: %prog [OPTIONS]" + parser = OptionParser(usage=usage) + parser.add_option("-p", "--prefix", dest="prefix", + help="Signal prefix used in the multinode job to retrieve IP address") + (options, args) = parser.parse_args() + + if not options.prefix: + parser.error("Prefix missing") + + lava_cache_file = open(LAVA_CACHE_PATH, 'r') + lava_cache_regexp = re.compile("^(?P<device_id>[a-zA-Z0-9_\-]+):(?P<key>[a-zA-Z0-9_\-]+)=(?P<value>.*)$") + ipaddr = None + for line in lava_cache_file.readlines(): + print line + lava_cache_match = lava_cache_regexp.search(line) + if lava_cache_match: + if lava_cache_match.group("key") == options.prefix + IPADDR: + ipaddr = lava_cache_match.group("value") + ipaddr_file = open(IPADDR_FILE, "w") + ipaddr_file.write(ipaddr) + ipaddr_file.close() + lava_cache_file.close() + if not ipaddr: + sys.exit(1) + config = open(CONFIG_PATH, "r") + config_template = Template(config.read()) + config.close() + dest_config = open(CONFIG_NAME, "w") + dest_config.write(config_template.safe_substitute(ipaddr=ipaddr + ":5555")) + dest_config.close() diff --git a/prepare-device.sh b/prepare-device.sh new file mode 100755 index 0000000..8d2759b --- /dev/null +++ b/prepare-device.sh @@ -0,0 +1,135 @@ +#!/bin/bash +# +# Workload Automation v2 for LAVA +# +# Copyright (C) 2014, Linaro Limited. +# +# This program is free software; you can redistribute it and/or +# modify it under the terms of the GNU General Public License +# as published by the Free Software Foundation; either version 2 +# of the License, or (at your option) any later version. +# +# This program is distributed in the hope that it will be useful, +# but WITHOUT ANY WARRANTY; without even the implied warranty of +# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the +# GNU General Public License for more details. +# +# You should have received a copy of the GNU General Public License +# along with this program; if not, write to the Free Software +# Foundation, Inc., 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301, USA. +# +# Author: Milosz Wasilewski <milosz.wasilewski@linaro.org> +# + +set -e +echo "Preparing device for mode: $1" + +if [ $1 == 'iks' ] +then + # enable IKS + IPADDR=`cat IPADDR` + echo "Enable IKS for $IPADDR" + adb root | true + adb connect $IPADDR:5555 + adb devices + echo "Waiting for device" + adb wait-for-device + echo "adb -s $IPADDR:5555 shell \"echo 1 > /sys/kernel/bL_switcher/active\"" + adb -s $IPADDR:5555 shell "echo 1 > /sys/kernel/bL_switcher/active" + adb -s $IPADDR:5555 shell "cat /sys/kernel/bL_switcher/active" +fi + +if [ $1 == 'a7only' ] +then + # disable IKS + IPADDR=`cat IPADDR` + echo "Disable IKS for $IPADDR" + adb root | true + adb connect $IPADDR:5555 + adb devices + echo "Waiting for device" + adb wait-for-device + echo "adb -s $IPADDR:5555 shell \"echo 0 > /sys/kernel/bL_switcher/active\"" + adb -s $IPADDR:5555 shell "echo 0 > /sys/kernel/bL_switcher/active" + adb -s $IPADDR:5555 shell "cat /sys/kernel/bL_switcher/active" + echo "Disable A15 cluster" + adb -s $IPADDR:5555 shell "echo 0 > /sys/devices/system/cpu/cpu3/online" + adb -s $IPADDR:5555 shell "echo 0 > /sys/devices/system/cpu/cpu4/online" +fi + +if [ $1 == 'a15only' ] +then + # disable IKS + IPADDR=`cat IPADDR` + echo "Disable IKS for $IPADDR" + adb root | true + adb connect $IPADDR:5555 + adb devices + echo "Waiting for device" + adb wait-for-device + echo "adb -s $IPADDR:5555 shell \"echo 0 > /sys/kernel/bL_switcher/active\"" + adb -s $IPADDR:5555 shell "echo 0 > /sys/kernel/bL_switcher/active" + adb -s $IPADDR:5555 shell "cat /sys/kernel/bL_switcher/active" + echo "Disable A7 cluster" + adb -s $IPADDR:5555 shell "echo 0 > /sys/devices/system/cpu/cpu0/online" + adb -s $IPADDR:5555 shell "echo 0 > /sys/devices/system/cpu/cpu1/online" + adb -s $IPADDR:5555 shell "echo 0 > /sys/devices/system/cpu/cpu2/online" +fi + +if [ $1 == 'a53_only' ] +then + IPADDR=`cat IPADDR` + adb root | true + adb connect $IPADDR:5555 + adb devices + echo "Waiting for device" + adb remount | true + adb wait-for-device + adb devices + echo "Disable A57 cluster" + adb -s $IPADDR:5555 shell "echo 0 > /sys/devices/system/cpu/cpu4/online | su" + adb -s $IPADDR:5555 shell "echo 0 > /sys/devices/system/cpu/cpu5/online | su" +fi + +if [ $1 == 'a57_only' ] +then + IPADDR=`cat IPADDR` + adb root | true + adb connect $IPADDR:5555 + adb devices + echo "Waiting for device" + adb remount | true + adb wait-for-device + adb devices + echo "Disable A53 cluster" + adb -s $IPADDR:5555 shell "echo 0 > /sys/devices/system/cpu/cpu0/online | su" + adb -s $IPADDR:5555 shell "echo 0 > /sys/devices/system/cpu/cpu1/online | su" + adb -s $IPADDR:5555 shell "echo 0 > /sys/devices/system/cpu/cpu2/online | su" + adb -s $IPADDR:5555 shell "echo 0 > /sys/devices/system/cpu/cpu3/online | su" +fi + +if [ $1 == 'hmp' ] +then + IPADDR=`cat IPADDR` + adb root | true + adb connect $IPADDR:5555 + adb devices + echo "Waiting for device" + adb remount | true + adb wait-for-device + adb devices +fi + +if [ $1 == 'eas' ] +then + IPADDR=`cat IPADDR` + adb root | true + adb connect $IPADDR:5555 + adb devices + echo "Waiting for device" + adb remount | true + adb wait-for-device + adb devices +fi + +exit 0 diff --git a/run-workload.sh b/run-workload.sh new file mode 100755 index 0000000..852eeb6 --- /dev/null +++ b/run-workload.sh @@ -0,0 +1,52 @@ +#!/bin/bash +# +# Workload Automation v2 for LAVA +# +# Copyright (C) 2014, Linaro Limited. +# +# This program is free software; you can redistribute it and/or +# modify it under the terms of the GNU General Public License +# as published by the Free Software Foundation; either version 2 +# of the License, or (at your option) any later version. +# +# This program is distributed in the hope that it will be useful, +# but WITHOUT ANY WARRANTY; without even the implied warranty of +# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the +# GNU General Public License for more details. +# +# You should have received a copy of the GNU General Public License +# along with this program; if not, write to the Free Software +# Foundation, Inc., 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301, USA. +# +# Author: Milosz Wasilewski <milosz.wasilewski@linaro.org> +# + +echo -e "PWD" +echo -e "**********************\n" +pwd +echo -e "**********************\n" +echo -e "Directory contents" +echo -e "**********************\n" +ls -la +echo -e "**********************\n" +echo -e "Agenda" +echo -e "**********************\n" +cat $1 +echo -e "**********************\n" +echo -e "CPU status" +echo -e "**********************\n" +IPADDR=`cat IPADDR` +adb -s $IPADDR:5555 shell "cat /proc/cpuinfo" +echo -n "online: " +adb -s $IPADDR:5555 shell "cat /sys/devices/system/cpu/online" +echo -n "offline: " +adb -s $IPADDR:5555 shell "cat /sys/devices/system/cpu/offline" +echo -n "possible: " +adb -s $IPADDR:5555 shell "cat /sys/devices/system/cpu/possible" + +echo -n "IKS enabled: " +adb -s $IPADDR:5555 shell "cat /sys/kernel/bL_switcher/active" +echo -e "**********************\n" + +wa run $1 -v -f -d $2 -c config.py +exit 0 diff --git a/tear-down.sh b/tear-down.sh new file mode 100755 index 0000000..ad529e8 --- /dev/null +++ b/tear-down.sh @@ -0,0 +1,7 @@ +#!/bin/bash + +IPADDR=`cat IPADDR` +adb devices +echo "Disconnecting adb from $IPADDR:5555" +adb disconnect $IPADDR:5555 +adb devices diff --git a/templates/a15only_andbench_t1.yaml b/templates/a15only_andbench_t1.yaml new file mode 100644 index 0000000..24ddc11 --- /dev/null +++ b/templates/a15only_andbench_t1.yaml @@ -0,0 +1,15 @@ +config: + result_processors: + - csv + - sqlite + sqlite_database: my_database.db +global: + iterations: 1 +workloads: + - id: 1a_a15 + runtime_parameters: + a15_governor_tunables: + above_hispeed_delay: 20000 + workload_name: andebench + workload_parameters: + number_of_threads: 1 diff --git a/templates/a15only_andbench_t5.yaml b/templates/a15only_andbench_t5.yaml new file mode 100644 index 0000000..436890d --- /dev/null +++ b/templates/a15only_andbench_t5.yaml @@ -0,0 +1,15 @@ +config: + result_processors: + - csv + - sqlite + sqlite_database: my_database.db +global: + iterations: 1 +workloads: + - id: 1a_a15 + runtime_parameters: + a15_governor_tunables: + above_hispeed_delay: 20000 + workload_name: andebench + workload_parameters: + number_of_threads: 5 diff --git a/templates/a15only_antutu_4.0.3.yaml b/templates/a15only_antutu_4.0.3.yaml new file mode 100644 index 0000000..bebe4c7 --- /dev/null +++ b/templates/a15only_antutu_4.0.3.yaml @@ -0,0 +1,16 @@ +config: + result_processors: + - csv + - sqlite + sqlite_database: my_database.db +global: + iterations: 5 +workloads: + - id: 1c_a15 + label: antutu4.0.3 + runtime_parameters: + a15_governor_tunables: + above_hispeed_delay: 20000 + workload_name: antutu + workload_parameters: + version: 4.0.3 diff --git a/templates/a15only_audio.yaml b/templates/a15only_audio.yaml new file mode 100644 index 0000000..de1ada9 --- /dev/null +++ b/templates/a15only_audio.yaml @@ -0,0 +1,13 @@ +config: + result_processors: + - csv + - sqlite + sqlite_database: my_database.db +global: + iterations: 1 +workloads: + - id: 1b_a15_audio + runtime_parameters: + a15_governor_tunables: + above_hispeed_delay: 20000 + workload_name: audio diff --git a/templates/a15only_bbench_audio.yaml b/templates/a15only_bbench_audio.yaml new file mode 100644 index 0000000..01d8b46 --- /dev/null +++ b/templates/a15only_bbench_audio.yaml @@ -0,0 +1,15 @@ +config: + result_processors: + - csv + - sqlite + sqlite_database: my_database.db +global: + iterations: 1 +workloads: + - id: 1a_a15_bbench_audio + runtime_parameters: + a15_governor_tunables: + above_hispeed_delay: 20000 + workload_name: bbench + workload_parameters: + with_audio: true diff --git a/templates/a15only_benchmarkpi.yaml b/templates/a15only_benchmarkpi.yaml new file mode 100644 index 0000000..d28e661 --- /dev/null +++ b/templates/a15only_benchmarkpi.yaml @@ -0,0 +1,13 @@ +config: + result_processors: + - csv + - sqlite + sqlite_database: my_database.db +global: + iterations: 5 +workloads: + - id: 1e_a15 + runtime_parameters: + a15_governor_tunables: + above_hispeed_delay: 20000 + workload_name: benchmarkpi diff --git a/templates/a15only_caffeinemark.yaml b/templates/a15only_caffeinemark.yaml new file mode 100644 index 0000000..a5385d3 --- /dev/null +++ b/templates/a15only_caffeinemark.yaml @@ -0,0 +1,13 @@ +config: + result_processors: + - csv + - sqlite + sqlite_database: my_database.db +global: + iterations: 1 +workloads: + - id: 1f_a15 + runtime_parameters: + a15_governor_tunables: + above_hispeed_delay: 20000 + workload_name: caffeinemark diff --git a/templates/a15only_cfbench.yaml b/templates/a15only_cfbench.yaml new file mode 100644 index 0000000..c5d5747 --- /dev/null +++ b/templates/a15only_cfbench.yaml @@ -0,0 +1,13 @@ +config: + result_processors: + - csv + - sqlite + sqlite_database: my_database.db +global: + iterations: 1 +workloads: + - id: 1g_a15 + runtime_parameters: + a15_governor_tunables: + above_hispeed_delay: 20000 + workload_name: cfbench diff --git a/templates/a15only_geekbench3.yaml b/templates/a15only_geekbench3.yaml new file mode 100644 index 0000000..f4bf77f --- /dev/null +++ b/templates/a15only_geekbench3.yaml @@ -0,0 +1,16 @@ +config: + result_processors: + - csv + - sqlite + sqlite_database: my_database.db +global: + iterations: 1 +workloads: + - id: 1h_a15 + label: geekbench3 + runtime_parameters: + a15_governor_tunables: + above_hispeed_delay: 20000 + workload_name: geekbench + workload_parameters: + version: 3 diff --git a/templates/a15only_linpack.yaml b/templates/a15only_linpack.yaml new file mode 100644 index 0000000..b0006ca --- /dev/null +++ b/templates/a15only_linpack.yaml @@ -0,0 +1,13 @@ +config: + result_processors: + - csv + - sqlite + sqlite_database: my_database.db +global: + iterations: 1 +workloads: + - id: 1i_a15 + runtime_parameters: + a15_governor_tunables: + above_hispeed_delay: 20000 + workload_name: linpack diff --git a/templates/a15only_quadrant.yaml b/templates/a15only_quadrant.yaml new file mode 100644 index 0000000..e4100a1 --- /dev/null +++ b/templates/a15only_quadrant.yaml @@ -0,0 +1,13 @@ +config: + result_processors: + - csv + - sqlite + sqlite_database: my_database.db +global: + iterations: 1 +workloads: + - id: 1j_a15 + runtime_parameters: + a15_governor_tunables: + above_hispeed_delay: 20000 + workload_name: quadrant diff --git a/templates/a15only_smartbench.yaml b/templates/a15only_smartbench.yaml new file mode 100644 index 0000000..ed28014 --- /dev/null +++ b/templates/a15only_smartbench.yaml @@ -0,0 +1,13 @@ +config: + result_processors: + - csv + - sqlite + sqlite_database: my_database.db +global: + iterations: 1 +workloads: + - id: 1k_a15 + runtime_parameters: + a15_governor_tunables: + above_hispeed_delay: 20000 + workload_name: smartbench diff --git a/templates/a15only_sqlite.yaml b/templates/a15only_sqlite.yaml new file mode 100644 index 0000000..11de209 --- /dev/null +++ b/templates/a15only_sqlite.yaml @@ -0,0 +1,13 @@ +config: + result_processors: + - csv + - sqlite + sqlite_database: my_database.db +global: + iterations: 1 +workloads: + - id: 1l_a15 + runtime_parameters: + a15_governor_tunables: + above_hispeed_delay: 20000 + workload_name: sqlite diff --git a/templates/a15only_vellamo.yaml b/templates/a15only_vellamo.yaml new file mode 100644 index 0000000..18a0e57 --- /dev/null +++ b/templates/a15only_vellamo.yaml @@ -0,0 +1,13 @@ +config: + result_processors: + - csv + - sqlite + sqlite_database: my_database.db +global: + iterations: 1 +workloads: + - id: 1o_a15 + runtime_parameters: + a15_governor_tunables: + above_hispeed_delay: 20000 + workload_name: vellamo diff --git a/templates/a53_only_andbench_t1.yaml b/templates/a53_only_andbench_t1.yaml new file mode 100644 index 0000000..6e08ea3 --- /dev/null +++ b/templates/a53_only_andbench_t1.yaml @@ -0,0 +1,12 @@ +config: + device: Juno + run_name: big.LITTLE_benchmarks_regression +global: + iterations: 1 +sections: + - id: a53_only +workloads: + - id: andbench_t1 + name: andebench + workload_parameters: + number_of_threads: 1 diff --git a/templates/a53_only_andbench_t5.yaml b/templates/a53_only_andbench_t5.yaml new file mode 100644 index 0000000..00305c7 --- /dev/null +++ b/templates/a53_only_andbench_t5.yaml @@ -0,0 +1,12 @@ +config: + device: Juno + run_name: big.LITTLE_benchmarks_regression +global: + iterations: 1 +sections: + - id: a53_only +workloads: + - id: andbench_t5 + name: andebench + workload_parameters: + number_of_threads: 5 diff --git a/templates/a53_only_antutu_4.0.3.yaml b/templates/a53_only_antutu_4.0.3.yaml new file mode 100644 index 0000000..54a605e --- /dev/null +++ b/templates/a53_only_antutu_4.0.3.yaml @@ -0,0 +1,13 @@ +config: + device: Juno + run_name: big.LITTLE_benchmarks_regression +global: + iterations: 1 +sections: + - id: a53_only +workloads: + - id: antutu + name: antutu + label: antutu4.0.3 + workload_parameters: + version: 4.0.3 diff --git a/templates/a53_only_audio.yaml b/templates/a53_only_audio.yaml new file mode 100644 index 0000000..84506fe --- /dev/null +++ b/templates/a53_only_audio.yaml @@ -0,0 +1,10 @@ +config: + device: Juno + run_name: big.LITTLE_Workloads_regression +global: + iterations: 1 +sections: + - id: a53_only +workloads: + - id: w02 + name: audio diff --git a/templates/a53_only_bbench_audio.yaml b/templates/a53_only_bbench_audio.yaml new file mode 100644 index 0000000..efeecf0 --- /dev/null +++ b/templates/a53_only_bbench_audio.yaml @@ -0,0 +1,10 @@ +config: + device: Juno + run_name: big.LITTLE_Workloads_regression +global: + iterations: 1 +sections: + - id: a53_only +workloads: + - id: w01 + name: bbench_with_audio diff --git a/templates/a53_only_benchmarkpi.yaml b/templates/a53_only_benchmarkpi.yaml new file mode 100644 index 0000000..b6e1eb8 --- /dev/null +++ b/templates/a53_only_benchmarkpi.yaml @@ -0,0 +1,10 @@ +config: + device: Juno + run_name: big.LITTLE_benchmarks_regression +global: + iterations: 1 +sections: + - id: a53_only +workloads: + - id: benchmarkpi + name: benchmarkpi diff --git a/templates/a53_only_caffeinemark.yaml b/templates/a53_only_caffeinemark.yaml new file mode 100644 index 0000000..7c0b8f9 --- /dev/null +++ b/templates/a53_only_caffeinemark.yaml @@ -0,0 +1,10 @@ +config: + device: Juno + run_name: big.LITTLE_benchmarks_regression +global: + iterations: 1 +sections: + - id: a53_only +workloads: + - id: caffeinemark + name: caffeinemark diff --git a/templates/a53_only_cfbench.yaml b/templates/a53_only_cfbench.yaml new file mode 100644 index 0000000..77a9ef9 --- /dev/null +++ b/templates/a53_only_cfbench.yaml @@ -0,0 +1,10 @@ +config: + device: Juno + run_name: big.LITTLE_benchmarks_regression +global: + iterations: 1 +sections: + - id: a53_only +workloads: + - id: cfbench + name: cfbench diff --git a/templates/a53_only_geekbench3.yaml b/templates/a53_only_geekbench3.yaml new file mode 100644 index 0000000..307eeb7 --- /dev/null +++ b/templates/a53_only_geekbench3.yaml @@ -0,0 +1,13 @@ +config: + device: Juno + run_name: big.LITTLE_benchmarks_regression +global: + iterations: 1 +sections: + - id: a53_only +workloads: + - id: geekbench3 + name: geekbench + label: geekbench3 + workload_parameters: + version: 3 diff --git a/templates/a53_only_glbenchmark_egypt_off_screen.yaml b/templates/a53_only_glbenchmark_egypt_off_screen.yaml new file mode 100644 index 0000000..b223d57 --- /dev/null +++ b/templates/a53_only_glbenchmark_egypt_off_screen.yaml @@ -0,0 +1,14 @@ +config: + device: Juno + run_name: big.LITTLE_benchmarks_regression +global: + iterations: 1 +sections: + - id: a53_only +workloads: + - id: glbenchmark_egypt_off_screen + name: glbenchmark + label: egypt 2.5.1 HD + workload_parameters: + version: 2.5.1 + variant: offscreen diff --git a/templates/a53_only_glbenchmark_egypt_on_screen.yaml b/templates/a53_only_glbenchmark_egypt_on_screen.yaml new file mode 100644 index 0000000..4767e69 --- /dev/null +++ b/templates/a53_only_glbenchmark_egypt_on_screen.yaml @@ -0,0 +1,14 @@ +config: + device: Juno + run_name: big.LITTLE_benchmarks_regression +global: + iterations: 1 +sections: + - id: a53_only +workloads: + - id: glbenchmark_egypt_on_screen + name: glbenchmark + label: egypt 2.5.1 HD + workload_parameters: + version: 2.5.1 + variant: onscreen diff --git a/templates/a53_only_glbenchmark_t-rex_off_screen.yaml b/templates/a53_only_glbenchmark_t-rex_off_screen.yaml new file mode 100644 index 0000000..47c880a --- /dev/null +++ b/templates/a53_only_glbenchmark_t-rex_off_screen.yaml @@ -0,0 +1,14 @@ +config: + device: Juno + run_name: big.LITTLE_benchmarks_regression +global: + iterations: 1 +sections: + - id: a53_only +workloads: + - id: glbenchmark_t-rex_off_screen + name: glbenchmark + label: t-rex 2.7.0 HD + workload_parameters: + version: 2.7.0 + variant: offscreen diff --git a/templates/a53_only_glbenchmark_t-rex_on_screen.yaml b/templates/a53_only_glbenchmark_t-rex_on_screen.yaml new file mode 100644 index 0000000..281178c --- /dev/null +++ b/templates/a53_only_glbenchmark_t-rex_on_screen.yaml @@ -0,0 +1,14 @@ +config: + device: Juno + run_name: big.LITTLE_benchmarks_regression +global: + iterations: 1 +sections: + - id: a53_only +workloads: + - id: glbenchmark_t-rex_on_screen + name: glbenchmark + label: t-rex 2.7.0 HD + workload_parameters: + version: 2.7.0 + variant: onscreen diff --git a/templates/a53_only_linpack.yaml b/templates/a53_only_linpack.yaml new file mode 100644 index 0000000..558c458 --- /dev/null +++ b/templates/a53_only_linpack.yaml @@ -0,0 +1,10 @@ +config: + device: Juno + run_name: big.LITTLE_benchmarks_regression +global: + iterations: 1 +sections: + - id: a53_only +workloads: + - id: linpack + name: linpack diff --git a/templates/a53_only_quadrant.yaml b/templates/a53_only_quadrant.yaml new file mode 100644 index 0000000..85be9d0 --- /dev/null +++ b/templates/a53_only_quadrant.yaml @@ -0,0 +1,10 @@ +config: + device: Juno + run_name: big.LITTLE_benchmarks_regression +global: + iterations: 1 +sections: + - id: a53_only +workloads: + - id: quadrant + name: quadrant diff --git a/templates/a53_only_smartbench.yaml b/templates/a53_only_smartbench.yaml new file mode 100644 index 0000000..d6d9a31 --- /dev/null +++ b/templates/a53_only_smartbench.yaml @@ -0,0 +1,10 @@ +config: + device: Juno + run_name: big.LITTLE_benchmarks_regression +global: + iterations: 1 +sections: + - id: a53_only +workloads: + - id: smartbench + name: smartbench diff --git a/templates/a53_only_sqlite.yaml b/templates/a53_only_sqlite.yaml new file mode 100644 index 0000000..ecdaa4d --- /dev/null +++ b/templates/a53_only_sqlite.yaml @@ -0,0 +1,10 @@ +config: + device: Juno + run_name: big.LITTLE_benchmarks_regression +global: + iterations: 1 +sections: + - id: a53_only +workloads: + - id: sqlite + name: sqlite diff --git a/templates/a53_only_vellamo.yaml b/templates/a53_only_vellamo.yaml new file mode 100644 index 0000000..72e170c --- /dev/null +++ b/templates/a53_only_vellamo.yaml @@ -0,0 +1,10 @@ +config: + device: Juno + run_name: big.LITTLE_benchmarks_regression +global: + iterations: 1 +sections: + - id: a53_only +workloads: + - id: vellamo + name: vellamo diff --git a/templates/a57_only_andbench_t1.yaml b/templates/a57_only_andbench_t1.yaml new file mode 100644 index 0000000..fef5b1f --- /dev/null +++ b/templates/a57_only_andbench_t1.yaml @@ -0,0 +1,12 @@ +config: + device: Juno + run_name: big.LITTLE_benchmarks_regression +global: + iterations: 1 +sections: + - id: a57_only +workloads: + - id: andbench_t1 + name: andebench + workload_parameters: + number_of_threads: 1 diff --git a/templates/a57_only_andbench_t5.yaml b/templates/a57_only_andbench_t5.yaml new file mode 100644 index 0000000..bfa41f9 --- /dev/null +++ b/templates/a57_only_andbench_t5.yaml @@ -0,0 +1,13 @@ +config: + device: Juno + run_name: big.LITTLE_benchmarks_regression +global: + iterations: 1 +sections: + - id: a57_only +workloads: + - id: andbench_t5 + name: andebench + label: andebenchst + workload_parameters: + number_of_threads: 5 diff --git a/templates/a57_only_antutu_4.0.3.yaml b/templates/a57_only_antutu_4.0.3.yaml new file mode 100644 index 0000000..a9ed5c9 --- /dev/null +++ b/templates/a57_only_antutu_4.0.3.yaml @@ -0,0 +1,13 @@ +config: + device: Juno + run_name: big.LITTLE_benchmarks_regression +global: + iterations: 1 +sections: + - id: a57_only +workloads: + - id: antutu + name: antutu + label: antutu4.0.3 + workload_parameters: + version: 4.0.3 diff --git a/templates/a57_only_audio.yaml b/templates/a57_only_audio.yaml new file mode 100644 index 0000000..1c050c9 --- /dev/null +++ b/templates/a57_only_audio.yaml @@ -0,0 +1,10 @@ +config: + device: Juno + run_name: big.LITTLE_Workloads_regression +global: + iterations: 1 +sections: + - id: a57_only +workloads: + - id: w02 + name: audio diff --git a/templates/a57_only_bbench_audio.yaml b/templates/a57_only_bbench_audio.yaml new file mode 100644 index 0000000..f718e62 --- /dev/null +++ b/templates/a57_only_bbench_audio.yaml @@ -0,0 +1,10 @@ +config: + device: Juno + run_name: big.LITTLE_Workloads_regression +global: + iterations: 1 +sections: + - id: a57_only +workloads: + - id: w01 + name: bbench_with_audio diff --git a/templates/a57_only_benchmarkpi.yaml b/templates/a57_only_benchmarkpi.yaml new file mode 100644 index 0000000..3af8231 --- /dev/null +++ b/templates/a57_only_benchmarkpi.yaml @@ -0,0 +1,10 @@ +config: + device: Juno + run_name: big.LITTLE_benchmarks_regression +global: + iterations: 1 +sections: + - id: a57_only +workloads: + - id: benchmarkpi + name: benchmarkpi diff --git a/templates/a57_only_caffeinemark.yaml b/templates/a57_only_caffeinemark.yaml new file mode 100644 index 0000000..583464d --- /dev/null +++ b/templates/a57_only_caffeinemark.yaml @@ -0,0 +1,10 @@ +config: + device: Juno + run_name: big.LITTLE_benchmarks_regression +global: + iterations: 1 +sections: + - id: a57_only +workloads: + - id: caffeinemark + name: caffeinemark diff --git a/templates/a57_only_cfbench.yaml b/templates/a57_only_cfbench.yaml new file mode 100644 index 0000000..41778e1 --- /dev/null +++ b/templates/a57_only_cfbench.yaml @@ -0,0 +1,10 @@ +config: + device: Juno + run_name: big.LITTLE_benchmarks_regression +global: + iterations: 1 +sections: + - id: a57_only +workloads: + - id: cfbench + name: cfbench diff --git a/templates/a57_only_geekbench3.yaml b/templates/a57_only_geekbench3.yaml new file mode 100644 index 0000000..c3435ed --- /dev/null +++ b/templates/a57_only_geekbench3.yaml @@ -0,0 +1,13 @@ +config: + device: Juno + run_name: big.LITTLE_benchmarks_regression +global: + iterations: 1 +sections: + - id: a57_only +workloads: + - id: geekbench3 + name: geekbench + label: geekbench3 + workload_parameters: + version: 3 diff --git a/templates/a57_only_glbenchmark_egypt_off_screen.yaml b/templates/a57_only_glbenchmark_egypt_off_screen.yaml new file mode 100644 index 0000000..e38ab79 --- /dev/null +++ b/templates/a57_only_glbenchmark_egypt_off_screen.yaml @@ -0,0 +1,14 @@ +config: + device: Juno + run_name: big.LITTLE_benchmarks_regression +global: + iterations: 1 +sections: + - id: a57_only +workloads: + - id: glbenchmark_egypt_off_screen + name: glbenchmark + label: egypt 2.5.1 HD + workload_parameters: + version: 2.5.1 + variant: offscreen diff --git a/templates/a57_only_glbenchmark_egypt_on_screen.yaml b/templates/a57_only_glbenchmark_egypt_on_screen.yaml new file mode 100644 index 0000000..c87c72c --- /dev/null +++ b/templates/a57_only_glbenchmark_egypt_on_screen.yaml @@ -0,0 +1,14 @@ +config: + device: Juno + run_name: big.LITTLE_benchmarks_regression +global: + iterations: 1 +sections: + - id: a57_only +workloads: + - id: glbenchmark_egypt_on_screen + name: glbenchmark + label: egypt 2.5.1 HD + workload_parameters: + version: 2.5.1 + variant: onscreen diff --git a/templates/a57_only_glbenchmark_t-rex_off_screen.yaml b/templates/a57_only_glbenchmark_t-rex_off_screen.yaml new file mode 100644 index 0000000..e90a25b --- /dev/null +++ b/templates/a57_only_glbenchmark_t-rex_off_screen.yaml @@ -0,0 +1,14 @@ +config: + device: Juno + run_name: big.LITTLE_benchmarks_regression +global: + iterations: 1 +sections: + - id: a57_only +workloads: + - id: glbenchmark_t-rex_off_screen + name: glbenchmark + label: t-rex 2.7.0 HD + workload_parameters: + version: 2.7.0 + variant: offscreen diff --git a/templates/a57_only_glbenchmark_t-rex_on_screen.yaml b/templates/a57_only_glbenchmark_t-rex_on_screen.yaml new file mode 100644 index 0000000..9831fcc --- /dev/null +++ b/templates/a57_only_glbenchmark_t-rex_on_screen.yaml @@ -0,0 +1,14 @@ +config: + device: Juno + run_name: big.LITTLE_benchmarks_regression +global: + iterations: 1 +sections: + - id: a57_only +workloads: + - id: glbenchmark_t-rex_on_screen + name: glbenchmark + label: t-rex 2.7.0 HD + workload_parameters: + version: 2.7.0 + variant: onscreen diff --git a/templates/a57_only_linpack.yaml b/templates/a57_only_linpack.yaml new file mode 100644 index 0000000..e4ecb8b --- /dev/null +++ b/templates/a57_only_linpack.yaml @@ -0,0 +1,10 @@ +config: + device: Juno + run_name: big.LITTLE_benchmarks_regression +global: + iterations: 1 +sections: + - id: a57_only +workloads: + - id: linpack + name: linpack diff --git a/templates/a57_only_quadrant.yaml b/templates/a57_only_quadrant.yaml new file mode 100644 index 0000000..8ebb7ce --- /dev/null +++ b/templates/a57_only_quadrant.yaml @@ -0,0 +1,10 @@ +config: + device: Juno + run_name: big.LITTLE_benchmarks_regression +global: + iterations: 1 +sections: + - id: a57_only +workloads: + - id: quadrant + name: quadrant diff --git a/templates/a57_only_smartbench.yaml b/templates/a57_only_smartbench.yaml new file mode 100644 index 0000000..a2c8b3f --- /dev/null +++ b/templates/a57_only_smartbench.yaml @@ -0,0 +1,10 @@ +config: + device: Juno + run_name: big.LITTLE_benchmarks_regression +global: + iterations: 1 +sections: + - id: a57_only +workloads: + - id: smartbench + name: smartbench diff --git a/templates/a57_only_sqlite.yaml b/templates/a57_only_sqlite.yaml new file mode 100644 index 0000000..5164328 --- /dev/null +++ b/templates/a57_only_sqlite.yaml @@ -0,0 +1,10 @@ +config: + device: Juno + run_name: big.LITTLE_benchmarks_regression +global: + iterations: 1 +sections: + - id: a57_only +workloads: + - id: sqlite + name: sqlite diff --git a/templates/a57_only_vellamo.yaml b/templates/a57_only_vellamo.yaml new file mode 100644 index 0000000..95ec274 --- /dev/null +++ b/templates/a57_only_vellamo.yaml @@ -0,0 +1,10 @@ +config: + device: Juno + run_name: big.LITTLE_benchmarks_regression +global: + iterations: 1 +sections: + - id: a57_only +workloads: + - id: vellamo + name: vellamo diff --git a/templates/a7only_audio.yaml b/templates/a7only_audio.yaml new file mode 100644 index 0000000..8da3cdd --- /dev/null +++ b/templates/a7only_audio.yaml @@ -0,0 +1,14 @@ +config: + result_processors: + - csv + - sqlite + sqlite_database: my_database.db +global: + iterations: 1 +workloads: + - id: 4b_a7_audio + runtime_parameters: + a7_governor_tunables: + above_hispeed_delay: 20000 + a7_min_frequency: 500000 + workload_name: audio diff --git a/templates/a7only_bbench_audio.yaml b/templates/a7only_bbench_audio.yaml new file mode 100644 index 0000000..7778a0b --- /dev/null +++ b/templates/a7only_bbench_audio.yaml @@ -0,0 +1,16 @@ +config: + result_processors: + - csv + - sqlite + sqlite_database: my_database.db +global: + iterations: 1 +workloads: + - id: 4a_a7_bbench_audio + runtime_parameters: + a7_governor_tunables: + above_hispeed_delay: 20000 + a7_min_frequency: 500000 + workload_name: bbench + workload_parameters: + with_audio: true diff --git a/templates/eas_andbench_t1.yaml b/templates/eas_andbench_t1.yaml new file mode 100644 index 0000000..ce2a23d --- /dev/null +++ b/templates/eas_andbench_t1.yaml @@ -0,0 +1,12 @@ +config: + device: Juno + run_name: big.LITTLE_benchmarks_regression +global: + iterations: 1 +sections: + - id: eas +workloads: + - id: andebench_t1 + name: andebench + workload_parameters: + number_of_threads: 1 diff --git a/templates/eas_andbench_t5.yaml b/templates/eas_andbench_t5.yaml new file mode 100644 index 0000000..85a897d --- /dev/null +++ b/templates/eas_andbench_t5.yaml @@ -0,0 +1,12 @@ +config: + device: Juno + run_name: big.LITTLE_benchmarks_regression +global: + iterations: 1 +sections: + - id: eas +workloads: + - id: andebench_t5 + name: andebench + workload_parameters: + number_of_threads: 5 diff --git a/templates/eas_antutu_4.0.3.yaml b/templates/eas_antutu_4.0.3.yaml new file mode 100644 index 0000000..1b807c5 --- /dev/null +++ b/templates/eas_antutu_4.0.3.yaml @@ -0,0 +1,13 @@ +config: + device: Juno + run_name: big.LITTLE_benchmarks_regression +global: + iterations: 1 +sections: + - id: eas +workloads: + - id: antutu_4_0_3 + name: antutu + label: antutu4.0.3 + workload_parameters: + version: 4.0.3 diff --git a/templates/eas_audio.yaml b/templates/eas_audio.yaml new file mode 100644 index 0000000..c5880fb --- /dev/null +++ b/templates/eas_audio.yaml @@ -0,0 +1,10 @@ +config: + device: Juno + run_name: big.LITTLE_Workloads_regression +global: + iterations: 1 +sections: + - id: eas +workloads: + - id: w02 + name: audio diff --git a/templates/eas_bbench_audio.yaml b/templates/eas_bbench_audio.yaml new file mode 100644 index 0000000..0e4b5ec --- /dev/null +++ b/templates/eas_bbench_audio.yaml @@ -0,0 +1,10 @@ +config: + device: Juno + run_name: big.LITTLE_Workloads_regression +global: + iterations: 1 +sections: + - id: eas +workloads: + - id: w01 + name: bbench_with_audio diff --git a/templates/eas_benchmarkpi.yaml b/templates/eas_benchmarkpi.yaml new file mode 100644 index 0000000..4f466aa --- /dev/null +++ b/templates/eas_benchmarkpi.yaml @@ -0,0 +1,10 @@ +config: + device: Juno + run_name: big.LITTLE_benchmarks_regression +global: + iterations: 1 +sections: + - id: eas +workloads: + - id: benchmarkpi + name: benchmarkpi diff --git a/templates/eas_caffeinemark.yaml b/templates/eas_caffeinemark.yaml new file mode 100644 index 0000000..f679a8e --- /dev/null +++ b/templates/eas_caffeinemark.yaml @@ -0,0 +1,10 @@ +config: + device: Juno + run_name: big.LITTLE_benchmarks_regression +global: + iterations: 1 +sections: + - id: eas +workloads: + - id: caffeinemark + name: caffeinemark diff --git a/templates/eas_cfbench.yaml b/templates/eas_cfbench.yaml new file mode 100644 index 0000000..773fe2a --- /dev/null +++ b/templates/eas_cfbench.yaml @@ -0,0 +1,10 @@ +config: + device: Juno + run_name: big.LITTLE_benchmarks_regression +global: + iterations: 1 +sections: + - id: eas +workloads: + - id: cfbench + name: cfbench diff --git a/templates/eas_geekbench3.yaml b/templates/eas_geekbench3.yaml new file mode 100644 index 0000000..64cf450 --- /dev/null +++ b/templates/eas_geekbench3.yaml @@ -0,0 +1,13 @@ +config: + device: Juno + run_name: big.LITTLE_benchmarks_regression +global: + iterations: 1 +sections: + - id: eas +workloads: + - id: geekbench3 + name: geekbench + label: geekbench3 + workload_parameters: + version: 3 diff --git a/templates/eas_glbenchmark_egypt_off_screen.yaml b/templates/eas_glbenchmark_egypt_off_screen.yaml new file mode 100644 index 0000000..834c93e --- /dev/null +++ b/templates/eas_glbenchmark_egypt_off_screen.yaml @@ -0,0 +1,14 @@ +config: + device: Juno + run_name: big.LITTLE_benchmarks_regression +global: + iterations: 1 +sections: + - id: eas +workloads: + - id: glbenchmark_egypt_off_screen + name: glbenchmark + label: egypt 2.5.1 HD + workload_parameters: + version: 2.5.1 + variant: offscreen diff --git a/templates/eas_glbenchmark_egypt_on_screen.yaml b/templates/eas_glbenchmark_egypt_on_screen.yaml new file mode 100644 index 0000000..30ea1bc --- /dev/null +++ b/templates/eas_glbenchmark_egypt_on_screen.yaml @@ -0,0 +1,14 @@ +config: + device: Juno + run_name: big.LITTLE_benchmarks_regression +global: + iterations: 1 +sections: + - id: eas +workloads: + - id: glbenchmark_egypt_on_screen + name: glbenchmark + label: egypt 2.5.1 HD + workload_parameters: + version: 2.5.1 + variant: onscreen diff --git a/templates/eas_glbenchmark_t-rex_off_screen.yaml b/templates/eas_glbenchmark_t-rex_off_screen.yaml new file mode 100644 index 0000000..399075d --- /dev/null +++ b/templates/eas_glbenchmark_t-rex_off_screen.yaml @@ -0,0 +1,14 @@ +config: + device: Juno + run_name: big.LITTLE_benchmarks_regression +global: + iterations: 1 +sections: + - id: eas +workloads: + - id: glbenchmark_t-rex_off_screen + name: glbenchmark + label: t-rex 2.7.0 HD + workload_parameters: + version: 2.7.0 + variant: offscreen diff --git a/templates/eas_glbenchmark_t-rex_on_screen.yaml b/templates/eas_glbenchmark_t-rex_on_screen.yaml new file mode 100644 index 0000000..5449639 --- /dev/null +++ b/templates/eas_glbenchmark_t-rex_on_screen.yaml @@ -0,0 +1,14 @@ +config: + device: Juno + run_name: big.LITTLE_benchmarks_regression +global: + iterations: 1 +sections: + - id: eas +workloads: + - id: glbenchmark_t-rex_on_screen + name: glbenchmark + label: t-rex 2.7.0 HD + workload_parameters: + version: 2.7.0 + variant: onscreen diff --git a/templates/eas_linpack.yaml b/templates/eas_linpack.yaml new file mode 100644 index 0000000..438a78b --- /dev/null +++ b/templates/eas_linpack.yaml @@ -0,0 +1,10 @@ +config: + device: Juno + run_name: big.LITTLE_benchmarks_regression +global: + iterations: 1 +sections: + - id: eas +workloads: + - id: linpack + name: linpack diff --git a/templates/eas_quadrant.yaml b/templates/eas_quadrant.yaml new file mode 100644 index 0000000..ec08755 --- /dev/null +++ b/templates/eas_quadrant.yaml @@ -0,0 +1,10 @@ +config: + device: Juno + run_name: big.LITTLE_benchmarks_regression +global: + iterations: 1 +sections: + - id: eas +workloads: + - id: quadrant + name: quadrant diff --git a/templates/eas_smartbench.yaml b/templates/eas_smartbench.yaml new file mode 100644 index 0000000..729827c --- /dev/null +++ b/templates/eas_smartbench.yaml @@ -0,0 +1,10 @@ +config: + device: Juno + run_name: big.LITTLE_benchmarks_regression +global: + iterations: 1 +sections: + - id: eas +workloads: + - id: smartbench + name: smartbench diff --git a/templates/eas_sqlite.yaml b/templates/eas_sqlite.yaml new file mode 100644 index 0000000..90fe0e8 --- /dev/null +++ b/templates/eas_sqlite.yaml @@ -0,0 +1,10 @@ +config: + device: Juno + run_name: big.LITTLE_benchmarks_regression +global: + iterations: 1 +sections: + - id: eas +workloads: + - id: sqlite + name: sqlite diff --git a/templates/eas_vellamo.yaml b/templates/eas_vellamo.yaml new file mode 100644 index 0000000..b3aa05b --- /dev/null +++ b/templates/eas_vellamo.yaml @@ -0,0 +1,10 @@ +config: + device: Juno + run_name: big.LITTLE_benchmarks_regression +global: + iterations: 1 +sections: + - id: eas +workloads: + - id: vellamo + name: vellamo diff --git a/templates/hmp_andbench_t1.yaml b/templates/hmp_andbench_t1.yaml new file mode 100644 index 0000000..75af073 --- /dev/null +++ b/templates/hmp_andbench_t1.yaml @@ -0,0 +1,18 @@ +config: + result_processors: + - csv + - sqlite + sqlite_database: my_database.db +global: + iterations: 1 +workloads: + - id: 2a_a7bc + runtime_parameters: + a15_governor_tunables: + above_hispeed_delay: 20000 + a7_governor_tunables: + above_hispeed_delay: 20000 + a7_min_frequency: 500000 + workload_name: andebench + workload_parameters: + number_of_threads: 1 diff --git a/templates/hmp_andbench_t5.yaml b/templates/hmp_andbench_t5.yaml new file mode 100644 index 0000000..1703627 --- /dev/null +++ b/templates/hmp_andbench_t5.yaml @@ -0,0 +1,18 @@ +config: + result_processors: + - csv + - sqlite + sqlite_database: my_database.db +global: + iterations: 1 +workloads: + - id: 2a_a7bc + runtime_parameters: + a15_governor_tunables: + above_hispeed_delay: 20000 + a7_governor_tunables: + above_hispeed_delay: 20000 + a7_min_frequency: 500000 + workload_name: andebench + workload_parameters: + number_of_threads: 5 diff --git a/templates/hmp_antutu_4.0.3.yaml b/templates/hmp_antutu_4.0.3.yaml new file mode 100644 index 0000000..eeab767 --- /dev/null +++ b/templates/hmp_antutu_4.0.3.yaml @@ -0,0 +1,19 @@ +config: + result_processors: + - csv + - sqlite + sqlite_database: my_database.db +global: + iterations: 1 +workloads: + - id: 2c_a7bc + label: antutu4.0.3 + runtime_parameters: + a15_governor_tunables: + above_hispeed_delay: 20000 + a7_governor_tunables: + above_hispeed_delay: 20000 + a7_min_frequency: 500000 + workload_name: antutu + workload_parameters: + version: 4.0.3 diff --git a/templates/hmp_audio.yaml b/templates/hmp_audio.yaml new file mode 100644 index 0000000..e134fdd --- /dev/null +++ b/templates/hmp_audio.yaml @@ -0,0 +1,16 @@ +config: + result_processors: + - csv + - sqlite + sqlite_database: my_database.db +global: + iterations: 1 +workloads: + - id: 2b_a7bc_audio + runtime_parameters: + a15_governor_tunables: + above_hispeed_delay: 20000 + a7_governor_tunables: + above_hispeed_delay: 20000 + a7_min_frequency: 500000 + workload_name: audio diff --git a/templates/hmp_bbench_audio.yaml b/templates/hmp_bbench_audio.yaml new file mode 100644 index 0000000..0beebc2 --- /dev/null +++ b/templates/hmp_bbench_audio.yaml @@ -0,0 +1,18 @@ +config: + result_processors: + - csv + - sqlite + sqlite_database: my_database.db +global: + iterations: 1 +workloads: + - id: 2a_a7bc_bbench_audio + runtime_parameters: + a15_governor_tunables: + above_hispeed_delay: 20000 + a7_governor_tunables: + above_hispeed_delay: 20000 + a7_min_frequency: 500000 + workload_name: bbench + workload_parameters: + with_audio: true diff --git a/templates/hmp_benchmarkpi.yaml b/templates/hmp_benchmarkpi.yaml new file mode 100644 index 0000000..dc9853e --- /dev/null +++ b/templates/hmp_benchmarkpi.yaml @@ -0,0 +1,16 @@ +config: + result_processors: + - csv + - sqlite + sqlite_database: my_database.db +global: + iterations: 1 +workloads: + - id: 2e_a7bc + runtime_parameters: + a15_governor_tunables: + above_hispeed_delay: 20000 + a7_governor_tunables: + above_hispeed_delay: 20000 + a7_min_frequency: 500000 + workload_name: benchmarkpi diff --git a/templates/hmp_caffeinemark.yaml b/templates/hmp_caffeinemark.yaml new file mode 100644 index 0000000..5247304 --- /dev/null +++ b/templates/hmp_caffeinemark.yaml @@ -0,0 +1,16 @@ +config: + result_processors: + - csv + - sqlite + sqlite_database: my_database.db +global: + iterations: 1 +workloads: + - id: 2f_a7bc + runtime_parameters: + a15_governor_tunables: + above_hispeed_delay: 20000 + a7_governor_tunables: + above_hispeed_delay: 20000 + a7_min_frequency: 500000 + workload_name: caffeinemark diff --git a/templates/hmp_cfbench.yaml b/templates/hmp_cfbench.yaml new file mode 100644 index 0000000..225569a --- /dev/null +++ b/templates/hmp_cfbench.yaml @@ -0,0 +1,16 @@ +config: + result_processors: + - csv + - sqlite + sqlite_database: my_database.db +global: + iterations: 1 +workloads: + - id: 2g_a7bc + runtime_parameters: + a15_governor_tunables: + above_hispeed_delay: 20000 + a7_governor_tunables: + above_hispeed_delay: 20000 + a7_min_frequency: 500000 + workload_name: cfbench diff --git a/templates/hmp_geekbench3.yaml b/templates/hmp_geekbench3.yaml new file mode 100644 index 0000000..0b71928 --- /dev/null +++ b/templates/hmp_geekbench3.yaml @@ -0,0 +1,19 @@ +config: + result_processors: + - csv + - sqlite + sqlite_database: my_database.db +global: + iterations: 1 +workloads: + - id: 2h_a7bc + label: geekbench3 + runtime_parameters: + a15_governor_tunables: + above_hispeed_delay: 20000 + a7_governor_tunables: + above_hispeed_delay: 20000 + a7_min_frequency: 500000 + workload_name: geekbench + workload_parameters: + version: 3 diff --git a/templates/hmp_juno_andbench_t1.yaml b/templates/hmp_juno_andbench_t1.yaml new file mode 100644 index 0000000..2ec89af --- /dev/null +++ b/templates/hmp_juno_andbench_t1.yaml @@ -0,0 +1,12 @@ +config: + device: Juno + run_name: big.LITTLE_benchmarks_regression +global: + iterations: 1 +sections: + - id: hmp +workloads: + - id: andebench_t1 + name: andebench + workload_parameters: + number_of_threads: 1 diff --git a/templates/hmp_juno_andbench_t5.yaml b/templates/hmp_juno_andbench_t5.yaml new file mode 100644 index 0000000..a04c953 --- /dev/null +++ b/templates/hmp_juno_andbench_t5.yaml @@ -0,0 +1,12 @@ +config: + device: Juno + run_name: big.LITTLE_benchmarks_regression +global: + iterations: 1 +sections: + - id: hmp +workloads: + - id: andebench_t5 + name: andebench + workload_parameters: + number_of_threads: 5 diff --git a/templates/hmp_juno_antutu_4.0.3.yaml b/templates/hmp_juno_antutu_4.0.3.yaml new file mode 100644 index 0000000..e078051 --- /dev/null +++ b/templates/hmp_juno_antutu_4.0.3.yaml @@ -0,0 +1,13 @@ +config: + device: Juno + run_name: big.LITTLE_benchmarks_regression +global: + iterations: 1 +sections: + - id: hmp +workloads: + - id: antutu_4_0_3 + name: antutu + label: antutu4.0.3 + workload_parameters: + version: 4.0.3 diff --git a/templates/hmp_juno_audio.yaml b/templates/hmp_juno_audio.yaml new file mode 100644 index 0000000..0a26d56 --- /dev/null +++ b/templates/hmp_juno_audio.yaml @@ -0,0 +1,10 @@ +config: + device: Juno + run_name: big.LITTLE_Workloads_regression +global: + iterations: 1 +sections: + - id: hmp +workloads: + - id: w02 + name: audio diff --git a/templates/hmp_juno_bbench_audio.yaml b/templates/hmp_juno_bbench_audio.yaml new file mode 100644 index 0000000..9d0781c --- /dev/null +++ b/templates/hmp_juno_bbench_audio.yaml @@ -0,0 +1,10 @@ +config: + device: Juno + run_name: big.LITTLE_Workloads_regression +global: + iterations: 1 +sections: + - id: hmp +workloads: + - id: w01 + name: bbench_with_audio diff --git a/templates/hmp_juno_benchmarkpi.yaml b/templates/hmp_juno_benchmarkpi.yaml new file mode 100644 index 0000000..1a2b216 --- /dev/null +++ b/templates/hmp_juno_benchmarkpi.yaml @@ -0,0 +1,10 @@ +config: + device: Juno + run_name: big.LITTLE_benchmarks_regression +global: + iterations: 1 +sections: + - id: hmp +workloads: + - id: benchmarkpi + name: benchmarkpi diff --git a/templates/hmp_juno_caffeinemark.yaml b/templates/hmp_juno_caffeinemark.yaml new file mode 100644 index 0000000..bf07fc7 --- /dev/null +++ b/templates/hmp_juno_caffeinemark.yaml @@ -0,0 +1,10 @@ +config: + device: Juno + run_name: big.LITTLE_benchmarks_regression +global: + iterations: 1 +sections: + - id: hmp +workloads: + - id: caffeinemark + name: caffeinemark diff --git a/templates/hmp_juno_cfbench.yaml b/templates/hmp_juno_cfbench.yaml new file mode 100644 index 0000000..e8c0569 --- /dev/null +++ b/templates/hmp_juno_cfbench.yaml @@ -0,0 +1,10 @@ +config: + device: Juno + run_name: big.LITTLE_benchmarks_regression +global: + iterations: 1 +sections: + - id: hmp +workloads: + - id: cfbench + name: cfbench diff --git a/templates/hmp_juno_geekbench3.yaml b/templates/hmp_juno_geekbench3.yaml new file mode 100644 index 0000000..15ae4d8 --- /dev/null +++ b/templates/hmp_juno_geekbench3.yaml @@ -0,0 +1,13 @@ +config: + device: Juno + run_name: big.LITTLE_benchmarks_regression +global: + iterations: 1 +sections: + - id: hmp +workloads: + - id: geekbench3 + name: geekbench + label: geekbench3 + workload_parameters: + version: 3 diff --git a/templates/hmp_juno_glbenchmark_egypt_off_screen.yaml b/templates/hmp_juno_glbenchmark_egypt_off_screen.yaml new file mode 100644 index 0000000..f208d39 --- /dev/null +++ b/templates/hmp_juno_glbenchmark_egypt_off_screen.yaml @@ -0,0 +1,14 @@ +config: + device: Juno + run_name: big.LITTLE_benchmarks_regression +global: + iterations: 1 +sections: + - id: hmp +workloads: + - id: glbenchmark_egypt_off_screen + name: glbenchmark + label: egypt 2.5.1 HD + workload_parameters: + version: 2.5.1 + variant: offscreen diff --git a/templates/hmp_juno_glbenchmark_egypt_on_screen.yaml b/templates/hmp_juno_glbenchmark_egypt_on_screen.yaml new file mode 100644 index 0000000..55d8b86 --- /dev/null +++ b/templates/hmp_juno_glbenchmark_egypt_on_screen.yaml @@ -0,0 +1,14 @@ +config: + device: Juno + run_name: big.LITTLE_benchmarks_regression +global: + iterations: 1 +sections: + - id: hmp +workloads: + - id: glbenchmark_egypt_on_screen + name: glbenchmark + label: egypt 2.5.1 HD + workload_parameters: + version: 2.5.1 + variant: onscreen diff --git a/templates/hmp_juno_glbenchmark_t-rex_off_screen.yaml b/templates/hmp_juno_glbenchmark_t-rex_off_screen.yaml new file mode 100644 index 0000000..757f821 --- /dev/null +++ b/templates/hmp_juno_glbenchmark_t-rex_off_screen.yaml @@ -0,0 +1,14 @@ +config: + device: Juno + run_name: big.LITTLE_benchmarks_regression +global: + iterations: 1 +sections: + - id: hmp +workloads: + - id: glbenchmark_t-rex_off_screen + name: glbenchmark + label: t-rex 2.7.0 HD + workload_parameters: + version: 2.7.0 + variant: offscreen diff --git a/templates/hmp_juno_glbenchmark_t-rex_on_screen.yaml b/templates/hmp_juno_glbenchmark_t-rex_on_screen.yaml new file mode 100644 index 0000000..0e8e360 --- /dev/null +++ b/templates/hmp_juno_glbenchmark_t-rex_on_screen.yaml @@ -0,0 +1,14 @@ +config: + device: Juno + run_name: big.LITTLE_benchmarks_regression +global: + iterations: 1 +sections: + - id: hmp +workloads: + - id: glbenchmark_t-rex_on_screen + name: glbenchmark + label: t-rex 2.7.0 HD + workload_parameters: + version: 2.7.0 + variant: onscreen diff --git a/templates/hmp_juno_linpack.yaml b/templates/hmp_juno_linpack.yaml new file mode 100644 index 0000000..27bcc8e --- /dev/null +++ b/templates/hmp_juno_linpack.yaml @@ -0,0 +1,10 @@ +config: + device: Juno + run_name: big.LITTLE_benchmarks_regression +global: + iterations: 1 +sections: + - id: hmp +workloads: + - id: linpack + name: linpack diff --git a/templates/hmp_juno_quadrant.yaml b/templates/hmp_juno_quadrant.yaml new file mode 100644 index 0000000..49854eb --- /dev/null +++ b/templates/hmp_juno_quadrant.yaml @@ -0,0 +1,10 @@ +config: + device: Juno + run_name: big.LITTLE_benchmarks_regression +global: + iterations: 1 +sections: + - id: hmp +workloads: + - id: quadrant + name: quadrant diff --git a/templates/hmp_juno_smartbench.yaml b/templates/hmp_juno_smartbench.yaml new file mode 100644 index 0000000..35a564d --- /dev/null +++ b/templates/hmp_juno_smartbench.yaml @@ -0,0 +1,10 @@ +config: + device: Juno + run_name: big.LITTLE_benchmarks_regression +global: + iterations: 1 +sections: + - id: hmp +workloads: + - id: smartbench + name: smartbench diff --git a/templates/hmp_juno_sqlite.yaml b/templates/hmp_juno_sqlite.yaml new file mode 100644 index 0000000..d148529 --- /dev/null +++ b/templates/hmp_juno_sqlite.yaml @@ -0,0 +1,10 @@ +config: + device: Juno + run_name: big.LITTLE_benchmarks_regression +global: + iterations: 1 +sections: + - id: hmp +workloads: + - id: sqlite + name: sqlite diff --git a/templates/hmp_juno_vellamo.yaml b/templates/hmp_juno_vellamo.yaml new file mode 100644 index 0000000..05d17ad --- /dev/null +++ b/templates/hmp_juno_vellamo.yaml @@ -0,0 +1,10 @@ +config: + device: Juno + run_name: big.LITTLE_benchmarks_regression +global: + iterations: 1 +sections: + - id: hmp +workloads: + - id: vellamo + name: vellamo diff --git a/templates/hmp_linpack.yaml b/templates/hmp_linpack.yaml new file mode 100644 index 0000000..53f8396 --- /dev/null +++ b/templates/hmp_linpack.yaml @@ -0,0 +1,16 @@ +config: + result_processors: + - csv + - sqlite + sqlite_database: my_database.db +global: + iterations: 1 +workloads: + - id: 2i_a7bc + runtime_parameters: + a15_governor_tunables: + above_hispeed_delay: 20000 + a7_governor_tunables: + above_hispeed_delay: 20000 + a7_min_frequency: 500000 + workload_name: linpack diff --git a/templates/hmp_quadrant.yaml b/templates/hmp_quadrant.yaml new file mode 100644 index 0000000..1554fd2 --- /dev/null +++ b/templates/hmp_quadrant.yaml @@ -0,0 +1,16 @@ +config: + result_processors: + - csv + - sqlite + sqlite_database: my_database.db +global: + iterations: 1 +workloads: + - id: 2j_a7bc + runtime_parameters: + a15_governor_tunables: + above_hispeed_delay: 20000 + a7_governor_tunables: + above_hispeed_delay: 20000 + a7_min_frequency: 500000 + workload_name: quadrant diff --git a/templates/hmp_smartbench.yaml b/templates/hmp_smartbench.yaml new file mode 100644 index 0000000..8e681b9 --- /dev/null +++ b/templates/hmp_smartbench.yaml @@ -0,0 +1,16 @@ +config: + result_processors: + - csv + - sqlite + sqlite_database: my_database.db +global: + iterations: 1 +workloads: + - id: 2k_a7bc + runtime_parameters: + a15_governor_tunables: + above_hispeed_delay: 20000 + a7_governor_tunables: + above_hispeed_delay: 20000 + a7_min_frequency: 500000 + workload_name: smartbench diff --git a/templates/hmp_sqlite.yaml b/templates/hmp_sqlite.yaml new file mode 100644 index 0000000..b6580fd --- /dev/null +++ b/templates/hmp_sqlite.yaml @@ -0,0 +1,16 @@ +config: + result_processors: + - csv + - sqlite + sqlite_database: my_database.db +global: + iterations: 1 +workloads: + - id: 2l_a7bc + runtime_parameters: + a15_governor_tunables: + above_hispeed_delay: 20000 + a7_governor_tunables: + above_hispeed_delay: 20000 + a7_min_frequency: 500000 + workload_name: sqlite diff --git a/templates/hmp_vellamo.yaml b/templates/hmp_vellamo.yaml new file mode 100644 index 0000000..f94059b --- /dev/null +++ b/templates/hmp_vellamo.yaml @@ -0,0 +1,16 @@ +config: + result_processors: + - csv + - sqlite + sqlite_database: my_database.db +global: + iterations: 1 +workloads: + - id: 2o_a7bc + runtime_parameters: + a15_governor_tunables: + above_hispeed_delay: 20000 + a7_governor_tunables: + above_hispeed_delay: 20000 + a7_min_frequency: 500000 + workload_name: vellamo diff --git a/templates/iks_andbench_t1.yaml b/templates/iks_andbench_t1.yaml new file mode 100644 index 0000000..0d506ca --- /dev/null +++ b/templates/iks_andbench_t1.yaml @@ -0,0 +1,12 @@ +config: + result_processors: + - csv + - sqlite + sqlite_database: my_database.db +global: + iterations: 1 +workloads: + - id: 3a_iks + workload_name: andebench + workload_parameters: + number_of_threads: 1 diff --git a/templates/iks_andbench_t5.yaml b/templates/iks_andbench_t5.yaml new file mode 100644 index 0000000..0ee59a4 --- /dev/null +++ b/templates/iks_andbench_t5.yaml @@ -0,0 +1,12 @@ +config: + result_processors: + - csv + - sqlite + sqlite_database: my_database.db +global: + iterations: 1 +workloads: + - id: 3b_iks + workload_name: andebench + workload_parameters: + number_of_threads: 1 diff --git a/templates/iks_antutu_4.0.3.yaml b/templates/iks_antutu_4.0.3.yaml new file mode 100644 index 0000000..8f1f3eb --- /dev/null +++ b/templates/iks_antutu_4.0.3.yaml @@ -0,0 +1,13 @@ +config: + result_processors: + - csv + - sqlite + sqlite_database: my_database.db +global: + iterations: 1 +workloads: + - id: 3c_iks + label: antutu4.0.3 + workload_name: antutu + workload_parameters: + version: 4.0.3 diff --git a/templates/iks_audio.yaml b/templates/iks_audio.yaml new file mode 100644 index 0000000..c161106 --- /dev/null +++ b/templates/iks_audio.yaml @@ -0,0 +1,10 @@ +config: + result_processors: + - csv + - sqlite + sqlite_database: my_database.db +global: + iterations: 1 +workloads: + - id: 3b_iks_audio + workload_name: audio diff --git a/templates/iks_bbench_audio.yaml b/templates/iks_bbench_audio.yaml new file mode 100644 index 0000000..1f3b132 --- /dev/null +++ b/templates/iks_bbench_audio.yaml @@ -0,0 +1,12 @@ +config: + result_processors: + - csv + - sqlite + sqlite_database: my_database.db +global: + iterations: 1 +workloads: + - id: 3a_iks_bbench_audio + workload_name: bbench + workload_parameters: + with_audio: true diff --git a/templates/iks_benchmarkpi.yaml b/templates/iks_benchmarkpi.yaml new file mode 100644 index 0000000..7948862 --- /dev/null +++ b/templates/iks_benchmarkpi.yaml @@ -0,0 +1,10 @@ +config: + result_processors: + - csv + - sqlite + sqlite_database: my_database.db +global: + iterations: 1 +workloads: + - id: 3e_iks + workload_name: benchmarkpi diff --git a/templates/iks_caffeinemark.yaml b/templates/iks_caffeinemark.yaml new file mode 100644 index 0000000..c06ab2a --- /dev/null +++ b/templates/iks_caffeinemark.yaml @@ -0,0 +1,10 @@ +config: + result_processors: + - csv + - sqlite + sqlite_database: my_database.db +global: + iterations: 1 +workloads: + - id: 3f_iks + workload_name: caffeinemark diff --git a/templates/iks_cfbench.yaml b/templates/iks_cfbench.yaml new file mode 100644 index 0000000..15940fb --- /dev/null +++ b/templates/iks_cfbench.yaml @@ -0,0 +1,10 @@ +config: + result_processors: + - csv + - sqlite + sqlite_database: my_database.db +global: + iterations: 1 +workloads: + - id: 3g_iks + workload_name: cfbench diff --git a/templates/iks_geekbench3.yaml b/templates/iks_geekbench3.yaml new file mode 100644 index 0000000..378962b --- /dev/null +++ b/templates/iks_geekbench3.yaml @@ -0,0 +1,13 @@ +config: + result_processors: + - csv + - sqlite + sqlite_database: my_database.db +global: + iterations: 1 +workloads: + - id: 3h_iks + label: geekbench3 + workload_name: geekbench + workload_parameters: + version: 3 diff --git a/templates/iks_linpack.yaml b/templates/iks_linpack.yaml new file mode 100644 index 0000000..4063277 --- /dev/null +++ b/templates/iks_linpack.yaml @@ -0,0 +1,10 @@ +config: + result_processors: + - csv + - sqlite + sqlite_database: my_database.db +global: + iterations: 1 +workloads: + - id: 3i_iks + workload_name: linpack diff --git a/templates/iks_quadrant.yaml b/templates/iks_quadrant.yaml new file mode 100644 index 0000000..807c83b --- /dev/null +++ b/templates/iks_quadrant.yaml @@ -0,0 +1,10 @@ +config: + result_processors: + - csv + - sqlite + sqlite_database: my_database.db +global: + iterations: 1 +workloads: + - id: 3j_iks + workload_name: quadrant diff --git a/templates/iks_smartbench.yaml b/templates/iks_smartbench.yaml new file mode 100644 index 0000000..73e9f69 --- /dev/null +++ b/templates/iks_smartbench.yaml @@ -0,0 +1,10 @@ +config: + result_processors: + - csv + - sqlite + sqlite_database: my_database.db +global: + iterations: 1 +workloads: + - id: 3k_iks + workload_name: smartbench diff --git a/templates/iks_sqlite.yaml b/templates/iks_sqlite.yaml new file mode 100644 index 0000000..3bc4412 --- /dev/null +++ b/templates/iks_sqlite.yaml @@ -0,0 +1,10 @@ +config: + result_processors: + - csv + - sqlite + sqlite_database: my_database.db +global: + iterations: 1 +workloads: + - id: 3l_iks + workload_name: sqlite diff --git a/templates/iks_vellamo.yaml b/templates/iks_vellamo.yaml new file mode 100644 index 0000000..17af8a9 --- /dev/null +++ b/templates/iks_vellamo.yaml @@ -0,0 +1,10 @@ +config: + result_processors: + - csv + - sqlite + sqlite_database: my_database.db +global: + iterations: 1 +workloads: + - id: 3o_iks + workload_name: vellamo diff --git a/wa2host.yaml b/wa2host.yaml new file mode 100644 index 0000000..a380ff1 --- /dev/null +++ b/wa2host.yaml @@ -0,0 +1,31 @@ +metadata: + format: Lava-Test Test Definition 1.0 + name: wa2-host + description: "WAv2 - host part of multinode job" + maintainer: + - milosz.wasilewski@linaro.org + os: + - ubuntu + scope: + - functional + devices: + - kvm + +params: + AGENDA: "hmp_audio.yaml" + JOB_NAME: "workload-automation" + MODE: "hmp" + SIGNAL_PREFIX: "workload" + +run: + steps: + - lava-test-case step1-$SIGNAL_PREFIX-copy-templates --shell cp /root/templates/config.py templates/ + - lava-test-case step2-$SIGNAL_PREFIX-prepare-agenda --shell ./prepare-agenda.py --agenda $AGENDA --job-name $JOB_NAME + - lava-test-case step3-$SIGNAL_PREFIX-wait-for-ip --shell lava-wait $SIGNAL_PREFIX-send-ip + - lava-test-case step4-$SIGNAL_PREFIX-prepare-config --shell ./prepare-config.py --prefix $SIGNAL_PREFIX + - lava-test-case step5-$SIGNAL_PREFIX-prepare-device --shell ./prepare-device.sh $MODE + - lava-test-case step6-$SIGNAL_PREFIX-run-workload --shell ./run-workload.sh $AGENDA $JOB_NAME + - if [ -f ./$JOB_NAME/results.csv ]; then lava-test-case-attach step7-$SIGNAL_PREFIX-run-workload ./$JOB_NAME/results.csv; fi + - if [ -f ./$JOB_NAME/run.log ]; then lava-test-case-attach step8-$SIGNAL_PREFIX-run-workload ./$JOB_NAME/run.log; fi + - lava-test-case step9-$SIGNAL_PREFIX-tear-down --shell ./tear-down.sh $JOB_NAME + - lava-test-case step10-$SIGNAL_PREFIX-multinode-sync --shell lava-sync $SIGNAL_PREFIX-finished diff --git a/wa2host_postprocessing.yaml b/wa2host_postprocessing.yaml new file mode 100644 index 0000000..1b4e5c8 --- /dev/null +++ b/wa2host_postprocessing.yaml @@ -0,0 +1,24 @@ +metadata: + format: Lava-Test Test Definition 1.0 + name: wa2-host-postprocessing + description: "WAv2 - host result postprocessing" + maintainer: + - milosz.wasilewski@linaro.org + os: + - ubuntu + scope: + - functional + devices: + - kvm + +params: + JOB_NAME: "workload-automation" + DELETE_DB: "false" + +run: + steps: + - ./postprocessing.py --job-name $JOB_NAME + - "if [ $DELETE_DB != 'false' ]; then rm /root/db_results $JOB_NAME.db; fi" + +parse: + pattern: "^(?P<test_case_id>\\S+)\\s+Measurement:(?P<measurement>\\d+\\.\\d+)\\s+Units:(?P<units>\\S+)\\s+Result:(?P<result>\\S+)" diff --git a/wa2target.yaml b/wa2target.yaml new file mode 100644 index 0000000..2569350 --- /dev/null +++ b/wa2target.yaml @@ -0,0 +1,27 @@ +metadata: + format: Lava-Test Test Definition 1.0 + name: wa2-target + description: "WAv2 - target part of multinode job" + maintainer: + - milosz.wasilewski@linaro.org + os: + - ubuntu + scope: + - functional + devices: + - vexpress-tc2 + - juno + +params: + SIGNAL_PREFIX: "workload" + +run: + steps: + - lava-test-case step1-$SIGNAL_PREFIX-cat-build-info --shell cat /system/build.prop + - lava-test-case step2-$SIGNAL_PREFIX-get-adb --shell getprop service.adb.tcp.port + - lava-test-case step3-$SIGNAL_PREFIX-set-adb --shell setprop service.adb.tcp.port 5555 + - lava-test-case step4-$SIGNAL_PREFIX-stop-adbd --shell stop adbd + - lava-test-case step5-$SIGNAL_PREFIX-start-adbd --shell start adbd + - lava-test-case step6-$SIGNAL_PREFIX-send-ip --shell lava-send $SIGNAL_PREFIX-send-ip $SIGNAL_PREFIX-ipaddr=$(getprop dhcp.eth0.ipaddress) + - lava-test-case step7-$SIGNAL_PREFIX-multinode-sync --shell lava-sync $SIGNAL_PREFIX-finished + |