summaryrefslogtreecommitdiff
path: root/tcwg-benchmark.sh
AgeCommit message (Collapse)Author
2021-06-21tcwg-benchmark.sh: Return infrastructure error on problems with HWMaxim Kuvyrkov
Change-Id: Ic621c2a683c56267855bdec9706a87c280964b52
2021-06-19tcwg-benchmark.sh: Support tcwg-sq-* machinesMaxim Kuvyrkov
Change-Id: I6cb610ee01e9b592971dae36e343aec7d6350e47
2021-06-19tcwg-benchmark.sh: Update parameter handlingMaxim Kuvyrkov
Change-Id: Id741296cb5d7f68a21a3e83a5d0dcca04f97300c
2021-06-19tcwg-benchmark.sh: Stop using $NODE_NAMEMaxim Kuvyrkov
... use $boardname instead. Change-Id: Iddb92273402d03267e45edf16577ca66b447b10d
2021-06-19tcwg-benchmark.sh: Update power-cycle procedureMaxim Kuvyrkov
Change-Id: I11adaab039ae4abf593cfaa72253a8c48d306cd5
2021-06-18tcwg-benchmark.sh: UpdateMaxim Kuvyrkov
Change-Id: I3e3d42c4777528904a1c502bfb479fc466f9e261
2021-06-18tcwg-benchmark.sh: UpdateMaxim Kuvyrkov
Change-Id: I759fdf3e13c5b83a3ee68f1e9ccbd781a816803f
2021-06-17tcwg-benchmark.sh: Move resolution of @build_num@ and @hw_tag@ to yamlMaxim Kuvyrkov
Change-Id: I084c675ed5c5cfe9d7a0a6e8cef710406d7c94f8
2021-06-16tcwg-benchmark.sh: Fix shellcheck warningMaxim Kuvyrkov
Change-Id: I3c1d7ea9907ffc243ae71ffa2aac4476458ff147
2021-06-16tcwg-benchmark.sh: Don't depend on PWD being jenkins-scripts/ dirMaxim Kuvyrkov
Change-Id: I0408d481d933372d7511ae10e2e0c8c1ef5bac4c
2021-06-16tcwg-benchmark.sh: Update handling of hw_tag in results_idMaxim Kuvyrkov
... to support tcwg-sq-01 and -02 boards. Change-Id: Ifa7b49ad8da5fb537de4be312b08a276ae0861ad
2021-03-23tcwg-benchmark.sh: Use dedicated (non-multiplexed) connection for rebootMaxim Kuvyrkov
Change-Id: I50adad4a8fc28f63bdcab9fd55eb16e31607c2f8
2021-03-23tcwg-benchmark.sh: Don't wait 5min for ssh to break connection due to rebootMaxim Kuvyrkov
Change-Id: Ibbfb9ccd93e1cd93a08875e6ea4997c93d6e1473
2021-03-22tcwg-benchmark.sh: Pass --image DOCKER_IMAGE to prepare-board.shMaxim Kuvyrkov
Change-Id: I0355ac53de92eb7a25d711d59e295ae46baf892d
2020-12-11tcwg-benchmark.sh: Better structure code for rebooting and power-cyclingMaxim Kuvyrkov
Change-Id: I711c726552dd0b96bb3790dd9d6114d3cedb289f
2020-12-11tcwg-benchmark.sh: Improve board recovery to check that filesystem is workingMaxim Kuvyrkov
This is to, hopefully, recover from filesystem failures like below: 00:02:35.206 + ssh tcwg-tk1-06.tcwglab sudo /sbin/reboot 00:02:35.306 Failed to start reboot.target: Unit reboot.target is not loaded properly: Input/output error. 00:02:35.307 See system logs and 'systemctl status reboot.target' for details. 00:02:35.308 Failed to open /dev/initctl: No such device or address 00:02:35.308 Failed to talk to init daemon. ... 00:03:05.323 + wait_for_ssh_server tcwg-tk1-06.tcwglab 22 100 ... 00:03:05.346 + rsync -az --delete bmk-scripts/ tcwg-tk1-06.tcwglab:bmk-scripts/ 00:03:05.514 rsync: failed to set times on "/home/tcwg-benchmark/bmk-scripts/.git": Read-only file system (30) Change-Id: I9c1b50d18034a7c6317505f0e770791bc178e8b7
2020-09-11jenkins-helpers.sh: Split $EXPECTED_EXIT into $INTERNAL_FAILMaxim Kuvyrkov
... and $EXTERNAL_FAIL. This allows us to distinguish between regressions that we should bisect and infra problems that we should skip bisects for. Change-Id: I8f3b82c86d95e27351b01a2b3d2467b8e15b309e
2020-09-10tcwg-benchmark.sh: Prepare board for benchmarking before starting dockerMaxim Kuvyrkov
... container. So that prepare-board.sh/benchmark.sh script has a chance to fix broken docker daemon. Change-Id: I5e20606141b91987fe99f7369494d0b10b06da56
2020-07-08tcwg-benchmark.sh: Move power-cycling code here from .yaml filesMaxim Kuvyrkov
Change-Id: I8c6ec7118f9015fa3ad3ea8c344fb66b5bf9a357
2020-04-29tcwg-benchmark*.sh: Update to pass --hw_tags to bmk-scripts/Maxim Kuvyrkov
Change-Id: I49685c1938c44548f88928c7afa455a863af8076
2020-04-29tcwg-benchmark.sh: Remove unused @hw_type@ substitution from $results_idMaxim Kuvyrkov
Change-Id: I6530286516fc131980e4379399ca0fff00883f8f
2020-04-23Shellcheck fixes round 2David Spickett
Also update the sanity check script to include .job files. Change-Id: Ibf72d9ff346ff7b012d4e282a6ac8f3b7e73590d
2020-04-22Various shellcheck warning fixesDavid Spickett
First round of low hanging fruit from the files with the fewest warnings. Change-Id: I60ad57b5bfb2f0be9bb6506252c820f44d055200
2020-04-17tcwg-benchmark.sh: Minor fixesDavid Spickett
* Dedupe getting hostname for ssh toolchain URLs * Check toolchain type earlier * Error if SSH doesn't respond after reboot (and change the other uses of wait_for_ssh_server to follow the same format) Change-Id: Ib7823e5a83500e0d95912ef0d3ba993051a67533
2020-04-01Change default to use "master" docker imagesMaxim Kuvyrkov
... instead of "tcwg-tested" due to https://projects.linaro.org/browse/LSS-1153 , which causes tcwg-tested images to not being updated. Change-Id: I2222b87892b029b23eb1baeb28747b148addb345
2020-02-06tcwg-benchmark.sh, tcwg_bmk-build.sh: Update after splitting tcwg-benchmarkMaxim Kuvyrkov
... job into tcwg-benchmark-tk1 and tcwg-benchmark-tx1. Change-Id: Ieccafcaa47fa522cc00d6ffd69fcc3494eb5a120
2019-10-10tcwg-benchmark.sh: Remove extra quoting after switch to remote_exec()Maxim Kuvyrkov
Change-Id: I2dda965799f91f6a94760e99fefc76ecb2749a1e
2019-10-10tcwg-benchmark.sh: Run board setup outside of containerMaxim Kuvyrkov
Change-Id: I7adcb1f58bcdd4f6f5f74d3e790cbb249bba943c
2019-10-10tcwg-benchmark.sh: Fix typoMaxim Kuvyrkov
Change-Id: I798c651d7a02c3f0a5ace45e125e3552836fa71a
2019-10-10tcwg-benchmark.sh: Simplify parameter passing through sshMaxim Kuvyrkov
... by using remote_exec, which quotes parameters appropriately. Change-Id: Ic62a08fab198b9293873541aa49a90c9e402c9a9
2019-10-10tcwg-benchmark.sh: Prepare board for benchmarkingMaxim Kuvyrkov
We have configuration steps that are needed to be run on the host board (e.g., stopping/starting services) and inside the container (e.g., starting/stopping perf workaround). Container can't stop services on the main machine (unless we proxy systemd interface somehow), and perf workaround is best to be started using the version of perf that benchmarking uses. Change-Id: I135060d043eb03946aef3d02e333df5902d1c8b7
2019-09-19tcwg-benchmark.sh: Use bionic containersDiana Picus
Change-Id: I9d082ddbb9caf2fa498c05220153184f93fe4c17
2019-09-17tcwg-benchmark.sh: Fix container cleanupMaxim Kuvyrkov
Don't forget to cleanup "build" container as well as "run" container. Change-Id: I836f418ba22e5b4aab16867d0745a4d44107708a
2019-09-17tcwg-benchmark.sh: Fix FIXMEMaxim Kuvyrkov
Don't tie benchmarking and build container images. Change-Id: Id034072f469fa4fc50a429a2afbf560dd51a0a93
2019-09-14tcwg-benchmark.sh: Bind-mount $WORKSPACE inside benchmarking containerMaxim Kuvyrkov
... to enable removal of stale/aborted benchmarking containers via $WORKSPACE/.lock cleanup. Stale benchmarking containers are dangerous due to perf workaround running inside, which steals samples from the "measuring" perf. Change-Id: I54dfbb42e5d04ff49c9bfb591df681cf16c5b781
2019-09-14tcwg-benchmark.sh: Cleanup container on benchmarking boardMaxim Kuvyrkov
Change-Id: If6f5d03352dd72d4a9e7345950efd65ae7f83eb0
2019-09-13Run benchmarks inside containersDiana Picus
This creates a new task ('bench') and starts a docker container to run the benchmarks in. It uses the same image as the 'build' task. Switching between aarch64 and aarch32 benchmarking breaks unless force install is requested because we only keep one version of the spec tools on the board. This will be fixed in a subsequent patch to bmk-scripts. Change-Id: Ie98cdf47aa3ed456e6349bac40d88bd7acaa7acd
2019-04-22tcwg_bmk-build.sh: Workaround clang's linking problem in -Os/-Oz LTO buildsMaxim Kuvyrkov
... by adding ability to set custom linking flags. See https://projects.linaro.org/browse/LLVM-557 . Clang's driver needs fixing to avoid passing -Os/-Oz to the linker. Change-Id: Id1858483f18babd95cd79c645479cdc6a2e378f0
2019-03-22tcwg_bmk-build.sh: Main support for tcwg_bmkMaxim Kuvyrkov
This patch updates tcwg_bmk-build.sh from the original copy of tcwg_kernel-build.sh, and adds a couple minor changes to docker-run.sh and tcwg-benchmark-results.sh. tcwg-benchmark*: Switch results server to bkp-01.tcwglab tcwg_bmk-build.sh: Use ABE's sysroot and binutils for LLVM's build round-robin.sh: Build LLVMgold.so plugin in build_llvm() for LTO Change-Id: Ibde7a9d004c8b3328cdd36333c14574934b1eeab
2019-03-15tcwg-benchmark.sh: Add support for clean_older_thanChristophe Lyon
... to remove old results and avoid filling up the disk. Change-Id: Ife87756fc92f48717baa0f84c7c3fe16b49b1899
2019-02-07tcwg-benchmark.sh: Ssh directly to the benchmark board.Maxim Kuvyrkov
We [ab]used build_container_exec to ssh the target board to get most recent ssh configuration. We have since started to require local ssh access to work as well (e.g., for reboot functionality), and implemented automatic updates of tcwg-buildslave and tcwg-benchmark /home files. Also, don't use ssh multiplexing (-Snone) to reliably forward ssh agent to the benchmarking board. We have seen strange ssh-agent failures over shared connections. Change-Id: Iab09821272aa91f8a80b0e1b8fc5a9dd1a6bd3fb
2019-01-25tcwg-benchmark.sh: Add support for :parallelize parameter in ccprefix.Christophe Lyon
We just need to keep this parameter if present, and pass it to run.sh unchanged. Just take care that the path component in a ssh:// toolchain is always the last one. Change-Id: I581af110e4df06adce5fcdfb3ae722ea74fc6451
2018-12-21tcwg-benchmark.sh: Use '22' as default port for ssh:// type of toolchain_urlChristophe Lyon
Change-Id: I4217c5c3f2b677f00a8bb43bb56b9044aa1b83ba
2018-12-21tcwg-benchmark.sh: Determine toolchain_type when toolchain_url is of ssh:// typeChristophe Lyon
Change-Id: Iab7b696ba0972db8e2362aa0896af9a35e179839
2018-12-21tcwg-benchmark.sh: Add sanity check for toolchain_typeChristophe Lyon
Make sure we could determine it. Change-Id: I5ac789d0ec8eb78ea016e83751ed132d8900cc92
2018-12-21tcwg-benchmark.sh: Support ssh:// method for sysroot.Christophe Lyon
Change-Id: I8397a8bcbeda5892d314f0675cc9be0c428cd214
2018-12-21tcwg-benchmark.sh: Force use of build_container_port when copying sysroot to ↵Christophe Lyon
build container. Change-Id: I4d7400dc9c138e1e7a5339dadfafd6aa4aaf9a26
2018-12-21tcwg-benchmark.sh: Do not create a remote build container when using ssh.Christophe Lyon
If toolchain_url is of ssh:// type, do not create a remote build container, just use the ssh connexion as provided. Change-Id: Id93be63fd61a0d99d433d7b6ebb65f0e1c2473f8
2018-11-26Don't ignore "null" values in variable expansionsMaxim Kuvyrkov
Replace ${var:-default} with ${var-default}. I learned something new about shell scripting today. From bash manual: === When not performing substring expansion, using the form described below (e.g., ‘:-’), Bash tests for a parameter that is unset or null. Omitting the colon results in a test only for a parameter that is unset. Put another way, if the colon is included, the operator tests for both parameter’s existence and that its value is not null; if the colon is omitted, the operator tests only for existence. === The immediate problem I need to fix is handling of host_aarchXX_excludecheck and host_x86_64_excludecheck parameters in tcwg-buildfarm.sh. With ":-" syntax the empty ("null") values are replaced by defaults, causing GCC testsuite to be ignored on aarchXX hosts when "--host_aarchXX_excludecheck ''" is given. There happens to be a single usage ":-" in ${rw:-rw} in start-container-qemu.sh, where ":-" is actually needed. Change-Id: Ibc8e070b698e1c76e2161eb65d40639b8cdec1f3
2018-06-01*.sh: Switch to *-tcwg-tested docker images.Maxim Kuvyrkov
Change-Id: I0abd9f0c7ec0da98990459cf175eb4e076bdab8d