summaryrefslogtreecommitdiff
AgeCommit message (Collapse)Author
2020-11-18tcwg-update-*-containers.sh: Update default distro to bionicMaxim Kuvyrkov
Change-Id: I10e660351a0930fe554d8de7b568898985d59d03
2020-11-06tcwg-llvm-release: Run release script for branchesDiana Picus
Update our scripts so we can run test-release.sh with a custom git ref. This should allow us to test master or release/N.x without a tag. We already had this functionality before, but it was using the deprecated '-svn-path' parameter instead of the current '-git-ref'. Also remove the custom trunk "release candidate", since there's no need to treat master as a special branch. I will also update the Jenkins job accordingly. Change-Id: Iccac0eba68bfec60cdec7f2e7b96e993afd11936
2020-11-04tcwg-llvm-release: Copy release to artifactsDiana Picus
Copy the release archive to $WORKSPACE/artifacts. At the moment this also preserves the upload via ssh, until I get a functional artifact upload. Change-Id: I08465ad9a27b92a468848afc18c5e8be774ceb4b
2020-10-30tcsg-llvm-common.sh: Don't prefix with public_htmlDiana Picus
push_binary_dir should be the single source of truth for the PUSHDIR, so push_scp_url should not add any prefixes. If we wish to have a public_html in the path, we should add it in push_binary_url instead, since that is what we use to create the push directory in tcwg-build-llvm.sh. But for now I don't think we need public_html at all anymore. Change-Id: Ie26430fbf00f94ffd1c70365c95a251fb14ce46c
2020-10-30tcwg-llvm-common: s/dev-01/bkp-01Diana Picus
dev-01 is having hardware issues, so we can't rely on it anymore. Try uploading binaries to bkp-01 instead. Change-Id: I8aca250b4d20a6b1c1bfe4ab7575e8699560cee5
2020-10-27tcwg_kernel-build.sh: Print the toolchain_type when unsupportedChristophe Lyon
This is similar to what tcwg_bmk-build.sh already does. Change-Id: Ifc7876307c164324fbe91049ea3030bd00a7d801
2020-10-27tcwg_bmk-build.sh: Add support for gnu_eabi toolchain typeChristophe Lyon
gnu_eabi toolchains need to build newlib instead of glibc and linux. In addition to adding support for "gnu_eabi" toolchain type, we also take care of building the right set of components. Change-Id: I1fdba8829d8b8609495e1a9e612701cc7d36c36b
2020-10-27round-robin-bisect.sh: Add support for newlibChristophe Lyon
Update the email recipients list when the updated project is newlib, like we do for glibc. Change-Id: I83b6e3499b6b5fe16cb5a0840e3c80af6456a1d6
2020-10-23print_host_for_node: Make "ignore_fail" optionalDiana Picus
We have at least one place (start-container-docker.sh) where print_host_for_node is called with only one argument. This causes jobs to fail with this error message: "$2: unbound variable". This patch tries to address the issue by using the empty expansion if the parameter is not set. Change-Id: I0d695a136829cc819e5cfc487b34f0fa6bb370bc
2020-10-12start-container-docker.sh: Use main system /homeMaxim Kuvyrkov
... and drop support for host-home docker volume. See https://review.linaro.org/c/ci/dockerfiles/+/36586 for rationale. Change-Id: Ic5f63df7296bc21002fee87ce78c4e1d855167fd
2020-10-05tcwg-update-llvmbot-containers: Add a buildbotDiana Picus
Add linaro-aarch64-flang-oot. Change-Id: I2cf8464f47380615ac2fcb3e73421bd6f4495c22
2020-09-14tcwg_gnu-build.sh: Reduce pass thresholdMaxim Kuvyrkov
... for benefit of tcwg_binutils project, which is currently at 0.93. Change-Id: I23338a905fc68b1b6bb94babdfac7a36577ad8e8
2020-09-11round-robin-bisect.sh: Fetch $bad_branch/$bad_rev from $bad_urlMaxim Kuvyrkov
... so far we were lucky that $bad_rev happened to be fetched in the workspace's clone. Change-Id: I3ecf57806607d2da3fc1d8229ccef1eace938ccf
2020-09-11jenkins-helpers.sh: Split $EXPECTED_EXIT into $INTERNAL_FAILMaxim Kuvyrkov
... and $EXTERNAL_FAIL. This allows us to distinguish between regressions that we should bisect and infra problems that we should skip bisects for. Change-Id: I8f3b82c86d95e27351b01a2b3d2467b8e15b309e
2020-09-11round-robin.sh: Fix QEMU bisectionsMaxim Kuvyrkov
Change-Id: I6f9e96686518596216020da0efe9f7903577c1ee
2020-09-10tcwg-benchmark.sh: Prepare board for benchmarking before starting dockerMaxim Kuvyrkov
... container. So that prepare-board.sh/benchmark.sh script has a chance to fix broken docker daemon. Change-Id: I5e20606141b91987fe99f7369494d0b10b06da56
2020-09-07tcwg-cleanup-stale-results.sh: New script to delete stale benchmarking resultsMaxim Kuvyrkov
... on bkp-01.tcwglab. This script parses toolchain/ci/base-artifacts.git repo and removes benchmarking results that are - NOT referenced in any linaro-local/ci/tcwg_bmk* branches and - older than 30 days. Change-Id: I5b29558f646ef2bfe58fb0fdb822668593f7db5b
2020-09-03tcwg_bmk-build.sh, jenkins-helpers.sh: Add support for arm-eabi targetChristophe Lyon
This is useful to run benchmarks on stm32 boards (Cortex-M, bare-metal). Change-Id: I115b982effea9d0ddebe990d74f8bb6c72806778
2020-08-31tcwg-llvm-release: Deal with flang and mlirDiana Picus
Flang and MLIR are new to the monorepo. By default, MLIR is enabled and flang is disabled. This patch enables flang on aarch64 (and x86 for comparison purposes). It also disables MLIR on armv7 since we do not support it (there are many test failures since 32-bit support in general is missing / incomplete / untested in MLIR). Change-Id: I2cfa31762001fbffc0c41717d3d3792a5ac757d7
2020-08-31Increase memory allocation for build containersDiana Picus
Building flang needs more than 1GB per core and trying with 2GB per core surpasses the 30000 threshold. Use unlimited instead. Change-Id: Ibe1a06d5e529eaad9ea3b4a9d6c569a1171bed9c
2020-08-17tcwg-benchmark-bare.sh: New script to run benchmarks on bare-metalChristophe Lyon
Starts a container with access to USB devices to build and run benchmarks on boards in bare-metal mode. Currently supports coremark only. Change-Id: I19876d32fc3c2b3322960f86798dc02a96aed25b
2020-08-12tcwg-benchmark-results.sh: Add support for --has_perf_logs optionChristophe Lyon
It defaults to "yes" so that we parse perf logs by default. Use "no" when no perf data is available (eg. when benchmarking on bare-metal). Change-Id: I0e6c4b4b6e39de5a55808f22154025e435561753
2020-08-12jenkins-helpers.sh: Add "failsafe" parameter to print_host_for_nodeChristophe Lyon
When we call print_host_for_node from print_node_with_least_containers, we don't want to fail early with an error if any of the tester nodes is offline, so keep iterating until we find a suitable one. Change-Id: I0e6159a54f40ba83a56af03289ea905ed97cb7e9
2020-07-30round-robin.sh: Compress testsuite logs to save disk spaceMaxim Kuvyrkov
Change-Id: I73e2ef1da8cb474b18a366ecccae09ab83185480
2020-07-29MakeRelease.job: Fix use of port 22 to upload binary tarballs/take #2Christophe Lyon
Sigh, the previous patch used a syntax that applies only with using an rsync daemon (with rsync: protocol). Let's use -e 'ssh -p 22', like we do in other scripts. Change-Id: I41d3cb7ff843abcc56a94775e2fd04c5f317f7fa
2020-07-29MakeRelease.job: Fix use of port 22 to upload binary tarballsChristophe Lyon
Adding "-p 22" does not work for rsync, which expects the port number as a ":port" suffix for the host specification. Change-Id: I41dbfbe11f73fd02386f90a0266488557a0009c7
2020-07-10MakeRelease.job: Use port 22 to upload binary tarballsChristophe Lyon
Our default ssh config points to the host container where the directory containing the binary tarballs is not mapped. Use port 22 to upload them to the right location. Change-Id: I5f18365f9d36541e3133ca81ed9ac2ac560bef30
2020-07-08round-robin-bisect.sh: Post jira comments for tcwg_{binutils, cross, gnu}Maxim Kuvyrkov
Change-Id: I9fd245d77848f0d8d1d2117ed117b1f17e2bcdd5
2020-07-08tcwg_bmk-build.sh: Skip builds that couldn't finish benchmarkingMaxim Kuvyrkov
Tcwg-benchmark-* jobs fail only due to infrastructure reasons. Benchmark build and run failures are assigned special 99..99 and 88..88 metrics, but the jenkins build succeed. Change-Id: I71639b6d4e1fd2a139390884c0d1eae0bb89a95d
2020-07-08tcwg-benchmark.sh: Move power-cycling code here from .yaml filesMaxim Kuvyrkov
Change-Id: I8c6ec7118f9015fa3ad3ea8c344fb66b5bf9a357
2020-07-06tcwg_bmk-build.sh: Gracefully handle benchmarking board going offlineMaxim Kuvyrkov
... which is represented by tcwg-benchmark-* build returning UNSTABLE result. Change-Id: Ifa8be8e601ef93412a3a62d9bed4a078fe38fa49
2020-07-03tcwg_gnu-build.sh: Use results comparison scripts from gcc-compare-resultsChristophe Lyon
They are based on GCC's compare_tests but support a list of unstable tests. Change-Id: Icc582846d2cdd5df895cad373e3021fc7e154fbd
2020-07-02round-robin.sh: Fix check_regressionMaxim Kuvyrkov
Don't expect ${c}_url defined when ${c}_branch is "baseline". Change-Id: I436efd471dd55655ea9a125194823ed084552ecc
2020-07-02tcwg_bmk-build.sh: Workaround missing benchmarking resultsMaxim Kuvyrkov
... which are referenced in base-artifacts repo. This problem occurred when bkp-01.tcwglab, where we store benchmarking results, ran out of disk space, so tcwg-benchmark-* jobs could not upload their results. This didn't stop tcwg_bmk-build.sh to treat this failure as regressions in various configurations, which were then bisected down to the first commit. At that point baselines for individual configurations were reset to the new failing state, and references to the missing results were committed to base-artifacts repo. We will fix this problem in several ways: 1. We have added tcwg-cleanup-stale-results.sh to parse base-artifacts repo and delete results with no references from that repo (thus preventing bkp-01.tcwglab from running out of disk space). 2. We are adding this workaround to purge broken entries from base-artifacts repo. 3. We will commit .csv summary of results into base-artifacts.git so that we won't need to rely on on-the-side storage of perf.data files. Change-Id: I922df040292c1686f4461052d21bdeb98bea0b03
2020-06-27round-robin.sh: For all .sum files also copy matching .log filesMaxim Kuvyrkov
Change-Id: Iad5af1671239484b5a55830c75c23a8158d56252
2020-06-22tcwg-start-container.sh: Handle containers stuck in restart loopMaxim Kuvyrkov
Change-Id: I6e32f290ba92449905ca0c215ec13d0384ada938
2020-06-19tcwg_gnu-build.sh: Fix order of cross-toolchain buildMaxim Kuvyrkov
Change-Id: Ibb21daee5883fade944073ef4cdb1d57ba905548
2020-06-19tcwg_gnu-build.sh: Add *-build_cross and *-check_cross configurationsMaxim Kuvyrkov
Change-Id: Ic648660f11602ebf82a34bd95469ba1018592287
2020-06-19tcwg-update-llvmbot-containers.sh: Put LLDB bots on tcwg-amp-05Maxim Kuvyrkov
Change-Id: I758566e05736de9c62ba8431843cb8c1c482b2d3
2020-06-09start-container-docker.sh: Assert that the task parameter has an acceptable ↵Christophe Lyon
value This is currently either build, bench or test. Change-Id: I96fa7adad47e0bb8d95668462218fb21d08a2cd7
2020-06-09tcwg-update-llvmbot-containers.sh: Update bot names (fixup)Maxim Kuvyrkov
Change-Id: I4a6ce34a182245a77d5bb3e7ff59ac9667906430
2020-06-09tcwg_gnu-build.sh: Fix shellcheck warningsMaxim Kuvyrkov
Change-Id: I6735863b1937995e6e4883e0a811376222219bf4
2020-06-09tcwg-update-llvmbot-containers.sh: Update bot names to match zorgMaxim Kuvyrkov
See https://reviews.llvm.org/D80573 Change-Id: I6deee117fab24fcf91a9e283fec3898124accc9b
2020-06-01tcwg-llvm-release: Use port 22 for copying binariesDiana Picus
We're doing this because our .ssh/config connects to the host container on dev-01 by default, and that doesn't have the upload directory mapped. Change-Id: I80305eb168abd62eab95ce6c627178593a52a905
2020-05-31round-robin-bisect.sh: Fix more missing instance of passing $bad_urlMaxim Kuvyrkov
Change-Id: Iffa2dff5d9a937c94e9c69a4102c4739788ddefb
2020-05-31round-robin-bisect.sh: Fix linux-next rebase workaroundMaxim Kuvyrkov
Change-Id: I472bf099af6d2ab6fb9dbb70c939634aaefafd48
2020-05-31round-robin-bisect.sh: Fix references to $linux_urlMaxim Kuvyrkov
... replace them with $bad_url. Change-Id: I73224638e852367ed8c42a178f36e9f7bf6c401e
2020-05-31round-robin-bisect.sh: Fix shellcheck warningsMaxim Kuvyrkov
Change-Id: Id9495fa4785702f155bc845f4db1f8b7691e9a48
2020-05-29round-robin*.sh: Pass component URL alongside component branchesMaxim Kuvyrkov
... when not using special "baseline" branch specifier. Change-Id: If3aabeb1a2729b8d270d842fdd0ad5809ebc990d
2020-05-29round-robin.sh: Use implicit baseline when triggering bisectMaxim Kuvyrkov
Change-Id: Ide6dbb22152a5096ba21667f497f2571384579de