summaryrefslogtreecommitdiff
AgeCommit message (Collapse)Author
2021-05-04Set metric from cflags.Prathamesh Kulkarni
Change-Id: Ie9ed975be89cbb39e195969ed3ef2913e28cbcd9
2021-05-03tcwg_kernel-build.sh: Refactor ccache logicMaxim Kuvyrkov
Change-Id: I3a5592e85f4edede3f3854b2e9e915208c5ab15e
2021-04-30tcwg_kernel-build.sh: Speed up bisections of qemu regressionsMaxim Kuvyrkov
... by using ccache for linux builds. Change-Id: Ifc7be118f3d5a5684f001d577d5f265c5d77e12d
2021-04-30tcwg_kernel-build.sh: Fix metric setting for qemu buildMaxim Kuvyrkov
When bisecting boot_linux() failure due to QEMU change we start at build_abe-qemu step, and get result metric set to "-1" by build_llvm step. Consequently, we consider boot_linux() failure as "uninteresting" regression. Change-Id: I364abb5ff828f1555fa82285dfaf58f9819d58e5
2021-04-26tcwg-update-llvmbot-containers.sh: Document number of Buildkite botsDavid Spickett
1 bot per config limits the total build time to 1x the slowest bot's build time. Change-Id: I9bf67a4675ac4bc4dc3a46a7227f34a835106310
2021-04-23tcwg-report-stale-rr-jobs.sh: Sort human output starting with git repoMaxim Kuvyrkov
Change-Id: I433cb200970fb4a288386c7063a2c6f3e0ac8367
2021-04-21Add comparison for vect metric.Prathamesh Kulkarni
Change-Id: I1c5e4c6b0cc43fbdf2923484b8c643e2a7c9c51e
2021-04-17tcwg-start-container.sh: Handle starting QEMU-based containersMaxim Kuvyrkov
... so that we can run SVE tcwg-llvmbot containers on x86_64 machines. Change-Id: Iaad0ba8e8012c4144b3672d547bc449bdf6b982b
2021-04-14tcwg-update-llvmbot-containers: Add buildkite testing botsDavid Spickett
To see what performance is like on Jade. The "-test" on the end means they'll connect to a different agent queue on the buildkite side and not disturb the production precommit. Change-Id: Ic2c79bead2adfdff26b808c30a46143fac89c298
2021-04-14tcwg-update-llvmbot-containers.sh: Swap silent and normal botsMaxim Kuvyrkov
... between tcwg-jade-01 and {tcwg-amp-03/04, tcwg-llvmbot_d05-01}. Change-Id: Ief43e5c4b485521595f25df2c6e41366387ac2e9
2021-04-14tcwg-update-llvmbot-containers.sh: Enable linaro-aarch64-flang-latest-gccMaxim Kuvyrkov
and linaro-aarch64-flang-latest-clang in production buildmaster. Change-Id: I82a519bf9f96d463b6541469fcd20386e4d86e88
2021-04-12tcwg-report-stale-rr-jobs.sh: Cache fetched refsMaxim Kuvyrkov
... to speedup subsequent fetches. Change-Id: Ic1ab5c90ce2b4e4627e3add064531b2790ee594a
2021-04-09tcwg-report-stale-rr-jobs.sh: Add tracking of all toolchain/ci reposMaxim Kuvyrkov
... not just base-artifacts.git. Tracking all repos will notify us when we need to switch to newer release branches, or when failure happens only for a particular component of a round-robin job. Change-Id: Id3a2f3f8f08134b8b0549ca090465f0ddf54d132
2021-04-09tcwg-report-orphan-rr-branches.sh: Give script a better nameMaxim Kuvyrkov
Change-Id: I45a1bd2f0b7c43e0f8803c4db0967330d8945755
2021-04-07tcwg-update-llvmbot-containers.sh: Disable flang-latest-{gcc,clang} botsMaxim Kuvyrkov
... which appear to be disabled on production buildmaster. We'll need to ping buildmaster maintainer to enable these. Change-Id: I3d042e813b49c4a0faf316c05dbd4fad71479969
2021-04-07round-robin-bisect.sh: Handle another edge caseMaxim Kuvyrkov
... in bisection of merge history. We can detect first_bad commit with a good parent that is outside of bisection range. E.g., BAD | \ BASE \ | FIRST BAD | / PARENT In this case PARENT is the last good revision, but falls outside of bisection range. Change-Id: I4b88b6c7a245f390705df70943cccd70964fd7f6
2021-04-07tcwg-update-llvmbot-containers.sh: Move all flang bots into productionMaxim Kuvyrkov
We also add a silent copy of the bots to test them in migration to Ubuntu Focal images. Change-Id: Icbac7be0569d27fa1c83a7c5c536f9e7f853f7da
2021-04-06tcwg-benchmark-bare.sh: Delete temporary toolchain copies after useChristophe Lyon
We are accumulating local toolchain copies (via rsync currently), leading to disk full issues. We can remove them after the benchmark completed. The current patch does not delete the toolchain if the benchmark failed, because we run under 'set -e', and thus we exit/execute the trap handler before removing the toolchain. Change-Id: Ie52bf3498118046d057093c9db39763c44f1b0c1
2021-04-05Refactor tcwg_bmk-build.sh and tcwg-benchmark-results.sh for metrics.Prathamesh Kulkarni
The patch adds an option to tcwg-benchmark-results.sh called "metric", and calls corresponding scripts to convert relevant metric-data to csv files. And adds metric to rr in tcwg_bmk-build.sh, which is set to "perf" by default. The rationale behind this change is to refactor the scripts to simplify adding more metrics in future. Change-Id: I3dfd2a572faeea4b0034fe6a6bb635824b3d60c3
2021-04-01round-robin-bisect.sh: Fix handling of an edge caseMaxim Kuvyrkov
... when first_bad commit is the child of baseline_rev. In this case baseline_rev was not in orig_commits_to_test and we failed on "Broken bisection range" assert. Fix by adding all previously tested revisions to orig_commits_to_test, which is renamed to commits_in_range. Change-Id: Iad37dbdb24bcddf42721dc8526b5b63a64653624
2021-04-01tcwg_bmk-build.sh: Do not look for perf logs with target==arm_eabiChristophe Lyon
When benchmarking for arm_eabi, we do not produce perf logs, so inform tcwg-benchmark-results.sh about that. Change-Id: Ifa304bd42ca80cf5d7ba28d8bc3f7377bdbf6b77
2021-03-30tcwg-update-llvmbot-containers.sh: Run pre-production (silent) flang botsMaxim Kuvyrkov
... on tcwg-jade-01 and keep tcwg-llvmbot_d05-01 only for production bots. Change-Id: I24cf929a18db6fe825b5e05b82ed47a75a5a8e23
2021-03-26Make build_abe apply an optional patch for $component specified by --patch.Prathamesh Kulkarni
The change lets build_abe take an optional argument following --patch, that specifies a patch to be applied for $component. And in tcwg_bmk-build.sh, apply linaro-local/vect-metric-branch to stage-2 gcc for applying vect metric patch. Change-Id: Ica927685e40ea0ae3988557e5cb561c83abf2f3b
2021-03-24Move Flang oot new driver to silent master.Stevan Radaković
Change-Id: Ia8a659fb002f9295c8041d0acdfb0d2dce4185b2
2021-03-23tcwg-benchmark.sh: Use dedicated (non-multiplexed) connection for rebootMaxim Kuvyrkov
Change-Id: I50adad4a8fc28f63bdcab9fd55eb16e31607c2f8
2021-03-23tcwg-benchmark.sh: Don't wait 5min for ssh to break connection due to rebootMaxim Kuvyrkov
Change-Id: Ibbfb9ccd93e1cd93a08875e6ea4997c93d6e1473
2021-03-23tcwg-report-stale-rr-jobs.sh: Fix human outputMaxim Kuvyrkov
Change-Id: Icc1cc42ed906d8974a78f20430ca7b7e3cf76d2d
2021-03-22tcwg-benchmark.sh: Pass --image DOCKER_IMAGE to prepare-board.shMaxim Kuvyrkov
Change-Id: I0355ac53de92eb7a25d711d59e295ae46baf892d
2021-03-22tcwg-report-stale-rr-jobs.sh: Improve human outputMaxim Kuvyrkov
Change-Id: I6a79e541bdc648cc08a41f8ea2d9998cb62595a5
2021-03-22start-container-docker.sh: Move workaround for dockerhub's limitsMaxim Kuvyrkov
... to dockerfiles.git/tcwg-base/tcwg-host/docker-wrapper . Our workaround to dockerhub's pull limits in start-container-docker.sh works well, but with one exception -- it doesn't properly work when container is started on a remote host, which we do a lot in tcwg-benchmark-* jobs. To solve this we migrate workaround logic to docker wrapper script, and add a new docker command for it -- "maybepull". Change-Id: I131f1adc56052164a76c5dfaf9d07a4d2f24ec43
2021-03-19tcwg-report-stale-rr-branches.sh: New scriptMaxim Kuvyrkov
... to list unused branches in toolchain/ci/* repos, so that they can be removed. Change-Id: I0a17de670b552a2ea7cdeec8fb8be53d4603cb20
2021-03-19tcwg-report-stale-rr-jobs.sh: Add --human true/false optionMaxim Kuvyrkov
... to fine-tune output format. Change-Id: I12991b14093e96a6029d3433df410567e0c12951
2021-03-19tcwg-update-llvmbot-containers.sh: Remove buildkite containers from tcwg-jade-01Maxim Kuvyrkov
... since buildkite is a completely different thing from silent buildmaster. Change-Id: Ie2b83e39ef183976fc0b4d5f4a115ad50f6e6bbe
2021-03-19tcwg-update-llvmbot-containers.sh: Run silent containers on tcwg-jade-01Maxim Kuvyrkov
... to stress-test it. Change-Id: I177f630f7c15ec73d37bad6dba7cb6ac10ffa617
2021-03-17tcwg-report-stale-rr-jobs.sh: Improve outputMaxim Kuvyrkov
Change-Id: I53d69a5ec231c8ba520ca37f4bc313b1dfc25b4a
2021-03-17tcwg-report-stale-rr-jobs.sh: New scriptMaxim Kuvyrkov
... to list round-robin CI jobs that hasn't had a good run in several days (10 days, by default). We'll use this script to monitor round-robin jobs that are failing due to infrastructure reasons. Change-Id: I0a76f0737903c023737c5ba9b7ff95c66b0974ac
2021-03-15Move some workers to llvm master staging.Stevan Radaković
Galina asked that these three workers be moved to staging: linaro-aarch64-flang-debug linaro-aarch64-flang-latest-clang linaro-aarch64-flang-latest-gcc Change-Id: Iac573756369b176648b9a8750375ab2580ecea90
2021-03-12tcwg-update-llvmbot-containers.sh: Remove aarch64 libcxx buildbotDavid Spickett
This is handled by buildkite now. Change-Id: I193cf1d0ab4fc6970db06cd14d19347e4333ea48
2021-03-11abe-bisect.sh: Fix typoChristophe Lyon
Change-Id: I5980647619518b0f007d8d87a4becf95e7fea730
2021-03-11abe-bisect.sh: Fix 'check' phase for good and bad commitsChristophe Lyon
ABE requires that a 'required' step be present on the command-line, otherwise it does nothing. --check is not one of them, but --build is. This patch adds --build all, along with --disable update to avoid updating the sources after the first build. Change-Id: I0bf548c8ef638943339e0d9841d4da7a6f3f3418
2021-03-11abe-bisect.sh: Exit with an explicit error if no .sum was producedChristophe Lyon
Change-Id: I06168dbe2fb075664a322b7620d38edcf135678f
2021-03-09Add new Flang worker configs.Stevan Radaković
Add new flang bots for latest gcc and latest clang configurations. Change-Id: Ic447f6c578f8ed06bfd656c1bc07b34da982d4cb
2021-03-09Add new Flang worker configs.Stevan Radaković
Change-Id: I3d15a4811e3fa812b51da4a60fad6f19ec3ce5ab
2021-03-07tcwg_bmk-build.sh: Speed up toolchain builds for arm-eabiChristophe Lyon
Hardcode the cpu/float-abit/mode to speed up toolchain builds: the alternative of building rmprofile multilibs takes a very long time. Setting the values here has the drawback that we have to build one toolchain per board type. The only stm32 board we have currently has a cortex-m4 with FPU. Change-Id: Ia2626405f9a6ed42915e7b575465d82b6c44871c
2021-03-05tcwg-update-llvmbot-containers.sh: Run two more libcxx bots on amp-06David Spickett
These will add capactity to handle the armv7 configs. Ideally we'd want to build and test on v7 hardware but I don't want that to delay removing the existing buildbots. So for now these agents will report as "armv8l" and buildkite will use any of them for any v7/v8 config. Later we can find some v7 hardware and I'll rename them to reflect that. Change-Id: I2819c37ea9eb7dd6d73fa875386bfd5026a4b035
2021-03-05tcwg-update-llvmbot-containers.sh: Run libcxx buildkite armv8 bots on amp-06David Spickett
As for AArch64 we have exceptions/no exceptions configs so one for each. Either agent can build either config. Jenkins was using amp-06 but it no longer does. Change-Id: Icd1aa5a425a1c5c8dfa99809e48197bcc0f92e88
2021-03-03tcwg_bmk-build.sh: Use rmprofile multilibs when targeting arm_eabiChristophe Lyon
When targeting arm_eabi, we compile for Cortex-M and need the right versions of startup code and libraries. Change-Id: I7bf15b342c7b55117c66266004e0396f2a3dccfc
2021-03-03tcwg-benchmark-bare.sh: Fix toolchain copy via rsyncChristophe Lyon
Change-Id: I4331cededc199656e0e8f0981073f6ea1af61ef8
2021-03-02tcwg_bmk-build.sh: Use rsync to access the toolchain when target is stm32Christophe Lyon
When running benchmarks on stm32, it's easier to rsync the toolchain towards tcwg-bmk-stm32-01 (slave to which the stm32 board is attached) rather than involving the tricky process of rsync-ing the benchmark sources towards the builder and remote compile, like we do for Spec. Change-Id: I2c87bcc7fbc80ba9d75d5c88a33a15f8e928b5bc
2021-03-02tcwg-benchmark-bare.sh: Create the "run" container before needing itChristophe Lyon
In case we need to copy the toolchain to the "run" container, we need to start it early. Change-Id: Iafcea3ecbb3d2d080f5a18d80f63205b39abc490