summaryrefslogtreecommitdiff
AgeCommit message (Collapse)Author
2017-06-09tcwg-benchmark-results-compare.sh: New script for ↵bmk-cmpChristophe Lyon
tcwg-benchmark-results-compare job. This script processes result files from tcwg-benchmark job, compares them to a reference and generates a comparison table. Jenkins passes pointers to results via resultref and resultseval parameters. The syntax is the rsync-friendly syntax used in the other related scripts and jobs. This script calls tcwg-benchmark-results.sh from this repo to convert raw results into csv files, and then calls a comparison script in bmk-scripts to compare the two time.csv files. Change-Id: I44500448827700556886e85776cc007be936fd47
2017-06-02tcwg-benchmark.sh: Cleanup.Maxim Kuvyrkov
Change-Id: I1fd67a58427e2c1393289b49a71f32835b72a7c4
2017-06-01jenkins-helpers.sh: Add support for our new tcwg-tk1-09 board.Christophe Lyon
Change-Id: I3cbad75f65d417b621f85c8a5af98d24fa0bf029
2017-05-31jenkins-helpers.sh: Also fetch gerrit changesets in clone_or_update_repo.Maxim Kuvyrkov
Change-Id: Ie4a331135ddc06e917ca0aee0fb584e09424489f
2017-05-31TestRelease.job: Fix typo.Maxim Kuvyrkov
Change-Id: Ib11afc68b3c72d8b5920baa365564c805b968974
2017-05-31tcwg-benchmark.sh: Avoid stale containersMaxim Kuvyrkov
... by setting up trap handler before start-container-docker.sh. It turns out that if build is aborted, then we finish creating the container, but don't install the trap handler. It is not clear whether this patch will solve the problem or not, but it is worth a try. Change-Id: I8cfb4b0bdd5c2b1a3374a4e85e7151dd237e1108
2017-05-31tcwg-benchmark-results.sh: Fix permissions.Maxim Kuvyrkov
Change-Id: I41cd27697d38d06773a346d525b1f53cc5b77f50
2017-05-31tcwg-benchmark.sh: Enable setting resultsdest from a parent jobMaxim Kuvyrkov
... so that the parent job can process results. Change-Id: I04476aa0b7b6085353f9000cb7da42d07342ca21
2017-05-31tcwg-benchmark-results.sh: New script for tcwg-benchmark-results job.Maxim Kuvyrkov
This script is processing result files from tcwg-benchmark job, which passes it resultsdest parameter. The results are, normally, located in dev-01.tcwglab:/home/tcwg-benchmark/results/$BUILD_TAG/. The output is 2 files: time.csv has time data from "official" SPEC2k6 results, and sample.csv has 10HZ sample data from perf.data files. Change-Id: I90ac529d7265194f779184d51913adaa16322470
2017-05-31jenkins-helpers.sh: Make print_node_with_least_container more robustMaxim Kuvyrkov
... when starting multiple containers at the same time. Change-Id: I806f5b5a414ce116e6f7cacd9bdaff3ad15821a6
2017-05-31tcwg-benchmark.sh: Build on least-busy x86_64 builder by defaultMaxim Kuvyrkov
instead of dev-01.tcwglab. Change-Id: I59c00cbcf1637bab118e864469bf2d0147a5512b
2017-05-31abe-bisect.sh: Remove gcc.git~master directory before starting.Christophe Lyon
To make sure abe starts in a clean state. Change-Id: I5bc880ce82b3cd3f0214d1c634991d6d5c37077f
2017-05-31abe-bisect.sh: Cleanup workdir before starting.Christophe Lyon
To avoid starting a bisect in a non-clean directory. Change-Id: I469c1b43596f8e45b68937c4e930c2b20d602083
2017-05-31TestRelease.job: Use jenkins helper to clone repoMaxim Kuvyrkov
... to handle SHA1 parameters to tcwg_regression_rev. Change-Id: I5a85f259e1e664d57c8c55d5e97458ec896a1988
2017-05-31TestRelease.job: Add support for wildcards in --tarball optionMaxim Kuvyrkov
... and remove support for file:// protocol as well as other useless stuff. Change-Id: I1091870add7708ba4d1b9a21c120ba82fbeaac4e
2017-05-30tcwg-llvm-*: Function to find projects with a branchRenato Golin
Change-Id: Iec34423be746d6267342068037e88e287374ab58
2017-05-26tcwg-llvm-build.sh: Add list of projects to considerRenato Golin
As discussed in TCWG-1134, we need a list of projects to checkout if the branch is master and there is a revision (buildbot and pre-commit base cases) as well as a branch and no list (for pre-commit patch cases. The relationship between lists and branches is that having a branch and not being in the list is ok, but being in the list and not having a branch is not. This patch addresses that, so that we can create any number of trigger jobs without worrying about the parameters we pass. It should either be safe, user error, or the job will bail. Needs https://review.linaro.org/19777 to work. Change-Id: I83fa889f3d3ebf80f08ffed218d4e72e40a88ecc
2017-05-26wget_wildcard_url: Don't check certificate for *.tcwglab hosts.Maxim Kuvyrkov
Change-Id: I77cc5dd3fe08d928bceda8fa76d09297f0d15e0b
2017-05-25tcwg-benchmark.sh: Use parameters from environmentMaxim Kuvyrkov
It is a pain to sync parameters between tcwg-benchmark.sh and .yaml file. Change-Id: Ifcae66a9acb6fae1805305e15a3168b6462d9094
2017-05-24tcwg-llvm-build.sh: Use llc for target nameRenato Golin
Change-Id: If201cb6dcbfb4bbfef6576dcc664d4a26b2107b4
2017-05-24tcwg-llvm-build.sh: Work around cmake quotingRenato Golin
Change-Id: I6803f44dcf0191866fc3499f22cde1410ae62356
2017-05-23tcwg-llvm-build.sh: Better validation of empty argumentsRenato Golin
Change-Id: Ibfa165cc383e98b7ad11c7fcb88c2371c7d97fa0
2017-05-23tcwg-llvm-build.sh: Adding --cmakeflags optionRenato Golin
Change-Id: I0fd7fe1d0dfdd297c0c0784baaa291211c56103e
2017-05-23tcwg-benchmark.sh: Use unique configs for SPEC2k6.Maxim Kuvyrkov
Change-Id: Iff18ebcfe15f2bfe7062163368ce94ed5885465b
2017-05-23jenkins-scripts.sh: Consistently use "set -euf -o pipefail".Maxim Kuvyrkov
Change-Id: Ib884d086e12c9b4441884d864d6d0dbbd144b431
2017-05-23tcwg-benchmark.sh: Fix path to remote sysroot.Maxim Kuvyrkov
Change-Id: I624d81597ab00ea08a1a0680dd48b0ece5d311fb
2017-05-23tcwg-benchmark.sh: Add missing option.Maxim Kuvyrkov
Change-Id: I3be3602dff67eef101e7febf23a5e382647ca091
2017-05-23tcwg-benchmark.sh: Use wget_wildcard_urlMaxim Kuvyrkov
... to support tcwg-benchmark-release job. Change-Id: Ife885d5d5b9ff6eb47135022905be17d51edfb65
2017-05-23jenkins-helpers.sh: Handle extra options to wget_wildcard_urlMaxim Kuvyrkov
... like "--no-check-certificate" when downloading from dev-01.tcwglab or "--directory-prefix=. --continue", when want to update files. Change-Id: Ie8a1e8e9522b09d25a7b77a21f1da8e7e7b602a9
2017-05-23jenkins-helpers.sh: Add wget_wildcard_url helperMaxim Kuvyrkov
... to download URLs like http://releases.linaro.org/components/toolchain/binaries/latest/aarch64-linux-gnu/gcc-linaro-*-x86_64_aarch64-linux-gnu.tar.xz . These are helpful in jobs like tcwg-test-release and tcwg-benchmark-release. Change-Id: Ia986923ea917d4d58a653eb032715aad0ec3175a
2017-05-22jenkins-helpers.sh: Improve clone_or_update_repo.Maxim Kuvyrkov
Change-Id: Ib337fe33afcb4de13d819ecc05e4722ad2504a3e
2017-05-22jenkins.sh: Collect .sum files only if --runtests was provided.Christophe Lyon
Otherwise check-artifacts.txt does not exist and grep fails, making jenkins.sh fail too. If --runtests was not used, we do not want to fail for lack of .sum files. Change-Id: I6cb7736cf40ec4b036d5806b9ee89a6f3d8dbb53
2017-05-22jenkins.sh: Remove use of Jenkins env variables.Christophe Lyon
Since these variables are not propagated to the containers, stop using the empty values for: NODE_NAME, JOB_NAME, BUILD_USER_FIRST_NAME, BUILD_USER_LAST_NAME, BUILD_USER_ID. This patch removes the use of BUILD_URL only when printing it to the manifest, and does not remove the uses of BUILD_URL when acquiring the build lock, which should be done in a later patch. Change-Id: I3f4677cb174c3d8604fb0c57a4de39e38d4187ce
2017-05-22tcwg-benchmark.sh: Handle --sysroot tarball.Maxim Kuvyrkov
Change-Id: I590035378964c6c13d7b07cd3de954881c62e269
2017-05-22tcwg-benchmark.sh: Handle --toolchain_url ssh://builder:ccprefixMaxim Kuvyrkov
Change-Id: I0a843c1a6db6644e25a26dafb0d3d417b8382010
2017-05-22tcwg-benchmark.sh: Pass run_profile to bmk-scriptsMaxim Kuvyrkov
... and re-arrange resultsdest path. Change-Id: I63de501c6860f0b883bf6949a3698de2d60aa828
2017-05-22tcwg-benchmark: Move code around to prepare for new features.Maxim Kuvyrkov
Change-Id: I3dd667c111de79c462890896101f56ca01f685ae
2017-05-22tcwg-benchmark: Remove useless parameterMaxim Kuvyrkov
Change-Id: Iec02de5abd9381be0f73297e56d9106b087a4d9f
2017-05-19tcwg-llvm-*: Only clone the repos that have the specified branchRenato Golin
This implements the simplest way to do a pre-commit test as described in TCWG-1124: Any tree that needs building will push to the appropriate branch all the projects that they need, regardless of changes. This can only work if the underlying process guarantees that: 1. No user will ever create a repo with that name, even by accident, for example, by Forcing an exclusive namespace like jenkins-test/username/branch. 2. The branches are deleted at the end, regardless of success or failure. To re-start a build on the same branch, just push it again and re-run the job. This may not be possible for Jenkins to do (as it doesn't have write permissions to all git repos we could possibly try to build from), so this will need some coordination with the rest of the LLVM scripts. This change also re-factors how to checkout the llvm repositories, so that we can control on a branch level and collect only the relevant SVN revisions from the branches we have actually checked out. Change-Id: I2f77ac49f23ce79f2057f1cc90e1ccd63e2a45f4
2017-05-18start-container-docker.sh: Source jenkins-helper.shMaxim Kuvyrkov
... to provide remote_exec. Change-Id: I3ed874ac3368665275eabb7bf012b41f6be0e5b5
2017-05-18tcwg-benchmark.sh: Rsync bmk-scripts to the boardMaxim Kuvyrkov
Bmk-scripts is cloned by the by scm plugin. Change-Id: I60a2140b6094043cab0c752b378f500659a16b63
2017-05-18jenkins-helpers.sh: New helper to clone/update repos.Maxim Kuvyrkov
Change-Id: I7f70eb448df590db2e810e2e5bbf8a56b18911fe
2017-05-18tcwg-benchmark.sh: Handle more parameters.Maxim Kuvyrkov
Change-Id: I3cc6581cdb3cbefade7b880ca35685d65ba6db69
2017-05-17jenkins-helper.sh, start-container-*.sh: Remove unneeded optionMaxim Kuvyrkov
We forward ssh-agent by default in .ssh/config. Change-Id: I30d2b71ff07b2a2fbee7c130de91059de5d3ade4
2017-05-17tcwg-benchmark.sh: Make shellcheck cleanMaxim Kuvyrkov
Change-Id: If759950c71f7478a5a94fc5cc1e53244bb75d379
2017-05-17start-container-docker.sh:Use remote_exec in ${prefix}container_execMaxim Kuvyrkov
Change-Id: I321bcd7bd9748d0aa4b3328513859540979c95f1
2017-05-17jenkins-helpers.sh: Add remote_exec helperMaxim Kuvyrkov
Change-Id: I709feab6aa37e6b9b1302fe31f39be063d27115d
2017-05-17tcwg-benchmark.sh: Make sure to not use uninitialized variables.Maxim Kuvyrkov
Change-Id: I726565c5ba0e30775adc9d91e05cf3f94bab4c46
2017-05-17tcwg-benchmark.sh: Add missing shebang.Maxim Kuvyrkov
Change-Id: I61031d4765eb37a2bbfb4105bdac5e457b1e7581
2017-05-17tcwg-benchmark.sh: Add processing of arguments.Maxim Kuvyrkov
Change-Id: I7b14bcf92c2d24f54255426e035e7ee0e14d1d51