summaryrefslogtreecommitdiff
AgeCommit message (Collapse)Author
2019-01-11jenkins-helpers.sh: Include contents of sourced config files in manifestMaxim Kuvyrkov
Change-Id: I12bfdcbc182ed807a6ea06f464122e9a8cecaa19
2019-01-11jenkins-helpers.sh: Create directory for manifest file.Maxim Kuvyrkov
Change-Id: I2a430189c09e5f1a4bcb51ecdad32e218ab7b844
2019-01-09tcwg-update-llvmbot-containers.sh: Handle TK1 botsMaxim Kuvyrkov
Change-Id: Icbaa2d4992858016fd993f805eceb25cd7b8b17a
2019-01-07git_init_linaro_local_remote to use toolchain/ci/* instead of the same repoKugan Vivekanandarajah
Change-Id: Iffb597ab8dbf676779c3a2135baf9d2f536cc808
2018-12-21tcwg-benchmark.sh: Use '22' as default port for ssh:// type of toolchain_urlChristophe Lyon
Change-Id: I4217c5c3f2b677f00a8bb43bb56b9044aa1b83ba
2018-12-21tcwg-benchmark.sh: Determine toolchain_type when toolchain_url is of ssh:// typeChristophe Lyon
Change-Id: Iab7b696ba0972db8e2362aa0896af9a35e179839
2018-12-21tcwg-benchmark.sh: Add sanity check for toolchain_typeChristophe Lyon
Make sure we could determine it. Change-Id: I5ac789d0ec8eb78ea016e83751ed132d8900cc92
2018-12-21tcwg-benchmark.sh: Support ssh:// method for sysroot.Christophe Lyon
Change-Id: I8397a8bcbeda5892d314f0675cc9be0c428cd214
2018-12-21tcwg-benchmark.sh: Force use of build_container_port when copying sysroot to ↵Christophe Lyon
build container. Change-Id: I4d7400dc9c138e1e7a5339dadfafd6aa4aaf9a26
2018-12-21tcwg-benchmark.sh: Do not create a remote build container when using ssh.Christophe Lyon
If toolchain_url is of ssh:// type, do not create a remote build container, just use the ssh connexion as provided. Change-Id: Id93be63fd61a0d99d433d7b6ebb65f0e1c2473f8
2018-12-18tcwg_kernel-bisect: Workaround '"' occurencesMaxim Kuvyrkov
Double-quotes can occur in git-show and git-log output, so replace them with single-quotes to avoid ending $CI_MAIL_BODY prematurely. Change-Id: I83a9786b6fdc023e302941a10d1372a479227448
2018-12-18tcwg_kernel-bisect: Improve email formattingMaxim Kuvyrkov
Change-Id: Ie3eb61223c45bd26872402533e1162e2d9eb8106
2018-12-18tcwg_kernel-bisect.sh: Update email recepients.Maxim Kuvyrkov
Add Tri Vo and update settings for Maxim K. Change-Id: I59201cae01b4e04d86d3dae89830b802e4f82dbb
2018-12-18tcwg_kernel-bisect.sh: Improve mail contentsMaxim Kuvyrkov
This requires us to switch from "properties-file" to "script-file" in JJB inject builder. Change-Id: Iab56b55c9e8209696137fdf0218ec327f8d7e535
2018-12-18tcwg_kernel-build.sh: Add new --mode reproduceMaxim Kuvyrkov
... to reproduce a previous build using manifest. Change-Id: I21521204a3d8b409c7dbf1c45137ddb8c6f85f15
2018-12-18tcwg_kernel-bisect.sh: Create artifacts directory earlierMaxim Kuvyrkov
... so that convert_args_to_variables can create manifest file when needed Change-Id: I21e484cb88c15a2dfe1c767663faf71445dc9214
2018-12-18tcwg_kernel-build.sh: Improve checking of parameters.Maxim Kuvyrkov
Change-Id: Iba94ba9ea421f2dc326b8909a71807ebe46a52b4
2018-12-18jenkins-helpers.sh: Add git_rev_parse_longMaxim Kuvyrkov
... which will be used for manifest generation. Change-Id: I5402707efc785f0dee507ce597f5ceefe88eaebc
2018-12-14jenkins-helpers.sh: Resolve absolute path to manifest file.Maxim Kuvyrkov
Change-Id: I3763506b1f6e2577022ae238d2a03c72acb05b4b
2018-12-14Alter timeout to work in the presence of set -ePeter Smith
The run_with_timeout_and_retry did not account for set -e so when the first command failed there was no retry. Changed to run the command in a subshell following the example of timeout in print_node_with_least_containers. Also renamed retval to ret to be more consistent with the rest of the script. Change-Id: I2f157b81914fc558d67e484e66c0108915c58dd8
2018-12-14round-robin.sh, tcwg_kernel-build.sh: Remove ${rr[git_read_only]}Maxim Kuvyrkov
This assert variable turned out to no be useful. Change-Id: Ibea06f6bab6e11ae2625bb1e440fbee1319decf7
2018-12-14tcwg_kernel-build.sh: Move round-robin helpers to round-robin.shMaxim Kuvyrkov
Change-Id: I6753fae4d94add85b5729ea1b121395ae5c679f0
2018-12-13tcwg-rsync-dir.sh: Use "FAILED" instead of "FAIL"Christophe Lyon
When looking at logs in the Jenkins console, searching for "fail" matches "pipefail" and "failure(s)". Using "FAILED" like in other tests helps quickly find where the problem is. Change-Id: I6b4a9e4699e9bc5df5667bf8bb1a326b18ae8db5
2018-12-13tcwg_kernel-bisect.sh: Fix more typos.Maxim Kuvyrkov
Change-Id: I84d39cf55217a091d365c3310ef3a02e386e9ab5
2018-12-13tcwg_kernel-bisect.sh: Add missing shift to process second set of flags.Maxim Kuvyrkov
Change-Id: I35a8b200eb558682bc27f182047983e6885bf143
2018-12-12tcwg_kernel-bisect.sh: Fix typo.Maxim Kuvyrkov
Change-Id: Id10d5e6b7246b70c53902460a41aaeee81b8c384
2018-12-12tcwg_kernel-build.sh: Fix typo.Maxim Kuvyrkov
Change-Id: I6bd417e5f36d7df05d530d9633117fce4d9f315f
2018-12-12tcwg_kernel-build.sh: Document ${rr[]} elementsMaxim Kuvyrkov
Change-Id: Ib2b7461f191a0a47df5ee61f21c2279c20707268
2018-12-12Fix handling of $top_artifactsMaxim Kuvyrkov
Make handling of $top_artifacts same as all other rr[] variables Change-Id: I9343217bf819bd46fa8d418c6549c4be32e4afd3
2018-12-12tcwg_kernel-build.sh: Make check_regression depend only on ${rr[]}Maxim Kuvyrkov
rr[reset_baseline]="$reset_baseline" Change-Id: I101947234502348c8f9ea32463c0ce31d7598fe9
2018-12-12tcwg_kernel-build.sh: Make build_linux depend only on ${rr[]}Maxim Kuvyrkov
rr[linux_config]="$linux_config" rr[toolchain]="$toolchain" Change-Id: I3a8bb31e2c9cb6954810fa8cd3b3215356c8730d
2018-12-12tcwg_kernel-build.sh: Make build_abe_1 depend only on ${rr[]}Maxim Kuvyrkov
rr[target]="$target" Change-Id: Ie0807b4c57f67f34c0363ea322ca42b4d0c56bfe
2018-12-12tcwg_kernel-build.sh: Make reset_artifacts depend only on ${rr[]}Maxim Kuvyrkov
Rename rr[current_project]="$current_project" rr[current_rev]="$current_rev" rr[git_read_only]="$git_read_only" rr[mode]="$mode" Change-Id: I6bb6a946f9a78d5ae89456b1b7345f020de9734a
2018-12-12tcwg_kernel-build.sh: Rename reset_artifacts depend only on ${rr[]}Maxim Kuvyrkov
Rename $top_artifacts -> ${rr[top_artifacts]} $baseline -> ${rr[baseline_branch]} Change-Id: I87d07cf41bbbce2fe020c1b84c782ce412e6f596
2018-12-12tcwg_kernel*: Rename git_repo and git_branchMaxim Kuvyrkov
This is a mechanical change to rename: git_repo[X] -> rr[X_url] git_branch[X] -> rr[X_rev] Change-Id: Idda39b49950b414fa6bacdb0094d5cb125d1867d
2018-12-12tcwg_kernel*: Rename config[*] to rr[*].Maxim Kuvyrkov
This is beginning of a massive variable renaming patch series. The goal is to encapsulate all configuration variables that round-robin routines are using into "rr" associative array. This encapsulation will allow to move round-robin routines such as clone_repo, prepare_abe, build_abe, etc. into helper file and make it depend on a well-documented array of configuration variables "rr". Change-Id: Ie8aad82c1527ced79465fa8d21a1eaa0b11f5e7b
2018-12-12tcwg_kernel-bisect.sh: Use manifest support to pass parametersMaxim Kuvyrkov
... to "build" script invocations. Change-Id: I7ee557bcaf405fd1059c73052d8f74c010deeae9
2018-12-12tcwg_kernel*: Stop using and remove default configurationMaxim Kuvyrkov
Rely on manifest snippets in tcwg_kernel/* instead. Also make obligatory_variables handle bash arrays by using "declare -p". User-visible change is that now developers will need to explicitly add "@@ ./tcwg_kernel/gnu-master.sh", etc., which have been default in the past. Change-Id: I788e7cdca098fddeb67e9087252f9d53691407bf
2018-12-12convert_args_to_variables: Rework handling of configuration variablesMaxim Kuvyrkov
1. Add support for bash associative arrays to convert_args_to_variables via "==arr[elem] value" syntax. 2. Improve convert_args_to_variables to use "declare -g" directive to declare variables in the global scope -- instead of "eval var=val" approach. Change-Id: I351669734a3d0e3b6aa1edbf8fa9cb071487775a
2018-12-12Add timeout and retry utility and use it for git clone and fetchPeter Smith
Git has been observed to hang at the git fetch-pack stage when either the git or ssh protocol is used to both local and remote repositories. There are a number of possible reasons for this to happen and it is not unique to Linaro. To work around a hung job keeping a slot open for many hours we add a timeout and retry mechanism that will at a minimum fail fast. Change-Id: I7bcfc66f2ff3b2ceab7dad148effe3397705136e
2018-12-11jenkins-helpers.sh: Avoid stale info in the manifestMaxim Kuvyrkov
... in convert_args_to_variables Change-Id: Ib270cd36c5de170f5e45d18579f70a46cd822298
2018-12-11tcwg_kernel-build.sh: Remove unnecessary indirection via ${git_dirs[]}Maxim Kuvyrkov
Change-Id: I0a7c32c871d33044be172855d037f152b2f5f82f
2018-12-11tcwg_kernel-build.sh: Add --mode continueMaxim Kuvyrkov
Add new "--mode continue" for developer purposes. Preserve existing artifacts and continue build from specified step. Change-Id: I4694cd8ae08f8ea2a5ef9a6c891c731449dc572e
2018-12-11tcwg_kernel-build.sh: Support building glibc and gcc-stage2Maxim Kuvyrkov
Make ABE routines more generic to enable building glibc and gcc stage2. These routines are going to be moved to round-robin.sh helper files to share with other jobs. Change-Id: I81038aa53293075faba643e4ad93303d5bd18041
2018-12-11tcwg_kernel-*.sh: Remove --tidy supportMaxim Kuvyrkov
Now that we are sharing workspaces among all configurations, we no longer need to be super-careful about disk space. Change-Id: I2702fe9ced1b104a335f91982ec06b1798bc80e9
2018-12-11tcwg_kernel-bisect.sh: Fix typo.Maxim Kuvyrkov
Change-Id: I088edfd403ca6c5e426357b3a830260f248c2b81
2018-12-11tcwg_kernel-bisect.sh: Update to use new format of "@@" inclusion directiveMaxim Kuvyrkov
Change-Id: Ie8aad82c1527ced79465fa8d21a1eaa0b11f5e8b
2018-12-10jenkins-helpers.sh, tcwg-update-snapshots_ref.sh: Add tcwg-sq-* machines.Christophe Lyon
In tcwg-update-snapshots_ref.sh, use the label associated with the 64-bits view of these machines, like we do for the other types. In jenkins-helpers.sh, like for other machines, handle both 32 and 64 bits views. Change-Id: I5b9119c138a9078d51fe374f3706922231200a4b
2018-12-07jenkins-helpers: Add manifest generation logic to convert_args_to_variablesMaxim Kuvyrkov
... and re-work bash sourcing logic "@@" to be more flexible / verbose. The idea is that specifying "%% ./manifest.sh" as the 1st argument on the command line will cause all subsequent arguments to be logged in ./manifest.sh. A reproducer build then can include "@@ ./manifest.sh" and reproduce the original build. Build environment that is not on the command line (e.g., repo revisions) can be added to the manifest with help of "manifest_out" helper. E.g., command-line argument "--current_rev master" will be logged in manifest as == current_rev="master" == and then logic in the script can override that with cat <<EOF | manifest_out current_rev=$(git rev-parse HEAD) EOF thus producing manifest with == current_rev="master" ... current_rev=abc123cab == Change-Id: I066be570c08eda4f80f148dccf475d1794eba229
2018-12-07tcwg_kernel-bisect.sh: Add useful suffixes to artifacts/build-* directoriesMaxim Kuvyrkov
Add -first_bad, -last_good, -baseline, and -bad suffixes to appropriate log directories. Change-Id: I0aca22ee185992aa156a3de71a156e81f637542c