Do not fail job on CIBT unil sequence works

Change-Id: I10c292096dae34936b8dcbfbc8d383a21ed02bfd
Bug-AGL: SPEC-2267
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Remove naginator

Change-Id: If28032d92dccc49991ec578dae88fbc221833c12
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

This section needs special handling

TODO: rewrite to run under set -e !

Change-Id: I4f26d8e5de03d2a16a6b8c8825ce7bc9df8da5d4
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Merge "Add caller to new branch argument for releng"

Merge "jjb/common/include-agl-lava-jobs-submit.sh: add a missing then"

jjb/common/include-agl-lava-jobs-submit.sh: add a missing then

this patch adds a missing "then"

Change-Id: Iaddfc12597864e3ba35a12baa6b0716660d969b3
Signed-off-by: Corentin LABBE <clabbe@baylibre.com>

jjb/common/include-agl-app-run-test-short.sh: Fix a typo in the qemu machine namme

include-agl-app-run-test-short.sh use the wrong qemux86_64 instead of qemux86-64 machine type

Bug-AGL: SPEC-1850

Change-Id: Ib029b7fdcc85dd45cbb467bc9d42edb1c14b9338
Signed-off-by: Corentin LABBE <clabbe@baylibre.com>

Add caller to new branch argument for releng

This is necessary to deal with the dtb changes in releng and not the CI scripts.

Change-Id: Ia12a8ccbb0527f7bd4a5518aeaefc5dafd7a7919
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Print out original job URL

Instead of the verify-fail job print the parent job url.

Change-Id: Id7b9f24d93eb527ecadeb4e3dfbf06c39b719410
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Use a 2-phase build pipeline

emulators first, then devboards.
A failing emulator build will abort instantly.
A failing devboard build will let the others continue.

Change-Id: Ice71a36c166cd04c1c501951e2702d58d4b2a2f7
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Merge "jjb/common/include-agl-app-run-test-short.sh: Fix a typo in the arch given by jenkins"

Delete-lava-tool-commands-already-replaced-with-lava

As the lavacli works fine now, the lava-tool part is no longer needed.
This patch delete just the part to list the devices and the part of auth
using lava-tool.

Change-Id: If3e27de642b4c5f901dec4453341dc07f71873d8
Signed-off-by: Khouloud Touil <ktouil@baylibre.com>

Replace lava-tool with lavacli

In order to move totally to lavacli, this patch:
- Apply changes to submit jobs using lavacli. As the blocking call
(--block) no longer exists with lavacli, so had to replace that with
a polling loop.
- Replace lava-tool with lavacli in the polling part in the labs-prepare
file, which checks the device status and availability.

Different changes tested at Baylibre.

Change-Id: I25b1ad4b47ae09a158e1e1cf42e30da5e6aa8b57
Signed-off-by: Khouloud Touil <ktouil@baylibre.com>

Continue repo sync even with broken (external) repositories

This avoids breaking CI with broken external repo
(as long as we don't build that very target).

Change-Id: I695506068b9ee49044f6ea15ed2277d5104adc7c
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Trim down the hwtest slave

Change-Id: I69e0bd20128fe41cd0953bea94e07ae5c4f86243
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Extend hwtest slave size to 10G

Change-Id: I4310988f32bc734987d0b785cef216a9ddd1388b
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Change to small instance

Change-Id: I553295d7809390f16616e692037630e98f291a03
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

No preclone needed in hwtest slave

Change-Id: If639a2d179f740235104be4e98bbeda498a6100b
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Allow backports from archive

Change-Id: Ifc8a61d2f419bc2bbad9b6cd1b6485892343a530
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Add smaller image template for hwtest slave

Change-Id: I80ab0095e62c48d9b9e75dfcbc3bb3cce8c75205
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Pull jessie-backports from archive

Needed for the build infra uprev.

Change-Id: Ic329208b55d9b29c791eff42d721ec31a2f97e6f
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

jjb/common/include-agl-app-run-test-short.sh: Fix a typo in the arch given by jenkins

Jenkins use the x86-64 arch, and not x86_64

Bug-AGL: SPEC-1850

Change-Id: Ia2f7b867d4a482f2cc6cfcfa3415c0151b1b1acc
Signed-off-by: Corentin LABBE <clabbe@baylibre.com>

Expand host size

Change-Id: I6e4464616fe8b240de808ba493cd449bcc1471e7
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Add repo tool

Change-Id: I1766a6fe269cf64c379d2e1f8241325e18301b1a
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Adapt build flavours and enable blockstorage after packer update

Change-Id: If1722716e50efdf7f78e9ff0fd53353f492b9959
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Rebuild control slave using non-optimized version first

Change-Id: Icd916f399b2dcc1bb3877f876acbb3b89aca1caa
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Add volume size flag as well

Change-Id: If06ca887d6afca794645382949ec75fae30c72ee
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Redo new baseimages with packer vers 1.4.0

and use the new image_disk_format

Change-Id: I17fa60f6013d5382237cdb100717cc9776945ac5
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Merge "Add credentials for APP test"

Add credentials for APP test

Change-Id: Id6c2b66e5ede69da4291d713a5c5d3c88037d5ca
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Merge "Remove select include"

Merge "Update application list"

Remove select include

It is not needed in the app context.

Change-Id: I23b8dab632df705fd06bf5dd9e99f772c68caa22
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Update application list

Change-Id: If8052d296ea711c376a9394c1522710ab6c3bd2f
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Merge "SPEC-1850: Implement CIBT for applications build"

SPEC-1850: Implement CIBT for applications build

This commit enable CIBT for applications.
For keeping the same naming for GERRIT_PATCHSET_NUMBER and
GERRIT_CHANGEID_NUMBER and use of the new releng-scripts app-changeid/app-patchset,
we use a new jjb/common/include-agl-app-run-test-short.sh

Change-Id: Ic2a93327236b932ae43125a172237a3882f4569e
Signed-off-by: Corentin LABBE <clabbe@baylibre.com>

Change TARGETSDKARCH to include new flags in thud

armv7vehf-neon-vfpv4 vs. armv7vet2hf-neon-vfpv4

Change-Id: I89be8589bd79ed3ed618da240f0f8e26a7ca3477
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Debug sdk installation

Change-Id: I59c6a679176ad711fc0595ad349148e78f3ede44
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Add missing character

we were missing '-' in the variable substitution. Fix it.

Change-Id: I4579304d1a594d7dbb3042850e94ffa5e083f2cc
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Temporary fix for device dtb changes until templates are fixed

Change-Id: I95a5c5e3f9d2ea43885de0fefec1cb2faf82fbea
old: uImage-bcm2710-rpi-3-b+vc4+ft5406.dtb
new: bcm2710-rpi-3-b+vc4+ft5406.dtb
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Merge "Revert "Updated machine spec""

Revert "Updated machine spec"

Unsupported by builder atm.

This reverts commit ab4982bce22b34d81b382d480f7a0d94bc1684ca.

Change-Id: I044bab978ddb50fb5fd3c51928b5079a78d9f62d

Merge "Updated machine spec"

Updated machine spec

Change-Id: I16284e1e28b621a06fd3eff93f961193faaae04b
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Merge "Update basebuilds for iops-optimized workers"

Update basebuilds for iops-optimized workers

Change-Id: Idc8dd9ddccdb59ab9baab0521f943f5d98d98042
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Add credentials for email reporting

Change-Id: If949f83e713688965e2c3fc7c833b101959e8e57
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Make sure to remove tmpdir

Change-Id: Ie2db7f66f76ac64c66fd87671e3be78094e993b2
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Fix for baseurl

Change-Id: I8aff2436d2404aad841c7e6a45ac2eba8c0a6e61
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

New doc site updates

Change the workflow to the new model.

Change-Id: Ie26250d47240e7113372df4b1e6e9e8d235d7864
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Workaround for intra-cloud requests

Revert when fixed.

Change-Id: I5ee0ab8eb06628d7a7e07bfb6eea23bc958a9b0c
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

jjb/common: lava-labs-prepare: check only the available boards

To avoid choosing a board with an offline status, this patch check
and lists only the boards with an Idle,Good status.

Change-Id: I64673c87b038b7e7e82001f7bfd2a35af5b73d60
Signed-off-by: Khouloud Touil <ktouil@baylibre.com>

Merge "Fix the --name argument"

Fix the --name argument

As the 'RELEASE_BRANCH' and 'RELEASE_VERSION' have been replaced with
'DIST_BB_AGL_BRANCH' and 'DIST_BB_AGLVERSION', so this patch fixes the
'--name' to use the new arguments.

Change-Id: I75448cf56b60fbef03adfceb70197e48069ab96a
Signed-off-by: Khouloud Touil <ktouil@baylibre.com>

Fix bug on failure reporting workflow

Do it as publisher and not in the multijob.

Change-Id: I3fc1a8fc5f9815daf62fc49370f527461ce45745
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Update application builds

Add latest projects.

Change-Id: I9e7bae1c365571da559eff3260ec1850eececee3
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Merge "Correct typo"

Correct typo

Remove extra double quote.

Change-Id: Ic1f6454fa258c51afbc2963dba78380d05ff1884
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Workaround for gerrit migration part 2

Change-Id: I0068c7365490766ff96b96437b1f20f542654283
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Add option to disable sstate-mirror in release builds

Change-Id: I4149a9a2eee0d96acd4900f4daf250a6dde71701
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Enhance reporting on platform side

Failed builds will now report -1.

Change-Id: Ic4b3e788a1cedf53771eff00e38cddcbd8729154
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

jjb/common: lava-labs-prepare: fix the url

This patch fixes the url when adding the identities using the lavacli
tool.

Change-Id: I0c0bab0cec63a06d74581e1f05c94d25befcc238
Signed-off-by: Khouloud Touil <ktouil@baylibre.com>

jjb/common: run-test-short: fix the link of the UPLOAD_URL

The UPLOAD_URL lacks the name of the machine, so this patch fixes the
link from where to upload the build-info file.

Change-Id: Ia80e80092eaacfae3cb68d819309d6e819405257
Signed-off-by: Khouloud Touil <ktouil@baylibre.com>

jjb/common: run-test-short: fetch/source build-info

Before trying to cat/source build-info, we have to fetch it from the
location where it was uploaded during the main build phase.

Change-Id: Ic9d8916a3a349f3b29cb2d5ef558c78729703908
Signed-off-by: Kevin Hilman <khilman@baylibre.com>

jjb/common: add build-info to uploads

Change-Id: I0e780bbdafd912a3734292f895f9788f3a8c22e9
Signed-off-by: Kevin Hilman <khilman@baylibre.com>

Merge "Add ssh token to doc update job"

Merge "run-test-short: Check the existence of the 'build-info' file"

Merge "Update gerrit key after migration"

Update gerrit key after migration

The migrated gerrit has new host identification. Adapt the dynamic slaves.

Change-Id: I0eaf421eb1df0d789a3bfd96ede2803b1eb4df2a
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Add ssh token to doc update job

Change-Id: I68e43589489af9bc76c99561090ef6e4324db3c2
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Merge "Uprev documentation job to display -next"

Merge "Add debug output and avoid key issues"

Uprev documentation job to display -next

Upload will be to https://docs.automotivelinux.org/next

Change-Id: I85b55026e16d2b47f213ede6d359af97aa58e09f
Bug-AGL: SPEC-2044
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Add debug output and avoid key issues

This needs to be debugged after the migration of the gerrit server.

Bug-AGL: SPEC-2273

Change-Id: I8f921ff3d64be5f6061e1a3d7b6b43c29e018bd7
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

run-test-short: Check the existence of the 'build-info' file

Before displaying the content of the 'build-info' file, we have to check
if this file exists.

Change-Id: I029e9ca65a182724ce447c6e1d69db246a681dc9
Signed-off-by: Khouloud Touil <ktouil@baylibre.com>

jjb/common: lava-labs: lavacli should not be fatal

For now, the use of lavacli is for debug only, so failure to list
devices with lavacli should not be fatal.

To fix, remove the `continue` so if it fails, it fill fall through to
the legacy use of lava-tool.

Change-Id: Id55622e1b0f3d9c0e90673b24e8fa3642a15bee9
Signed-off-by: Kevin Hilman <khilman@baylibre.com>

jjb/common: lavacli: no username in URL

Don't use a URL with a username in it for the lavacli config file.
The lavacli config file already has a `username` field, and having it
also in the URL makes lavacli fail.

Change-Id: I88e8ce06519b0b09476d5a4bc693b95b40f20e59
Signed-off-by: Kevin Hilman <khilman@baylibre.com>

jjb/common: lava-labs-prepare: fix lavacli config error

lavacli doesn't like an empty config file.  The first "identities add"
will automatcially create the new config file, as long as the
~/.config dir exists.

Change-Id: I337f8b6883362a0f01b58e34645c825a186ab7d7
Signed-off-by: Kevin Hilman <khilman@baylibre.com>

lava-labs-prepare: Fix lavacli auth add error

lavacli is returning an error if the config file for adding identities does
not exist.
Create the file before using `lavacli auth add`

Change-Id: I3928355055299ddbdd1d269d74a762a563577fb8
Signed-off-by: Loys Ollivier <lollivier@baylibre.com>

Merge changes I81dfc60f,I56fe3edc,Ic1bf8296,Ifd68eb42,Iddf7394c

* changes:
  Use the --version argument
  Use the --branch argument
  Use the new --build-id argument
  Use the new --commit argument
  Modify the --build-version content

Merge "Use the build-info file"

Fix timeout

The indentation was wrong for the timeout to be applied.

Change-Id: Ie556d3e61400585770f476057921b9decb6185d8
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

AGL-verify/ci-platform: add QEMU arm/arm64 builds

Change-Id: I0554333c0760af73e9b303acebd81c7050ed8b8e
Signed-off-by: Kevin Hilman <khilman@baylibre.com>

Use the --version argument

This patch uses the --version argument that will contain the
DIST_BB_AGLVERSION value that is extracted from the build-info file.

Change-Id: I81dfc60f290db8983af9dfcc51f47a71c1a2b031
Signed-off-by: Khouloud Touil <ktouil@baylibre.com>

Use the --branch argument

This patch uses the --branch argument that will contain the
DIST_BB_AGL_BRANCH value that is extracted from the build-info file.

Change-Id: I56fe3edcfc73b0ce661181283f029026e2b37811
Signed-off-by: Khouloud Touil <ktouil@baylibre.com>

Use the new --build-id argument

This patch uses the new --build-id argument of create-jobs that will
contain the DIST_BUILD_ID value that is extracted from the build-info
file.

Change-Id: Ic1bf82967a4cd94bce9701251d7f5a9700998271
Signed-off-by: Khouloud Touil <ktouil@baylibre.com>

Use the new --commit argument

This patch uses a new --commit argument that will contain the
DIST_BUILD_HASH value that is extracted from the build-info
file. These changes are in both files 'include-agl-run-test
-short-guppy.sh' and 'include-agl-run-test-short.sh'.

Change-Id: Ifd68eb4270f3540e1a379fac135d7f290374d1d7
Signed-off-by: Khouloud Touil <ktouil@baylibre.com>

Modify the --build-version content

Modify the --build-version content to take the DIST_BB_DISTRO_VERSION
content which is going to be extracted from the build-info file in both
files 'include-agl-run-test-short-guppy.sh' and 'include-agl-run-test-short.sh'.

Change-Id: Iddf7394c624a5fdc08cddf806eaebb70456c4398
Signed-off-by: Khouloud Touil <ktouil@baylibre.com>

Use the build-info file

The build-info file contain a lot of useful informations that could
be used differently. This commit adds a source command to use these
informations in both files 'include-agl-run-test-short-guppy.sh'and
'include-agl-run-test-short.sh'.

Change-Id: I67c216defbde6589901de24c674b840ba692a814
Signed-off-by: Khouloud Touil <ktouil@baylibre.com>

Avoid any issues in the regexp for the trigger

In case the gerrit comment contains a similar expression we might retrigger.
Avoid a collision here and change the trigger keyword.

Change-Id: I2f3477a666b3c8bce49175b7f52070b08ba4d710
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Merge "Display build-info"

Merge "Enable the request of test report email"

Update application job template for guppy

Add guppy and change adapt the application repos.

Change-Id: I4016532695e0ab5fdb9b670456c6b6fdd6e7f6f1
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Update timeouts

Change-Id: I30dcd5fb581870c094973171ef53257039ae8f2e
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Display build-info

This patch displays the build-info file contents in order to use them
later in creating test jobs.

Change-Id: Iacfab0324152387f5d10ea45e4352c25448aa5cb
Signed-off-by: Khouloud Touil <ktouil@baylibre.com>

Update doc generator for guppy

Change-Id: I7301d1bfc14e31d272f16790762778aea43537bf
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Enable the request of test report email

Add new feature to the ci-managmenet that will request to send test
report email to the specified email addresses in the automotive-
testreports list after a certain delay (1 hour=3600 sec).

This commit is accomplished based on the work of Corentin Labbe
<clabbe@baylibre.com>.

Change-Id: I14350b13b5b6cf2550303999ced56055a392212b
Signed-off-by: Khouloud Touil <ktouil@baylibre.com>

Add weston as a device tag

This patch check the name of the board and add the weston as a device tag
if the board name doesn't include the "-nogfx" suffix.

Change-Id: I26c69286078b2e7e6dd6447da5be4246bbbea4e7
Signed-off-by: Khouloud Touil <ktouil@baylibre.com>

Merge "jjb: lava-labs-prepare: use lavacli to find devices and tags"

jjb: Add new --device-tags argument

This commit adds new --device-tags argument to the create_job process.
The create_job will use the device tags to create the job template.

Note, this commit will work only if the lavacli package is well configured.

Change-Id: Ib9358daaaa9ecfbb0c261991b0d86b48796eb701
Signed-off-by: Khouloud Touil <ktouil@baylibre.com>