ci-management.git
5 years agoAdapt CI pipeline after the Icefish release 05/24205/2
Jan-Simon Moeller [Tue, 10 Mar 2020 18:59:45 +0000 (19:59 +0100)]
Adapt CI pipeline after the Icefish release

This changes the CI pipeline based on SPEC-3262.

Bug-AGL: SPEC-3262
Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org>
Change-Id: I1cc557e02f978327662e7f00f5bd94f77e5d3120

5 years agoStreamline and simplify release jobs 87/24187/1
Jan-Simon Moeller [Thu, 5 Mar 2020 22:52:48 +0000 (23:52 +0100)]
Streamline and simplify release jobs

Extend automation.

Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org>
Change-Id: I959da9e8048dcf8fe87bf6ae23d7350947ec5b40

5 years agoAdd build variant for agl-compositor image in CI 83/24183/1
Jan-Simon Möller [Thu, 5 Mar 2020 17:02:20 +0000 (18:02 +0100)]
Add build variant for agl-compositor image in CI

Build the agl-compositor feature for qemux86-64.

Change-Id: I83b79a390d3981b98b24aa53a56aacf9a3f177e5
Bug-AGL: SPEC-3253
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
5 years agoEnable missing patch selection in html5 build 81/24181/1
Jan-Simon Möller [Thu, 5 Mar 2020 13:59:05 +0000 (14:59 +0100)]
Enable missing patch selection in html5 build

The selection of the gerrit commit was missing. Add it.

Change-Id: Ie8b70f18a27231febdddb9a6e8fee09444632d28
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
5 years agoSPEC-3004: Permit to copy build artifact for raspberrpi4 79/24179/1
Corentin LABBE [Thu, 5 Mar 2020 10:13:40 +0000 (11:13 +0100)]
SPEC-3004: Permit to copy build artifact for raspberrpi4

Even if raspberrpi4 was enabled in CIB, build artifacts are still not
copied.
This patch enable it for the releng querry.

Bug-AGL: SPEC-3004

Change-Id: I04dbc796a7f92b1b0ef9b7e1d1d6df6c6e597ffa
Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
5 years agoUse built-in dependencies for wic-tools 78/24178/1
Jan-Simon Moeller [Wed, 4 Mar 2020 23:27:18 +0000 (00:27 +0100)]
Use built-in dependencies for wic-tools

streamline build process.

Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org>
Change-Id: I95477e22975095a8b01dfe3cd578c7bab3c75db5

5 years agoUse correct name for html5 image 77/24177/1
Jan-Simon Moeller [Wed, 4 Mar 2020 23:22:07 +0000 (00:22 +0100)]
Use correct name for html5 image

Fix a typo in the job.

Bug-AGL: SPEC-3108
Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org>
Change-Id: I8110b7566f2d3b77f168238d14a674e9c3677b80

5 years agoEnable the html5 build variant for qemux86-64 75/24175/1
Jan-Simon Moeller [Wed, 4 Mar 2020 22:56:58 +0000 (23:56 +0100)]
Enable the html5 build variant for qemux86-64

Also build a variant with html5 enabled.
For now qemux86-64 only.

Bug-AGL: SPEC-3108
Change-Id: I629a70807afd251e7e13aa5f90b0923e7a756ce9

5 years agoReplace manual fetcher with jjb variant 51/24151/1
Jan-Simon Moeller [Mon, 2 Mar 2020 17:38:23 +0000 (18:38 +0100)]
Replace manual fetcher with jjb variant

This replaces the old jenkins job with a new one.

Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org>
Change-Id: I7970914b9a7daf964eb2a942d76571dd90934009

5 years agoAdd the html5 image to the CI pipeline 32/24132/2
Jan-Simon Moeller [Thu, 27 Feb 2020 13:20:23 +0000 (14:20 +0100)]
Add the html5 image to the CI pipeline

Add a new job to the pipeline (qemux86-64 for now) to build-test the
html5 image.

Bug-AGL: SPEC-3108

.

Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org>
Change-Id: I9ef99da8cc325e55bcf44c641acbce12d59015ac

5 years agoPrint estimate of build job cost 55/24055/4
Jan-Simon Moeller [Thu, 20 Feb 2020 20:39:25 +0000 (21:39 +0100)]
Print estimate of build job cost

Retrieve the approximate cost of the build job.
There is no api call for our instance flavour, so use close match.

Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org>
Change-Id: I7ea96ccabc76550989aa0dcb97b3806f0dd2e047

5 years agoUpdate global build timeout to 900 min 47/24047/1
Jan-Simon Moeller [Wed, 19 Feb 2020 12:11:02 +0000 (13:11 +0100)]
Update global build timeout to 900 min

Some builds hit the 10h job timeout mark atm.

Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org>
Change-Id: I2fa681d474e854e8335171f760ecf4e78dde4c8c

5 years agoUpdate archiver feature regexp 38/24038/1
Jan-Simon Moeller [Tue, 18 Feb 2020 17:35:48 +0000 (18:35 +0100)]
Update archiver feature regexp

The archiver feature will need extra parameters set to catch
all recipes. We exclude any proprietary code on purpose so
rewrite COPYLEFT_LICENSE_EXCLUDE in your conf/local.conf
if necessary.

Bug-AGL: SPEC-3186

.

Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org>
Change-Id: I020f0f30a73625df159895c7912643baf20798a7

5 years agoVayu tends to fail on fetching git.ti.com 67/23967/1
Jan-Simon Möller [Mon, 17 Feb 2020 13:38:58 +0000 (14:38 +0100)]
Vayu tends to fail on fetching git.ti.com

for now make it not fail the whole CI job.

Change-Id: I84baf1313aaf0db87fae3bf71dfe660f1a2ab6b0
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
5 years agoAdapt ci-app-jjb to icefish 65/23965/1
Jan-Simon Moeller [Sat, 15 Feb 2020 23:10:01 +0000 (00:10 +0100)]
Adapt ci-app-jjb to icefish

Add icefish.

.

Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org>
Change-Id: I9741220db5b5435d63c8e87721a590297f43c1d2

5 years agoAvoid race condition on .gitconfig.lock 52/23952/1
Jan-Simon Moeller [Fri, 14 Feb 2020 10:30:15 +0000 (11:30 +0100)]
Avoid race condition on .gitconfig.lock

on parallel builds on the same host.

This avoids:

error: could not lock config file /home/jenkins/.gitconfig: File exists
Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org>
Change-Id: Ib3f0b3cec91d87f0170c92c6781df67e2e7c75af

5 years agoPin repo tool to specific branch 90/23790/1
Jan-Simon Moeller [Tue, 11 Feb 2020 10:57:49 +0000 (11:57 +0100)]
Pin repo tool to specific branch

to avoid breaking the CI builds until new baseimages are deployed.

repo changed the minimal git version in its latest update and
now it refuses to work with git versions below 2.10.x .
Until we have new baseimages deployed, pin repo to the 'repo-1' branch.

Bug-AGL: SPEC-3173
Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org>
Change-Id: I3272524d94ef78733b109fce6b773aa61df9588f

5 years agoAGLBRANCH is not defined in this context. 80/23780/2
Jan-Simon Moeller [Mon, 10 Feb 2020 18:48:13 +0000 (18:48 +0000)]
AGLBRANCH is not defined in this context.

Use TARGETBRANCH as it is defined in this context.

Bug-AGL: SPEC-2978

Change-Id: Icb1307ff4beef3d80b9e51e81920924b357b9428
Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org>
5 years agoSPEC-2978: clone the release branches 74/23774/1
Corentin LABBE [Mon, 10 Feb 2020 09:53:00 +0000 (10:53 +0100)]
SPEC-2978: clone the release branches

We get to a point where we have board differences between releases also
in releng-scripts.

This patch adapt ci-management to clone the $AGLBRANCH instead of just 'release'.
Bug-AGL: SPEC-2978

Change-Id: I759a857655200f4a8ca833173557219f8a0282ca
Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
5 years agoUpdate application list for ci-apps-verify 42/23742/1
Jan-Simon Möller [Wed, 5 Feb 2020 15:23:33 +0000 (16:23 +0100)]
Update application list for ci-apps-verify

.

Change-Id: I899e9f943e89e90a4ee1087fabb7fe845f7b079a
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
5 years agoUpdate app-project.yaml.inc for ci-apps-verify 95/23595/1
Jan-Simon Moeller [Mon, 20 Jan 2020 21:11:08 +0000 (22:11 +0100)]
Update app-project.yaml.inc for ci-apps-verify

Update the list of repositories.

Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org>
Change-Id: Ib84fa725f682fffb4a629b0d348c0e2f2ced2dd1

5 years agoSPEC-2963: Enable CIB for raspberrypi4 69/23569/2
Corentin LABBE [Fri, 10 Jan 2020 09:25:50 +0000 (10:25 +0100)]
SPEC-2963: Enable CIB for raspberrypi4

Enable CIB for raspberrypi4. We will enable CIBT later, when the board will work
in the lab.

Change-Id: I16bddaf40e7e53549689812fcbfe71c2168fead0
Bug-AGL: SPEC-2963
Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
5 years agoAlso build applications by recipe using externalsrc 08/23508/1
Jan-Simon Moeller [Mon, 30 Dec 2019 16:09:03 +0000 (17:09 +0100)]
Also build applications by recipe using externalsrc

Beside the build using the SDK also build by recipe using EXTERNALSRC.

.

Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org>
Change-Id: I83b5ae4be6d29ada750c42ec244f91190fd9e326

5 years agoMerge "Add jenkins jobs for deploying the icefish release"
Jan-Simon Moeller [Mon, 2 Dec 2019 17:41:59 +0000 (17:41 +0000)]
Merge "Add jenkins jobs for deploying the icefish release"

5 years agoAdd jenkins jobs for deploying the icefish release 31/23131/1
Jan-Simon Möller [Mon, 2 Dec 2019 17:15:36 +0000 (18:15 +0100)]
Add jenkins jobs for deploying the icefish release

Change-Id: I62019d12fbc5fe1f6e9ce011e16af5b491e2e7c0
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
5 years agoRearrange platform ci triggers 16/23116/1
Jan-Simon Moeller [Thu, 28 Nov 2019 22:03:40 +0000 (23:03 +0100)]
Rearrange platform ci triggers

This change does one touchstone build. We save some overall execution time.

Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org>
Change-Id: I41eb16b1e48992d44b572c46649d449a55e34dda

5 years agoMerge "Revert "Disable dra7xx-evm target""
Jan-Simon Moeller [Mon, 25 Nov 2019 16:43:26 +0000 (16:43 +0000)]
Merge "Revert "Disable dra7xx-evm target""

5 years agoRevert "Disable dra7xx-evm target" 36/23036/2
Khouloud Touil [Fri, 22 Nov 2019 16:16:34 +0000 (16:16 +0000)]
Revert "Disable dra7xx-evm target"

This reverts commit 0723eea188feb956b1c8a9e8ee02c36f4484a5e1.

Reason for revert: <git.ti.com appears to be working again>

Bug-AGL: SPEC-2923

Change-Id: I03e838cd8abe02eec13b4d721f9bc68830edc5a8
Signed-off-by: Khouloud Touil <ktouil@baylibre.com>
5 years agoAdd release build for icefish 98/22998/2
Jan-Simon Moeller [Wed, 20 Nov 2019 22:52:22 +0000 (23:52 +0100)]
Add release build for icefish

Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org>
Change-Id: Iee40b5ad3e9bc54f0848708e6a31771f0e12a7eb

5 years agoFix mapping of h3+kf device for labs 80/22980/1
Jan-Simon Moeller [Tue, 19 Nov 2019 22:18:31 +0000 (23:18 +0100)]
Fix mapping of h3+kf device for labs

We were using a plain h3 instead of h3+kf. Fix it.

Bug-AGL: SPEC-2921

Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org>
Change-Id: I8699373e84795d651b68558a43863383bd4039af

5 years agoMerge "SPEC-2921: Add the h3ulcb-nogfx CIB/CIBT"
Jan-Simon Moeller [Tue, 19 Nov 2019 15:11:01 +0000 (15:11 +0000)]
Merge "SPEC-2921: Add the h3ulcb-nogfx CIB/CIBT"

5 years agoUse snapshot SDK for application CI jobs on halibut 53/22953/1
Jan-Simon Moeller [Thu, 14 Nov 2019 17:08:07 +0000 (18:08 +0100)]
Use snapshot SDK for application CI jobs on halibut

We can use the latest SDK snapshot on halibut now.

Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org>
Change-Id: Ic21d6c572bfc29e64dd8472b2022215ed4905d32

5 years agoSPEC-2921: Add the h3ulcb-nogfx CIB/CIBT 21/22921/1
Corentin LABBE [Tue, 12 Nov 2019 14:38:19 +0000 (15:38 +0100)]
SPEC-2921: Add the h3ulcb-nogfx CIB/CIBT

This patchs adds build and boot test for the h3ulcb.

Change-Id: I1dc84e88513aab49db2f7965712f7491c2451af8
Bug-AGL: SPEC-2921
Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
5 years agoSPEC-2903: define GERRIT_HOST 57/22757/1
Corentin LABBE [Thu, 24 Oct 2019 12:49:46 +0000 (14:49 +0200)]
SPEC-2903: define GERRIT_HOST

If GERRIT_HOST is empty fallback to gerrit.automotivelinux.org

Bug-AGL: SPEC-2903
Change-Id: Iced5435293c9fc0c3d260e3e27b2f15e03d9ea89
Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
5 years agoDisable dra7xx-evm target 49/22749/1
Jan-Simon Moeller [Tue, 22 Oct 2019 13:14:26 +0000 (15:14 +0200)]
Disable dra7xx-evm target

until the git server is responsive again.

Bug-AGL: SPEC-2923

.

Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org>
Change-Id: Idfcb94b7e195b8edd3b65316c3ff7f3641b4ef7c

5 years agoChange Email used for test-reports 00/22700/3
Khouloud Touil [Thu, 17 Oct 2019 12:01:03 +0000 (14:01 +0200)]
Change Email used for test-reports

As AGL is migrating to groups.io, Adapting the test-report email to use
the new one.

AGL-bug: SPEC-2908

Signed-off-by: Khouloud Touil <ktouil@baylibre.com>
Change-Id: If19c7c1dcbf52442aff14bc42c6b3bcb8c68ed85

5 years agoRework the messaging back to gerrit and improve escaping 88/22688/2
Jan-Simon Moeller [Tue, 15 Oct 2019 22:00:29 +0000 (00:00 +0200)]
Rework the messaging back to gerrit and improve escaping

This will allow to post more detailed messages back to gerrit.

Note the double quotes used and the eval before the ssh to enforce the expansion.

Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org>
Change-Id: I1c0d618796ef1cb697529575f7b9925ae4926a97

5 years agoAlways run the result parsing 57/22657/1
Jan-Simon Möller [Tue, 15 Oct 2019 16:17:34 +0000 (18:17 +0200)]
Always run the result parsing

This fixes the application builds where we have no skiplist for most.
Before this we bailed out on return 0 and did never parse the result.
Now the result parsing is it's own function and always being called.

Bug-AGL: SPEC-2882

.

Change-Id: I58c05fa48dd9121e0eeb494975513dcc88290dc5
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
5 years agoFix escaping for report back to gerrit 26/22626/1
Jan-Simon Möller [Mon, 14 Oct 2019 11:38:32 +0000 (13:38 +0200)]
Fix escaping for report back to gerrit

Bug-AGL: SPEC-2703

Change-Id: I223a4242942ac9e751f0b6dd3caab0309f2a566a
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
5 years agoSPEC-2703: print a link to the job log 14/22614/3
Corentin LABBE [Fri, 11 Oct 2019 09:04:30 +0000 (11:04 +0200)]
SPEC-2703: print a link to the job log

This patchs adds a link to the console logs when sending result.

Bug-AGL: SPEC-2703
Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
Change-Id: Idb95e5cdf80072c4cfdce95ecc4facabffb43caf

5 years agoRemove verbosity from jenkins jobs 27/22527/2
Jan-Simon Moeller [Thu, 26 Sep 2019 20:28:12 +0000 (22:28 +0200)]
Remove verbosity from jenkins jobs

clean the logs. Can be re-enabled when debugging is needed.

Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org>
Change-Id: I13bba480196e3932c45123c62f03064e420f257f

5 years agoUpdate app project list 02/22502/1
Jan-Simon Möller [Wed, 25 Sep 2019 08:49:57 +0000 (10:49 +0200)]
Update app project list

Change-Id: Idad54e215ee8f46bbb6c4948dcf9bb0a07789185
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
5 years agoSPEC-2703: fix a typo on TESTNAME 84/22484/1
Corentin LABBE [Mon, 23 Sep 2019 08:17:10 +0000 (10:17 +0200)]
SPEC-2703: fix a typo on TESTNAME

TESTNAME was mispelled in the debug output.

Change-Id: I068da47c52626672f6e307349e95e03d3b7b20c3
Bug-AGL: SPEC-2703
Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
5 years agoSPEC-2703: fix parsing of the testname 49/22449/1
Corentin LABBE [Wed, 18 Sep 2019 08:51:07 +0000 (10:51 +0200)]
SPEC-2703: fix parsing of the testname

The raw testline contains an * which breaks the parsing of the testname.
This patchs adds quote to prevent that.

Change-Id: I8f11b3d9ee5444983dd886954a5e2712025a7314
Bug-AGL: SPEC-2703
Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
5 years agoSPEC-2703: fix a typo 41/22441/1
Corentin LABBE [Tue, 17 Sep 2019 18:00:54 +0000 (20:00 +0200)]
SPEC-2703: fix a typo

The existence test is inverted, fix it.

Change-Id: Ida3104e34b3475c80b206091464b1e9a88d8be49
Bug-AGL: SPEC-2703
Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
5 years agoFix trigger for artifact removal 39/22439/1
Jan-Simon Möller [Tue, 17 Sep 2019 13:51:24 +0000 (15:51 +0200)]
Fix trigger for artifact removal

Change-Id: I223db61a7a5d1f3c939ca267716fa3eb8ca0dc92
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
5 years agoSPEC-2703: use lavacli identity 37/22437/2
Corentin LABBE [Tue, 17 Sep 2019 05:20:40 +0000 (07:20 +0200)]
SPEC-2703: use lavacli identity

The lavacli results does not provide the identity argument and so does
not work.
This patch adds the missing "-i $lab" for made it works.

While at it, this patch converts two hardcoded "-i agl" call to use the correct
lab variable.

As asked during the meeting, let's add a sanity check that this lab
variable is set.

Bug-AGL: SPEC-2703
Change-Id: I9432f8b27aa7157e08b48f5caeb905a18152fa6a
Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
5 years agoMerge "SPEC-2703: do not fail with set -xe"
Jan-Simon Moeller [Mon, 16 Sep 2019 11:35:33 +0000 (11:35 +0000)]
Merge "SPEC-2703: do not fail with set -xe"

5 years agoSPEC-2703: do not fail with set -xe 89/22389/4
Corentin LABBE [Wed, 11 Sep 2019 18:49:34 +0000 (20:49 +0200)]
SPEC-2703: do not fail with set -xe

This patch move the grepping test inside the if for not failling due to
set -xe
For the same reason, harden the code checking if git clone was
successfull.

Change-Id: Idb0619c4e90c9a3a0654a024fbd2166e49df98c6
Bug-AGL: SPEC-2703
Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
5 years agoMerge "Dont fail the CI when build-info is unavaillable"
Jan-Simon Moeller [Thu, 12 Sep 2019 04:52:30 +0000 (04:52 +0000)]
Merge "Dont fail the CI when build-info is unavaillable"

5 years agoDont fail the CI when build-info is unavaillable 88/22388/3
Corentin LABBE [Wed, 11 Sep 2019 18:18:12 +0000 (20:18 +0200)]
Dont fail the CI when build-info is unavaillable

This patchs made the download of build-info non-fatal.
The build-info is used before running releng-scripts and for email
report.

Bug-AGL: SPEC-2177
Change-Id: I8ffaacafce472faa32dc06ecac486be037938f67
Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
5 years agoInclude MACHINE name in message. 91/22391/1
Jan-Simon Möller [Wed, 11 Sep 2019 23:29:24 +0000 (01:29 +0200)]
Include MACHINE name in message.

Change-Id: I1ec20a66dfc4a427642806011f6de8d4e7c75408
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
5 years agoSPEC-2703: Fix remaining problems in skiplist 81/22381/2
Corentin LABBE [Wed, 11 Sep 2019 07:58:58 +0000 (09:58 +0200)]
SPEC-2703: Fix remaining problems in skiplist

This patch fix the following problems:
- {{GERRIT_CHANGE_NUMBER}},${{GERRIT_PATCHSET_NUMBER}}: bad substitution
   A copy paste from jenkins commands, but I forgot to remove the double {}

- missing grep -v '\*', removed by ec3e1dc57d7a6a454f9ed1f0210b07b8270a1fbb ("Follow up fix")

- for apps, no dedicated skipdir as asked in SPEC-2703

Change-Id: I8dfdc6ff4d03fc946e0b8ad35f092e217afd685b
Bug-AGL: SPEC-2703:
Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
5 years agoFollow-up fix 79/22379/1
Jan-Simon Möller [Tue, 10 Sep 2019 21:20:59 +0000 (23:20 +0200)]
Follow-up fix

Change-Id: I13c0e82a53a19d4343eb2659d1c86eea399d94c3
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
5 years agoFix error in CIBT scripting and harden pipeline 78/22378/1
Jan-Simon Möller [Tue, 10 Sep 2019 15:54:04 +0000 (17:54 +0200)]
Fix error in CIBT scripting and harden pipeline

do not fail on CIBT result evaluation.

Change-Id: I91e84cc9e30a149f8e56c218b1f97375c76c3d95
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
5 years agoSPEC-2703: Permit to have a per-machine skiplist 72/22372/2
Corentin LABBE [Tue, 10 Sep 2019 12:18:02 +0000 (14:18 +0200)]
SPEC-2703: Permit to have a per-machine skiplist

The service weston does not start on qemu/qemuarm64.
for having this service check skipped only for thoses two machine, we
need to have a per-machine skiplist.

In the process, we add the possibiity to have a per GERRIT_PROJECT
skiplist.
Furthermore, I "migrate" the skiplist for apps in a skiplists directory.

Change-Id: I989b2bdf2463272ee1f407a933be49a2f4219d5f
Bug-AGL: SPEC-2703
Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
5 years agoSPEC-2703: pass/fail criteria for lava jobs 37/22237/5
Corentin LABBE [Fri, 23 Aug 2019 14:16:52 +0000 (16:16 +0200)]
SPEC-2703: pass/fail criteria for lava jobs

This patchs implement pass/fail analysis of job tests.
All failling test are compared to a skiplist for removing known failling
tests.

If it exists any remaining failling test after the skiplist phase, the
job is set as fail in gerrit.

Bug-AGL: SPEC-2703
Change-Id: I4af8f54caaeef616c529b626ca8010e7159d8206
Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
5 years agojjb/common: fix DIST_BUILD_TOPIC usage 30/22230/1
Kevin Hilman [Wed, 28 Aug 2019 21:18:04 +0000 (14:18 -0700)]
jjb/common: fix DIST_BUILD_TOPIC usage

Fix use of DIST_BUILD_TOPIC to be used with --build-version (instead
of --name).  build-version is the key used in the backend to collect
all related jobs, whereas --name is just for the LAVA job name.

The email report request also uses $DIST_BUILD_TOPIC, which will allow
and email report to be generated with results for all tests with the
same $DIST_BUILD_TOPIC.

Bug-AGL: SPEC-2646

Change-Id: I8657270bcbbc06f361b079a07f3922cf4e782e1a
Signed-off-by: Kevin Hilman <khilman@baylibre.com>
5 years agoMerge "Manage the polling with lavacli"
Jan-Simon Moeller [Wed, 28 Aug 2019 11:37:23 +0000 (11:37 +0000)]
Merge "Manage the polling with lavacli"

5 years agoAdd key for lavasoftware.org 21/22221/1
build.automotivelinux.org [Tue, 27 Aug 2019 05:54:25 +0000 (07:54 +0200)]
Add key for lavasoftware.org

This enables installation of lavacli.

Signed-off-by: build.automotivelinux.org <jenkins@automotivelinux.org>
Change-Id: I123fcecea66fcd60a3000b3b5d57570f2e4eda5c

5 years agojjb/common: use DIST_BUILD_TOPIC when available 20/22220/3
Kevin Hilman [Mon, 26 Aug 2019 23:40:52 +0000 (16:40 -0700)]
jjb/common: use DIST_BUILD_TOPIC when available

Switch to $DIST_BUILD_TOPIC (if available) for determining the unique
ID used for the kernelCI backend data, as well as requesting the email
report.

Bug-AGL: SPEC-2646

Change-Id: Ib71c592c2973b5cbf31bc0d95a5a9d40ef3769a0
Signed-off-by: Kevin Hilman <khilman@baylibre.com>
5 years agoChange sdk URL to use mirror.automotivelinux.org 91/22191/1
build.automotivelinux.org [Wed, 21 Aug 2019 16:00:22 +0000 (18:00 +0200)]
Change sdk URL to use mirror.automotivelinux.org

Download.automotivelinux.org forwards now to mirrors.kernel.org and this displays short filenames (sigh).
This to have the full SDK filename we use the direct url to our download server.

Signed-off-by: build.automotivelinux.org <jenkins@automotivelinux.org>
Change-Id: Ie268e7875ad1e095b6f49ca593de86f390d1688e

5 years agoRevert "Use new --build-tags argument" 54/22154/1
Jan-Simon Moeller [Wed, 14 Aug 2019 23:16:46 +0000 (23:16 +0000)]
Revert "Use new --build-tags argument"

This broke CI:

$> lavacli -i agl jobs submit testjob_lab-agl-core.yaml
job_id='Unable to call '\''jobs.submit'\'': <Fault 400: "Problem with submitted job data: extra keys not allowed @ data['\''build-tags'\'']">'

e.g.:
https://build.automotivelinux.org/job/ci-platform-meta-agl-verify-CIBT-intel-corei7-64/1607/console

Please submit again when issue is fixed.

This reverts commit d7de9bda09604f110f70870a66b5a12418eb16f3.

Change-Id: I7a9e8c46a7cae39ea40d885e9f5c0da556de01f6

5 years agoUse new --build-tags argument 21/22121/2
Khouloud Touil [Wed, 7 Aug 2019 15:00:22 +0000 (17:00 +0200)]
Use new --build-tags argument

Use new --build-tags argument that is extracted from the build-info
file using the "DIST_BB_MACHINE_FEATURES" value which contain the
machine features.

Bug-AGL: SPEC-2721

Signed-off-by: Khouloud Touil <ktouil@baylibre.com>
Change-Id: Ia47247c6c26f08aaf796fa57e091b0d3411f1762

5 years agojjb/common: app tests: use more specific version name 74/22074/1
Kevin Hilman [Thu, 1 Aug 2019 23:40:37 +0000 (16:40 -0700)]
jjb/common: app tests: use more specific version name

To help distinquish app framework tests in LAVA and the
kernelci-backend, add "app" to the name used for the metadata passed
to LAVA/kernelCI.

Bug-AGL: SPEC-2719

Change-Id: Ia63cc0d5c56458a5cc350ec2e532027b25656ffc
Signed-off-by: Kevin Hilman <khilman@baylibre.com>
5 years agoMerge "Add halibut to ci-apps-jjb"
Jan-Simon Moeller [Wed, 31 Jul 2019 15:57:22 +0000 (15:57 +0000)]
Merge "Add halibut to ci-apps-jjb"

5 years agoAdd halibut to ci-apps-jjb 36/22036/1
Jan-Simon Möller [Wed, 31 Jul 2019 15:53:34 +0000 (17:53 +0200)]
Add halibut to ci-apps-jjb

We need to declare the halibut branch for applications.

Change-Id: Ia01f63a54d68b5657349c476ab4ec5d333c2d8d8
Bug-AGL: SPEC-2704
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
5 years agoManage the polling with lavacli 61/21861/2
Khouloud Touil [Fri, 12 Jul 2019 12:45:37 +0000 (14:45 +0200)]
Manage the polling with lavacli

Instead of using a timeout to manage the polling part, this patch
replace it with a lavacli command which is 'lavacli jobs wait'that will
wait for the job to finish, but after 2 hours the 'job wait' will be
stopped even the job if not finished, we are estimating after a 2 hours
of waiting, a problem is occurring in the job.

Signed-off-by: Khouloud Touil <ktouil@baylibre.com>
Change-Id: Ic81a635b0cc2dc5dda3028aefb78f88be0d79a31

5 years agoMerge "Update application ci project list"
Jan-Simon Moeller [Thu, 25 Jul 2019 15:18:32 +0000 (15:18 +0000)]
Merge "Update application ci project list"

5 years agoUpdate application ci project list 70/21970/1
Jan-Simon Möller [Thu, 25 Jul 2019 12:53:40 +0000 (14:53 +0200)]
Update application ci project list

Change-Id: Ibbc2d7b04629ceeafe86987b820cd55cc1b76aa3
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
5 years agojjb/common: aglsetup: use topic if available 09/21909/2
Kevin Hilman [Thu, 18 Jul 2019 16:50:02 +0000 (09:50 -0700)]
jjb/common: aglsetup: use topic if available

If aglsetup.sh is a new enough version, use the --topic option to set
a unique topic string.

TODO: support release/snapshot builds as well as CI builds.

Bug-AGL: SPEC-2646

Change-Id: I599063f349cc98e3f11b97201edebe7431012dd1
Suggested-by: Stephane Desneux <stephane.desneux@iot.bzh>
Signed-off-by: Kevin Hilman <khilman@baylibre.com>
5 years agopacker: change the source url of lavacli 51/21851/1
Khouloud Touil [Thu, 11 Jul 2019 15:00:54 +0000 (17:00 +0200)]
packer: change the source url of lavacli

As we pushed some changes to lavacli, and for now it is only in Linaro
stretch-backports, so we will use their url instead of the
"http://deb.debian.org/".

Signed-off-by: Khouloud Touil <ktouil@baylibre.com>
Change-Id: I065ec8467ee491e083b4523ab70223347ed5d320

5 years agoModify the build-version as well as the GIT_DESCRIBE values 50/21850/1
Khouloud Touil [Thu, 11 Jul 2019 13:37:28 +0000 (15:37 +0200)]
Modify the build-version as well as the GIT_DESCRIBE values

Using only the DIST_LAYERS_MD5 wont give us any really useful
information so we use the version to get a proper information and append
that with the DIST_LAYERS_MD5 to garantee the uniqueness for the email
test reports.

Signed-off-by: Khouloud Touil <ktouil@baylibre.com>
Change-Id: I9418d48c1d89718dcad63f4786f28490d257322c

5 years agoChange the GIT_DESCRIBE value 49/21849/1
Khouloud Touil [Thu, 11 Jul 2019 09:30:03 +0000 (11:30 +0200)]
Change the GIT_DESCRIBE value

To follow the changes of the build-version value we should change the
GIT_DESCRIBE value to the same value which is DIST_LAYERS_MD5.

Signed-off-by: Khouloud Touil <ktouil@baylibre.com>
Change-Id: Ia5c37620c57feee4bbb032b0127ea04e036a65fd

5 years agoAlso react on lava jobs that were canceled in jenkins 35/21835/1
Jan-Simon Möller [Mon, 8 Jul 2019 17:00:50 +0000 (19:00 +0200)]
Also react on lava jobs that were canceled in jenkins

This is needed to avoid jenkins polling until the timeout when a job
was aborted.

Change-Id: Ibcf0fffaeaac86a1198e4f0411e784ff74ab9f5b
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
5 years agoBe less verbose in CIBT jobs 34/21834/1
Jan-Simon Möller [Mon, 8 Jul 2019 16:49:28 +0000 (18:49 +0200)]
Be less verbose in CIBT jobs

Remove the set -x and print JOB_URL prominently.

Change-Id: I81b2283557e5b2ca5ca7815adb43f4e930250357
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
5 years agoUpdate application repos 30/21830/1
Jan-Simon Möller [Mon, 8 Jul 2019 11:34:57 +0000 (13:34 +0200)]
Update application repos

Add agl-service-audiomixer and messaging app.

Bug-AGL: SPEC-2544
Bug-AGL: SPEC-2565

Change-Id: Icc5a947ff5ce6bd461e7550876529205906a060e
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
5 years agoChange the build-version value 09/21809/3
Khouloud Touil [Thu, 4 Jul 2019 09:43:00 +0000 (11:43 +0200)]
Change the build-version value

To guarantee the a unique value of the build version, this patch change it
to take the DIST_LAYERS_MD5 value and let down the DIST_BB_DISTRO_VERSION
value which is not unique in the same day as it takes the build day date.
This way we will have one email test report per build and get ride of
the redundancy.

Bug-AGL: SPEC-2177

Signed-off-by: Khouloud Touil <ktouil@baylibre.com>
Change-Id: I60e166c185a922306a7fef0b123841957577c46c

5 years agoMerge "Remove the send email report part when submitting the job"
Jan-Simon Moeller [Thu, 20 Jun 2019 21:31:40 +0000 (21:31 +0000)]
Merge "Remove the send email report part when submitting the job"

5 years agoEnhance CI checkout for meta-renesas-rcar-gen3 and disable naginator 91/21691/1
build.automotivelinux.org [Thu, 20 Jun 2019 15:45:23 +0000 (17:45 +0200)]
Enhance CI checkout for meta-renesas-rcar-gen3 and disable naginator

The meta-renesas-rcar-gen3 layer is now in the subfolder bsp.

Also disable naginator.

Bug-AGL: SPEC-2450
Signed-off-by: build.automotivelinux.org <jenkins@automotivelinux.org>
Change-Id: I92aa66fb35d3ef254069a594297cffc11e260420

5 years agoFix the email report script 90/21690/1
build.automotivelinux.org [Thu, 20 Jun 2019 12:59:27 +0000 (14:59 +0200)]
Fix the email report script

We run under set -e . Any non-zero return value will instantly stop execution.
We cannot check for '0'. Please keep that in mind.

Also fix the location of the ci artifacts.

Bug-AGL: SPEC-2177
Signed-off-by: build.automotivelinux.org <jenkins@automotivelinux.org>
Change-Id: Ib72ff3b13b3765f18dbce8a966c9e92a6a8ebb6b

5 years agoUse the generic qemu* toolchains for the applications 81/21681/1
build.automotivelinux.org [Wed, 19 Jun 2019 17:32:28 +0000 (19:32 +0200)]
Use the generic qemu* toolchains for the applications

We no longer need to pick a specific board for an architecture.
All supported architecture (x86-64, arm, aarch64) have now a
qemu target and a matching toolchain.

Bug-AGL: SPEC-2540

Change-Id: I4f77acb10c1e35e745e2a2c11aee1f8f49cb96ab
Signed-off-by: build.automotivelinux.org <jenkins@automotivelinux.org>
5 years agoRemove the send email report part when submitting the job 78/21678/1
Khouloud Touil [Wed, 19 Jun 2019 14:15:25 +0000 (16:15 +0200)]
Remove the send email report part when submitting the job

After managing to send the email test report after all the job have been
finished, this patch remove the part to send email when submitting the job.

Bug-AGL: SPEC-2177

Signed-off-by: Khouloud Touil <ktouil@baylibre.com>
Change-Id: I477ae5513cc1d9c5dcba9b2b71bb6bc38cbbbb99

5 years agoMerge "ci-platform-jjb: enable CIBT for qemuarm"
Jan-Simon Moeller [Wed, 19 Jun 2019 14:07:13 +0000 (14:07 +0000)]
Merge "ci-platform-jjb: enable CIBT for qemuarm"

5 years agoAdd credentials-binding to the send email entrypoint 67/21667/4
Khouloud Touil [Mon, 17 Jun 2019 15:24:59 +0000 (17:24 +0200)]
Add credentials-binding to the send email entrypoint

This patch adds the needed credentials-binding to send email report
which is the KCI_EMAIL_AUTH_TOKEN.

Bug-AGL: SPEC-2177

Signed-off-by: Khouloud Touil <ktouil@baylibre.com>
Change-Id: I86b84132ca3279607ffdcaaae6d08bb441914f03

5 years agoInsert the script include-agl-send-email-report.sh 66/21666/4
Khouloud Touil [Fri, 14 Jun 2019 13:23:52 +0000 (15:23 +0200)]
Insert the script include-agl-send-email-report.sh

Insert the script include-agl-send-email-report.sh to send the email report
to this entrypoint.

Bug-AGL: SPEC-2177

Signed-off-by: Khouloud Touil <ktouil@baylibre.com>
Change-Id: Ib73f581526fe0b842266d04a656cc330b8fd644d

5 years agoAdd a new script include-agl-send-email-report.sh 65/21665/4
Khouloud Touil [Fri, 14 Jun 2019 13:21:54 +0000 (15:21 +0200)]
Add a new script include-agl-send-email-report.sh

This script sends an email report with all the agl-testplan.

Bug-AGL: SPEC-2177

Signed-off-by: Khouloud Touil <ktouil@baylibre.com>
Change-Id: Ida258e410d8e0321d97cf30d379f7696443373da

5 years agoci-platform-jjb: enable CIBT for qemuarm 64/21664/1
Corentin LABBE [Mon, 17 Jun 2019 14:27:05 +0000 (16:27 +0200)]
ci-platform-jjb: enable CIBT for qemuarm

Since releng-script now support qemuarm, and that build produce
bootable arm kernel, we can enable CIBT for arm.

Bug-AGL: SPEC-2376

Change-Id: I2c9b3995e4162dee87abff97d2f2a02a24499faa
Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
5 years agoAdd release jobs for halibut part 2 10/21610/1
Jan-Simon Möller [Wed, 12 Jun 2019 18:08:02 +0000 (20:08 +0200)]
Add release jobs for halibut part 2

Add the final release jobs for halibut.

Change-Id: Ibcdc8eaa993d118235bad17cf0ea27e6d59fcf33
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
5 years agoci-platform-jjb: enable CIBT for qemuarm64 02/21502/2
Corentin LABBE [Wed, 5 Jun 2019 14:05:42 +0000 (16:05 +0200)]
ci-platform-jjb: enable CIBT for qemuarm64

Since releng-script now support qemuarm64, and that build prroduce
bootable arm64 kernel, we can enable CIBT for arm64.

Bug-AGL: SPEC-2376
Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
Change-Id: Ic4776799065f363f2754b6952e51f5216b133323

5 years agoMerge "Add release jobs to CI for HH"
Jan-Simon Moeller [Sun, 2 Jun 2019 21:53:15 +0000 (21:53 +0000)]
Merge "Add release jobs to CI for HH"

5 years agoAdd release jobs to CI for HH 81/21481/1
Jan-Simon Möller [Sun, 2 Jun 2019 21:51:09 +0000 (23:51 +0200)]
Add release jobs to CI for HH

Change-Id: I07907b16fa5379ef68e61287c4b4f15ec4092eb0
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
5 years agoMerge "jjb/common: run-test-short: only use lavacli tags"
Jan-Simon Moeller [Fri, 31 May 2019 20:19:53 +0000 (20:19 +0000)]
Merge "jjb/common: run-test-short: only use lavacli tags"

5 years agoSkip build-info if it does not exist 69/21469/1
Jan-Simon Möller [Fri, 31 May 2019 11:34:10 +0000 (13:34 +0200)]
Skip build-info if it does not exist

This fixes https://gerrit.automotivelinux.org/gerrit/#/c/AGL/meta-agl-demo/+/21462/ .

Change-Id: I5b00fe9ee35299bf0938c606c6acd9fcfa2af1ae
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
5 years agojjb/common: run-test-short: only use lavacli tags 67/21467/1
Kevin Hilman [Thu, 30 May 2019 22:47:55 +0000 (15:47 -0700)]
jjb/common: run-test-short: only use lavacli tags

Only pass tags that were queried from the LAVA devices themselves,
don't add any additional tags (e.g. "weston")

This is done since after recent changes to releng-scripts, using
--device-tags will *require* those tags to be present for a given
device for the job to run, and currently no devices are using the
"weston" tag.

How to properly handle the -nogfx builds for boards with no
display/gfx needs to be revisited after proper tag handling is merged.

Change-Id: Ic6ba4743866c5de35ee45063c834c569c4b728eb
Signed-off-by: Kevin Hilman <khilman@baylibre.com>
5 years agojjb/common: lava-jobs-submit: fix email recipients 59/21459/1
Kevin Hilman [Thu, 30 May 2019 19:28:39 +0000 (12:28 -0700)]
jjb/common: lava-jobs-submit: fix email recipients

Remove the leading space from the email recipient when requesting an
email report.  The leading space was causing the SMTP handling on the
backend to reject the request.

Change-Id: Id176728a7c6eea8f54128d74cf658b13b6be81cb
Signed-off-by: Kevin Hilman <khilman@baylibre.com>
5 years agoMerge "Add entry point for testreport email"
Jan-Simon Moeller [Thu, 30 May 2019 14:31:38 +0000 (14:31 +0000)]
Merge "Add entry point for testreport email"

5 years agoMake sure we keep the CNAME file in the doc upload 90/21390/1
Jan-Simon Möller [Thu, 23 May 2019 13:20:51 +0000 (15:20 +0200)]
Make sure we keep the CNAME file in the doc upload

Change-Id: I8fe8d808b7d91342f6000d5a0232edaa9662e809
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
5 years agoAdd entry point for testreport email 59/21359/2
build.automotivelinux.org [Tue, 21 May 2019 16:47:51 +0000 (18:47 +0200)]
Add entry point for testreport email

Bug-AGL: SPEC-1474

Change-Id: I9800023fb68196b875b55e83147b9576b86eccec
Signed-off-by: build.automotivelinux.org <jenkins@automotivelinux.org>
5 years agoMerge "SPEC-2075: Enable CIBT for upsquare"
Jan-Simon Moeller [Wed, 22 May 2019 10:52:08 +0000 (10:52 +0000)]
Merge "SPEC-2075: Enable CIBT for upsquare"