ci-management.git
7 years agojjb/common: Fix race condition when using grep and tr 87/12587/3
Loys Ollivier [Thu, 14 Dec 2017 10:31:20 +0000 (11:31 +0100)]
jjb/common: Fix race condition when using grep and tr

when using grep + tr to find board availability, status, a race
condition happens sometimes. When it happens the job is stuck and
timeout fails.

Fix it by calling sequentially grep then tr and not piping.

Change-Id: Ib1322e280900b62abdd827992b42183024cd094c
Signed-off-by: Loys Ollivier <lollivier@baylibre.com>
7 years agojjb/common: Fix query of lava log in jenkins log 03/12503/1
Loys Ollivier [Wed, 13 Dec 2017 12:32:23 +0000 (13:32 +0100)]
jjb/common: Fix query of lava log in jenkins log

Fix the query of the log in jenkins log. Use the lava website url and not the
lava API url.

JIRA: SPEC-1178

Change-Id: I9ddc48b13e91a91aa2e53c768aa02f2ae12e5a99
Signed-off-by: Loys Ollivier <lollivier@baylibre.com>
7 years agojjb/common: run-test-prepare: fix unmapped boards 57/12457/1
Kevin Hilman [Tue, 12 Dec 2017 05:07:43 +0000 (05:07 +0000)]
jjb/common: run-test-prepare: fix unmapped boards

If a $MACHINE doesn't have a proper mapping for LAVA or
releng-scripts, fail gracefully (exit 0)

Change-Id: I8d25e2dd861cb29cefd74c07138f5f78e590569f
Signed-off-by: Kevin Hilman <khilman@baylibre.com>
7 years agojjb/common: clean up device names to standardized ones. 23/12423/1
Loys Ollivier [Mon, 11 Dec 2017 10:33:22 +0000 (11:33 +0100)]
jjb/common: clean up device names to standardized ones.

Use the device_name table aliases earlier in the CI process. That way
all the scripts are using the correct device name. Avoiding name
mismatch resulting to CI failure.

Change-Id: Ia6f9f8beb06c43a24605abb24e676eaed68cc67e
Signed-off-by: Loys Ollivier <lollivier@baylibre.com>
7 years agojjb/common: run-test-short-*: meaningful LAVA job names 85/12385/3
Loys Ollivier [Fri, 1 Dec 2017 10:06:02 +0000 (11:06 +0100)]
jjb/common: run-test-short-*: meaningful LAVA job names

The previous job name was always "AGL-gerrit" which is not very useful.
Change it to "AGL-gerrit-" + change_number + patchset_number

Change-Id: I161de8a3547f864d4a50e5d984561899e0401532
Signed-off-by: Loys Ollivier <lollivier@baylibre.com>
7 years agojjb/common: remove hwtest.enable files v2 83/12383/3
Loys Ollivier [Fri, 1 Dec 2017 09:59:03 +0000 (10:59 +0100)]
jjb/common: remove hwtest.enable files v2

releng-scripts now supports LAVA job generation for all boards.

Remove the check in run-test-prepare.sh on whether or not to create LAVA
test jobs. Replace this test by several exports using releng-scripts
job-prereq tool. These exports will be used to rsync the files to the CI
upload server.
If the calls to job-prereq returns an error, make the script fail
gracefully.

Transition all platforms in run-test-short.sh to use releng-scripts.
Transition all platforms in run-test-short-release.sh to use releng scripts.

JIRA: SPEC-1144

Change-Id: I1e0e6d39b986770adcdfcf92c5d589a7fbe99a33
Signed-off-by: Loys Ollivier <lollivier@baylibre.com>
7 years agoMerge "Revert "jjb/common: remove hwtest.enable files""
Jan-Simon Moeller [Thu, 7 Dec 2017 20:09:46 +0000 (20:09 +0000)]
Merge "Revert "jjb/common: remove hwtest.enable files""

7 years agoRevert "jjb/common: run-test-short-*: meaningful LAVA job names" 71/12371/1
Jan-Simon Moeller [Thu, 7 Dec 2017 20:09:26 +0000 (20:09 +0000)]
Revert "jjb/common: run-test-short-*: meaningful LAVA job names"
Revert due to issues with jobs.
This reverts commit 7ec5cece04ee2af16f224214e7c8e23212c08c54.

Change-Id: I3e660f27485731b13bdf1959a9f441d81a3efaf9

7 years agoRevert "jjb/common: remove hwtest.enable files" 69/12369/1
Jan-Simon Moeller [Thu, 7 Dec 2017 20:06:27 +0000 (20:06 +0000)]
Revert "jjb/common: remove hwtest.enable files"

Issues with the jobs.

This reverts commit f28a1005057b096a95ba73bc3bf3e029b835deaa.

Change-Id: Icf75e5b462b0d4aff3c8d2c5806b8ca9270ad22b

7 years agojjb/common: run-test-short-*: meaningful LAVA job names 65/12265/3
Loys Ollivier [Fri, 1 Dec 2017 10:06:02 +0000 (11:06 +0100)]
jjb/common: run-test-short-*: meaningful LAVA job names

The previous job name was always "AGL-gerrit" which is not very useful.
Change it to "AGL-gerrit-" + change_number + patchset_number

Change-Id: I2c929a2c0d0541e593be4e459766a836a1b57e4b
Signed-off-by: Loys Ollivier <lollivier@baylibre.com>
7 years agojjb/common: remove hwtest.enable files 29/12229/7
Loys Ollivier [Fri, 1 Dec 2017 09:59:03 +0000 (10:59 +0100)]
jjb/common: remove hwtest.enable files

releng-scripts now supports LAVA job generation for all boards.

Remove the check in run-test-prepare.sh on whether or not to create LAVA
test jobs. Replace this test by several exports using releng-scripts
job-prereq tool. These exports will be used to rsync the files to the CI
upload server.

Transition all platforms in run-test-short.sh to use releng-scripts.
Transition all platforms in run-test-short-release.sh to use releng scripts.

JIRA: SPEC-1144

Change-Id: I558563704bbe9bf0bf554219f4f7ca8e086649bb
Signed-off-by: Loys Ollivier <lollivier@baylibre.com>
7 years agoAdd eel branch for application CI 69/12269/1
Jan-Simon Möller [Fri, 1 Dec 2017 12:24:25 +0000 (13:24 +0100)]
Add eel branch for application CI

Change-Id: Id0a49e2ab2b3fc90968e93633f37015b9138910d
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
7 years agoFail gracefully if SDK is not found 43/12243/1
Jan-Simon Möller [Thu, 30 Nov 2017 14:30:27 +0000 (15:30 +0100)]
Fail gracefully if SDK is not found

Change-Id: Ic21a7d3b9a38bc0eb7a86cc730534ec08b718116
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
7 years agoMerge "jjb/common: run-test-short: always use releng"
Jan-Simon Moeller [Thu, 30 Nov 2017 13:11:36 +0000 (13:11 +0000)]
Merge "jjb/common: run-test-short: always use releng"

7 years agoMerge "jjb/common/lava-labs-prepare: LAVA fail gracefully if device not found"
Jan-Simon Moeller [Thu, 30 Nov 2017 13:11:13 +0000 (13:11 +0000)]
Merge "jjb/common/lava-labs-prepare: LAVA fail gracefully if device not found"

7 years agojjb/common/lava-labs-prepare: LAVA fail gracefully if device not found 27/12227/2
lollivier [Thu, 30 Nov 2017 09:56:54 +0000 (10:56 +0100)]
jjb/common/lava-labs-prepare: LAVA fail gracefully if device not found

When LAVA labs are offline, or otherwise unavailable,
"lava-tool devices-list" fails causing the whole job to fail.

Detect this error earlier when trying to add the authentication and skip
the lab if offline.
If the device was not found in any lab, exit with success.

JIRA: SPEC-1142

Change-Id: Ia2cdeea3da8ade7feb5962e0898f40e59ca9cfdb
Signed-off-by: lollivier <lollivier@baylibre.com>
7 years agojjb/common: run-test-short: always use releng 03/12203/1
Kevin Hilman [Wed, 29 Nov 2017 19:51:52 +0000 (19:51 +0000)]
jjb/common: run-test-short: always use releng

When present, use releng to generate LAVA jobs for all boards.

Change-Id: I134f17d977a131fed2ec4973567f1dfd949a3cad
Signed-off-by: Kevin Hilman <khilman@baylibre.com>
7 years agojjb/common: lava-labs-prepare: rename dra7 05/12205/1
Kevin Hilman [Wed, 29 Nov 2017 19:49:09 +0000 (19:49 +0000)]
jjb/common: lava-labs-prepare: rename dra7

Rename dra7-evm to use upstream LAVA device-type conventions.

Change-Id: Ice5912fc1668d644184949032124bb4fce0c7854
Signed-off-by: Kevin Hilman <khilman@baylibre.com>
7 years agoAdd new applications to CI 07/12107/1
Jan-Simon Möller [Thu, 23 Nov 2017 07:55:30 +0000 (08:55 +0100)]
Add new applications to CI

This adds these app repos to CI:
      - agl-service-audio-4a
      - agl-service-audio-mpcd
      - agl-service-unicens
      - navigation
      - onscreenapp

Change-Id: Ia7f56d277999bfceb6d877b72a73cd630a28c937
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
7 years agoAdd the cyclone5 board to CI 65/12065/1
Jan-Simon Möller [Tue, 21 Nov 2017 18:49:31 +0000 (19:49 +0100)]
Add the cyclone5 board to CI

This adds the cyclone5 board and replaces the porter-nogfx.

Change-Id: I202262bc8b208c84dcaa5671c6e20c0a45bec65d
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
7 years agojjb/common: lava-labs-prepare: extend aliases 25/12025/1
Loys Ollivier [Thu, 16 Nov 2017 09:28:38 +0000 (10:28 +0100)]
jjb/common: lava-labs-prepare: extend aliases

Extend the aliases table for all existing devices, even the one not using
releng. That way we can search for the correct device type in the lava
labs.

Change-Id: Iaaa5b66923d4ed1e302d874457af573e12384acf
Signed-off-by: Loys Ollivier <lollivier@baylibre.com>
7 years agojjb/common: lava-labs-prepare: catching errors 09/11909/2
Kevin Hilman [Mon, 13 Nov 2017 20:00:33 +0000 (20:00 +0000)]
jjb/common: lava-labs-prepare: catching errors

When no device of the requested device-type is available, abort early
with a useful error message, otherwise job continues and fails in
confusing ways.

Change-Id: I8fdb4160a1ca88d8ba5eb768d70975e9466f696a
Signed-off-by: Kevin Hilman <khilman@baylibre.com>
7 years agojjb/common: lava-jobs-submit 93/11993/1
Loys Ollivier [Wed, 15 Nov 2017 17:04:20 +0000 (18:04 +0100)]
jjb/common: lava-jobs-submit

lava-tool submit-jobs go back to --block as wait-for-jobs isn't working
as expected. Revert the change until wait-for-jobs works.

But keep this version of the tool to have a link to the lava-job posted
in the log when using submit-job.

Change-Id: Ie7d045d198b00b19d198404fc67b2bcfe992e9a6
Signed-off-by: Loys Ollivier <lollivier@baylibre.com>
7 years agojjb/common: lava-jobs: create device name aliases 85/11985/1
Loys Ollivier [Wed, 15 Nov 2017 09:24:09 +0000 (10:24 +0100)]
jjb/common: lava-jobs: create device name aliases

The previous version would fail to find some boards if the device names
were different between lava, AGL, releng.
This version creates a device alias table. And uses this table with the
correct name for each component (AGL, lava, releng).

Change-Id: Ief064c5ff9edb2d824e80549148ee0ab40ebcddf
Signed-off-by: Loys Ollivier <lollivier@baylibre.com>
7 years agojjb/common: lava-jobs-submit: remove timeout 83/11983/1
Loys Ollivier [Wed, 15 Nov 2017 09:06:14 +0000 (10:06 +0100)]
jjb/common: lava-jobs-submit: remove timeout

Remove the timeout from lava submit jobs.
The previous version would timeout after 5 minutes but this is not enough
if the job is qeued. Let Jenkins handle the timeout and remove that one.

Change-Id: I501a539020174b2c9e030716717f1d3d0b06e539
Signed-off-by: Loys Ollivier <lollivier@baylibre.com>
7 years agoFix lab URL using RPC2/ 55/11855/1
Jan-Simon Möller [Sat, 11 Nov 2017 09:19:28 +0000 (10:19 +0100)]
Fix lab URL using RPC2/

Change-Id: I695244c8d6880499db2ac611603b538efc093d3f
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
7 years agoMerge "jjb/common: lava-jobs-submit: fixup wait for job"
Jan-Simon Moeller [Sat, 11 Nov 2017 09:12:01 +0000 (09:12 +0000)]
Merge "jjb/common: lava-jobs-submit: fixup wait for job"

7 years agoAdd python-simplejson as dependency of lava-tool 0.19 53/11853/1
Jan-Simon Möller [Sat, 11 Nov 2017 08:21:24 +0000 (09:21 +0100)]
Add python-simplejson as dependency of lava-tool 0.19

Change-Id: Icfdfc454106b14c94f05da61d5e349d22ae1fbaa
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
7 years agoDisable src and sstate mirror on image 43/11843/1
Jan-Simon Möller [Fri, 10 Nov 2017 22:11:01 +0000 (23:11 +0100)]
Disable src and sstate mirror on image

Change-Id: Ic5cbae9c7eda50110b23acc4a354528bfc02975a
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
7 years agopacker/provision: agl_dependencies force lava-tool version 0.19 31/11831/1
Loys Ollivier [Fri, 10 Nov 2017 14:41:16 +0000 (15:41 +0100)]
packer/provision: agl_dependencies force lava-tool version 0.19

lava-tool version 0.14 from ubuntu xenial is almost deprecated.
Use the jessie-backeports version 0.19.

Change-Id: I4ddb6eb81757ffdb978c8d2edafc4931cf5a42a4
Signed-off-by: Loys Ollivier <lollivier@baylibre.com>
7 years agojjb/common: lava-jobs-submit: fixup wait for job 27/11827/3
Loys Ollivier [Fri, 10 Nov 2017 10:31:20 +0000 (11:31 +0100)]
jjb/common: lava-jobs-submit: fixup wait for job

REQUIRES: lava-tool version >= 0.19

The previous version using submit-job with "--block" would never
timeout and remain blocked even if there was an issue during the
LAVA job execution.

This patch fixes the issue by using wait-job-events with a tiemout.
Parsing has been updated to follow these commands as well.

Change-Id: If090d278cb58c1c1b902793bf0ca40daceb2fd97
Signed-off-by: Loys Ollivier <lollivier@baylibre.com>
7 years agojjb/common: lava-jobs-submit: fixup device-list failure 99/11799/1
Kevin Hilman [Fri, 10 Nov 2017 00:25:00 +0000 (00:25 +0000)]
jjb/common: lava-jobs-submit: fixup device-list failure

The previous reordering of lava lab selection result in a failure
the second time through the devices list.

This patch fixes the failure enough to get things working again,
but the ordering needs to be fixed so that there is only one pass
through the devices-list.

Change-Id: I1131b380cb5a8a8235cbf1f838574726d6ef11a6
Signed-off-by: Kevin Hilman <khilman@baylibre.com>
7 years agoCIBT Update the callback arg for releng. 77/11777/1
Loys Ollivier [Thu, 9 Nov 2017 10:31:28 +0000 (11:31 +0100)]
CIBT Update the callback arg for releng.

Update callback arg for releng following releng changes:
https://gerrit.automotivelinux.org/gerrit/#/c/11751/

Change-Id: I2f63727e2357d84085c8c91f8bcbe8983489abc4
Signed-off-by: Loys Ollivier <lollivier@baylibre.com>
7 years agoCIBT improve lava lab searching and coding style 53/11753/1
Loys Ollivier [Wed, 8 Nov 2017 13:03:21 +0000 (14:03 +0100)]
CIBT improve lava lab searching and coding style

Fix coding style, indentation.

Improve the lab search, if a lab has the device do not search in others
as it won't be used.

Change-Id: I7471511ff7af3d2f6d8708943b42099a450ef770
Signed-off-by: Loys Ollivier <lollivier@baylibre.com>
7 years agoCIBT find the LAVA lab before calling releng 43/11743/4
Loys Ollivier [Tue, 7 Nov 2017 14:35:21 +0000 (15:35 +0100)]
CIBT find the LAVA lab before calling releng

Add some logic to lava-labs-prepare:
- Search for the machine in the list of labs
- export the lab name if found

Call releng with the corresponding lab name in run-test-short

Send the job directly to the corresponding lab in lava-jobs-submit.
Keep the 'checking for device' in this script as well, just to make sure
the device is still available and can run the job. Otherwise the script
could be blocked there if the device status changes.

Change-Id: I50646b7fdb607cb9245a1d31e644eee45a2a2356
Signed-off-by: Loys Ollivier <lollivier@baylibre.com>
7 years agoMerge "Lava jobs update raspberrypi3 device_type name"
Jan-Simon Moeller [Tue, 7 Nov 2017 13:59:49 +0000 (13:59 +0000)]
Merge "Lava jobs update raspberrypi3 device_type name"

7 years agoFix agl-run-test-short 39/11739/1
Loys Ollivier [Tue, 7 Nov 2017 13:50:42 +0000 (14:50 +0100)]
Fix agl-run-test-short

Remove machine typo from the releng script call and use the machine
argument instead.

Change-Id: I012204bf61f45f6c6d4ae56c579db84c9072278a
Signed-off-by: Loys Ollivier <lollivier@baylibre.com>
7 years agoLava jobs update raspberrypi3 device_type name 37/11737/1
Loys Ollivier [Tue, 7 Nov 2017 13:19:05 +0000 (14:19 +0100)]
Lava jobs update raspberrypi3 device_type name

For the raspberrypi3, update the device_type name to the LAVA
names for the rpi3 32bit:
- raspberrypi3-uboot
- bcm2837-rpi-3-b-32b

Change-Id: Icc654e47fd03b437165fb9c9aac5efdac490ef5c
Signed-off-by: Loys Ollivier <lollivier@baylibre.com>
7 years agoTypo fix in agl-run-test-short 31/11731/2
Loys Ollivier [Tue, 7 Nov 2017 11:04:43 +0000 (12:04 +0100)]
Typo fix in agl-run-test-short

Fix a typo in the if to call releng-scripts.

Change-Id: Idb2331b79d8a0947ae1d69f3bc73cd266c01b7ef
Signed-off-by: Loys Ollivier <lollivier@baylibre.com>
7 years agoMerge changes Ie341a1ed,Ibd6449c1
Jan-Simon Moeller [Mon, 6 Nov 2017 23:16:29 +0000 (23:16 +0000)]
Merge changes Ie341a1ed,Ibd6449c1

* changes:
  Update releng calls to use new args
  Use releng for rapsberrypi3

7 years agoFix comment triggers to be strict 11/11711/2
Jeremy Phelps [Mon, 6 Nov 2017 16:52:42 +0000 (10:52 -0600)]
Fix comment triggers to be strict

Comment triggers stuck in a loop since
some jobs contain "remove-artifacts" in the
job name.  Made the matching strict.

Change-Id: Icaeb4a9db2a128ea00e0b3e775fe7c9fa52ff2a7
Signed-off-by: Jeremy Phelps <jphelps@linuxfoundation.org>
7 years agoUpdate releng calls to use new args 09/11709/1
Loys Ollivier [Mon, 6 Nov 2017 15:12:21 +0000 (16:12 +0100)]
Update releng calls to use new args

Update the releng arguments:
- Use the new url scheme with CI, changeid and patchset
- Use machine argument

Change-Id: Ie341a1edf6f341796a7fe0647bf61f29172eedb4
Signed-off-by: Loys Ollivier <lollivier@baylibre.com>
7 years agoUse releng for rapsberrypi3 07/11707/3
Loys Ollivier [Mon, 6 Nov 2017 14:22:44 +0000 (15:22 +0100)]
Use releng for rapsberrypi3

Add the rapsebrrypi3 to the list of boards using releng-scripts for
LAVA job definition generation.

Change-Id: Ibd6449c101aff829d2814d3b15a7c9feae6d4b52
Signed-off-by: Loys Ollivier <lollivier@baylibre.com>
7 years agoFix task dependency bug in eel also in CI build 81/11381/1
Jan-Simon Möller [Thu, 19 Oct 2017 10:41:57 +0000 (12:41 +0200)]
Fix task dependency bug in eel also in CI build

Change-Id: I6f61a2c15f0f9fcfe27ed66b688bf1a4e8921825
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
7 years agoAdd hotfix to release build for YP bug 12070 71/11371/1
Jan-Simon Möller [Wed, 18 Oct 2017 08:20:58 +0000 (10:20 +0200)]
Add hotfix to release build for YP bug 12070

This adds a hotfix for https://bugzilla.yoctoproject.org/show_bug.cgi?id=12070
until it is fixe upstream.

Change-Id: I9fe57d853f44ad57af115825b2d66e859e20d53e
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
7 years agoAdd source and binary release jobs for EE 69/11369/1
Jan-Simon Möller [Wed, 18 Oct 2017 08:16:02 +0000 (10:16 +0200)]
Add source and binary release jobs for EE

Change-Id: I75103b1943f7a2778d4fb1a7e06383e9515566b4
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
7 years agoAdd include fragment for ptest 29/11329/1
Jan-Simon Möller [Sat, 14 Oct 2017 19:21:45 +0000 (21:21 +0200)]
Add include fragment for ptest

Change-Id: I963b015bb05b1d83ac88f69ff7921a39e16b1742
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
7 years agoDisable isafw report and change trigger 25/11325/1
Jan-Simon Möller [Sat, 14 Oct 2017 11:19:53 +0000 (13:19 +0200)]
Disable isafw report and change trigger

Change-Id: Ie9af0df97a76b4684201fe392153aa8cc680c4a0
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
7 years agoAdd agl-service-mediaplayer 19/11319/1
Jan-Simon Möller [Sat, 14 Oct 2017 08:14:06 +0000 (10:14 +0200)]
Add agl-service-mediaplayer

Change-Id: I9d66727c44c1db17f201f4025fec716923c0c69b
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
7 years agoMerge "jjb/common: run-test-short: use new releng opts"
Jan-Simon Moeller [Thu, 12 Oct 2017 19:44:27 +0000 (19:44 +0000)]
Merge "jjb/common: run-test-short: use new releng opts"

7 years agoFix a few typos 59/11259/1
Jan-Simon Möller [Thu, 12 Oct 2017 18:38:33 +0000 (20:38 +0200)]
Fix a few typos

Change-Id: Icf398847d42940fc79f9379a347808a5fe9fe3dc
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
7 years agojjb/common: run-test-short: use new releng opts 57/11257/1
Kevin Hilman [Fri, 6 Oct 2017 18:53:13 +0000 (18:53 +0000)]
jjb/common: run-test-short: use new releng opts

releng-scripts command-line args were updated to allow more
flexibility in defining rootfs image.  Use new options.

Change-Id: Id75a4cfa521a872173cbe628f54ab6a86484d994
Signed-off-by: Kevin Hilman <khilman@baylibre.com>
7 years agoAdd release build job template for eel 47/11247/1
Jan-Simon Möller [Thu, 12 Oct 2017 10:40:24 +0000 (12:40 +0200)]
Add release build job template for eel

Change-Id: If6e448e00f01c4f9316fcd0545d1eb015f3d2221
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
7 years agoAdd tests from qa-testdefinitions to dab-snapshot build 45/11245/1
Jan-Simon Möller [Thu, 12 Oct 2017 10:17:55 +0000 (12:17 +0200)]
Add tests from qa-testdefinitions to dab-snapshot build

Change-Id: I63d012a25ecce656d1acc9090c8de278eccd2287
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
7 years agoAllow build of SDK for aarch64 and rsync after test 31/11231/1
Jan-Simon Möller [Wed, 11 Oct 2017 14:37:43 +0000 (16:37 +0200)]
Allow build of SDK for aarch64 and rsync after test

Change-Id: Ic3934c7a32314709f5bb376c57c180960ae0f0e9
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
7 years agoEnforce uImage on dab 13/11213/1
Jan-Simon Möller [Tue, 10 Oct 2017 20:22:37 +0000 (22:22 +0200)]
Enforce uImage on dab

Change-Id: I4ce0b0606f0e2990255334f1c0247f7241dd82b7
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
7 years agoAdd CI for apps/agl-service-gstreamer 01/11201/1
Jan-Simon Möller [Tue, 10 Oct 2017 10:34:12 +0000 (12:34 +0200)]
Add CI for apps/agl-service-gstreamer

Change-Id: I3ad36050d01bac6688b83e05c696cbfee0d92c59
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
7 years agoEnforce the reinstallation of jinja2 93/11193/1
Jan-Simon Möller [Mon, 9 Oct 2017 21:15:08 +0000 (23:15 +0200)]
Enforce the reinstallation of jinja2

to make sure we get the desired version ...

Change-Id: I56a8be583340b851e62773bb4d8ba5ac9dde692d
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
7 years agojjb/common: run-test-short: fix pip show 89/11189/1
Kevin Hilman [Mon, 9 Oct 2017 19:26:45 +0000 (19:26 +0000)]
jjb/common: run-test-short: fix pip show

Change-Id: I53d14d65f3e88c956722cc4ba12603e2ef3f8038
Signed-off-by: Kevin Hilman <khilman@baylibre.com>
7 years agojjb/common: run-test-short: show jinja2 version 87/11187/1
Kevin Hilman [Mon, 9 Oct 2017 18:05:22 +0000 (18:05 +0000)]
jjb/common: run-test-short: show jinja2 version

Change-Id: Idd324bc07bc21135eabb632dfaf2070f9ca73f55
Signed-off-by: Kevin Hilman <khilman@baylibre.com>
7 years agoMerge "Increase timeout and skip test prepare"
Jan-Simon Moeller [Mon, 9 Oct 2017 06:37:47 +0000 (06:37 +0000)]
Merge "Increase timeout and skip test prepare"

7 years agoIncrease timeout and skip test prepare 75/11175/1
Jan-Simon Möller [Mon, 9 Oct 2017 06:36:44 +0000 (08:36 +0200)]
Increase timeout and skip test prepare

Change-Id: I17457661b7b654463035078f2778ce86a021c99d
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
7 years agojjb/common: run-test-short: fix board-specific check for releng-scripts 51/11151/1
Kevin Hilman [Thu, 5 Oct 2017 20:15:26 +0000 (20:15 +0000)]
jjb/common: run-test-short: fix board-specific check for releng-scripts

The (broken) conditional used to check which boards to use with releng-scripts
was always returning true.  Fix it to use [[ ]] instead of (( ))

Change-Id: I244d95c95a40e14e7a3ea682030733096b2af746
Signed-off-by: Kevin Hilman <khilman@baylibre.com>
7 years agoMerge "Do not abort the other CIBT jobs on failure"
Jan-Simon Moeller [Wed, 4 Oct 2017 21:10:30 +0000 (21:10 +0000)]
Merge "Do not abort the other CIBT jobs on failure"

7 years agoDo not abort the other CIBT jobs on failure 31/11131/1
Jan-Simon Möller [Wed, 4 Oct 2017 21:00:11 +0000 (23:00 +0200)]
Do not abort the other CIBT jobs on failure

Change-Id: Icbda1c48bd82df5178b3bb737f31ade3919608b8
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
7 years agojjb/common: run-test-short: add tests, unique version and callbacks 23/11123/2
Kevin Hilman [Wed, 4 Oct 2017 18:45:39 +0000 (18:45 +0000)]
jjb/common: run-test-short: add tests, unique version and callbacks

Use the gerrit changeset/patch numbers in combination with a SHA1 of
the repo manifest to create a unique build_version for the metadata.

Enable jobs to send results to lab-baylibre-legacy backend.

Send all tests (there are so few, might as well run them all.)

Change-Id: I7009621e0ab0eefbf345e5f801623b029cd7c332
Signed-off-by: Kevin Hilman <khilman@baylibre.com>
7 years agoMerge "jjb/common: aglsetup: save pre-build env"
Jan-Simon Moeller [Wed, 4 Oct 2017 17:29:33 +0000 (17:29 +0000)]
Merge "jjb/common: aglsetup: save pre-build env"

7 years agoMerge "jjb/common: run-test-short: fix line-continuation typo"
Jan-Simon Moeller [Wed, 4 Oct 2017 17:29:13 +0000 (17:29 +0000)]
Merge "jjb/common: run-test-short: fix line-continuation typo"

7 years agopacker: agl_dependencies: need latest python jinja2 lib 19/11119/1
Kevin Hilman [Wed, 4 Oct 2017 14:44:08 +0000 (14:44 +0000)]
packer: agl_dependencies: need latest python jinja2 lib

releng-scripts templating depends on the current stable (v2.9) version
of jinja2.

Change-Id: I0cde55c53567755edf3f2d1e8b009d0b0b7cc8ec
Signed-off-by: Kevin Hilman <khilman@baylibre.com>
7 years agojjb/common: run-test-short: fix line-continuation typo 03/11103/1
Kevin Hilman [Tue, 3 Oct 2017 22:43:14 +0000 (22:43 +0000)]
jjb/common: run-test-short: fix line-continuation typo

Change-Id: Ib8b128e82a520c50c978b7d308bb64fa70e08c96
Signed-off-by: Kevin Hilman <khilman@baylibre.com>
7 years agojjb/common: aglsetup: save pre-build env 91/11091/1
Kevin Hilman [Mon, 2 Oct 2017 22:15:44 +0000 (22:15 +0000)]
jjb/common: aglsetup: save pre-build env

Save some pre-build environment which can be saved/uploaded
and used to reproduce builds and share with downstream CI
infrastructure.

Change-Id: Iec896bb6a1936158986907b06cb6367ed775ddf4
Signed-off-by: Kevin Hilman <khilman@baylibre.com>
7 years agoFix issue with difference in buildid by using changeset number only 69/11069/1
Jan-Simon Möller [Thu, 28 Sep 2017 14:27:05 +0000 (16:27 +0200)]
Fix issue with difference in buildid by using changeset number only

Change-Id: I852c93da0514dbdc224612b7d150a17b572e6021
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
7 years agoAdd application repositories for agl-service-soundmanager-2017 and agl-service-window... 67/11067/1
Jan-Simon Möller [Thu, 28 Sep 2017 13:02:23 +0000 (15:02 +0200)]
Add application repositories for agl-service-soundmanager-2017 and agl-service-windowmanager-2017

Change-Id: I613805d157182907b5b0d21c1714727736a7f99e
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
7 years agoRemove safety switch 65/11065/1
Jan-Simon Möller [Thu, 28 Sep 2017 12:49:18 +0000 (14:49 +0200)]
Remove safety switch

Change-Id: Ia6320c3f78308acab6e9a33987c5a2bb90db41ea
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
7 years agoFix job name and typo in script 63/11063/2
Jan-Simon Möller [Thu, 28 Sep 2017 12:21:44 +0000 (14:21 +0200)]
Fix job name and typo in script

Fix job name in ci-app yaml file and typo variable name in
common script.

Change-Id: I903b5135852b710efb187cb2194fe60c59e825b0
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
7 years agoAfter merge, rebuild app 61/11061/1
Jan-Simon Möller [Thu, 28 Sep 2017 11:59:36 +0000 (13:59 +0200)]
After merge, rebuild app

and upload it to the app repository folder on
the download server for consumption.

Change-Id: I3df70f0ce11f0d448999e9b54e637a53070e0439
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
7 years agoExempt aarch64 on dab currently. 59/11059/1
Jan-Simon Möller [Wed, 27 Sep 2017 20:35:41 +0000 (22:35 +0200)]
Exempt aarch64 on dab currently.

Change-Id: Iddf1b14e632d43e43567058ecbbdaa3bd59d4374
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
7 years agoMerge "Adapt trigger for app build"
Jan-Simon Moeller [Wed, 27 Sep 2017 20:36:06 +0000 (20:36 +0000)]
Merge "Adapt trigger for app build"

7 years agoAdapt trigger for app build 57/11057/1
Jan-Simon Möller [Wed, 27 Sep 2017 20:26:17 +0000 (22:26 +0200)]
Adapt trigger for app build

Change-Id: Ie32360bcdf4fcf0586494cdc4e70aa5e0e4c5f13
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
7 years agoMerge "Per branch app build"
Jan-Simon Moeller [Wed, 27 Sep 2017 20:11:31 +0000 (20:11 +0000)]
Merge "Per branch app build"

7 years agoPer branch app build 55/11055/1
Jan-Simon Möller [Wed, 27 Sep 2017 19:26:16 +0000 (21:26 +0200)]
Per branch app build

Thie change introduces app builds per apps/* repo branch.
E.g. master and dab branch are separately tracked and built.

Preparation of the app folder.

Change-Id: I5f15b68e072c6abc69dfd41197ad2052ed8aed4e
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
7 years agoUpdate snapshot build recipe for dab and add dragonboard as 'full' aarch64 target 53/11053/1
Jan-Simon Möller [Wed, 27 Sep 2017 17:28:03 +0000 (19:28 +0200)]
Update snapshot build recipe for dab and add dragonboard as 'full' aarch64 target

Change-Id: Ia2ea7f485282941d22ef81bd2b0d73e7350fd90e
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
7 years agoLAVA jobs: create jobs using releng 03/11003/2
Kevin Hilman [Thu, 21 Sep 2017 21:48:25 +0000 (21:48 +0000)]
LAVA jobs: create jobs using releng

Switch to using releng-scripts "create-jobs" util for creating LAVA
jobs from new templating system.

For beta-testing, only use for QEMU and m3ulcb for now

(Yes, the if/else/endif without nesting is ugly, but makes the
 patch easier to read without all the whitespace change for
 indents.  Whitespace can be updated in a follow-up if this
 change is accepted.)

Change-Id: I46c4f97927515c1772fdef9842f041ef2be60000
Signed-off-by: Kevin Hilman <khilman@baylibre.com>
7 years agoappend needs extra space 83/10983/1
Jan-Simon Möller [Tue, 19 Sep 2017 15:07:05 +0000 (17:07 +0200)]
append needs extra space

Change-Id: Iebb770258d31cd87ec55427c96a408fb9e61c75e
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
7 years agoMerge "Fix typo"
Jan-Simon Moeller [Mon, 18 Sep 2017 22:50:28 +0000 (22:50 +0000)]
Merge "Fix typo"

7 years agoFix typo 65/10965/1
Jan-Simon Möller [Mon, 18 Sep 2017 22:18:41 +0000 (00:18 +0200)]
Fix typo

Change-Id: Ic8c1605ed18a214415f706297e08eb0536c33d9c
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
7 years agoMerge "Enable CI specific DISTRO_FEATURES"
Jan-Simon Moeller [Mon, 18 Sep 2017 21:44:07 +0000 (21:44 +0000)]
Merge "Enable CI specific DISTRO_FEATURES"

7 years agoEnable CI specific DISTRO_FEATURES 63/10963/1
Jan-Simon Möller [Mon, 18 Sep 2017 21:17:46 +0000 (23:17 +0200)]
Enable CI specific DISTRO_FEATURES

this is the tuning for the output filesystems that we need in CI (ext4.xz).

Later this is used for other flags. Benefit of a DISTRO_FEATURES is that
it is easily reproducible outside of CI.

Change-Id: I24b7e3240539c5d463a4656b8e50725b90dbac13
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
7 years agoMerge "Remove hardcoded fstypes"
Jan-Simon Moeller [Mon, 18 Sep 2017 14:02:45 +0000 (14:02 +0000)]
Merge "Remove hardcoded fstypes"

7 years agoRemove hardcoded fstypes 53/10953/2
Jan-Simon Möller [Mon, 18 Sep 2017 13:36:12 +0000 (15:36 +0200)]
Remove hardcoded fstypes

and rely on our repo-wide unification of the fstypes.
This enables hddimage for intel-corei7-64 again.

Change-Id: I93deffd4a54eead4b178d5ee34b91b9a2e6eabb5
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
7 years agoMerge "Convert doc site job to jjb"
Jan-Simon Moeller [Mon, 18 Sep 2017 01:03:12 +0000 (01:03 +0000)]
Merge "Convert doc site job to jjb"

7 years agoConvert doc site job to jjb 41/10941/1
Jan-Simon Möller [Mon, 18 Sep 2017 00:00:23 +0000 (02:00 +0200)]
Convert doc site job to jjb

Change-Id: I87700e558dc20705f85a2ed78f8fe9df057e95e4
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
7 years agoUpdate application CI job and extend local test script 39/10939/2
Jan-Simon Möller [Sun, 17 Sep 2017 22:52:47 +0000 (00:52 +0200)]
Update application CI job and extend local test script

Change-Id: I0f6609aeddc4b9b2d335921d980db6f4978b2cb6
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
7 years agoRework branch support for application CI 37/10937/1
Jan-Simon Möller [Sun, 17 Sep 2017 18:54:15 +0000 (20:54 +0200)]
Rework branch support for application CI

In this step the default builds for master and dab are reduced to just master.
Some apps like gps do not work with dab at all. So it does not make sense to
build them also for dab.

We have these options:
a) introduce branches into the app repos to match the AGL branch
b) define the equivalent of an API level so apps are build matching their level

a) works short-term  b) mid-/long-term.

Change-Id: I1538a22cca75240e85fa39313061156c0e75e995
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
7 years agoLet the builds continue to see what targets build before stopping the phase 67/10867/1
Jan-Simon Möller [Tue, 12 Sep 2017 12:30:53 +0000 (14:30 +0200)]
Let the builds continue to see what targets build before stopping the phase

Change-Id: If377fcd945d0d9856efab384f06088d2c74accca
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
7 years agoAdd new app repositories to CI loop 37/10837/1
Jan-Simon Möller [Fri, 8 Sep 2017 14:48:35 +0000 (16:48 +0200)]
Add new app repositories to CI loop

Change-Id: I18d4bedc88ec1ddedaa6fd4296a0c1249bc954be
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
7 years agoUse predefined parameter to avoid bug in selection 35/10735/1
Jan-Simon Möller [Thu, 31 Aug 2017 05:26:57 +0000 (07:26 +0200)]
Use predefined parameter to avoid bug in selection

Change-Id: I3e403e39a9a2b59022527e8a81c41adf313e2baf
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
7 years agoMerge "jjb/common: run-test-prepare: clone releng-scripts"
Jan-Simon Moeller [Thu, 31 Aug 2017 01:24:46 +0000 (01:24 +0000)]
Merge "jjb/common: run-test-prepare: clone releng-scripts"

7 years agojjb/common: run-test-prepare: clone releng-scripts 79/10679/2
Kevin Hilman [Tue, 22 Aug 2017 23:26:33 +0000 (16:26 -0700)]
jjb/common: run-test-prepare: clone releng-scripts

Preparation for new templating system.

Templates and utils for generating new LAVA YAML templates based on
jinja2 will be developed in the releng-scripts repo.  Clone the
"release" branch of that repo into $REPODIR, and add the utils dir to
$PATH.

Change-Id: If8a517ecb80cd849e022c82eba2794714c9ca787
Signed-off-by: Kevin Hilman <khilman@baylibre.com>
7 years agoUpdate also git submodules after re-setting to commit version 03/10703/1
Jan-Simon Möller [Sat, 26 Aug 2017 23:07:39 +0000 (01:07 +0200)]
Update also git submodules after re-setting to commit version

Change-Id: I625c64859ff613f8bc5ea2574503273535e89bd0
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>