lava-labs-prepare: Fix lavacli auth add error

lavacli is returning an error if the config file for adding identities does
not exist.
Create the file before using `lavacli auth add`

Change-Id: I3928355055299ddbdd1d269d74a762a563577fb8
Signed-off-by: Loys Ollivier <lollivier@baylibre.com>

Merge changes I81dfc60f,I56fe3edc,Ic1bf8296,Ifd68eb42,Iddf7394c

* changes:
  Use the --version argument
  Use the --branch argument
  Use the new --build-id argument
  Use the new --commit argument
  Modify the --build-version content

Merge "Use the build-info file"

Fix timeout

The indentation was wrong for the timeout to be applied.

Change-Id: Ie556d3e61400585770f476057921b9decb6185d8
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

AGL-verify/ci-platform: add QEMU arm/arm64 builds

Change-Id: I0554333c0760af73e9b303acebd81c7050ed8b8e
Signed-off-by: Kevin Hilman <khilman@baylibre.com>

Use the --version argument

This patch uses the --version argument that will contain the
DIST_BB_AGLVERSION value that is extracted from the build-info file.

Change-Id: I81dfc60f290db8983af9dfcc51f47a71c1a2b031
Signed-off-by: Khouloud Touil <ktouil@baylibre.com>

Use the --branch argument

This patch uses the --branch argument that will contain the
DIST_BB_AGL_BRANCH value that is extracted from the build-info file.

Change-Id: I56fe3edcfc73b0ce661181283f029026e2b37811
Signed-off-by: Khouloud Touil <ktouil@baylibre.com>

Use the new --build-id argument

This patch uses the new --build-id argument of create-jobs that will
contain the DIST_BUILD_ID value that is extracted from the build-info
file.

Change-Id: Ic1bf82967a4cd94bce9701251d7f5a9700998271
Signed-off-by: Khouloud Touil <ktouil@baylibre.com>

Use the new --commit argument

This patch uses a new --commit argument that will contain the
DIST_BUILD_HASH value that is extracted from the build-info
file. These changes are in both files 'include-agl-run-test
-short-guppy.sh' and 'include-agl-run-test-short.sh'.

Change-Id: Ifd68eb4270f3540e1a379fac135d7f290374d1d7
Signed-off-by: Khouloud Touil <ktouil@baylibre.com>

Modify the --build-version content

Modify the --build-version content to take the DIST_BB_DISTRO_VERSION
content which is going to be extracted from the build-info file in both
files 'include-agl-run-test-short-guppy.sh' and 'include-agl-run-test-short.sh'.

Change-Id: Iddf7394c624a5fdc08cddf806eaebb70456c4398
Signed-off-by: Khouloud Touil <ktouil@baylibre.com>

Use the build-info file

The build-info file contain a lot of useful informations that could
be used differently. This commit adds a source command to use these
informations in both files 'include-agl-run-test-short-guppy.sh'and
'include-agl-run-test-short.sh'.

Change-Id: I67c216defbde6589901de24c674b840ba692a814
Signed-off-by: Khouloud Touil <ktouil@baylibre.com>

Avoid any issues in the regexp for the trigger

In case the gerrit comment contains a similar expression we might retrigger.
Avoid a collision here and change the trigger keyword.

Change-Id: I2f3477a666b3c8bce49175b7f52070b08ba4d710
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Merge "Display build-info"

Merge "Enable the request of test report email"

Update application job template for guppy

Add guppy and change adapt the application repos.

Change-Id: I4016532695e0ab5fdb9b670456c6b6fdd6e7f6f1
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Update timeouts

Change-Id: I30dcd5fb581870c094973171ef53257039ae8f2e
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Display build-info

This patch displays the build-info file contents in order to use them
later in creating test jobs.

Change-Id: Iacfab0324152387f5d10ea45e4352c25448aa5cb
Signed-off-by: Khouloud Touil <ktouil@baylibre.com>

Update doc generator for guppy

Change-Id: I7301d1bfc14e31d272f16790762778aea43537bf
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Enable the request of test report email

Add new feature to the ci-managmenet that will request to send test
report email to the specified email addresses in the automotive-
testreports list after a certain delay (1 hour=3600 sec).

This commit is accomplished based on the work of Corentin Labbe
<clabbe@baylibre.com>.

Change-Id: I14350b13b5b6cf2550303999ced56055a392212b
Signed-off-by: Khouloud Touil <ktouil@baylibre.com>

Add weston as a device tag

This patch check the name of the board and add the weston as a device tag
if the board name doesn't include the "-nogfx" suffix.

Change-Id: I26c69286078b2e7e6dd6447da5be4246bbbea4e7
Signed-off-by: Khouloud Touil <ktouil@baylibre.com>

Merge "jjb: lava-labs-prepare: use lavacli to find devices and tags"

jjb: Add new --device-tags argument

This commit adds new --device-tags argument to the create_job process.
The create_job will use the device tags to create the job template.

Note, this commit will work only if the lavacli package is well configured.

Change-Id: Ib9358daaaa9ecfbb0c261991b0d86b48796eb701
Signed-off-by: Khouloud Touil <ktouil@baylibre.com>

jjb: lava-labs-prepare: use lavacli to find devices and tags

lava-tool is deprecated. There is a new "Tags" feature in lavacli that we
would like to leverage to create customize tests depending on tags.
Include lavacli into the script dependencies.
Use it to find devices and list corresponding tags.

Note, for now it is not replacing lava-tool but only ran alongside to test
the behavior.

Change-Id: I29546f4109ce869f7f047639f46e4a9c4499a9b2
Signed-off-by: Loys Ollivier <lollivier@baylibre.com>

Merge "Add iperf for debugging cloud nodes"

Add iperf for debugging cloud nodes

Change-Id: I7c6dc4c199879994bf2c6bcf6a63d21b6e05f314
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

jjb/common: fix flounder test plans

releng-scripts no longer requires passing --tests, instead if has
appropriate defaults based on CI or release builds.

Change-Id: Iff32ff43818f939d798671691973251f8ffe3fb3
Signed-off-by: Kevin Hilman <khilman@baylibre.com>

Merge "Support BUILDONLY job parameter"

Support BUILDONLY job parameter

to select just a single machine.

Change-Id: I76d884c800c7e130420e13b8d7d431803facfe7d
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Fix git upload to github

by providing the required credentials.

Change-Id: I6c33ec99624fd8acfe08cbb978271cff8def1422
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Remove obsolete storagebox

Change-Id: I9371d524fcc151ac60896d71cd37702090e9a083
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Merge "Add github to known hosts"

Merge "Add header in flounder lava submission"

Commit guppy release jobs for sources and sandbox

These are working now and can be committed.

Change-Id: I39a979cde74f03cc19f125da82e72de0202b6aba
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Add header in flounder lava submission

so we find the TARGETMACHINE variable as well.

Change-Id: I8c2b77f6d2050087a47c5eb7438c4eeba9108702
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Add github to known hosts

and avoid key verification issue.

Change-Id: If8b6023cf4bae141bf9eff3ee0b70b127282faa5
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Pull script from ci-management

Change-Id: I1a047cab0e50a27b2880b005961379bd3ca5deea
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

docs: new job for multiversion documentation site

The generated website has two subfolders and a front page to let use chose
between AGL versions:
* master
* flounder

Bug-AGL: SPEC-1993

Change-Id: Ia8edd76f5f8119c2a4f29a2e36113aa2207e6031
Signed-off-by: Stephane Desneux <stephane.desneux@iot.bzh>

Merge "jjb/common: fix guppy test templates"

Add header to test section of guppy snapshot build

This corrects a missing variable in the lava job submission.

Change-Id: I0e60cd87b12f756df0fee49cbd1f96e14103615f
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

jjb/common: fix guppy test templates

A previous change[1] moved to rely on test templates for test plans,
instead of passing --test when using releng-scripts, however when this
script was added for guppy[2], it was copied from an older version.

Fix this version to not use --test either.

[1] 142b04edc103 jjb/common: run-tests: rely on templates for test plans
[2] b76de43474cf (gerrit/master) Add release job for guppy

Change-Id: I98e00695ddb49a917cda40743b8c7328987ffe98
Signed-off-by: Kevin Hilman <khilman@baylibre.com>

Add agl-service-platform-info

Change-Id: I828150d345e0e8116a754b9c41f881c62e2c3e6a
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Merge "Comply to the SPEC-495"

Comply to the SPEC-495

The Applications from AGL framework should have a full packaging solution, Independent of yocto workflow.

Unfortunately the build part of the Applications is only in documentation or in yocto recipes.
The Applications build with AGL framework must be automated without any yocto recipes.

Change-Id: Ibba27c037df55c1487f0bcc7fdb75e8572515d4f
Signed-off-by: Romain Forlot <romain.forlot@iot.bzh>

jjb/common: run-test-short release: use TARGETMACHINE

The "deploy/images" dir pushd to the downloads server does not have the
-nogfx suffix.

Therefore, use $TARGETMACHINE instead of $MACHINE when passing --url to
releng-scripts so that the machine name is correct in the URL.

Change-Id: I3403851fa9f89e2839c7311db5d2ca1f555da3b7
Signed-off-by: Kevin Hilman <khilman@baylibre.com>

Add release job for guppy

Change-Id: I4bac3775da003dc677d50bafab88fc00b8754890
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Enhance mirror generation

Change-Id: If7daff9fe1ca06f17cd1b31e4e526d92ce443c06
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

jjb/common: run-tests: rely on templates for test plans

Instead of always pasing "--tests all" rely on the templates in
releng-scripts (templates/config) to determine the test plans to run
based on --build-type.

Change-Id: I7ac3b0a35f4cd3c45af9f2b28f8892fa31a04e2e
Signed-off-by: Kevin Hilman <khilman@baylibre.com>

jjb: lava-labs-prepare: only use lab-agl-core

We're now using a single LAVA master (lab-agl-core) with multiple remote
LAVA workers, so ci-management/jjb scripts only need to submit jobs to
one LAVA master.

While here, remove the long-unused lab-baylibre-seattle

Change-Id: I22f1ec039f7512809f0aac61b7ce5ea68131889b
Signed-off-by: Kevin Hilman <khilman@baylibre.com>

Merge "Add agl-service-voice-high to ci loop"

Merge "Change agl-jobbuilder alias to id"

Change agl-jobbuilder alias to id

Jenkins seems to misinterpret the id sometimes.

Change-Id: If4c7a1aaabd40c2abe07cb6db1eb9cca731ac19b
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Merge "Revert "Run ci-management on agl-test-slave instead of master node""

Revert "Run ci-management on agl-test-slave instead of master node"

This reverts commit 16be25556ebff182882c4baf45408d1a2b7424b7.

Change-Id: Iaed2c620b5c1c8dc30c269628fe26c1382f9ef18

Add agl-service-voice-high to ci loop

Change-Id: I2ccfe477dec70433c458f9c6fc3b05478721802b
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Merge "Update app list in ci-apps"

Update app list in ci-apps

Change-Id: I680c9d7949e6d68ac7295158c717241d172ad8e2
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Use generated autobuild script if none commited

It could be useful to not commit the autobuild script in the repository then you'll
always use a generated autobuild script. Doing so you always use the most up-to-date
autobuild script following the upstream version.

If the script hasn't been generated during the build then fallback to the classic method
'make package'.

Bug-AGL: SPEC-1832

Change-Id: I6a5e72ebb9254c7140e6ad7c31e02ba06fe2e0e0
Signed-off-by: Romain Forlot <romain.forlot@iot.bzh>

Merge "Submit flounder release job to lava and kernelci"

Fix folder structure for app upload

Change-Id: I514e23d0b969e8571aab001fd52dd1710324d738
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Merge "Run ci-management on agl-test-slave instead of master node"

Run ci-management on agl-test-slave instead of master node

master got an package update and the jjb version is now incompatible.
We can ensure the jjb on the agl-test-slave clound image.

Change-Id: I3a6083cdbde74a01a46379976182a88470ab68d4
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Update app ci loop

for flounder and new projects

Change-Id: I3564c6c934e14d398a8afe236aa62b1d4a6a3637
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Submit flounder release job to lava and kernelci

Change-Id: Ic26d5775b1ff6ca2c13e586212bb761c6055afac
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Use known working version of jjb

Change-Id: I300fd56d8ed26d78dd12a0c77822fcecc909ddac
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Disable ipv6 in slave images

Change-Id: I611edcdacb58bd565f14a9dac583d3c2c06cd26b
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Add agl-service-taskmanager and taskmanager to ci loop

Change-Id: Ic93a8064983840bfc234a9135d8ca6051f291d10
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Exclude trivial rebases and drafts from triggering builds

Change-Id: Idca983dca032d4de08a7d2d578a1a6cdba653c89
Bug-AGL: SPEC-1597
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Speed-up build

by disabling the limits.

Change-Id: Ib82ad11609642a356930a236bb3b06df611d9c41
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Remove conflict in installation of nodejs

: The following packages have unmet dependencies:
: nodejs : Conflicts: npm

Change-Id: Ic331d758b111edd15d778c71971cbf3915678d54
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Fixed nodejs+npm install (noninteractive mode)

Change-Id: I80380416d80541f73603ca6b41e1ec88fcc66821
Signed-off-by: Sebastien Douheret <sebastien.douheret@iot.bzh>

Convert signalling into publish-trigger

Change-Id: I51d783a20249a367c9b27e59a8b96551ed9b0b7e
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Uprev templates to apiv3

Change-Id: I7b4e12e450534d7923af10b779b12f0cbe68e52a
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Introduce gracetime into pipeline

Change-Id: I5e4fce954d02b25d25cb9442e9704d0ab55a7179
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Use v3 api for vexx

Change-Id: I3c1bc61f972ffec15b63ae25d3e603c124aa938c
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Merge "Crossbuild std go libraries for MacOS and Windows"

Bump nodejs 8.x and npm 5.x

Default nodejs & npm are very old (nodejs 4.x and npm 3.x) and don't
allow to build xds dashboard. Note that one reason to bump to a
recent npm version (at least npm ^5.0.0) is the support of
package-lock.json that is very useful to lock dependencies of nodejs
packages in a project.
(for more info see https://docs.npmjs.com/files/package-lock.json)

Change-Id: I639b97ee12e9d11f47a09bf5443fb2470fbf485a
Signed-off-by: Sebastien Douheret <sebastien.douheret@iot.bzh>

Crossbuild std go libraries for MacOS and Windows

Standard go librairies must be compiled at least once to be able to
build go code for other OSes.
Note that you must be root in order to write resulting static
libraries into /usr/lib/go-X.Y/pkg/windows_amd64 and
/usr/lib/go-X.Y/pkg/darwin_amd64

Change-Id: Icdf09f627ad2c5c1bbf1b42fb8c92f9d9e65469d
Signed-off-by: Sebastien Douheret <sebastien.douheret@iot.bzh>

Merge "Use gpg server pool to avoid connection issues"

Use gpg server pool to avoid connection issues

Change-Id: I306f92ce1cac2481bc9067a2fde30448f979bc30
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Add new app repos to ci loop

Add navigation, network, soundmanager and windowmanager services.

Change-Id: I444c7e74db31656cabf73a1c9f5776d92dc48373
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Removed unwanted popd from xds build

Change-Id: I3985a66fdb1336d9216ea0b6eb65960e804a5298
Signed-off-by: Sebastien Douheret <sebastien.douheret@iot.bzh>

Rework xds build

Change-Id: I18830298ef2d8fe4d65b588735ed1662042505ce
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Enable set -x for xds builds

Change-Id: I6514de300eb1f8581b1e4deffb016c842c8dd282
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Fix mkdir command for xds builds

Change-Id: Ic5ce10308c6da924897deee475bdcb13cc678915
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Add flounder release jobs part 2

Change-Id: Ibbd10206a99f62034be9831cd12f4506e3f43dd0
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Add release build job for flounder part 1

Change-Id: I051aee7c222f7123353bef69d25526da56ab30cf
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Adapt to recent changes in app-templates

we have more versions where the wgt will end up ...

Change-Id: Ic59cb9e5629d64ad1779b6139c390cefa554d4cb
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

In case of cmake enforce an out-of-tree build

This fixes a build error with newer app templates if no autobuild script is found.

Change-Id: Iad3ea26ddd8cd3f680f8788cd08b8d2a374e8dc5
Bug-AGL: SPEC-1534
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Merge "Do not fail if transfer fails"

Do not fail if transfer fails

Make the storagebox sync not fail the process

Change-Id: I9ebc2120af8819f9e3fda0ef93d5a1583dec9629
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Merge "Add more apps to ci loop"

Add more apps to ci loop

Add:
- agl-service-can-low-level
- agl-service-iiodevices
- launcher

Remove:
- low-level-can-service (replaced with above)

Change-Id: I50cff984ea23bfa3a01634e32ddfcf48187ceecc
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Move credentials into macros

Change-Id: I22c96cda6b0fd75b4ac624b6bf1aa45717455cad
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Fix typo in variable name

No '-' allowed. Fix it.

Change-Id: Iaecd076cdc0e100e975c7fead28d37d8e8739f4e
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Also upload changeID artifacts to storagebox

Change-Id: I96df1500304f1325acbb8691cd350e4e501fbebf
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Add agl-service-bluetooth-pbap to CI loop

New repo created, thus added to CI loop.

Change-Id: I09d8e19e2a79bbaee965509b1ba80c8d1514d126
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Add xds-cli xds-agent xds-gdb in ci-xds-jjb.yaml

Add xds-cli xds-agent xds-gdb in ci-xds-verify for test build
For the moment just xds-server was test

Change-Id: I1ca57eed45caed65401ceedef9161fa1e6abceae
Signed-off-by: Frederic Marec <frederic.marec@iot.bzh>

Do not use wic-tools in dab release

Change-Id: I90a7a4ff5f72a7cdc0f24dda467c39f3701809ef
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Add template for build of xds-server in CI

Change-Id: I15fe3da53ef882657161111cfb179cf8307778a1
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Fix key import

Change-Id: Ia51673829bcfbbb21edb695f4240738e1186b906
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>