Jan-Simon Möller [Wed, 15 Sep 2021 12:09:13 +0000 (14:09 +0200)]
Extend the waiting time for emulated platforms
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
Change-Id: I3d8cf2dd5227edabf8dc39eb50f5fa0560a5d221
Jan-Simon Moeller [Sun, 4 Jul 2021 19:05:52 +0000 (19:05 +0000)]
Merge "SPEC-4003: Use pyartiproxy for uploading a file to artyfactory"
Corentin LABBE [Tue, 30 Mar 2021 09:11:33 +0000 (09:11 +0000)]
SPEC-4003: Use pyartiproxy for uploading a file to artyfactory
Dumpjournal will now dump to artyfactory by default.
Bug-AGL: SPEC-4003
Change-Id: I2ae89be507062bceb84a6a7cbd054dcce09b6874
Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
Jan-Simon Möller [Wed, 12 May 2021 19:16:26 +0000 (21:16 +0200)]
Add skiplist for bbe
bbe has no sound. skip sound tests.
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
Change-Id: Ief9254c5c856b19df063985bce3b2de7d4b6ac87
Jan-Simon Möller [Mon, 10 May 2021 20:27:10 +0000 (22:27 +0200)]
Extend wait time for compositor restart
This fixes slow (e.g. mesa) startup.
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
Change-Id: I10ef1e14ca97370c59984b5d848b90e6cbb9d40b
Corentin LABBE [Wed, 17 Feb 2021 08:53:15 +0000 (08:53 +0000)]
application-lifecycle: replace continue by return
Lot of code was moved in do_release_test(), but since it is not in a
loop anymore, continue are noop.
Replace them by returns.
Fixes:
1aee04806027c9496f5860a0dfcdbd4aafde148d ("SPEC-3484: create new application tests using new wgt types")
Change-Id: I1dcd7b389dd859d8aadb3608c6e5255d13a470b8
Bug-AGL: SPEC-3808
Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
Jan-Simon Moeller [Wed, 20 Jan 2021 15:01:50 +0000 (15:01 +0000)]
Merge "SPEC-3764: add screenshoot test"
Corentin LABBE [Fri, 15 Jan 2021 12:47:16 +0000 (12:47 +0000)]
SPEC-3764: add screenshoot test
Add basic screenshooter test.
Change-Id: I8be9c6b4f621dc757c7e8ab846384c0fb32561df
Bug-AGL: SPEC-3764
Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
Jan-Simon Moeller [Fri, 15 Jan 2021 22:51:34 +0000 (23:51 +0100)]
Add AGL_CAN_INTERFACE=vcan0 to application-lifecycle
Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org>
Change-Id: Ic0b2e75122835786899aae2979feb8d29edefd5c
Jan-Simon Möller [Wed, 13 Jan 2021 16:34:39 +0000 (17:34 +0100)]
Update pyagl testdefinition to set AGL_CAN_INTERFACE
We need to use vcan0 for the canreplay.
Bug-AGL: SPEC-3756
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
Change-Id: I8e3e8c7d6eadf081014e129cfd59ad217004f46d
Jan-Simon Möller [Fri, 27 Nov 2020 14:09:28 +0000 (15:09 +0100)]
Disable colors in journal dump
Avoid escaping characters.
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
Change-Id: I50b1895cc148b43a73e8730f76a39c29382973cb
Jan-Simon Möller [Wed, 25 Nov 2020 11:25:28 +0000 (12:25 +0100)]
Do not require tests that enforce internet to be available in CI
Do not enforce tests that require the internet connection to be up.
This is the case for geoclue and weather.
We might be able to revert this in the future after
fixes to the systemd dependencies and lab setup.
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
Change-Id: I1f53e6bfda5be7c9f9613b485efb4f2e25839a63
Jan-Simon Möller [Thu, 22 Oct 2020 09:20:42 +0000 (11:20 +0200)]
Flip order in veth setup
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
Change-Id: I2da141b438122eee2768582c5a31054cb8a68964
Corentin LABBE [Wed, 21 Oct 2020 09:37:32 +0000 (11:37 +0200)]
SPEC-3597: prevent conman to break routes
conman break routes after adding veth, prevent this.
Change-Id: Ic674a8ad609783950ac2ca95a9176d427c59b6ad
Bug-AGL: SPEC-3597
Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
Jan-Simon Moeller [Mon, 19 Oct 2020 11:04:58 +0000 (11:04 +0000)]
Merge "Extend skiplists and fix typo in export"
Jan-Simon Möller [Mon, 19 Oct 2020 11:02:28 +0000 (13:02 +0200)]
Extend skiplists and fix typo in export
We the can test 1_pyagl-tests.can_write_wo_auth can easily fail on
the 2nd invocation. Work this around until fixed.
Bug-AGL: SPEC-3648
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
Change-Id: I25af2c86604672f2e439fef19b400c83fff358d9
Corentin LABBE [Wed, 14 Oct 2020 07:18:58 +0000 (09:18 +0200)]
SPEC-3631: Add veth test
Add veth test which adds an extra virtual network card for testing.
Change-Id: I4e6fef99009830cd016b2124b45b6815192b5ced
Bug-AGL: SPEC-3631
Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
Jan-Simon Möller [Tue, 13 Oct 2020 20:49:53 +0000 (22:49 +0200)]
Add AGL_AVAILABLE_INTERFACES to application test
The standalone run did have it defined, but the application test
did mit the setting of
AGL_AVAILABLE_INTERFACES=ethernet.
If necessary it has to be redefined in the test for bluetooth and wifi
per board.
Bug-AGL: SPEC-3597
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
Change-Id: I0772f9a6cc449406785fb167f575d6ca65e6267c
Jan-Simon Moeller [Wed, 7 Oct 2020 16:00:52 +0000 (18:00 +0200)]
Disable afm-test execution
agl-service-homescreen crashes when a testwgt is executed.
Until resolved, disable the test wgt execution.
Bug-AGL: SPEC-3608
Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org>
Change-Id: I415b2fe80338f4090ef037c77d61af8205fbb77e
Corentin LABBE [Fri, 25 Sep 2020 11:41:41 +0000 (13:41 +0200)]
SPEC-3484: Use the new gcovr-wrapper
For using gcov, a new gcovr-wrapper was created.
Let's use it, capture its output ang generate some metrics.
Bug-AGL: SPEC-3484
Change-Id: Idbd9aa34d37d31414d18341b035440e28df5dc83
Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
Jan-Simon Moeller [Mon, 14 Sep 2020 16:58:43 +0000 (16:58 +0000)]
Merge "SPEC-3484: install and basicly test coverage package"
Jan-Simon Moeller [Mon, 14 Sep 2020 16:17:58 +0000 (16:17 +0000)]
Merge "Change regular pyagl invocation to nohw"
Jan-Simon Moeller [Mon, 14 Sep 2020 13:53:21 +0000 (15:53 +0200)]
Change regular pyagl invocation to nohw
In CI we will execute the 'not hwrequired' flag.
Make this the default case in the test-suites.
Bug-AGL: SPEC-3572
Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org>
Change-Id: I370bb3c12953d7455a1a4c06c573cbc10ee17bda
Corentin LABBE [Mon, 31 Aug 2020 11:58:41 +0000 (13:58 +0200)]
SPEC-3484: install and basicly test coverage package
Install and test coverage the same way than normal package.
Handling coverage generated files will be handled later.
Bug-AGL: SPEC-3484
Change-Id: I02d4ea1aa77954a7c85317accb6b565ece8676c0
Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
Corentin LABBE [Mon, 14 Sep 2020 08:12:28 +0000 (10:12 +0200)]
SPEC-3550: fix parsing of id
The id could be not the first element, and so the parsing is wrong.
Change-Id: I325aac6de4733a166c7be8e3515b85e9edff4365
Bug-AGL: SPEC-3550
Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
Corentin LABBE [Thu, 10 Sep 2020 12:37:20 +0000 (14:37 +0200)]
SPEC-3550: name could be in uppercase
In config.xml, name could be in uppercase, so let's use id which is
lowercase.
Change-Id: Ibc3e9e145692c7773f70a1308c7ff0de27e9f0bd
Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
Jan-Simon Moeller [Wed, 9 Sep 2020 14:30:30 +0000 (16:30 +0200)]
Add not hwrequired to regular script case
Qemu by default has no hardware attached. Limit the run to not
execut hardware-specific tests.
Bug-AGL: SPEC-3572
Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org>
Change-Id: I3305d0c34737cf026989e2bde197d8ce3d96db19
Jan-Simon Moeller [Wed, 9 Sep 2020 12:35:45 +0000 (14:35 +0200)]
Add test definitions for pyagl
We can now call pytest using the pyagl/tests module.
These expose -k regular and -k hwrequired, thus create two caller scripts.
Also create a sample testsuite entry using the regular variant with limited AGL_AVAILABLE_INTERFACES.
Bug-AGL: SPEC-3572
Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org>
Change-Id: Ic6b977da959f946ca88348715d5249748c70f736
Corentin LABBE [Thu, 27 Aug 2020 08:39:05 +0000 (10:39 +0200)]
SPEC-3550: handle package with service name different than their filename
Some package has their service name different than their filename.
This patch handle this situation
Bug-AGL: SPEC-3550
Change-Id: I99c102f411ce5a0636fa14528cd2890694d986c6
Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
Corentin LABBE [Thu, 13 Aug 2020 09:26:34 +0000 (11:26 +0200)]
SPEC-3484: create new application tests using new wgt types
The wgt-test and wgt-coverage needs to be handled differently.
This patchs splits the application tests to handle all files
encountered.
First we download all files, then we use them in a specific order.
Change-Id: Idc71ecfe36496db314b288f2b8ca7c2d61887de7
Bug-AGL: SPEC-3484
Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
Corentin LABBE [Wed, 12 Aug 2020 14:44:19 +0000 (16:44 +0200)]
SPEC-3482: handle new package name
Now we build all package type, we need to handle coverage/test packages.
Bug-AGL: SPEC-3482
Change-Id: Idb6dc2d453f26183094d6679dcc5c1f553780a16
Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
Jan-Simon Moeller [Mon, 10 Aug 2020 18:22:20 +0000 (20:22 +0200)]
Print the syslog when the application does not start
Dump the journal when the app does not start.
Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org>
Change-Id: Ia886e87599721deca57dd8664c6637c3cd1f9b3f
Corentin LABBE [Mon, 10 Aug 2020 08:54:38 +0000 (10:54 +0200)]
SPEC-3533: unzip wgt files in a dedicated directory
For finding wgtname, we download an index.html and the WGT archive could
contains a file with the same name and unzip complain about replacing a file.
The solution is to unzip in an empty dedicated directory.
Change-Id: I9680eb8909256e749a2b5177ed1d942add841af5
BUG-AGL: SPEC-3533
Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
Corentin LABBE [Thu, 16 Jul 2020 07:30:47 +0000 (09:30 +0200)]
SPEC-3495: fix greping of systemd units
The grep pattern for systemd units is not enough restrictive.
So let's made grep a little more restrictive.
Change-Id: If0f75919a89c39da63e5375e3b3cdd020c6ea324
Bug-AGL: SPEC-3495
Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
Corentin LABBE [Mon, 13 Jul 2020 12:43:53 +0000 (14:43 +0200)]
SPEC-3495: handle better all package name
Package could have -debug in their filename, but their service name is
without it.
Some package could exists with a basename-extension, so we need to grep
better to not catch them all.
Example: agl-service-bluetooth catch agl-service-bluetooth-map.
Change-Id: Ibc750e7893a8cbe3fc22a0d8f13a32c28a898bd1
Bug-AGL: SPEC-3495
Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
Corentin LABBE [Mon, 15 Jun 2020 12:29:06 +0000 (14:29 +0200)]
SPEC-3427: check if RID is null
RID could be null if process failed to start.
In that case, we will retry to start it.
On a second fail, we will not continue the test suite and fail.
In th same time add a second status check, but after a delay to be sure
the service is still working.
Bug-AGL: SPEC-3427
Change-Id: I566f1aefa06cbb791674373340ce87be220b18a2
Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
Jan-Simon Moeller [Thu, 28 May 2020 14:21:08 +0000 (16:21 +0200)]
Make the script runnable locally and adapt ps call
The script can be run for testing locally now and afm-util ps needs to start as the target user.
Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org>
Change-Id: Ief0f785a46439531d4257c2eef9ced15be1b20fb
Jan-Simon Möller [Thu, 28 May 2020 09:46:57 +0000 (11:46 +0200)]
Remove versioning of wgts from test
This was removed thus there is no '@?.?' .
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
Jan-Simon Moeller [Tue, 24 Mar 2020 13:24:41 +0000 (14:24 +0100)]
Update skiplists.
lava-read-feedback fail on qemu due to a sequence issues.
This is merely a timing issue on the lava side that we mask here.
Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org>
Change-Id: I19070931704e7b9bf0a27e9370fdffd5adb899ba
Jan-Simon Möller [Fri, 20 Dec 2019 23:27:20 +0000 (00:27 +0100)]
Disable the can module unload/load test
And also fix a logic bug in the test_can_modules.
The test can stay disabled. There is no need to unload the modules.
Bug-AGL: SPEC-3070
.
Change-Id: Ic94d5bb9cad3d6cdcbc6534cfc4003213ad82aaa
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
Corentin LABBE [Tue, 17 Dec 2019 12:54:46 +0000 (13:54 +0100)]
SPEC-3064: handle removal of can_bcm
The test removing can module fail on DRA7 due to can_bcm using it.
This patchs handle this case.
Bug-AGL: SPEC-3064
Change-Id: I272e0ea62786fb43c4ea68601f2fb12864a279b6
Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
Jan-Simon Moeller [Tue, 10 Dec 2019 13:39:37 +0000 (13:39 +0000)]
Merge "Skip the can test"
Corentin LABBE [Mon, 9 Dec 2019 13:53:24 +0000 (14:53 +0100)]
SPEC-2970: Do not fail ofone and bluetooth services if bluetooth tag is non present
When no bluetooth dongle is present, there is a timing issue which let
the service fail.
So if no bluetooth tag is present, skip the service test instead of
failling.
Bug-AGL: SPEC-2907
Change-Id: I10755ec698ab632ffcf0eec18ebe6bc41b1b5ec1
Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
Khouloud Touil [Mon, 9 Dec 2019 10:41:42 +0000 (11:41 +0100)]
Skip the can test
As the behaviour of the test not determined, to avoid the fail of the
test, we will skip it if the value of no_transmission not found.
AGL-bug: SPEC-3025
Change-Id: If24e512f2cc83ee7018a4309cb64434cf3a2b938
Signed-off-by: Khouloud Touil <ktouil@baylibre.com>
Corentin LABBE [Wed, 4 Dec 2019 14:40:23 +0000 (15:40 +0100)]
SPEC-2970: Add bluetooth and ofono on qemu ARM/ARM64 skiplists
Since bluetooth is still failling on qemu ARM and ARM64 (and bring down
ofono by dependency), let's add them to the skiplist.
Change-Id: I1ac3485f339763f16d49e7527faa74f6efe71b30
Bug-AGL: SPEC-2970
Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
Jan-Simon Moeller [Thu, 28 Nov 2019 22:30:48 +0000 (23:30 +0100)]
Also call kill in the right context
depending on the app.
Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org>
Change-Id: I7208497e81fb3fcb2636bf7559b27ff2b5ce7676
Jan-Simon Moeller [Thu, 28 Nov 2019 22:19:48 +0000 (23:19 +0100)]
Call info ps and status in the context of the app user
We need to call the info and status call under the context of user under which the app runs.
Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org>
Change-Id: I25abff89db22c5effb6addfbc59ec30575aae2ed
Jan-Simon Moeller [Thu, 28 Nov 2019 15:06:15 +0000 (15:06 +0000)]
Merge "SPEC-2996: handle rcar_can"
Corentin LABBE [Thu, 28 Nov 2019 09:10:49 +0000 (10:10 +0100)]
SPEC-2996: handle rcar_can
The test remove can_dv module fail on H3 due to rcar_can using it.
This patchs handle this case.
Change-Id: I452a61813567ad09f3f819ce73c1c11753326514
Bug-AGL: SPEC-2996
Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
Corentin LABBE [Thu, 28 Nov 2019 09:05:10 +0000 (10:05 +0100)]
SPEC-2996: Fix ip check
BusyBox ip print its version stderr, so we need to redirect it to stdin.
Furthermore, using set -x reset the error code, we need to store it before.
Bug-AGL: SPEC-2996
Change-Id: I4b80475b0f9291fc55e661362a981ac14dbdb9b0
Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
Corentin LABBE [Wed, 27 Nov 2019 09:58:26 +0000 (10:58 +0100)]
SPEC-2996: rework the CAN modules tests
The CAN modules tests have lots of redundant code, let's add some
function for probing/removing modules.
Furthermore, some tests cannot work with busybox ip, I adds some tests
for it.
When reworking the tests, I have removed the "lsmod |grep can" tests
which was of no value.
I have also removed all sleep which was undocumented(probably for some
log flushing), if something need them I will re-add it with comment.
Bug-AGL: SPEC-2996
Change-Id: I2e8a109d799c58726d848814fd4c21a9fbd2eef5
Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
Jan-Simon Möller [Tue, 26 Nov 2019 21:12:07 +0000 (22:12 +0100)]
Verbose output
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
Jan-Simon Moeller [Tue, 26 Nov 2019 16:58:11 +0000 (16:58 +0000)]
Merge "test_can_loopback_mode: Add ip util version check"
Corentin LABBE [Tue, 26 Nov 2019 10:43:06 +0000 (11:43 +0100)]
test_can_loopback_mode: Add ip util version check
CAN tests fail on M3 and H3 because their build includes busybox version
of ip (and not iproute one).
This patchs adds a test for detecting if the right ip util is installed.
Change-Id: I5909bc0af23271626dec9c1ed7003bdfc9129041
Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
Corentin LABBE [Tue, 26 Nov 2019 09:07:37 +0000 (10:07 +0100)]
SPEC-2970: Improove logging size
When TERM is dump, the width of logging is cropped at 80columns which
made debugging harder.
This patchs increase columns size to 1000.
Bug-AGL: SPEC-2970
Change-Id: Ia70136b6aa6242362b1286631ae4b00ab567ae2e
Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
Jose Bollo [Wed, 6 Nov 2019 15:06:47 +0000 (16:06 +0100)]
Cynagora: Replace cynara with cynagora
Currently we disable ptests/socket tests
to be enabled in SPEC-2940 and SPEC-2941.
Shift from the permission database cynara
to cynagora permission database with a compatibility
library.
Bug-AGL: SPEC-2844
Bug-AGL: SPEC-2941
Signed-off-by: Jose Bollo <jose.bollo@iot.bzh>
Change-Id: I673e47ae237a83926f15d003dd2d2623a08eefb5
Jan-Simon Moeller [Wed, 23 Oct 2019 12:03:12 +0000 (14:03 +0200)]
Mask the bluetooth test until issues are resolved
Currently the bluetooth service fails exclusively on m3ulcb-nogfx.
We need to adapt the CI infra (lava labs) either with additional hw
or adapt the dtb used conditionally. This needs further work.
Meanwhile mask the bluetooth service test on the m3ulcb-nogfx target
to avoid false-positives being reported.
Bug-AGL: SPEC-2921
.
Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org>
Change-Id: I592ea7f8a6b8ddc4ff10eac8428162c44a1d3ac4
Corentin LABBE [Wed, 23 Oct 2019 09:04:02 +0000 (11:04 +0200)]
remove debuging information of do_afm_util
This printing breaks 'rid' parsing, remove it.
Bug-AGL: SPEC-2903
Bug-AGL: SPEC-2925
Change-Id: I505ab9d2994f983de53849fce25d87c8af44362d
Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
Corentin LABBE [Tue, 22 Oct 2019 12:11:15 +0000 (14:11 +0200)]
SPEC-2903: fix the grep test method
While inspecting if application test is working with our latest
SPEC-2903 changes I see in job 8845 the following errors:
+ grep urn:AGL:widget:provided-api config.xml
+ '<feature' 'name=\"urn:AGL:widget:provided-api\">'
./common/scripts/application-lifecycle.sh: line 74: <feature: command not found
So let's change the grep method.
Furthermore, add a debug for the do_afm_util for being sure it work as
needed.
Bug-AGL: SPEC-2903
Change-Id: I5a8a6d98cd9dc6c1b2d1626fc6841eb2c2b16d53
Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
Corentin LABBE [Mon, 21 Oct 2019 14:00:34 +0000 (16:00 +0200)]
SPEC-2903: Use a wrapper instead of constructing a command
This patch change the way we ran afm-util commands by using a simple
wrapper.
Furthermore, since we are in a loop, let's reset all variable
(SERVICE_PLATFORM/etc..) to 0 at the beginning of the loop.
Extra-furthermore: restore the unzip error code test, but in non-fatal
way, since busybox unzip seems to dont like our CRC.
Bug-AGL: SPEC-2903
Change-Id: I5d7357fd74307ed69a6675beac57d8601fdcdb52
Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
Jan-Simon Moeller [Fri, 18 Oct 2019 22:30:33 +0000 (00:30 +0200)]
Improve lifecycle test
Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org>
Change-Id: I9076278096e15829b4bca52f6b5ef9e9a3b39e9e
Jan-Simon Moeller [Thu, 17 Oct 2019 19:06:00 +0000 (19:06 +0000)]
Merge "Differ platform and user scope in service and application"
Jan-Simon Moeller [Thu, 17 Oct 2019 18:57:59 +0000 (20:57 +0200)]
Differ platform and user scope in service and application
When executing the lifecycle test, we need to take into account if
the service or app runs in platform or user scope.
Bug-AGL: SPEC-2903
.
Signed-off-by: Jan-Simon Moeller <jsmoeller@linuxfoundation.org>
Change-Id: I49a53a5a2b14666757b65b0f8203eb73ed2c7b45
Jan-Simon Moeller [Wed, 16 Oct 2019 07:52:13 +0000 (07:52 +0000)]
Merge "Inverse the fail/pass logic"
Jan-Simon Moeller [Wed, 16 Oct 2019 07:51:31 +0000 (07:51 +0000)]
Merge "qa-testdefinitions: Split can tests to avoid failures"
Khouloud Touil [Tue, 15 Oct 2019 14:54:15 +0000 (16:54 +0200)]
Inverse the fail/pass logic
This test should be failing, so it should be set to pass when it
fails, and should be set to fail when it passes.
AGL-bug: SPEC-2878
Change-Id: I43921717eea77d654921eca4691c936bb2901e54
Signed-off-by: Khouloud Touil <ktouil@baylibre.com>
Khouloud Touil [Fri, 11 Oct 2019 10:50:11 +0000 (12:50 +0200)]
qa-testdefinitions: Split can tests to avoid failures
Split the can tests in two, one for basic tests that doesn't need the
two can interfaces to be related, and the other one is for a board with
two related interfaces.
Modify the test_can_modules to be run on a board with only one can if at
least.
AGL-bug: SPEC-2878
Change-Id: I6f761458c3e191aa8000d19cb05b0592566cb6c9
Signed-off-by: Khouloud Touil <ktouil@baylibre.com>
Jan-Simon Moeller [Sun, 6 Oct 2019 13:27:40 +0000 (13:27 +0000)]
Merge "Avoid some test cases failures"
Khouloud Touil [Thu, 3 Oct 2019 09:17:04 +0000 (11:17 +0200)]
Avoid some test cases failures
To make sure that the can interface could be configured, we have to make
it dowm each time before the start of the config step.
Change-Id: I7bebea65072ffd822ee30241c68a0a89123b1576
Signed-off-by: Khouloud Touil <ktouil@baylibre.com>
Jan-Simon Moeller [Wed, 11 Sep 2019 22:57:43 +0000 (22:57 +0000)]
Merge "Use the new arg --build-tags and the arg --device-tags"
Corentin LABBE [Tue, 10 Sep 2019 12:22:21 +0000 (14:22 +0200)]
SPEC-2740: add weston in the qemuarm/qemuarm64 skiplist
weston does not start on qemuarm/qemuarm64, let's add it to the test skiplist.
Change-Id: I885b8fe0e6521a1e707c4a3298a9f7d9aa384728
Bug-AGL: SPEC-2740
Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
Khouloud Touil [Wed, 7 Aug 2019 15:08:30 +0000 (17:08 +0200)]
Use the new arg --build-tags and the arg --device-tags
Use the new arg --build-tags along with the arg --device-tags to decide
the tests to be run and the tests to be skiped.
The test to be tested in this patch is for the weston service.
Bug-AGL: SPEC-2721
Change-Id: Ia34680c5e60e27dfe286626fedc5775efff87ba3
Signed-off-by: Khouloud Touil <ktouil@baylibre.com>
Jan-Simon Moeller [Wed, 27 Mar 2019 17:15:48 +0000 (17:15 +0000)]
Merge "Add application-lifecycle test"
Corentin LABBE [Tue, 12 Mar 2019 13:49:29 +0000 (14:49 +0100)]
Add application-lifecycle test
This patch adds basic Application Lifecycle Workflow Test (fetch, uninstall, install, start)
Bug-AGL: SPEC-1850
Change-Id: Ie65648e043b7909aecb2fe64dfbf2b2bba8f1f37
Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
Khouloud Touil [Wed, 13 Mar 2019 14:59:31 +0000 (15:59 +0100)]
Fix the nomenclatur of LAVA test cases
This patch fixes the problem of the naming issue. Test cases that have
the same name will end up overwriting previous test cases when storing
the results in the data base. So this patch is to changes the test cases
names and to be more understandable.
Change-Id: Iab3aaf62aefb120b7a04d21bd83aabf7034e72f4
Signed-off-by: Khouloud Touil <ktouil@baylibre.com>
Khouloud Touil [Wed, 13 Mar 2019 14:28:01 +0000 (15:28 +0100)]
Fix: delete the temporary file
Before breaking the loop, the temporary file should be deleted.
Change-Id: I3d2abb49b78cdf08e77ce4007d24e40dd4a93ea5
Signed-off-by: Khouloud Touil <ktouil@baylibre.com>
Khouloud Touil [Wed, 13 Mar 2019 14:19:00 +0000 (15:19 +0100)]
Fix the for loop
To avoid looping several times through the same test case the 'break'
should be moved to the right position.
Change-Id: I8a4d5e73b1f2ef39f8593209b928323a1770dedf
Signed-off-by: Khouloud Touil <ktouil@baylibre.com>
Khouloud Touil [Wed, 13 Mar 2019 14:17:05 +0000 (15:17 +0100)]
test_can_bitrate: fix indentation
This patch fixes indentation in the 'test_can_bitrate.sh' file.
Change-Id: I1968e9e7e39429e3900b845c1f72ff393f741d16
Signed-off-by: Khouloud Touil <ktouil@baylibre.com>
Khouloud Touil [Thu, 24 Jan 2019 10:05:49 +0000 (11:05 +0100)]
Add new parameters
Passing the board tags as parameters to the .yaml file.
Change-Id: If3c5e9dc5d4e31f00b29cb8f2bf2da60890f8fc5
Signed-off-by: Khouloud Touil <ktouil@baylibre.com>
Kevin Hilman [Tue, 27 Nov 2018 00:14:32 +0000 (16:14 -0800)]
ptest wrapper: disable smack
All the smack ptest does is generate a bunch of random files, which
fills up the filesystem and then fails.
Disable it.
Change-Id: I859f683105ee89b1d5082e7477f76f127c99da67
Signed-off-by: Kevin Hilman <khilman@baylibre.com>
Kevin Hilman [Tue, 27 Nov 2018 00:26:18 +0000 (16:26 -0800)]
ptest wrapper: add ptest-installed PASS
Add a "ptest-installed" test-case in the successful case also, so that
there is always "ptest-installed" test case when ptests are attempted.
Change-Id: I277ad66bf51a8b7e65fdea4cf77b6e1d862811c0
Signed-off-by: Kevin Hilman <khilman@baylibre.com>
Kevin Hilman [Tue, 27 Nov 2018 00:02:24 +0000 (16:02 -0800)]
ptest wrapper: use new LAVA mode
ptest-runner now has a new LAVA mode (enabled with -L) that will
automatically output the LAVA_SIGNAL messages needed for LAVA to
automatically parse/collect test results.
Re-work this wrapper script to that it just uses the new LAVA mode.
Change-Id: I310f1188f65de5f86e8179c12aedce6a92932e9a
Signed-off-by: Kevin Hilman <khilman@baylibre.com>
Jan-Simon Möller [Fri, 16 Nov 2018 06:27:32 +0000 (07:27 +0100)]
Tune down on selection of ptests and ramp-up one-by-one
E.g. the systemd ptest will break network which is bad in a network env.
So start with less and add more after checking manually.
Change-Id: Iff199dfb6e42475495e036330b0962739e2f74f4
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
Jan-Simon Möller [Tue, 16 Oct 2018 05:45:55 +0000 (07:45 +0200)]
Add sample folders for daily, weekly and release
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
Jan-Simon Moeller [Mon, 8 Oct 2018 09:16:07 +0000 (09:16 +0000)]
Merge "yocto-ptest: fix ptest-runner failure case"
Kevin Hilman [Sat, 6 Oct 2018 15:56:37 +0000 (17:56 +0200)]
yocto-ptest: fix ptest-runner failure case
lava-test-case only takes one argument for TEST_CASE_ID
Change-Id: Ic6e2f93a4f8829c8307528661fd3f9f6db4b6d88
Signed-off-by: Kevin Hilman <khilman@baylibre.com>
Kevin Hilman [Sat, 6 Oct 2018 15:18:58 +0000 (17:18 +0200)]
yocto-ptest: fix bash syntax error
Change-Id: I7bacce4d52f2ab15c2b855ca853e5b64e13c887d
Signed-off-by: Kevin Hilman <khilman@baylibre.com>
Jan-Simon Möller [Tue, 2 Oct 2018 17:42:29 +0000 (19:42 +0200)]
Fix typo in wrapper
Change-Id: I89c02dcdc2bb283cf83442daf0bd78edd208ff42
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
Jan-Simon Möller [Tue, 2 Oct 2018 17:30:20 +0000 (19:30 +0200)]
Add the long ptest job and enhance the short job
Change-Id: I42dd644656a47fd9ba3b35a25e848535f61ca0a9
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
Jan-Simon Möller [Mon, 1 Oct 2018 11:05:39 +0000 (13:05 +0200)]
Add test to dump the systemd journal
Change-Id: I2ad02f6828e165a898fb4a739ab3c893267d4c53
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
Jan-Simon Möller [Mon, 1 Oct 2018 10:54:26 +0000 (12:54 +0200)]
Add job to delay shutdown for manual inspection
Change-Id: Ib7e3495a03256e6dcaafda529db99bad805ace03
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
Jan-Simon Möller [Fri, 28 Sep 2018 12:40:38 +0000 (14:40 +0200)]
Update units to test with ptest
Change-Id: Iaae973d8240d8754eac2c49010728c42157674b3
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
Jan-Simon Möller [Wed, 26 Sep 2018 21:42:19 +0000 (23:42 +0200)]
Remove deprecated service check
homescreen.service is no longer supported.
Change-Id: Icc0595e9aac9522e0b55fb9e524066187cd0efeb
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
khouloud touil [Thu, 12 Jul 2018 08:36:46 +0000 (10:36 +0200)]
Fix the CAN bus tests
At first to be able to configure the can interfaces, we had to use the libsocketcan,
but this lib should be used with canutils utilities, but a conflict happened between
the canutils and the can-utils, so I had to fix the tests to be able to use only
the can-utils utilities.
This link for a LAVA test job for these tests:
http://lava.baylibre.com:10080/scheduler/job/10883
Change-Id: I7b988496d6977d6d9d82f8f82b58520444dbc7d6
Signed-off-by: khouloud touil <ktouil@baylibre.com>
khouloud touil [Fri, 22 Jun 2018 12:26:49 +0000 (14:26 +0200)]
CAN bus tests
This commit for testing CAN modules, sending and receiving frames, showing stats and and testing suitable bitrates for transmission.
The "test_can_loopback_mode" test can be run on a board with one interface.
This test will fail gracfully if the board dosen't have any CAN interface.
The other tests needs to be run on a board with two CAN interfaces (e.g. dra7 with external transceiver.)
These tests requires two interfaces on the same board to send frames with the first interface and to receive them with the other one
These tests will fail gracfully by skiping all test cases if the board doesn't have two interfaces.
This link for the DRA7xx-EVM job : http://lava.baylibre.com:10080/scheduler/job/2860
This link for the AM335X-BONEBLACK (no CAN interface) : http://lava.baylibre.com:10080/scheduler/job/2862
Change-Id: I7d4c69f7817adbea8281d264cbbb7fa55571584e
Signed-off-by: khouloud touil <ktouil@baylibre.com>
jobol [Wed, 14 Mar 2018 12:58:25 +0000 (13:58 +0100)]
service-ids-check: Add check uid/gid of services
This new test allows to check whether service
run with expected uid and gid. This check doesn't
check that the service runs because there is an
other check for that.
It currently only checks weston service to run as
display/display but it can be easily extended for
checking other services.
Bug-AGL: SPEC-546
Signed-off-by: jobol <jose.bollo@iot.bzh>
Loys Ollivier [Thu, 9 Nov 2017 10:10:00 +0000 (11:10 +0100)]
Yocto ptest wrapper extend ptest set
Extend the set of ptests to run to: acl attr bluez5 busybox dbus-test.
Reduce the LAVA output to summarize the results of ptests.
Change-Id: I088789dbc148f4007c8b9971adeadce689cbb6b0
Signed-off-by: Loys Ollivier <lollivier@baylibre.com>
lollivier [Fri, 20 Oct 2017 09:30:03 +0000 (11:30 +0200)]
New Yocto ptest definition & script
Add a new yocto ptest definition to the pool of tests.
The script is a wrapper around the ptests.
For now it only runs the ptests for busybox.
Bug-AGL: SPEC-911
Change-Id: I6fe96297c0d5db71c2ef41dc5afd67eecf3d8e97
Signed-off-by: lollivier <lollivier@baylibre.com>
Jan-Simon Möller [Tue, 17 Oct 2017 22:13:06 +0000 (00:13 +0200)]
Rename check for homescreen and remove lightmediascanner service
This change corrects the service-check-gfx.sh script.
HomeScreen.service is actually named homescreen.service.
lightmediascanner.service does not exist in the target rootfs.
Change-Id: Ief1a1641e2e5242f155255af02b1c250b377ae12
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
Jan-Simon Moeller [Thu, 12 Oct 2017 12:45:24 +0000 (12:45 +0000)]
Merge "Adapt service checks for gfx and nogfx case"
Code Review / src / qa-testdefinitions.git / log