Khouloud Touil [Tue, 15 Oct 2019 14:54:15 +0000 (16:54 +0200)]
Inverse the fail/pass logic
This test should be failing, so it should be set to pass when it
fails, and should be set to fail when it passes.
AGL-bug: SPEC-2878
Change-Id: I43921717eea77d654921eca4691c936bb2901e54
Signed-off-by: Khouloud Touil <ktouil@baylibre.com>
Khouloud Touil [Fri, 11 Oct 2019 10:50:11 +0000 (12:50 +0200)]
qa-testdefinitions: Split can tests to avoid failures
Split the can tests in two, one for basic tests that doesn't need the
two can interfaces to be related, and the other one is for a board with
two related interfaces.
Modify the test_can_modules to be run on a board with only one can if at
least.
AGL-bug: SPEC-2878
Change-Id: I6f761458c3e191aa8000d19cb05b0592566cb6c9
Signed-off-by: Khouloud Touil <ktouil@baylibre.com>
Jan-Simon Moeller [Sun, 6 Oct 2019 13:27:40 +0000 (13:27 +0000)]
Merge "Avoid some test cases failures"
Khouloud Touil [Thu, 3 Oct 2019 09:17:04 +0000 (11:17 +0200)]
Avoid some test cases failures
To make sure that the can interface could be configured, we have to make
it dowm each time before the start of the config step.
Change-Id: I7bebea65072ffd822ee30241c68a0a89123b1576
Signed-off-by: Khouloud Touil <ktouil@baylibre.com>
Jan-Simon Moeller [Wed, 11 Sep 2019 22:57:43 +0000 (22:57 +0000)]
Merge "Use the new arg --build-tags and the arg --device-tags"
Corentin LABBE [Tue, 10 Sep 2019 12:22:21 +0000 (14:22 +0200)]
SPEC-2740: add weston in the qemuarm/qemuarm64 skiplist
weston does not start on qemuarm/qemuarm64, let's add it to the test skiplist.
Change-Id: I885b8fe0e6521a1e707c4a3298a9f7d9aa384728
Bug-AGL: SPEC-2740
Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
Khouloud Touil [Wed, 7 Aug 2019 15:08:30 +0000 (17:08 +0200)]
Use the new arg --build-tags and the arg --device-tags
Use the new arg --build-tags along with the arg --device-tags to decide
the tests to be run and the tests to be skiped.
The test to be tested in this patch is for the weston service.
Bug-AGL: SPEC-2721
Change-Id: Ia34680c5e60e27dfe286626fedc5775efff87ba3
Signed-off-by: Khouloud Touil <ktouil@baylibre.com>
Jan-Simon Moeller [Wed, 27 Mar 2019 17:15:48 +0000 (17:15 +0000)]
Merge "Add application-lifecycle test"
Corentin LABBE [Tue, 12 Mar 2019 13:49:29 +0000 (14:49 +0100)]
Add application-lifecycle test
This patch adds basic Application Lifecycle Workflow Test (fetch, uninstall, install, start)
Bug-AGL: SPEC-1850
Change-Id: Ie65648e043b7909aecb2fe64dfbf2b2bba8f1f37
Signed-off-by: Corentin LABBE <clabbe@baylibre.com>
Khouloud Touil [Wed, 13 Mar 2019 14:59:31 +0000 (15:59 +0100)]
Fix the nomenclatur of LAVA test cases
This patch fixes the problem of the naming issue. Test cases that have
the same name will end up overwriting previous test cases when storing
the results in the data base. So this patch is to changes the test cases
names and to be more understandable.
Change-Id: Iab3aaf62aefb120b7a04d21bd83aabf7034e72f4
Signed-off-by: Khouloud Touil <ktouil@baylibre.com>
Khouloud Touil [Wed, 13 Mar 2019 14:28:01 +0000 (15:28 +0100)]
Fix: delete the temporary file
Before breaking the loop, the temporary file should be deleted.
Change-Id: I3d2abb49b78cdf08e77ce4007d24e40dd4a93ea5
Signed-off-by: Khouloud Touil <ktouil@baylibre.com>
Khouloud Touil [Wed, 13 Mar 2019 14:19:00 +0000 (15:19 +0100)]
Fix the for loop
To avoid looping several times through the same test case the 'break'
should be moved to the right position.
Change-Id: I8a4d5e73b1f2ef39f8593209b928323a1770dedf
Signed-off-by: Khouloud Touil <ktouil@baylibre.com>
Khouloud Touil [Wed, 13 Mar 2019 14:17:05 +0000 (15:17 +0100)]
test_can_bitrate: fix indentation
This patch fixes indentation in the 'test_can_bitrate.sh' file.
Change-Id: I1968e9e7e39429e3900b845c1f72ff393f741d16
Signed-off-by: Khouloud Touil <ktouil@baylibre.com>
Khouloud Touil [Thu, 24 Jan 2019 10:05:49 +0000 (11:05 +0100)]
Add new parameters
Passing the board tags as parameters to the .yaml file.
Change-Id: If3c5e9dc5d4e31f00b29cb8f2bf2da60890f8fc5
Signed-off-by: Khouloud Touil <ktouil@baylibre.com>
Kevin Hilman [Tue, 27 Nov 2018 00:14:32 +0000 (16:14 -0800)]
ptest wrapper: disable smack
All the smack ptest does is generate a bunch of random files, which
fills up the filesystem and then fails.
Disable it.
Change-Id: I859f683105ee89b1d5082e7477f76f127c99da67
Signed-off-by: Kevin Hilman <khilman@baylibre.com>
Kevin Hilman [Tue, 27 Nov 2018 00:26:18 +0000 (16:26 -0800)]
ptest wrapper: add ptest-installed PASS
Add a "ptest-installed" test-case in the successful case also, so that
there is always "ptest-installed" test case when ptests are attempted.
Change-Id: I277ad66bf51a8b7e65fdea4cf77b6e1d862811c0
Signed-off-by: Kevin Hilman <khilman@baylibre.com>
Kevin Hilman [Tue, 27 Nov 2018 00:02:24 +0000 (16:02 -0800)]
ptest wrapper: use new LAVA mode
ptest-runner now has a new LAVA mode (enabled with -L) that will
automatically output the LAVA_SIGNAL messages needed for LAVA to
automatically parse/collect test results.
Re-work this wrapper script to that it just uses the new LAVA mode.
Change-Id: I310f1188f65de5f86e8179c12aedce6a92932e9a
Signed-off-by: Kevin Hilman <khilman@baylibre.com>
Jan-Simon Möller [Fri, 16 Nov 2018 06:27:32 +0000 (07:27 +0100)]
Tune down on selection of ptests and ramp-up one-by-one
E.g. the systemd ptest will break network which is bad in a network env.
So start with less and add more after checking manually.
Change-Id: Iff199dfb6e42475495e036330b0962739e2f74f4
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
Jan-Simon Möller [Tue, 16 Oct 2018 05:45:55 +0000 (07:45 +0200)]
Add sample folders for daily, weekly and release
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
Jan-Simon Moeller [Mon, 8 Oct 2018 09:16:07 +0000 (09:16 +0000)]
Merge "yocto-ptest: fix ptest-runner failure case"
Kevin Hilman [Sat, 6 Oct 2018 15:56:37 +0000 (17:56 +0200)]
yocto-ptest: fix ptest-runner failure case
lava-test-case only takes one argument for TEST_CASE_ID
Change-Id: Ic6e2f93a4f8829c8307528661fd3f9f6db4b6d88
Signed-off-by: Kevin Hilman <khilman@baylibre.com>
Kevin Hilman [Sat, 6 Oct 2018 15:18:58 +0000 (17:18 +0200)]
yocto-ptest: fix bash syntax error
Change-Id: I7bacce4d52f2ab15c2b855ca853e5b64e13c887d
Signed-off-by: Kevin Hilman <khilman@baylibre.com>
Jan-Simon Möller [Tue, 2 Oct 2018 17:42:29 +0000 (19:42 +0200)]
Fix typo in wrapper
Change-Id: I89c02dcdc2bb283cf83442daf0bd78edd208ff42
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
Jan-Simon Möller [Tue, 2 Oct 2018 17:30:20 +0000 (19:30 +0200)]
Add the long ptest job and enhance the short job
Change-Id: I42dd644656a47fd9ba3b35a25e848535f61ca0a9
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
Jan-Simon Möller [Mon, 1 Oct 2018 11:05:39 +0000 (13:05 +0200)]
Add test to dump the systemd journal
Change-Id: I2ad02f6828e165a898fb4a739ab3c893267d4c53
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
Jan-Simon Möller [Mon, 1 Oct 2018 10:54:26 +0000 (12:54 +0200)]
Add job to delay shutdown for manual inspection
Change-Id: Ib7e3495a03256e6dcaafda529db99bad805ace03
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
Jan-Simon Möller [Fri, 28 Sep 2018 12:40:38 +0000 (14:40 +0200)]
Update units to test with ptest
Change-Id: Iaae973d8240d8754eac2c49010728c42157674b3
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
Jan-Simon Möller [Wed, 26 Sep 2018 21:42:19 +0000 (23:42 +0200)]
Remove deprecated service check
homescreen.service is no longer supported.
Change-Id: Icc0595e9aac9522e0b55fb9e524066187cd0efeb
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
khouloud touil [Thu, 12 Jul 2018 08:36:46 +0000 (10:36 +0200)]
Fix the CAN bus tests
At first to be able to configure the can interfaces, we had to use the libsocketcan,
but this lib should be used with canutils utilities, but a conflict happened between
the canutils and the can-utils, so I had to fix the tests to be able to use only
the can-utils utilities.
This link for a LAVA test job for these tests:
http://lava.baylibre.com:10080/scheduler/job/10883
Change-Id: I7b988496d6977d6d9d82f8f82b58520444dbc7d6
Signed-off-by: khouloud touil <ktouil@baylibre.com>
khouloud touil [Fri, 22 Jun 2018 12:26:49 +0000 (14:26 +0200)]
CAN bus tests
This commit for testing CAN modules, sending and receiving frames, showing stats and and testing suitable bitrates for transmission.
The "test_can_loopback_mode" test can be run on a board with one interface.
This test will fail gracfully if the board dosen't have any CAN interface.
The other tests needs to be run on a board with two CAN interfaces (e.g. dra7 with external transceiver.)
These tests requires two interfaces on the same board to send frames with the first interface and to receive them with the other one
These tests will fail gracfully by skiping all test cases if the board doesn't have two interfaces.
This link for the DRA7xx-EVM job : http://lava.baylibre.com:10080/scheduler/job/2860
This link for the AM335X-BONEBLACK (no CAN interface) : http://lava.baylibre.com:10080/scheduler/job/2862
Change-Id: I7d4c69f7817adbea8281d264cbbb7fa55571584e
Signed-off-by: khouloud touil <ktouil@baylibre.com>
jobol [Wed, 14 Mar 2018 12:58:25 +0000 (13:58 +0100)]
service-ids-check: Add check uid/gid of services
This new test allows to check whether service
run with expected uid and gid. This check doesn't
check that the service runs because there is an
other check for that.
It currently only checks weston service to run as
display/display but it can be easily extended for
checking other services.
Bug-AGL: SPEC-546
Signed-off-by: jobol <jose.bollo@iot.bzh>
Loys Ollivier [Thu, 9 Nov 2017 10:10:00 +0000 (11:10 +0100)]
Yocto ptest wrapper extend ptest set
Extend the set of ptests to run to: acl attr bluez5 busybox dbus-test.
Reduce the LAVA output to summarize the results of ptests.
Change-Id: I088789dbc148f4007c8b9971adeadce689cbb6b0
Signed-off-by: Loys Ollivier <lollivier@baylibre.com>
lollivier [Fri, 20 Oct 2017 09:30:03 +0000 (11:30 +0200)]
New Yocto ptest definition & script
Add a new yocto ptest definition to the pool of tests.
The script is a wrapper around the ptests.
For now it only runs the ptests for busybox.
Bug-AGL: SPEC-911
Change-Id: I6fe96297c0d5db71c2ef41dc5afd67eecf3d8e97
Signed-off-by: lollivier <lollivier@baylibre.com>
Jan-Simon Möller [Tue, 17 Oct 2017 22:13:06 +0000 (00:13 +0200)]
Rename check for homescreen and remove lightmediascanner service
This change corrects the service-check-gfx.sh script.
HomeScreen.service is actually named homescreen.service.
lightmediascanner.service does not exist in the target rootfs.
Change-Id: Ief1a1641e2e5242f155255af02b1c250b377ae12
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
Jan-Simon Moeller [Thu, 12 Oct 2017 12:45:24 +0000 (12:45 +0000)]
Merge "Adapt service checks for gfx and nogfx case"
Jan-Simon Möller [Thu, 12 Oct 2017 10:05:51 +0000 (12:05 +0200)]
Add 5 sec delay for service check
to ensure all services (weston/homescreen) are really up
as they might still be starting once we reach the login
prompt.
Change-Id: I1e16146704f1b11d576ffab1524b279e4be5a82c
Bug-AGL: SPEC-950
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
Jan-Simon Möller [Thu, 12 Oct 2017 09:56:15 +0000 (11:56 +0200)]
Adapt service checks for gfx and nogfx case
Based on SPEC-949, remove the afm-user-daemon service as it is a session service and no system service.
Add systemctl list-units at the end.
Bug-AGL: SPEC-949
Change-Id: I90cde515efc5dbbd031691026f76345f8828be1a
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
Jan-Simon Möller [Tue, 10 Oct 2017 21:06:21 +0000 (23:06 +0200)]
Prepare the nogfx variant of the service check
and enhance verbosity.
Change-Id: Ia95a6236ffc4229703714ad58b70b21c00884c5c
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
Jan-Simon Möller [Fri, 29 Sep 2017 10:19:13 +0000 (12:19 +0200)]
Add some more output in case the service is not up to assist debugging
Change-Id: Ia61db614df402ccf9daf37ef685a002b08e3d824
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
Jan-Simon Moeller [Tue, 26 Sep 2017 11:30:43 +0000 (11:30 +0000)]
Merge "[SPEC-272] Add service test"
Loys Ollivier [Tue, 26 Sep 2017 06:57:22 +0000 (08:57 +0200)]
Add test documentation and example
Added:
- README to point to releng-scripts
- test documentation
- a test example skeleton
Change-Id: I75e7be55eb836adf4c8c6816689ffe5a65b76145
Signed-off-by: Loys Ollivier <lollivier@baylibre.com>
Loys Ollivier [Fri, 22 Sep 2017 14:23:41 +0000 (16:23 +0200)]
[SPEC-272] Add service test
New test definition. Check that needed services are up.
Signed-off-by: Loys Ollivier <lollivier@baylibre.com>
Jan-Simon Möller [Tue, 13 Jun 2017 11:07:39 +0000 (13:07 +0200)]
Remove lscpu and lsb_release as they're not in our filesystem.
Change-Id: Ibe359a3140362f30e1a28f3431caf5beb60acdf2
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
Jan-Simon Möller [Tue, 13 Jun 2017 09:15:28 +0000 (11:15 +0200)]
Add examples for tests
Change-Id: I2488c210df0b71c1d7b752babce16fd80d17acd3
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
Jan-Simon Möller [Thu, 2 Mar 2017 17:06:51 +0000 (18:06 +0100)]
Add gitreview file
Change-Id: Ia69d00c3fd36bfab138d1fc72130e0499ae1b779
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
Jan-Simon Möller [Tue, 28 Feb 2017 12:11:08 +0000 (13:11 +0100)]
Add first test to testdefinition repo.
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>
Jan-Simon Moeller [Tue, 28 Feb 2017 11:56:35 +0000 (11:56 +0000)]
Initial empty repository
Code Review / src / qa-testdefinitions.git / log