wgtpkg-install: search in subdir "htdocs" also

For widgets that are fully HTML, the search of the content
was not checking the subdirectory "htdocs" that is enforced
elsewhere.

This commits add the search of the content in the subdirectory
"htdocs". This is a temporarily fix. A better complete solution
has to be delivered later.

Bug-AGL: SPEC-808

Change-Id: I8bef7c4a31ff919827ceca05e203c2b277cf7657
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Set explicit path for services and units

This patch removes references to /usr/local and
add reference to the installation directory.

The companion programs can be run using path
relatives to the installation directory.

Bug-AGL: SPEC-384

Change-Id: I7e10be1d0df1b62f3be0104f88d1787dd849d152
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Handle file-properties for setting eXecutable flag

This commits introduce the feature "urn:AGL:widget:file-properties".

This feature actually only allows to set execution flag to files
of the widget.

Example:
  <feature name="urn:AGL:widget:file-properties">
    <param name="flite" value="executable" />
    <param name="jtalk" value="executable" />
  </feature>

Bug-AGL: SPEC-384

Change-Id: If13ca3b1015576317fd52cb9540b77d0e2675f67
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Fix socket dependency for afb service

Change-Id: Icb65d7165e1f1c0811f170effe148606bc367872
Signed-off-by: Ronan Le Martret <ronan.lemartret@iot.bzh>

Executing /bin/bash explicitly

Although 'afm-util' uses PIPESTATUS[] to catch error from
dbus-send, it doesn't require executing /bin/bash.

Change-Id: I45b8a19b3dcdf789103472e16de64e0d50351548
Signed-off-by: Tadao Tanikawa <tanikawa.tadao@jp.panasonic.com>

clean markdown documentation

Change-Id: I1b0a1628b42097c47a844aa0c8030d4534428421
Signed-off-by: Ronan Le Martret <ronan.lemartret@iot.bzh>

Add service debugging support (afm-debug).

Add necessary tools/scripts, such as afm-debug, to allow service binding.
These tools are only available in develvopment (AGL_DEVEL is set).

Change-Id: I4e946146af985c74c8bd97d8c118b932394bbc5e
Signed-off-by: Sebastien Douheret <sebastien.douheret@iot.bzh>
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Don't list terminated processes

Listing processes that are terminated
might be disturbing. So it is now removed.

In some future, it should be good to return on
option even terminated processes with an indication
of their termination status.

Bug-AGL: SPEC-728

Change-Id: I89bff7f880e6a5717c1572e3ee80cfe7dec8e594
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Allow to install widget with no icon

This patch allows a widget to not specify any icon
but it still enforce when an icon is specified to
specify only one icon and to provide the attribute
"src".

Bug-AGL: SPEC-702

Change-Id: Ieeb17e4de8885a3a525b35ae365e51b421d39f83
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

afm-util: make output more readable

Change-Id: I919c3e6d34c74688162a0b0806a6397fb7601a76
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

unit.conf: Allow service to run by default

Bug-AGL: SPEC-734

Change-Id: Ifc2d1795041d0254af7db518f64c988bb747200c
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

install: improve port detection

Check any existing X-AFM-http-port or
X-AFM--http-port.

Change-Id: I1111095664535c849c76870f2e5104fb07099ab4
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Fix bad error reporting

The use of %m was buggy due to the implementation
of 'vverbose': it always returned ENOTTY

   Inappropriate ioctl for device

Change-Id: I0b7dd4c2f4ce5a45611042a8b9ba3e6db0e60803
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Moves handling of reloads

The new version ensures that the daemons are responsibles
of reloading the units. This is no more done by default.

Change-Id: I9ff33a628dfc05e429dbc7bf127d641691f2a3b9
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

afm-util: report correctly error status of dbus-send

Bug-AGL: SPEC-699

Change-Id: I8398f9dedefbe02a1ba57ed3725fa680a8db3cfa
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Add .gitreview for dab

Change-Id: I9672e7b25dae2d2b73f6f2e67ae56adb583b6da9
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

Fix socket (de)activation at (de)install

When installing or deinstalling, it is needed to
issue a "systemctl (--user) restart sockets.target"

This patch implement it on user side.

To be improved.

Change-Id: I152eb6a1cf5df50b1fe3143837d6d42ee6619349
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Fix daemon reload (to be improved)

Change-Id: Ica099aa439e6c022de4982a58b0990065d932b0b
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Fix socket activation

Change-Id: Ic511bf717c61105003d750235229bfc50ee7fccd
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Fix infinite loop in wgt_info_param

Change-Id: I8a623a40e48108c8999083667dae1230da2d206f
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

docs: fix book.json (headers/footers)

Change-Id: I7d997b9a8c17caa83e0e9c4f4611e0aac04be6b4
Signed-off-by: Stephane Desneux <stephane.desneux@iot.bzh>

Merge "Auto generate cover from book.json fields."

docs: add document revision

Change-Id: Ib98fae58d8a95dceea42347a5e46d6d39d565852
Signed-off-by: Stephane Desneux <stephane.desneux@iot.bzh>

Auto generate cover from book.json fields.

Change-Id: I8203040b759289b08d5311a74e6df557fe8250bd
Signed-off-by: Sebastien Douheret <sebastien.douheret@iot.bzh>

docs: remove incomplete docs from book

Change-Id: I1ed6c95a906c086a010b302eca6a48c2a3ac3eef
Signed-off-by: Stephane Desneux <stephane.desneux@iot.bzh>

Fix pdf paging and make-units rendering (svg to png).

Change-Id: I60b5ab02602b993d8d92504b25f0a35d340d5444
Signed-off-by: Sebastien Douheret <sebastien.douheret@iot.bzh>

Fix spelling and images size.

Change-Id: I01c6342fa9f6b16753ed5f48645538e48af09a5a
Signed-off-by: Sebastien Douheret <sebastien.douheret@iot.bzh>

Re-order doc chapters

Change-Id: I44cf2054fa06816480e26fc19b45c6f8a464a708
Signed-off-by: Sebastien Douheret <sebastien.douheret@iot.bzh>

Remove proposal statement.

Change-Id: I5d63279149c46e095afeec97bfad3c61e40fedee
Signed-off-by: Sebastien Douheret <sebastien.douheret@iot.bzh>

Add gitbook documentation (support PDF generation).

To generate PDF doc:
     ./gendocs.sh pdf

To generate HTML doc (local webserver):
     ./gendocs.sh serve

Change-Id: Ib9b195814f4596a5cf5233d6a331d206e76c9bae
Signed-off-by: Sebastien Douheret <sebastien.douheret@iot.bzh>

docs: minor enhancements, typo fixes

Change-Id: Ic2cb29cb96e6542405736628f2d0cce995cb21ce
Signed-off-by: Stephane Desneux <stephane.desneux@iot.bzh>

Fix service name within socket units

Change-Id: Ic8e562dd31a9bf7e3f1e22f0cda8e381242e3468
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

fix binding version to 1

Change-Id: I98e6de97e170b8cbb51b48e0e3cf7e52e6def7f9
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Fix lack of error message on mustach issue

Change-Id: I16139c133d7031e38f4c63ff6369f1d7478fc86f
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Check content existing and fix executable

Change-Id: I4060334cb9c677df1ce86c99a1cb37abc007f3c7
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Fix lack of message when setting exec bit

Nothing was telling that the content couldn't be
set as executable. Note that nothing is made to check
that a content (executable or not) exist.
Also note that installing several executables for
one widget isn't possible now.

Change-Id: I10373fa27cd8d1d90c292e3529d8a5eec62bb8f0
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Rework on parsing units conf

Change-Id: Ia95dae65e74a42f9f49154c9421391421f9ca1c0
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Implement deinstallation of units

Change-Id: I7d9812211bb75f34d55b4035d5b4a3b7ea66f461
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Use structures for generating units

Change-Id: I7258a494d62ef22219c973048d052965cb5fea28
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Improve environment setting

Some environment variable were set in the configuration files.
This wasn't a valuable solution. Allowing now system tning to
put environment variables in files of /etc/afm/unit.env.d
is much more flexible.

Change-Id: I1796061c9055a2860f0bbab340aa3a6e7b85dd3d
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Handle systemd's "inactive" state as transient

Inactive is returned sometimes but it means that
the service is not started yet not that it failed
to start.

AGL-Issue: SPEC-520

Change-Id: I3b39b983b45a0f6ee449958100595c5c486cbfdd
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Improve afm-unit.conf

This commit introduces a common clear name for
services bound to websockets.

It also improves the formating of commands to
be run by afb-daemon.

It also removes an unsupported key (commented).

Change-Id: I4e6e74eef50b89ba82d2c33d4c94faab8f07b587
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Allows or in mustache instanciation

This allows to simplify the configuration file
afm-unit.conf.

Restore the type application/vnd.agl.service

Change-Id: Iaadde2c2d96155cea6d1b8bee4d3c78e885cf44a
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Provide unit in config.xml and documentation

This commit remove urn:AGL:widget:provided-application
in favour of urn:AGL:widget:provided-unit.
In the same time, the feature urn:AGL:widget:provided-api
must be attached to a unit. This will enable to export
more than one API for a unit if needed.

Change-Id: I17ade3651db2cd61402875333d063ee05cf57a10
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

wgtpkg-install: choose the port

The installer now chooses a port for an installed application.

This choose is made by consulting the previously installed
applications and by getting the lowest port available in the
range 1024..32767.

Change-Id: Iab4238b4d52447a2d261d87d45bbb02f0b7a35e5
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

utils-systemd: implement start/stop of units

This implementation is very basic and
must be improved.

Change-Id: Id1540e646c83285c61849092bbd8fb645c0954ed
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Allows to compile without libsystemd

This fixes a problem with bitbake when building
native packages.

Change-Id: I28586720010237db578ec55cb5254212c88240e7
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Switch to use systemd database

Installation now creates unit files.
This commits use these created unit files
to fill the application database of
afm-user-daemon.

Change-Id: Ice39d3ff51b6afe41609f3ce4ff0e89b2f3a0ca7
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

utils-systemd: provide enumeration of units

This enumeration is based on the filesystem,
units are listed from the configured directory.
This is necessarily because not all units can be
loaded by systemd but all can be started.

Change-Id: Ic4d1331c8c54f5bbaa747ff8084da2b0c5a65c55
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Use the same dbus connection

Opening one connection per part of the
program doesn't make sense and waste resources.
Using a common one is much better.

Change-Id: I74dc3cd7ae41d7bfa2f03f4a252495e8f5f81578
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

wgtpkg-unit: fix last empty continuation

Change-Id: Id0a9581032add095756141a4373b34cee3cd6f80
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Emits reload to systemd when needed

The current implementation enforce the reload
when a 'wants' target is created or deleted.
This should work well for system units.
However, for system units, this behaviour isn't
enought when more that a user is active because
only the user that installs the application will
be updated. For this reason, a paralelle mechanism
has to be defined.

Also note that systemd is henceforth required for
tools because wgtpkg-installer needs it now.

Change-Id: I4fc03a44dbc58c2374ea21dbf6b436f646d04e00
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

utils-systemd: introduction of systemd interface

Isolate the interface to systemd.

Change-Id: I03ea654da9fab2df0e6eec980b0e5623487d1b73
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

wgtpkg-unit: add management of wanted-by in unit descriptions

This allows the automatic creation of the links in wants
subdirectories.

Change-Id: Ib948fb11abbbd902f733279136f51ad1649923ef
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

wgtpkg-install: creates the systemd units

Change-Id: Ia3cdcb76a9f7b3bda77a9d9fcb38dfd85eb85804
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

wgtpkg-unit: install/uninstall functions added

Change-Id: Ib147de12d0b2c8e783ddb6aae2f9978f288d98fd
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

afm-unit.conf: adds type application/x-executable

Change-Id: Ie62113512094909bd02e7e89fd44b56a9df67d17
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Fix issue in labelling files

The current version of security manager put this tags

 - SECURITY_MANAGER_PATH_PRIVATE
 - SECURITY_MANAGER_PATH_RW

      User::App::XXXX

 - SECURITY_MANAGER_PATH_PUBLIC
 - SECURITY_MANAGER_PATH_RO

      User::Home

 - SECURITY_MANAGER_PATH_PUBLIC_RO

      _ (underscore or floor)

Putting floor is bad because it produces
files and directories that can't be removed.

Using SECURITY_MANAGER_PATH_RO instead of
SECURITY_MANAGER_PATH_PUBLIC_RO sets the
label "User::Home". It is valid because this
label is already read only for applications.
But it is writable by the "System" labelled
services at the opposite of "_".

Change-Id: I685fe366fddb95858c66b827e28acf6d005bcfc0
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

afm-run: improve error diagnostic

Change-Id: Ic23bcc031fdc72e15675bffcbac619ef41a2f241
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

utils-json: fix a warning when compiling

Change-Id: I3e354cb9e940798a995e79fe67d05607130c9714
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

afm-unit.conf: connect to systemd sockets

Change-Id: I45d4ae48d47d8690f41222df4d05c04cd241ce37
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Splits the widget validation function

Change-Id: I543995c8bb64a859a7c0eb6cc09217d2f71ccc38
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

utils-file: fix bug in writing

Change-Id: I7da9ee72992cba4c49c0d1286a38674d3f7ed4bc
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

switch to cmake 3.4.3 at least

Change-Id: Ib63bd000abaabd4966519b75356668d31aed58f9
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

improve names in CMakeLists

Change-Id: If86544db50c5813868550338a68c0e11ea469a35
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

afm-util: adds run-remote and start-remote commands

Change-Id: I2c94d072886f4dd004ea13f7bf0c1ce61b757ca8
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Try to improves the error message after exec

Change-Id: Ibaed600a85ce1b7c3e445ceb39c780e99ca61062
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Set the workdir in afm/afm-unit.conf

I'm not sure that it will be still present at the end
but let go ahead with that.

Change-Id: I123035c29c049c780b71b4181c15bd2d3a96e7c7
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Adds SIGKILL as normal exit status

Change-Id: Ia67df22859b23d9da614d619d84900654bb2f7a0
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

improves matching of patterns for unit description

Change-Id: I2c3f9f0b45b79d5baa9ad5c19876f1412456c19d
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Add comments

Change-Id: Icbbdbd4ed51db62c7619c6210842411b8d2e04a4
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

fix a bug in mustach

occured if closing before opening

Change-Id: I9c9515535d83f2c13bb75c0638e12c0a5a333413
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

adds 'run-by-default' permission

Change-Id: Ie327c0253ea12e8a0b837195653f0762b76c9f79
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Adds handling of JSON pointers (RFC 6901)

Change-Id: Ib2e1c75f81c32d0b6bc50af2ba48bb95a413842a
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Fix readdir that doesn't return dt_type

This is an incomplete fix. More readdir calls
exists that should be treated.

Change-Id: Ib80c9f4ac8fe7ce02d22968a9cf37f7841514f57
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Fix readdir that doesn't return dt_type

This is an incomplete fix. More readdir calls
exists that should be treated.

Change-Id: Ic9ed98c7695a7c3d15136d0fe5eb9b5634f74d09
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Set roothttp option for html app

roothttp option (see commit dc011f99aed9407c8319b1b70a81f56ad2f02bc8) must be
set to a valid directory (for example . that's mean roodir) in order to serve
static files of html5 app.

Change-Id: I13a17f6699298a80a346dbb6b4c3ecb6ab236bd6
Signed-off-by: Sebastien Douheret <sebastien.douheret@iot.bzh>

Ignore vscode project

Change-Id: I9040f9fb6a8875a7e0e5bab08ce23db5557ef433
Signed-off-by: Sebastien Douheret <sebastien.douheret@iot.bzh>

Fix typos in docs

Change-Id: I901ff5bb6f22ba7076914c7cbe92f69b4b89cb0e
Signed-off-by: Sebastien Douheret <sebastien.douheret@iot.bzh>

Fix bug in mustach.c

Change-Id: I353ae1cc33795ba8ffd98fcec503125ec9d455a3
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Rename binding to api in config.xml

Signed-off-by: jobol <jose.bollo@iot.bzh>

Improves names

The name binding is related to an internal
concept of the binder. The term API is more
generic. Dont forget that an API can be provided
by more than one binding (but only one at a given
time).

Change-Id: I91b2f3d96de6aace5fcb434cf64df7e8ed61630f
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Prepare the Integration with systemd

This is an intermediate commit providing
basic functionnalities for setting up
integration of the framework with systemd.

 - file afm-unit.conf is a mustache template
 - translation of config.xml to json object
 - mustache (extended) application of the json to the template
 - post processing of the result for extracting unit files

This processing is currently available as a test
(and a tool) and will be integrated after more
developement, test and validation.

Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Get the install directory

The function 'move_widget' was the only one
that worried about the name of the installation
directory. This commit split the function in two
and enforce to get the name of the install
directory.

Change-Id: I6d89b4c94b2898a6ba95a3045b3f5db23d54c499
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Fix a possible access to uninitialized memory

Change-Id: Ica1cf7d81b561ce34039e5212ed6578950f1bfdd
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Add utils-file and provide json-c

This is an intermediate commit providing
new features for common utils.

Change-Id: Ide92167d8e4e5013ddadd718c02071ea837938e3
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Make utils-json handle dot keys

Change-Id: I8b9b91accc0e30726e3be7f287b8312b0d7f3d02
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Update date in headers

Also update .gitignore

Change-Id: I9d3e82c59318d983243ffce6d0a726ad5186fa2d
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Put strings in one place

Change-Id: I79afd4fa18996e7879db4c11480a5400637dad2d
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Set application id when forking

This improvement should make log message more clear.

Change-Id: Ifc78f7d913a1798a43b54df6b2bf9b52232d328a
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Remove use of deprecated readdir_r

Change-Id: I55bd335f1a731e3a02fdb598c8bd869686269aab
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Adds 2017 to copyrights

Change-Id: I3fcd64a038c6c5bca3d70186e2e68604aa392ed4
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

temporary grant requested permissions

Change-Id: If9a7d2a183aa8b0c0ed531b4d915443e199b488b
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

conf/afm-launch.conf: use --roothttp=htdocs only for HTML5 applications

Change-Id: Ieaa7b9f6f320610a56d020c9ac10fca313d892f9
Signed-off-by: Stephane Desneux <stephane.desneux@iot.bzh>

afm-db: Search applications case insensitively

Makes the identifier of the application case insensitive.

Being case correct is the fast track.
Having the wrong case is not an error but just less efficient.

Change-Id: Id18f1cfcf49c9f9f336947ebb08bba335a0adc6a
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

wgt-info: Enforce lower case ids and version

This will be used next to avoid faking identity
of applications using the case difference.

Change-Id: I13cbdd5124b58b2a72c15054df6f3cd0e11a2cc5
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

wgtpkg-install: set exec flag for application/vnd.agl.native

This is needed for executable having a binder.

Also conforming to RFC 2045, mime types are made
case insensitive.

Change-Id: I065c8eada5ec044daca73b3bf994b0d6f3587414
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

fix html link

Change-Id: Ia1be9d8370620e4dcfd00130108928daef61a7ed
Signed-off-by: Ronan <ronan.lemartret@iot.bzh>

fix svg path for gen html

Change-Id: Ib91a405a5a7d49ad6f6c752aef6cb6cadee9ab9f
Signed-off-by: Ronan <ronan.lemartret@iot.bzh>

Doc reworked, relifted

Change-Id: If41313a44cb66c0aa0f315b264284d081ff87f8e
Signed-off-by: Romain Forlot <romain.forlot@iot.bzh>