Refactor stress test

Stress test now has 2 parts: the server part and
the client part.

Change-Id: I24e46060a1a710381476157f4fb4e8ad32370a5e
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Fix a crash on disconnection

Change-Id: Ib3654ac8125b040f8264524e7c821a6559f627cd
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Fix a memory leak

Change-Id: Id47b417f6e5f8bf2322b1de7ed12579de711160f
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

fix typo

Change-Id: I7a445c73a9bb6b39c3ba5e19422f5bcc319364fe
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Add startup call in command line

The option -c (aka --call) allows to specify calls
to api/verb at startup. The calls are made sequentially.

Change-Id: I7f087dce71480fe288cca355c209a4c8ccf4f4b9
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Make implementation multithread

This changes makes many improvement needed
for multi-threading:
 - json object can't be shared across threads
   because get/set is not protected
 - event are now multithread compatible

Change-Id: Id44b12c68e0fa67042b8ea44939af4edfa76270a
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Enforce flush of incoming data

Change-Id: I81deb974460e7f3edbccf132efeac87f873d78dd
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Make HelloWord binding multi-thread

Handling of event was not compatible with
multi threaded. This implmentation solves
this by protecting event access with mutexes.

Change-Id: Ie52216289000f1ae6352c9dda442dfbda1ebe850
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Refactor of initialisation

Change-Id: Ie5209f74ea1a65571a3ec54724131f15d22ca35f
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Refactor setting of directories

When not specified, the default directories are
now ".". The workdir is relative to the current directory
and other directories are relative the the workdir.

Change-Id: I52c013e3a3c93b3f984903562cf0c56d990900e6
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Fix typo

Change-Id: I0077f77984accdd1f07d0e7c1526720f687ec58e
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Isolate interupt management

Provision daemon features:
 - SIGTERM for terminating
 - SIGHUP for config reload

Change-Id: Id45a0b963812105c22ead5a0a2004f3f531a2a65
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Websocket client select if looping or not

Allows the client to tell websocket module to not
loop on messages.

Change-Id: Iaa1025ce5442a5659554ba66fcc5869a1e8659b4
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Refactor of API interfaces

The new interface has increased functionnality,
it allows to set debug flags by API.

Change-Id: Ibd35fb02ed645e22cac8e7021b37b96e07e79877
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Add hooking of daemon interface

Change-Id: I5840609f4300ade98412e8527ac5ce1f1e8c0c59
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Improve log messages

Add ability to discuss directly with systemd journal.
Add report of functions name when logging.

Change-Id: Ia7c5836e387b621b47e3700a7abca40bc0e481c8
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Finalize hooking of requests

Change-Id: I0c03b2c8ce556f1e6987ee5a7ad355ba9e67f142
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Reactivate hooking of requests

Change-Id: I0fc8429063d99e10344aaadba06480a470b9eb9d
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Avoid prompting error on empty line

Change-Id: I9da7f17f93f1948da23f6a2304f0718d7bee6464
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Improve names

Change-Id: Ib7e31b50a725c73e6eaba414c6628524fbcd84f9
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Make websocket concurrent

Stress tests shown that the module wsj1
wasn't ready to concurrency.

Change-Id: Ia54196f97e9712adf0920b59b188d570f39a6b4f
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Add a script for stressing the daemon

Change-Id: Ic8c5241339106376daaf91acafca1e4fb0f5f818
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Add an easy function for synchronous calls

The added function, 'jobs_call', allows to call
a job with 'group' sequencing and 'timeout'
handling synchronously.

The difference with 'jobs_enter' is that the
function 'jobs_call' assert that the job is
terminated when 'callback' returns.

Change-Id: I8c01d1cd017787ca0448b03a899305a9069ebb6c
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Avoid to stick on event loop

When working synchronously, waiting continuously
to an event can make deadlocks. This commit
enforce threads that wait for some job completion
to wait for a fixed amount of time.

An alternative management with signals should
be studied in future.

Change-Id: Idcfadc60f8c14d73d7fa32e937c6ea0f552cc09b
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Reduce explicitely recursion

When evaluating permissions, the recursive
algorithm is replaced with an algorithm
that eliminates the tail recursion.

Change-Id: I3298c42fa658498a954f4bf7dedfad87f00ab736
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Make daemon interface common

For the future, having only one piece of code
to handle daemon interface to bindings is an
improvement.

Change-Id: I806c424eb1a82637d27bc84b921612789907d971
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Add permission subsystem

Change-Id: I0bbbf55832faf6413dd6147174934d0d4dc5277d
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Ensure that subcall_sync use subcall

The intent is to provide the asynchronous subcall
as standard. This is needed for fixing subcall
across connections (DBus or WebSocket).

Change-Id: Ia046cfa4d0124bfa3ba7eb8e8f936eeafcf09875
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Avoid to count child threads

The count of allowed threads must be the real
count of threads started.

Change-Id: Iaefc9fa4368042d6db45ed3333f9591da027b2f0
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Improve debugging options

Change-Id: I3550a4c2500b98efa985e678217e3d91bc8ca4c6
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Add synchronous subcalls

Synchronous subcalls are more easy for
writing simple applications with sequential
logic.

Change-Id: I76a0231a64a6db8270014cd2a64284e1b0fc16ec
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Use SIGHUP instead of SIGKILL

This doesn't enforces anymore the brutal
termination.

Change-Id: I62445c7cb3692354637906fb1ddda1787c8fb82a
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Launch job at a earlier step

Change-Id: I3fcb96e4d748e38eacc4d413a451143dd9b4a10d
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Definitive switch to internal's xreq

This switch allows to work on a common base for
the requests.

Change-Id: I94e7fdda80c1966af399309334c41c7c8c8259dc
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Migrates subcalls to use xreq

Change-Id: If865208bc0c207511d2b11e4cff617005ed01e56
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Introduce subcontext for subcalls

Change-Id: I5460e9c502cee814c59a0ee60c2be001385e7b4a
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Switch API D-Bus to xreq

Change-Id: I16bfa2594f8de4babcc0d3cc1a62e7d0856d2479
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Switch API websocket to xreq

Change-Id: I57600d8dc99bf37f207b126a0e3ab5731ad08ced
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Improve interface xreq

Add missing function for further work

Change-Id: I4e2b7a35b45ffb0edb1fd14b52500c9b00fab807
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Add notification message for added API

Change-Id: I797afeaa0758f2fef854a1ffaee398aff6c9041e
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Rework the jobs

Enforce starting jobs with acquiring the
calling thread.

Removes invoke methods in favour of
enter/leave synchronisation.

Change-Id: I7086f7f53b919b43ddafd2355316abc0d3516f49
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Use xreq for services

Change-Id: I05d0ddb36635c01b3d56ae52a08fbb68f3b3a6a9
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Use xreq for websockets

Change-Id: Ia489f863e8be3384fbe8a240f6010f7d5916b72a
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Factorize common code for handling requests

The common code for session handling is
shared using struct afb_xreq. At the moment
only hreq leverages the new feature.

The objective is double: make the work of
writing new internal requests more easy and
prepare to check permissions.

Change-Id: If3ca311d68c2d8c427d1125f31a2704b150c2c94
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Allow detection of session closure

In some case it can be good to have a function called
when the session closes. This is the case when a binding
records an item in the context. With this modification
the recorded item can be simply NULL.

Change-Id: I5e23f00eb2a6e2639fdeea15f9dea79c7df9dfbb
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Start to implement the bindings V2

More work has to be done for merging common
code.

Change-Id: I72b01901f978854843967c12bfcb3cc59cc10310
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Overall integration of job initialisation

Move the job initialisation from main to jobs.

Change-Id: I8f5b54adb62e60592884ff1e3fad9811b5934d47
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Fix concurrency issues on event manager

Having only one event manager is not possible
in multithreading due to the way that systemd
has to manage timer events. We observed that
timers were not armed when set in a thread
because event was polling in an other thread.

This patch provides more than one event manager
and at most as many as the number of threads
avalaible to start.

Change-Id: Iaeab353b7bc79ce61361ab73c7b197a9e69a6109
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Refactor initialisation of the daemon

This commit prepares a future job centrered
main where 'sig_monitor_init', 'jobs_init',
'jobs_add_events', 'jobs_queue0' and 'jobs_add_me'
will be merged in one single call provided as
a feature of module jobs.

Change-Id: I8ccb1bf1761c4fa1031e903bead863ff68e7df83
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Prepare migration to binding v2

Change-Id: I48c1fdb5199c9fb0f001576ceed3ddcb50fc9066
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

cosmetic

Change-Id: I26e35f99a68557d005ee46dd4cd1c0fbd728bfd2
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Prepare move to bindings version 2

Change-Id: I3105a5898d0703d1e57eff09f179b38742482842
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Add comments

Improves the comments of the module jobs

Change-Id: Id99e9c6d6c9572d68ae9cca0f13e2498348de91d
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Refactor job to allow synchronous calls

The family of methods "jobs_invoke" make synchronous
job activation. It waits for the completion of the
job while still dispatching it internally and
providing the calling thread for processing any job
queued.

Change-Id: Id36a30789cc51245a7bbfca42f0122cf4ea623b2
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Fix bug in recycling jobs

The bug was creating an infinite loop starving
the system (or other possible horrific stuff).

Also updated the test.

Change-Id: Id71dd112d2ed4651ac8aa56d2c57b088d69b8655
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Make main thread used for common jobs

This commit make the main thread behaving
like any other threads. The main loop
is shared across threads, the first one
without job taking it. The main event loop
now have the lowest priority. It is
activated only when no job is queued.
This has the good effect to not try to
overfill the queue of jobs.

Change-Id: I07cecc9d94a02134c63bc2a814db56e171ab719e
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Remove option readyfd

This option is no more useful. Instead it is
possible to use systemd notify feature.

Change-Id: I8dd286242d3dc74238ca0908e83072367874d19e
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Speed up accesses to session's cookies

Minor improvement to speed up refactored contextes.

Change-Id: I45c1c4b0cecec52d10c2b7c5cd8e738fd75b25d6
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Replace session's value with sessions's cookies

This is a simplifaction with the benefits of
only allocating needed memory and avoiding to
create indexes on apis (path to dynanic?).
Conversely it replaces a direct access with
a linear search.

Change-Id: Ibb130528ad8f23dfd6b420c228f51e181efb2664
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Implement dichotomic search of APIs

This is a small improvement but it costs
so few that it is welcome.

Change-Id: I96db79b17ec811582c8e5d1d512afacece284016
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Simplify functions for calls

For historical reasons, the call to apis was
passing the length of the api and the length
of the verb. The reason was to avoid a copy
of strings. But the copy occured only for HTTP
requests. Having this implementation is of
small interest and compromise future changes.

This patch simplify things.

Change-Id: I8157724c6c721b6797cd0eab52b07e1b8d6eb5f8
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Refactor of threading and signal monitor

The goal is to allow use of this facilities for
things that are not 'afb_req'.

Change-Id: I0d99c227934ed45136477bf6235bd1541d5f05cf
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Instanciate the environment variables

Because it could be of interest to transmit the
port and the token in environment variables,
provision is made here to instanciate environment
variables before exec.

Change-Id: I65cc8e052ca9e2831520a19d2da2a96ada7f672e
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Integration of socket activation for services

The services provided using the option --ws-server
can now be linked to socket activation of systemd.

When afb-daemon is launched, the api to be provided
by socket activation is declared by adding the
option

   --ws-server=sd:APINAME

Where APINAME is the name of the provided api.

The binder looks to the prefix "sd:" to automatically
use the "listen fd" of name APINAME for serving
the api APINAME.

In the socket activation unit the connection
to this socket must be named using the
directive FileDescriptorName as below:

[socket]
FileDescriptorName=APINAME
...

Change-Id: I281e1a2b9fed3eac3bd0ee27b7f56df99df7bbd6
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Beginning of integration as systemd service

This allows to receive socket activation by names.

Change-Id: I6896dec785e8d434da452ed2d1341016f6eadb60
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

notify systemd of being started

Change-Id: I10251b0800ac44e59d2a17ebd202c9f55c5c9196
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Add comments about always setting INFER_EXTENSION.

INFER_EXTENSION must always be set in order to provide right mimetypes for
some files.
For example mimetype for css files must be 'text/css' and not 'text/plain' as
returned by libmagic. If mimetype is not correct, css files of HTML5 webapps
will be not correctly interpreted resulting in a strange rendering in browser
like Chrome.

Change-Id: I7f0d9f97ede19308c87256f7850f5c51135827f3
Signed-off-by: Sebastien Douheret <sebastien.douheret@iot.bzh>

fix SEGFLT when unhendled request

Change-Id: I34c657972111db843d0d9d26a1732b21ac519c57
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Enable INFER_EXTENSION and add well-known mime types.

Change-Id: I7c433eea63c01d2b0813a9cc84c12433839bf125
Signed-off-by: Sebastien Douheret <sebastien.douheret@iot.bzh>

Fix issue in initialisation of api by sessions

Change-Id: I72639196ce7462c34a2037cc825cf819add4a2fc
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

fix issue for C++

Change-Id: I14b5fb9a0f517d5a784cbbc43ca1401877d0f2fe
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

fix mimetype by using libmagic

Change-Id: I418b7f9323d4847dfef0f1f3f6dd90f6538b2ffb
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Update documentation of --roothttp option.

By default when roothttp option is not set, no files are served but
note that apis are still available.

Change-Id: I461b6c94d4d16cf873c0f8fb2543576595ed24c1
Signed-off-by: Sebastien Douheret <sebastien.douheret@iot.bzh>

Ignore Visual Studio Code project

Change-Id: Iecbef1a7887496deb849ab807ebf4de644e66343
Signed-off-by: Sebastien Douheret <sebastien.douheret@iot.bzh>

Fix html heading and hyperlink order

Change-Id: I4f52c1c68fa357306faf6cd976a69e65de580fdb
Signed-off-by: Sebastien Douheret <sebastien.douheret@iot.bzh>

Improves documentation and directory management

Change-Id: I21c102f7439343476765c65011664feece2d2c18
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Add option --random-token

Also fix a bug in use of getopt_long.

Change-Id: Iffc90104665664c8e5a61fbee70f03f3cdb660cb
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

First step for grouping processes

Actually make afb-daemon the process group leader.

Change-Id: I01ca7bb027416e2446cfa322b69684da4db852e2
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Improves logging

Adds error message for errors related to HTTP.

Change-Id: I5a3069528f8e9a7fe9a8dae6c201a783948a565a
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Adds options --no-httpd and --exec

The option option --exec use the remaining arguments
of the command line (at the right of --exec) as a
command to launch with its arguments. Arguments can
use @p (for port), @t (for token) or @@ for @.

When the option --exec is given, the command is launched
as soon as afb-daemon is ready. When the command die,
afb-daemon exits and before exiting, afb-daemon kills
the launched command and its childs.

The option --no-http forbids the activation of
the HTTP server.

Change-Id: Icdd91d84c818796b5ac6ea5d33ff3549a2fe3c25
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

adds short option for verbosity

Change-Id: I2282057344b2b986520f1a76f5a3c0a827d63075
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

allows to repeat option --ldpaths

Change-Id: Id07b02eaef35732416de2fb1c6b24f3f75979ed6
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Refactor of file main.c

File main.c is splitted in 2 files, one for scanning
arguments and the other for setting up the process.

Change-Id: I5f2d7fd354392d13cdeac6c2a8fceaaf551dea22
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Improves naming of session's module

Make names looking like other names

Change-Id: I63ce3d8a3d84193eca9d517cecb1888d630a9b2d
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Removes uses of readdir_r

Since glibc 2.24, readdir_r is deprecated.

Change-Id: Id0e186e67b7e60bd537a8ba85ede446be0c5095e
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

cleanup: removes legacy-named file

The file include/afb/afb-plugin.h was kept
for compatibility with previous versions.

Change-Id: If144803b5f56e9828ec78de5279520319bbc3342
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Cleanup of the project

The bindings "audio", "media" and "radio"
were in the project since its beginning
for historical reasons.

But this bindings msut not be part of the
current tree of sources.

Change-Id: I9d903f094ddc4d2457e63987df0c221d2bd7b4d1
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Adds 2017 to copyrights

Change-Id: Id85c4eb4e36a05b61346004ba95daa19faf5074f
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Update gitreview file for master branch

Change-Id: I44fea156e7dc5c5fb16ae16aad7529476b35d485
Signed-off-by: Jan-Simon Möller <jsmoeller@linuxfoundation.org>

main: Removes setting roothttp to . by default

When option --roothttp is not set, the server will
not serve HTTP files.

Change-Id: I16e09f7ad6f735967cde27d5c51758499110fb54
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

afb-hsrv: Adds an error when alias dir doesn't exist

Change-Id: Iab0f9b1997f6471ceab8bb43be07d6d00c53fd78
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

fix html link

Change-Id: Iafcdcc919352c567bd097ee86aadae02e38c5415
Signed-off-by: Ronan <ronan.lemartret@iot.bzh>

fix svg path for website

Change-Id: I059fe29816c0cba1f423d02f5bc7034438843cac
Signed-off-by: Ronan <ronan.lemartret@iot.bzh>

Fix typo, get diagrams pictures and reordering doc

Change-Id: Id8327460cf59b330283a98db8cef3a89ef505d30
Signed-off-by: Romain Forlot <romain.forlot@iot.bzh>

afb-api-so: adds verbosity on dlopen error

Change-Id: Ibe42a346c29e71b12d67ebbf43a6fc8152df8202
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

api-so: cleanup

The structure monitoring is not used anymore.

Change-Id: I3b900f7b109b2549f0b4cf17550bb71c4b49d32d
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

hook: add few comments

Change-Id: I453625b70f13a5b01a84b2ac60eb6fb9e0dd0ebd
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

hook: adding of hook feature for requests

The current implementation is for hooking requests.
It allows implementation of command line option for
debugging. Further development is needed to also
handle events and service API. Also a binding for
debugging would be cool.

Change-Id: Ib1ac4711180db7b4097ed92ebbbf1a1a9fd2cc1c
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

event: add ability to get the event name

Change-Id: Iecfeb4ab07c07715093d729710669abecee722de
Signed-off-by: José Bollo <jose.bollo@iot.bzh>

Threads: handles request with threads

This implementation handles all requests with threads.
Later implementation could add a mechanism to choose
what request will be handled by threads.

Each API receive its requests in serial order without
reentrancy. Here again, this can change in the future
if a choice is possible to allow reentrant calls.

The signal/event are not processed using threads
in this version. It may change in the future.

Signed-off-by: José Bollo <jose.bollo@iot.bzh>