A Novel Artificial Organic Controller with Hermite Optical Flow Feedback for Mobile Robot Navigation
Navigation of mobile robots is still a challenging problem due to the uncertain and dynamics of environments [1]. Typically, navigation consists of different tasks [1] such as: perception, exploration, mapping, localization, path planning, and path execution. In this work, navigation is limited to a strategy or methodology that guides a mobile robot to accomplish a task through an environment with obstacles—static or dynamic—without collisions, using sensors. Also, this work considers a robotic system with a unique vision-based sensor for perception.
Artificial intelligence (AI) has been widely used for navigation of mobile robots. Different AI methods have been proposed, such as: fuzzy logic [2], artificial neural networks [3], hybrid neuro-fuzzy controllers [4–6], evolutionary and meta-heuristics algorithms [7], and nature-inspired computing (e.g., particle swarm optimization and ant colony optimization) [8, 9]. Artificial intelligence has been used in different levels of cognition such as: reasoning, decision-making, and learning.
Furthermore, some applications using AI-based controllers and features based on optical flow to compute the control law are present in the literature. For instance, Williams et al. [10] propose a support vector machines (SVM)—kernel to carry out vehicle tracking using optical flow features. Meta-cognitive neuro-fuzzy inference systems (McFIS) for accurate detection of human actions from video sequences have been proposed by Subramanian et al. [11]. In fact, they employ optical flow-based features, and the functional relationship between these optical flow-based features and action classes is approximated using the McFIS classifier. Boroujeni et al. [12] propose a method for obstacle detection using optical flow and k-means clustering-based classifier to determine obstacles’ positions. Narayanan et al. [13] aim to develop a real-time system capable of rapidly detecting and tracking vehicles in a video stream using a monocular vision system. The detection is based on the Viola–Jones classifier and optical flow features [13]. In addition, Crnko et al. [14] propose a biomimetic measurement of optical flow and centroid for visual-servo control of hover flight.
In that way, this work proposes a novel nature-inspired and intelligent controller for navigation of mobile robots constrained to a single vision-based sensor, using a recent hybrid fuzzy inference system and artificial hydrocarbon networks (AHN) approach so-called fuzzy-molecular inference (FMI) system. This fuzzy-molecular inference system inherits characteristics from fuzzy inference systems (FIS) such as storage of knowledge from experts, dealing with uncertainty, and linguistic interpretation [15]; but also from artificial organic networks (AON), a learning method inspired on chemical organic compounds that allow packaging information in molecular units, organizing of information, and dealing with aggressive uncertainty and noise [16]. In advance, fuzzy-molecular inference systems can deal with uncertainty and under aggressive conditions of noise, with relative easiness of implementation [15]. Examples of FMI-based controllers can be found in literature [15, 17]. In addition, this proposed controller uses a real-time Hermite optical flow (RT-HOF) approach for detecting direction of moving objects in the visual range of the mobile robot. In fact, RT-HOF is a method that determines the displacement of each pixel at some time in an image sequence representing the motion of objects in the scene or the relative motion of the sensor, with the usage of the Hermite transform (HT) [18] as a biological image model in real-time. This RT-HOF approach has been proved to be easy to implement and faster than conventional optical flow methods [19], giving advantages to be used in online navigation.
The rest of the chapter is organized as follows: Section 2 briefly describes the fundamentals of the proposal: artificial hydrocarbon networks algorithm as part of artificial organic networks method, the fuzzy-molecular inference system, and the real-time Hermite optical flow method. Section 3 formalizes the proposed nature-inspired and intelligent control for mobile robots and its design. Later on, Section 4 describes the implementation of the proposed artificial organic controller in a mobile robot system. Section 5 presents experimental results of the proposed controller, and Section 6 concludes the work.
Nature-inspired and intelligent computing
This section describes the fundamentals of the proposed controller for robot navigation. First, artificial hydrocarbon networks learning algorithm is introduced. Then, the fuzzy-molecular inference system is described, and lastly, the real-time Hermite optical flow approach is presented.
ARTIFICIAL HYDROCARBON NETWORKS
Artificial hydrocarbon networks (AHN) is a nature-inspired learning algorithm based on the artificial organic networks framework. In fact, artificial organic networks (AON) technique is a meta-heuristic method and framework inspired on chemical organic structures and the energy involved in the interaction among them. Inspiration of AON method considers packaging information in independent structures named molecules which they can relate among them using chemical energy-based heuristics [16]. Therefore, AON method provides modularity, inheritance, organization, and structural stability in the output response [16].Thus, artificial hydrocarbon network method is a supervised learning technique that inherits from AON framework, restricted in the shape and type of molecules occupied [16]. From the latter, AHN is inspired on chemical hydrocarbon compounds that constraint the method only using two atomic units, that is, hydrogen and carbon atoms, that can be related together with at most one and four degrees of freedom, respectively, as described below.
The basic unit with information of AHN is the so-called CH-molecule structure. It is made of two or more atoms related among them in order to define a functional behavior φ centred in the carbon atom and parameterized with the other hydrogen atoms linked to it, as shown in Eq. (1), where σ is a real value called the carbon value, Hi ∈ ℂ is the ith hydrogen atom linked to the carbon atom,k ≤ 4 represents the number of hydrogen atoms in the molecule, and x is the input signal representing a stimulus of the overall molecule.
|
φ(x)=σ∏i=1k(x−Hi)φx=σ∏i=1kx−Hi |
(1) |
Then, these molecules can form other types of structures so-called compounds, which include nonlinear relationships among all molecules [16]. In this work, forming compounds are restricted to be linear and saturated compounds like Eq. (2), where CHk represents a molecule with k < 4 hydrogen atoms associated to it, n is the number of CH-molecules in the compound, and A − B represents a simple bond between two molecules A and B. At the end, this linear and saturated compound is made of two CH3molecules and (n − 2) CH2 molecules [20].
|
(2) |
In terms of the behavior of the compound, it is expressed as a nonlinear function ψ that depends on the molecular behaviors and the type of bond between molecules. In this work, ψ is defined as a piecewise function of nCH-molecules like Eq. (3) [17], where Li represents the ith bound at which a molecule can act over the input space, and φi is the ith molecular behavior in the forming compound. To this end, if the input domain is in the interval x ∈ [xmin, xmax], then L0 = xmin and Ln = xmax.
|
(3) |
Lastly, an artificial hydrocarbon network is a mixture AHN of a set of compounds interacting among them in definite ratios named stoichiometric coefficients αm as shown in Eq. (4), where c is the number of compounds in the mixture, and ψm is the mth behavior of compound in the mixture [16]. In this work, the artificial hydrocarbon network structure is restricted to be one compound such that AHN(x) = ψ1(x).
|
(4) |
Chemical heuristic rules for searching and building an optimum artificial hydrocarbon network with specific carbon and hydrogen values are computed using the so-called AHN-algorithm depicted in Figure 1 (for a detailed description, see for example [21]). Finally, examples of applications using this technique can be found in literature [20, 22–24].
FUZZY-MOLECULAR INFERENCE SYSTEM
Fuzzy-molecular inference (FMI) systems are ensembles of artificial hydrocarbon networks and fuzzy inference systems [15] that consist of three steps: fuzzification, fuzzy inference engine, and molecular defuzzification. The overall process maps crisp inputs to a fuzzy space, and resulting values are returned to as crisp outputs using a molecular approach based on artificial hydrocarbon networks. In addition, a knowledge base stores information about a specific problem [15]. The basis fuzzy-molecular rule is shown in Eq. (5), where xi is a linguistic variable of the antecedents in a set of fuzzy partitions, Fi, yf is the variable of the consequent in the fth fuzzy-molecular rule, Mj is the j-molecular unit of a linear and saturated hydrocarbon compound stimulated with the resulting fuzzy implication value of the T-norm Δ.
|
(5) |
First at the fuzzification step, the fuzzy-molecular inference system receives an input signal x also known as the linguistic variable, and it is mapped to a fuzzy value in the range of [0,1]. Then, let F be a fuzzy set and μF(x) the membership function of, F,∀ x ∈ X where X is the input domain space. Moreover, μF(x) ∈ [0, 1] is a real value representing the degree of belonging to x into the fuzzy set F.Additionally, this linguistic variable can be partitioned into k different fuzzy sets Fi. Then, its membership value can be computed over the set of membership functions μFi(x)μFix for all i = 1, …, k. To this end, the shape of the membership functions depends on the purpose of the problem domain [15].
The second step considers the fuzzy inference engine as a mechanism that computes the consequent value yf of a set of fuzzy rules that accept membership values of linguistic variables, as already shown in Eq. (5). If assuming that μΔ(x1, …, xk) is the result of any T-norm function, then Eq. (5) can be rewritten as Eq. (6), using μΔ as the min function [15].
|
Rf:ifΔ(x1∈F1,…,xi∈Fi,…,xk∈Fk),thenyf=φj(min{μF1(x1),…,μFk(xk)})Rf:ifΔx1∈F1,…,xi∈Fi,…,xk∈Fk,thenyf=φjminμF1x1,…,μFkxk |
(6) |
Lastly, the molecular defuzzification step computes the crisp output value y as Eq. (7) using all fuzzy rules of the form as Eq. (6), where μΔfμΔf is the fth fuzzy evaluation of the antecedents, and yf is the fth consequent value for all fuzzy rules [15].
|
y=∑μΔf(x1,…,xk)⋅yf∑μΔf(x1,…,xk)y=∑μΔfx1…xk⋅yf∑μΔfx1…xk |
(7) |
The proper knowledge of the specific problem domain can be enclosed into a knowledge base, summarizing all fuzzy rules of Eq. (6), assigning any CH-molecule of the compound to each antecedent [15]. To this end, examples of applications using the FMI system can be found in literature [15–17, 22, 25].
REAL-TIME HERMITE OPTICAL FLOW
Optical flow (OF) is defined as a two dimensional distribution of “apparent velocities” of the objects in the scene that in most cases are associated with intensity variations of the objects into an image sequence [26]. It is represented by a vector field that represents the displacement of pixels. For example, Figure 2 shows the vector field obtained from frames 43 and 44 of the camera motion sequence [27].
Classical differential optical flow methods assume that the intensity value of the objects remain constant in two consecutive time instants of an image sequence L(X, t). This assumption was proposed by Horn and Schunck in 1981 [28] and is known as the constant intensity constraint like Eq. (8) where X = (x, y, 1)T is the pixel location, W = (u, v, 1)T represents the horizontal and vertical pixel displacements, respectively, between two images at time t and (t + 1).
|
L(X+W,t+1)−L(X,t)=0LX+W,t+1−LXt=0 |
(8) |
If small displacements are assumed, a Taylor expansion is considered; and the optical flow constraintEq. (9) is obtained where ∇3L = (Lx, Ly, Lt)T are the derivatives of the intensity image L(X) in x, ydirections and time.
|
WT(∇3L)=0WT∇3L=0 |
(9) |
If only the constant intensity constraint is used, it is not possible to determine the two components of displacement u and v; then, an ill-posed problem is obtained known as the aperture problem where only the normal component of the motion can be obtained [28]. Therefore, it needs additional constraints to fully calculate the optical flow. Recent differential optical flow methods have proposed additional constraints to overcome the aperture problem and to improve accuracy of the displacement obtained, that is, add local image constraints.
Horn and Schunck [28] proposed the smoothness constraint which assumes that the flow is smooth, that is, pixels within a neighborhood have similar magnitude and orientation. Thereby, the optical flow estimation method of Horn can be found minimizing, by an iterative approach, the energy functional of Eq. (10), where ∇3L = (Lx, Ly, Lt)T , Ω is the image domain, and α is a smoothness parameter. In most cases, the constant intensity constraint assumption of Eq. (8) is not fulfilled. Therefore, to overcome this problem, an additional term independent to intensity change is required. In [29, 30], a constant gradient constraint is proposed as shown in Eq. (11). A way to represent the most important visual characteristics is using bio-inspired models as the Hermite transform [31].
|
∫Ω(WT(∇3L∇3LT)W+α|∇W|2)dX=0∫ΩWT∇3L∇3LTW+α∇W2dX=0 |
(10) |
|
∇L(X+W)−∇L(X)=0∇LX+W−∇LX=0 |
(11) |
The Hermite transform is an image model based in a polynomial decomposition from a perceptual standpoint. This image model emulates the local processing and the response of receptive fields, for example, the Gaussian derivative model of the human vision system [31, 32]. In fact, it is computed by convolution of the image L(x, y) with the analysis filters Dm,n − m like in Eq. (12), where Lm,n − m(x, y) are the cartesianHermite coefficients, m and (n − m) are the analysis order in the orthogonal directions xand y, and (x0, y0) represents the position of the sampling lattice S.
|
Lm,n−m(x0,y0)=∫−∞∞∫−∞∞L(x,y)Dm,n−m(x0−x,y0−y)dxdyn=0,1,…,∞m=0,1,⋯,nLm,n−mx0y0=∫−∞∞∫−∞∞LxyDm,n−mx0−x,y0−ydxdyn=0,1,…,∞m=0,1,⋯,n |
(12) |
The filter functions Dm,n − m(x, y) are defined by the analysis window v2(x, y)and the polynomials orthogonal to this window Gm,n − m(x, y) as expressed in Eq. (13). At last, the separable Hermite filters Dm,n − m(x, y) = Dm(x)Dn − m(y)are defined with a Gaussian v(x,y)=1σπ√exp(−(x2+y2)2σ2)vxy=1σπexp−x2+y22σ2 with normalization factor for a unitary energy inv2(x, y), as in Eq. (14). Figure 3 shows an example of the Hermite filters Dn(x) for N = 5 (n = 0, 1, …, N).
|
Dm,n−m(x,y)=Gm,n−m(−x,−y)v2(−x,−y)Dm,n−mxy=Gm,n−m−x,−yv2−x,−y |
(13) |
|
Dn(x)=(−1)n2nn!√1σπ√Hn(xσ)exp(−x2σ2)Dnx=−1n2nn!1σπHnxσexp−x2σ2 |
(14) |
The steered Hermite transform (SHT) can be defined by rotating the cartesianHermite coefficients Lm,n − m(x, y) by the angular functions gm,n − m(θ) such that Eq. (15) holds, where lm,n − m,θ(x, y) are steered Hermite coefficients for the local angle θ, and gm,n − m(θ) expresses the directional selectivity of the filter as shown in Eq. (16) [33].
|
lm,n−m,θ(x,y)=⎧⎩⎨⎪⎪⎪⎪∑k=0n(Lk,n−k(x,y))(gk,n−k(θ)),m=00,m>0lm,n−m,θxy=∑k=0nLk,n−kxygk,n−kθ,m=00,m>0 |
(15) |
|
gm,n−m(θ)=(nm)−−−−−√(cosmθ)(sinn−mθ)gm,n−mθ=nmcosmθsinn−mθ |
(16) |
The steered Hermite coefficients lm,n − m,θ(x, y) allow to adapt the analysis process to the local content of the image, for example, using directional Gaussian derivatives filters [34], and the angle θ can be estimated by a criterion of maximum energy direction (e.g., the gradient of the image). Figure 4 shows the steered Hermite coefficients of the House test image [35] for N = 3 (n = 0, 1, 2, 3).
The steered Hermite transform can be used to increase the accuracy of the optical flow by using a biological image model and by incorporating the steered Hermite coefficients as constraint independent to intensity changes. In [19], a modified version of Horn and Schunck approach was proposed. This includes an expansion of the constant intensity constraint and incorporates the steered Hermite coefficient constraint shown in Eq. (17), where γ is a weight parameter.
|
[L0(X+W)−L0(X)]+γ[∑n=1Nln,θ(X+W)−∑n=1Nln,θ(X)]=0,L0X+W−L0X+γ∑n=1Nln,θX+W−∑n=1Nln,θX=0, |
(17) |
Applying a Taylor expansion of Eq. (17) and reducing terms using the relation Lk=⟨L(x),Hk(xσ)⟩Lk=Lx,Hkxσ[18], it can be obtained the optical flow Hermite constraint equation as denoted in Eq. (18):
|
[uL0,1(X)+vL1,0(X)+∂L0(X)∂t]+γ∑n=1N[uln,θ(m)+1(X)+vln,θ(n)+1(X)+∂ln,θ(X)∂t]=0uL0,1X+vL1,0X+∂L0X∂t+γ∑n=1Nuln,θm+1X+vln,θn+1X+∂ln,θX∂t=0 |
(18) |
Where
ln,θ(m)+1(X)=∑n=1NL(m)+1,n−m(X)⋅gm,n−m(θ),ln,θ(n)+1(X)=∑n=1NLm,(n+1)−m(X)⋅gm,n−m(θ).
Using variational calculus, the corresponding Euler–Lagrange equations computed are like in Eqs. (19) and (20) where L0t(X)=∂L0(X)∂t,ln,θt(X)=∂ln,θ(X)∂tL0tX=∂L0X∂t,ln,θtX=∂ln,θX∂t, and ∇2u represent the Laplacian of u. To this end, Figure 5 shows the pseudocode for the real-time Hermite optical flow (RT-HOF) iterative solution by Gauss–Seidel.
[L20,1(X)+γL0,1(X)∑n=1N(ln,θ(n)+1(X))]u+[L0,1(X)L1,0(X)+γL0,1(X)∑n=1N(ln,θ(m)+1(X))]v=L0,12X+γL0,1X∑n=1Nln,θn+1Xu+L0,1XL1,0X+γL0,1X∑n=1Nln,θm+1Xv=
|
α2∇2u−[L0t(X)+γ∑n=1N(ln,θt(X))]α2∇2u−L0tX+γ∑n=1Nln,θtX |
(19) |
[L0,1(X)L1,0(X)+γL1,0(X)∑n=1N(ln,θ(n)+1(X))]u+[L21,0(X)+γL1,0(X)∑n=1N(ln,θ(m)+1(X))]v=L0,1XL1,0X+γL1,0X∑n=1Nln,θn+1Xu+L1,02X+γL1,0X∑n=1Nln,θm+1Xv=
|
α2∇2v−[L1,0(X)L0t(X)+γ∑n=1N(ln,θt(X))]α2∇2v−L1,0XL0tX+γ∑n=1Nln,θtX |
(20) |
Nature-inspired and intelligent controller for robot navigation
As stated above, this work proposes a nature-inspired and intelligent controller for navigation of mobile robots constrained to a single vision-based sensor, like Figure 6. In fact, this artificial organic controller consists of a fuzzy-molecular inference system as the control strategy (i.e., using a hybrid fuzzy inference system with artificial hydrocarbon networks), and a motion feedback from a single vision-based sensor that processes image sequences using the real-time Hermite optical flow approach. Following, main components of the artificial organic controller are described.
CONTROL LAW BASED ON A FUZZY-MOLECULAR INFERENCE SYSTEM
Consider a mobile robot with a single vision-based sensor, for example, a video camera, which it can move around a flat environment. If the environment consists of static and dynamic obstacles, the aim of the motion controller is to avoid obstacles as well as to move the robot in a proper way.
In that sense, the robot perceives the environment through the camera, obtaining relative displacements of the objects in front of the robot (see Section 3.2) in two axes: horizontal (û) and vertical (vˆ)v^. Then, these relative displacements are used as inputs to the robot controller, as shown in Figure 6. In particular, the control law is proposed to be implemented using the fuzzy-molecular inference system as follows:
FUZZIFICATION STEP
The design of this step considers selecting the set of inputs to the controller. As described above, two inputs are used: relative horizontal displacement û and relative vertical displacement vˆv^. Fuzzification also requires partitioning the domain space into k fuzzy sets {F1, …, Fk} with their corresponding membership functions {μF1(uˆ),…,μFk(uˆ)}μF1u^,…,μFku^ for input û and {μF1(vˆ),…,μFk(vˆ)}μF1v^,…,μFkv^ for input vˆv^. For example, fuzzy partitions for û can be: “negative,” “zero,” and “positive”. Notice that the number of fuzzy sets k might be different for each input. It is remarkable to say that the membership functions should be selected accordingly.
FUZZY INFERENCE ENGINE STEP
This step requires the definition of fuzzy rules with respect to the goal of the controller. Notice that the consequent values yf in Eq. (6) are computed using the molecular behavior φj of the molecule Mjassigned to that specific rule Rf. Thus, a set of CH-molecules has to be defined (see below).
MOLECULAR DEFUZZIFICATION STEP
The last step of the proposed controller considers the computation of the control signal y that has to be selected in order to activate the associated actuator in the robot, for example, the direct current motor coupled to wheels. For instance, if the mobile robot has a differential mechanism with two wheels, then two DC motors are coupled, for example, left motor (yL) and right motor (yR). Thus, defuzzification step uses Eq. (7) to compute yL and yR, and a set of CH-molecules defined for each output signal (yLand yR). As restricted in previous section, the set of CH-molecules are arranged in a linear and saturated hydrocarbon compound like Eq. (2). Thus, it is required to set the number of molecules n in the compound, the set of hydrogen atoms Hi for each molecule, the carbon value σ for each molecule, and the set of bounds Li at which the molecules act. Refer to Eqs. (1) to (4) if needed. As an example, Figure 7 shows a typical representation of the artificial hydrocarbon compound [15, 16] so-called structural formula, where H values represent the hydrogen values, exponent values at C’s represent carbon values, and L values are the bounds of molecules.
MOTION FEEDBACK USING THE RT-HOF APPROACH
A vision-based sensor is proposed to use in mobile robots in order to retrieve motion feedback. In particular, a video camera located in front of the robot can be used. For instance, two adjacent images are obtained. Then, the real-time Hermite optical flow algorithm is used to compute relative displacements of objects between the two images. This procedure outputs a map of displacements. Since the relative displacements in the map are two dimensional vectors, decomposition in horizontal (u) and vertical (v) axes is computed for each displacement vector. To this end, the mean value per axis of all decompositions is calculated, obtaining the relative mean horizontal displacement and the relative mean vertical displacement values, û and vˆv^, respectively.
If one object at the time is in front of the video camera, then û represents the mean displacement of the object relative to the horizontal perspective of the image, that is, the displacement of the object from left-to-right or right-to-left in front of the robot, and vˆv^ represents the mean displacement of the object relative to the vertical perspective of the image, that is, the displacement of the object from near-to-far or far-to-near the robot. Thus, both û and vˆv^ values can be employed as motion feedback of the robot and inputs of the proposed controller.
Implementation on navigation mobile robots
This section introduces the case study employed for implementing and validating the proposed artificial organic controller based on the FMI system and the RT-HOF approach for motion feedback. First, a description of the robotics system is presented. Then, the design of the particular artificial organic controller is shown. Lastly, it describes the process of calibration of the motion feedback system.
DESCRIPTION OF THE ROBOTICS SYSTEM
The robotics system used in this case study is based on a previous work reported in [19]. The mobile robot was implemented with the LEGO Mindstorms EV3 as both the mechanical and the electrical platform because it is easy and practical to use. The robot was built as tank configuration using two direct current (DC) motors and two rubber bands as actuators, and the robot was planned to be in a differential steering configuration. Also, a webcam was mounted on the robot to be used as the single vision-based sensor. For experimental purposes, the intelligent brick of the LEGO Mindstorms EV3 set was used as the interface between the mobile robot and a computer with MATLAB. The latter was employed to compute the control of the whole system. Both the webcam and the intelligent brick communicated with the computer via USB. Figure 8 shows a diagram of the robotic system [19]. The technical specifications of the robotic system are summarized in Table 1.
DESIGN OF THE ARTIFICIAL ORGANIC CONTROLLER
The fuzzy-molecular inference system-based controller was developed using the methodology described in Section 3. Two inputs were selected as follows: relative mean horizontal displacement û and relative mean vertical displacement vˆv^. Also, the input domain space was partitioned in three fuzzy sets for each input like: “negative” (N), “zero” (Z), and “positive” (P). The proposed membership functions for both inputs û and vˆv^ are depicted in Figures 9 and 10, respectively.
In addition, Table 2 shows the set of fuzzy rules to this artificial organic controller, and Figure 11shows the artificial hydrocarbon compound developed for this case study. Notice that there are three CH-molecules representing “move-backward” (MB), “stop-motion” (MS), and “move-forward” (MF), and two identical compounds are used, one for each wheel in the robot.
CALIBRATION OF THE MOTION FEEDBACK
Previous work [19] proved that the real-time Hermite optical flow algorithm (Figure 5) can be used in soft and hard real-time frameworks, arising the opportunity to employ this technique in mobile robots. In fact, the motion feedback system implemented in this work acquires images at 100ms of frame rate. Then, a pair of two adjacent images are analysed using the real-time Hermite optical flow algorithm of Figure 5. A map of the displacements is then obtained showing where objects in images are moving. In particular, an automated segmentation is done in order to get only the displacements that reach an empirical threshold, assuming that dynamic obstacles perform displacements greater than this threshold. For this case study, a threshold value of T = 1.0 was selected, using trial-and-error. Additionally, this case study supposes that one obstacle at most is in front of the robot and restricts the visual region of the robot at the centre of the frames (i.e., frames are divided in three vertical regions, selecting the central one). Later on, the automated segmentation finds the dynamic obstacle and computes its local displacements. To this end, the robotics system computes the mean values ûand vˆv^, as described in Section 3.2.
Experimental results
In order to validate the performance of the proposed controller, three tests were conducted about the actions taken from the mobile robot when dealing with dynamic obstacles. In addition, a comparison between the proposed controller and a rule-based controller previously developed in [19] was run. In the following section, these experimental results are summarized.
TESTS ON AVOIDING DYNAMIC OBSTACLES
This experiment consisted on steering the robot when dynamic objects are across the vision range of it. In particular, the robot avoids the obstacle in the opposite direction of its movement. In that sense, the proposed artificial organic controller is able to compute the relative displacement of the obstacle with respect to the robot, and then, the nature-inspired control strategy could calculate the power supply offering to the two motors, independently.In advance, three tests were conducted. The first test considered the dynamic object (i.e., another robot) to move from left-to-right perpendicular to the direction of the robot, expecting that the robot steers to the left. The second test consisted in the same dynamic object, but moving from right-to-left perpendicular to the direction of the robot, expecting that the latter moves to the right. Finally, the third test considered a dynamic obstacle moving in a perpendicular direction with respect to the direction of the robot. Tables 3 to 5 summarize the mean relative horizontal û and vertical vˆv^ displacements computed with the RT-HOF algorithm, the output power supplies for both motors, left yL and right yR, in the robot, and the interpretation of the steering direction of the robot. In addition, Figures 12 to 14show the trajectories obtained from the artificial organic controller in the robot during the three tests.
Observing at Figures 12 and 13, the correction of the direction is done fast in the robot while looking the dynamic obstacle in front. Reactiveness in the third test (Figure 14) is quite lower than in the first two tests. Currently, the robot can avoid obstacles in all situations. As an example, Figure 15 shows the visual range of the robot and the relative displacements obtained from the RT-HOF algorithm.
COMPARISON OF MOBILE ROBOT NAVIGATION CONTROLLERS
An inspection comparison was also done in order to highlight advantages and limitations on the performance of the proposed artificial organic controller. In fact, the controller in the previous work [19] reported a rule-based controller. Figures 16 to 18 show the response of the avoidance obstacles in the same configuration of tests: Dynamic object moves from left-to-right, from right-to-left and in diagonal, respectively.
First, the new artificial organic controller has better performance in terms of time reaction. Using the rule-based controller, the robot reacts in large time with respect to the distance of the dynamic object. It also considers a slow action that can be seen in the curvature of the depicted trajectory, and the robot does not return to the main direction (once the direction is corrected, the robot does not go back to the previous direction). The latter might be a disadvantage in the overall time of navigation, and the orientation of the robot could be lost.
On the other hand using the proposed artificial organic controller, the robot reacts in short time with respect to the distance of the dynamic object. In addition, once the steering is performed, the power supply to the wheels is recovered to the initial power. Moreover, the action is done fast (in contrast with the other controller) and the direction of the robot comes back close to the initial orientation. As an advantage, this controller might be used to surround dynamic obstacles that can minimize the overall time of the performance.It is remarkable to say that the rule-based controller is a reactive approach in contrast to the deliberative approach performed with the artificial organic controller. From the perspective of agents systems, deliberative approaches can deal with uncertainty, imprecise, and noise in a suitable way [37]. In addition, the artificial organic controller can be more scalable, reliable, and easy to understand. In advance, using the hybrid fuzzy-molecular inference system gives an easy way to tune and interpret the performance of the controller, in comparison with the rule-based controller. Lastly, learnability is allowed in the proposed controller.
Conclusions
This chapter presents a novel artificial organic controller for mobile robot navigation, based on a hybrid fuzzy-molecular inference system as the nature-inspired control strategy and a single vision-based motion feedback using the real-time Hermite optical flow approach.In fact, this artificial organic controller proposed the fuzzy-molecular inference system because it inherits characteristics from fuzzy inference systems like storage of knowledge from experts, dealing with uncertainty, and linguistic interpretation; but also from artificial hydrocarbon networks method that allows packaging information in molecular units, organizing of information, and dealing with aggressive uncertainty and noise. In addition, this proposed controller uses a real-time Hermite optical flow approach .Experimental results showed that the proposed artificial organic controller can avoid dynamic obstacles. In addition, the comparison with a rule-based controller highlights that the proposed controller is easy to implement and to understand. Also, it is scalable and reliable in terms of uncertainty, imprecise, and noise.For future work, this research is looking for implementing a learning mechanism in the artificial organic controller in order to automate the adaptation to the environment, and membership functions could be tuned automatically. To this end, complex environments should be tested to improve the real-time Hermite optical flow algorithm.