Literature Review Volume 3 Issue 4
The Polytechnic School, Arizona State University, USA
Correspondence: Sangram Redkar, The Polytechnic School, Arizona State University, Mesa, Az-86212, USA
Received: June 10, 2019 | Published: August 1, 2019
Citation: New P, Bates A, Fuente JD, et al. Adaptive oscillator controller for quadrupled hopping robots. MOJ App Bio Biomech. 2019;3(4):85?94. DOI: 10.15406/mojabb.2019.03.00109
As the robots are used in some of the extreme environments such as battle fields, disaster sites or extra planetary exploration, it is necessary to provide robust locomotive strategies that are optimal to each terrain. The hopping gait has been well studied in robotics and proven to be a potential method for locomotion in some of these areas. There have been some difficulties in developing terrain following controllers that maintain robust, steady state hopping gait which is disturbance resistant. This paper discusses controller strategies that have shown the ability to produce the robust hopping gait. An adaptive oscillator controller presented is this paper works remarkably well, both in simulation and experiments. In this paper, novel control methods based on the phase angle are used to control oscillating robotic systems. The phase oscillator uses the sine and cosine of the phase angle to change key properties of a mass-spring-damper system, including amplitude, frequency, and equilibrium. A hopping robot is used to show the applications of this phase oscillator. This paper presents the theoretical framework, simulations and experimental results.
Keywords: phase angle, hopping robot, limit cycle, oscillator, controllerAn autonomous system is one, which can sense an external event, make some logical choice based on the event, and then respond to the stimulus. In this respect, autonomous robotics has become ubiquitous in modern life. The cost of many consumable products has been greatly reduced through increased production and efficiencies in manufacturing processes, largely due to robotics. Some of the new and most exciting areas where robots are tasked are in Search and Rescue (SAR) scenarios1 and military operations to help soldiers with battle field awareness, logistics and physical augmentation.2‒14 A potentially more effective mode of locomotion for rough terrain can be found with legged robotics. Many legged robotic configurations are possible. Control systems are needed to add energy for locomotion in legged robots such as monopedal, bipedal, or quadrupedal robots. Systems can add energy based on negative damping,11 patterns based on phase angles,12,13 and impedance control.14 In this work, methods have been developed to add energy to assist motion based on adaptive oscillator control. This control method has been shown to work on linear and rotary mechanical systems. This phase-based approach is very powerful because a forcing function can be developed that can act on a hybrid dynamic locomotion system. Even though the dynamics change when the leg is contacting the ground in the stance phase and in the air during the flight phase, the forcing function does not change. It should be noted that in the case of these hopper robots versus some other phase angle controlled systems, the forcing function is not continuously active, rather is activated based on a phase angle and the control objective, i.e. operation in a steady state limit cycle or dampening to zero velocity.
A phase oscillator has been used mainly in wearable robotic systems. A simple application of phase oscillator control is the swing-up and balancing of an inverted pendulum. Many approaches have been used to control the system, including energy based control,8‒15 feedback stabilization,14,15 bang-bang control,16 sliding mode control,17‒19 robust control,20 hybrid control,21 partial linearization,22,23 machine learning,24 and simulator-based foresight control.25
One of the common control methods is the energy based control or Lyapunov type control method. The energy control method considers the current energy in the system and the total energy needed. When the energy in the system is less than the total energy needed, the control adds energy to the system, usually by providing the full torque in the same direction as the angular velocity. Once the system has enough energy, the control switches to a different method. A problem with energy based control is the quick changes in the forcing function. When the velocity switches from positive to negative, the forcing function switches from full force positive to full force negative. In simulation, quick, large changes are not a problem. But in a real robotic system, quick, large changes can damage the actuator or reduce its life. The phase oscillator can be used for both swing-up and balancing and can create a continuous forcing function that is better for a practical robotic system.
One of the earliest legged walking machines was designed around 1850 by the Russian mathematician Pafnuty Chebyshev. Since then designers, scientists, researchers and inventors have been trying to replicate what nature seems to have done so well. In the last 100 years, a number of systems have been developed into successful machines.17 In mid 1980’s Marc Raibert showed that hopping is a useful gait for robots with his 3-D prototype and eventually with the “Monopod”.7 Raibert’s designs were mass, spring, and damper systems that used compressed air to act as a spring to produce the effect of both a suspension system and an energy storage device. Zhuang Gao et al.,19 also made the argument that legged robots can navigate terrain that wheeled or tracked vehicles have trouble with. They surveyed many commercially available heavy duty legged robots to assess the state of performance in these types of robots. The mission of the robots, they discussed, ranged from forestry to military to space exploration; these included the Plustech Walking Machine 20, Boston Dynamics Big Dog21 and LS3,22 and NASA’s ATHELETE.23
They concluded that these robots could be well suited for outdoor exploration and disaster relief but many problems still exist. There are adverse efficiencies typically from poor leg design. There is a strong need for compliance and in most cases it is produced virtually instead of direct compliance. Virtual compliance is the use of force sensors in an end effector to allow a robot to move in the direction of an externally applied force,24,25 This gives the appearance of compliance or a soft touch. There is also a need to reduce computational complexity in the control algorithm. This problem appears to be common between both heavy-duty legged robots and their smaller counterparts.26‒28 Zhuang specifically suggested that further research should aim to develop a simpler intelligent control algorithm that meets compliance requirements. In a study published in 2010, hopping in humans and robots were studied.29 The authors suggested that current research has used apex-preserving hopping as the model for human and robotic hopping. In their opinion this model should be replaced with a spring, mass, damper system that utilized a constant energy supply. A constant energy supply means that every cycle of the gait receives the same energetic input no matter what are the states of the hopper. As system experiences dissipative losses of energy from damping and friction, the energy injection, in theory, will compensate for the losses.
The paradigm of the hopping model as apex-preserving to one of terrain following will result in a more robust, disturbance resistant hopper and one which is less computationally demanding. They suggest that the energy dissipation itself is an essential component to a stable, steady state hopping instead of being an intrinsic perturbation to the system. A question that comes out of the paper is “does there exist a solution that guarantees stable hopping to produce robust and stable terrain following locomotion?” We propose that the Hill-type muscle model may produce the desired result. This model utilizes a force-length and force-velocity relationship to achieve stability and robustness from perturbations. It also uses a contractive element along with both a series and parallel elastic element.30,31 A mechanism, if it existed, also could use these relationships and elements to produce a system with the same stability as the model. Many similarities exist between the Hill-type muscle model and the phase oscillator control system discussed in this paper. The most important similarity is the result of a stable controller that is resistant to disturbances and converges to a steady state limit cycle independent of initial conditions.
Phase plane analysis can be studied to determine if the system shows limit cycle.32 In this work, a non-linear forcing function based on the sine of the phase angle is used to drive system to limit cycle. Because the sine function can never be greater or smaller than one or negative one, the function is bounded.
A standard, second order, mechanical system equation is given by equation (1) where m represents the mass, b represents the damping, k represents the stiffness.
(1)
The natural frequency of oscillations of the system modeled by Equation (1) is dependent on the mass, m, and spring constant, . The behavior of the amplitude of the oscillations is dependent on the damping coefficient, b. If, the system has positive damping, the oscillations will shrink and disappear over time. If , the system has negative damping, and the oscillations will continue to grow. If, the system has no damping, and the oscillations will remain at a constant amplitude.
Researchers have added negative damping to systems to force a system to move, but the negative damping can become unstable because grows as the velocity gets larger.
(2)
A simpler method of control is a phase oscillator. A phase oscillator adds energy to the system based on the phase angle of the system. Figures 1 & 2 shows the phase angle,, on a phase plot. is defined by
Figure 1 Spring response due to positive, negative, and no damping. m= 1 kg, k= 50 N/m, b is in Ns/m, initial position = 1 m, initial velocity = 0 m/s.
Figure 2 Phase plot definition, horizontal axis is the position, x, and the vertical axis is the velocity, x ̇. The sine of the phase angle phi is given by the opposite over the hypotenuse. The hypotenuse is given by √(x ̇^2+x^2 ).
(3)
The phase angle can be used to determine when to add energy to the system and how much energy to add. The phase angle remains close tofor the majority of each oscillation. When the velocity is divided by the natural frequency (defined in Equation 4), the phase angle (redefined in Equation 5), allows for more precise phase oscillator controls (Figures 3-6).
(4)
(5)
The control system described here adds energy to the mechanical system by using the phase oscillator and the equation is given by
(6)
Figure 7 shows the system response with damping and phase oscillator. In this case, the oscillations converge to a limit cycle. This limit cycle can be found by solving Equation 6 analytically. The sine of the phase angle is defined by Equation 7. The steady-state solution of Equation 6 is given by Equations 8, 9, and 10 as shown below.
Figure 7 Spring response with phase oscillator. m= 1 kg, b= 1 Ns/m, k= 50 N/m, c= 20 N, initial position = 1 m, initial velocity = 0 m/s.
(7)
(8)
(9)
(10)
Substituting equations 8 and 9 into equation 10 yields equation 11.
(11)
Equations 8, 9, 10, and 11 can be substituted into Equation 6, as shown in Equation 12, to show the dependence of the amplitude of the system, , on the coefficient .
(12)
( (13)
(14)
(15)
Equations 14 and 15 show the relationship between C and A. Using the sine of the phase angle as a forcing function can be thought of as adding another damping term to the system. A positive coefficient in Equation 6 gives negative damping, as the forcing function is on the right-hand side of the equation, adding energy to the system. Unlike the damping provided by the term, the damping provided by is bounded in the range of. Also, the damping of the phase oscillator varies fromto C even whenis very small. The behavior of the bounded damping can explain intuitively the steady-state solution given by Equation 8. Whenis large, the positive damping from removes more energy from the system than the negative damping from adds to the system. When is small, the positive damping from removes less energy from the system than the negative damping from adds to the system. In either case, the system is pushed toward the same limit cycle, as seen in Figure 7. While giving the sine term with a positive coefficient can be thought of as negative damping, a negative coefficient can be thought of as positive damping, removing energy from the system. Figure 8 shows energy being removed from a system by a phase oscillator.
Figure 8 Spring response with phase oscillator. m= 1 kg, b= 0 Ns/m, k= 50 N/m, c= -5 N, initial position = 1 m, initial velocity = 0 m/s.
Equation 16 gives the definition of the cosine of the phase angle. The cosine of the phase angle has in the numerator instead of , meaning using cosine instead of sine as a forcing function will act as a spring instead of damping. Equations 17 to 20 show the steady state solution from Equation 8 which is still valid for a system with no damping.
(16)
(17)
(18)
(19)
(20)
A negative coefficient of the cosine of the phase angle results in a normal spring, which “pulls” toward. Similar to the sine term, the force is bounded by and varies betwee . A positive coefficient results in a spring which “pushes” away from, but pushes with more force as the displacement increases. Figure 9 shows how a system (without damping) changes with the addition of a phase oscillator using the cosine of the phase angle. As is negative, the phase oscillator acts as a spring, increasing the frequency. The increased frequency can be explained mathematically by Equation 20.
Figure 9 Spring response without and with phase oscillator (cosine). m= 1 kg, b= 0 Ns/m, k= 20 N/m, c= = -5 N, initial position = 1 m, initial velocity = 0 m/s.
The phase oscillator can use both the sine of the phase angle and the cosine of the phase angle simultaneously to control both the amplitude and the frequency of an oscillating system. Equation 21 shows a system forced by a phase oscillator using both the sine and cosine of the phase angle. The system can still be solved with Equation 8, as shown by Equations 22 through 24.
(21)
(22)
(23)
(24)
Equations 23 and 24 allow the designer to choose any amplitude and frequency. The shown is the frequency of the solution, not necessarily the natural frequency of the system (Figure 10). Using both sine and cosine in the phase oscillator is useful for visualizing the damping and spring components, separately. However, the two terms can be combined into a single term for simplicity. Figure 11 and Equations 25 through 27 define the phase shift and the amplitude. Equations 28 through 30 show the simplification of the phase oscillator.
Figure 10 Spring response without and with phase oscillator (cosine). m= 1 kg, b= 0 Ns/m, k= 20 N/m, c= = 5 N, initial position = 1 m, initial velocity = 0 m/s.
(25)
(26)
(27)
(28)
(29)
(30)
The balance between damping and spring provided by the phase oscillator depends on the phase shift of the forcing function, . The maximum value reached by the forcing function is given by the amplitude, . Figure 12 shows the spiral staircase behavior of the phase shift, bounded by the interval . Figure 13 shows the conical behavior of the amplitude which is bounded by the interval. Using sine of phase angle as the forcing function, can change the amplitude of the oscillations directly based on the c value. But, it is not possible to control the frequency of the oscillations as it depends only on system’s natural frequency. On the other hand, using cosine of the phase angle as a forcing function can only affect the frequency of the system during transitions but cannot generate a limit cycle. Therefore, using both sine and cosine of the phase angle can control both the amplitude and frequency of the oscillations based on the values c1 and c2.
The mechanical system put represented as a general second order system is :
(31)
The existence of the limit cycle can be evaluated with the Poincarè-Bendixson criterion. Using the continuously differentiable function of Equation 32, its gradient is shown in Equation 33. The product of the system in Equation 31 and the gradient of of Equation 33 is presented in Equation 34.
(32)
(33)
(34)
According to the Poincarè-Bendixson criterion it is possible to determine a region where is closed and bounded, in which it is guaranteed the existence of a closed orbit. The vector field points inwards for , outwards for , and tangent for . Consequently for this system the vector field points inwards in Equation 35, outwards in Equation 36, and is tangent in Equation 38.
(35)
(36)
(37)
Therefore we get the closed orbit
(38)
Consequently , and . The limit cycle exist for . The orbit is well defined for , , whereis a proportionality variable that defines the radius of the orbit. This proportionality variable depends on the design parameters for frequency and amplitude of the oscillations as seen in Equation 23 and Equation 24. Solving these equations for the general second order dynamic system, the value of amplitude is defined in Equation 39 and the frequency of the oscillations in Equation 40.
(39)
(40)
The phase based oscillator controller can operate as non-linear controller using error as the variable of interest, which is equal to the difference , where is the desired value of x. The forcing function for the controller is defined as:
(41)
Where 0 < n << 1. The use of n will avoid indefinite values for controller. The forcing function will drive the error to zero for values of . Using will oscillate the error to zero at the natural frequency of the system, usingreduces the response time and the stabilization time. In order to compare the performance of phase oscillator controller with linear PID controller, simulations were performed on the example system to follow the step reference at 2 seconds, and 3 perturbations were introduced. The PID controller has the structure given by Equation 42
(42)
The PID controller is tuned with MATLAB tuning toolbox, the gainsare used. For phase controller, the values for =-1000 and =-8000 are used. The results of the simulation are shown in Figure 13. Although both the controller showed similar performance, the phase oscillator controller exhibited slightly faster response than PID.
The hopping robot is shown in Figure 14. A pneumatic cylinder is used as the actuator with spring (7 pounds/inch or 1.25k newton/meter) that was used for direct compliance and to return energy to the system as it hopped. The leg is attached to the body through a rotary joint and a four bar linkage system with the motors. The four bar linkage system can be seen in Figure 15. The linear strip (Figure 16) was secured between two plates. It was decided that the one end of the plates could be attached to the spring retainer. The spring retainer was secured in place at the end of the cylinder. A notch was added to the hip and a grove was cut into the inner linear strip plate to ensure that the linear strip was always in the proper place to be read by the encoder. This feature is not shown in Figure 16. A bronze sleeve bearing was installed inside the hip. This allowed the cylinder and the hip to slide freely past one another. The spring is also pressed into the hip. The other end of the spring was pressed against the spring retainer which is fixed to the bottom of the cylinder. All parts were made with 6061 aluminums except for the acrylic inner linear strip plate and the polymer linear strip bracket. The actuators were Numatics M Series 1-1/16” spring return and were deployed using Numatics LO1 Series valves. The valves were mounted to the side walls of the body, positioned in between the motors. The original design for control of the robot was with the Cerebot MC-7 board which uses a Microchip Pic-33 processor. This was eventually changed to an Advantech PC-104. The digital input and output used a Sensoray 526 board. The PC-104 was eventually chosen because of its ability to read in four encoders simultaneously. Figure 17 shows the component block diagram for easy visualization of the quadruped robot system.
A variety of 2 DOF planer models were created in Working Model 2D. The models consisted of two spring actuator legs connected by a link of half the estimated weight of the robot and the length equivalent to the longest length of the robot. The legs were fixed in a perpendicular position relative to the body for all of the models. In simulations where no disturbances were introduced, the model was stable and quickly converged on a steady state (Figure 18). In this model an unintended consequence of the new leg design was realized. The model showed that as the actuators fired and the mass would begin to move upward vertically, the springs were compressing as well, absorbing some of the energy that was being added to the system. It appeared that this affected the efficiency of the robot but did not detract from its’ stability characteristics.
In another simulation a disturbance was presented by adding a block to the otherwise flat ground. The block can be seen in Figure 19 on the left hand side of the <li class="ref" id="ref1">. To start the model, one leg of the robot was placed on top of the block. This made the robot hop to the left and alternatively back to the right again. After running five seconds, the robot encountered the disturbance again; landing on the block for two consecutive hops. This forced the model to go unstable toppling over to an inverted position. This result was not necessarily unexpected as it was assumed that a disturbance of large enough size and duration could produce an instability. It is important to note that there was no trajectory objective programmed into the control software. The model was programmed with the Phase Oscillator Controller with the objective of hopping.
In actual experiments, encoders on robot were used to collect four sets of data, see Table 1. Three sets were collected using one encoder to determine when to activate all the actuators. All four encoders collected position data. The fourth trial used all four encoders to determine the actuation timing of each individual, respective leg. Again, all four encoders collected position data for each leg. The phase portraits for the spring show that while the robot moved toward a steady state oscillation there were some full compressions of the springs. Approximately 0.15m represented a full compression of the spring. These events were the extreme case and were generally dampened on the subsequent hops. In Figure 20, a clear bounded ‘limit’ cycle seems to emerge from the graph. It should also be noted that the spring compression did not follow a regular pattern. The compressions increased or decreased due to the attitude of the robot. When a leg was the first to return to the ground, that particular leg would tend to compress more than the others. The last leg to hit was conversely the leg that experienced the least compression in its spring. Figure 21 displays the test results from a trial that introduced a disturbance. The disturbance was created by manually nudging or hitting robot while hopping. It can be observed that despite of disturbance the robot retuned to steady hopping (Figure 22).
In this work, an application of phase oscillator for quadruped hopping robot was investigated. The controller was adaptive and was able to drive the system to a controlled limit cycle despite of perturbation. This control strategy is easier to implement in a real time. This control loop can execute at 100Hz on a low cost microcontroller. Another advantage of this oscillator was that it learned the amplitude and frequency of the external periodic signal quickly. The system was based in the entrainment or phase lock of the external signal and the oscillator. In future, we are planning to implement adaptive hopf oscillator in hopping robot. This oscillator aims at providing assistance to periodic motions. It can be used to synchronize the oscillator with external periodic signal and then to estimate the states of the system. The estimated states will used to compute the control signal and then force the system to follow the behavior.
The authors declare that there are no conflicts of interest.
©2019 New, et al. This is an open access article distributed under the terms of the, which permits unrestricted use, distribution, and build upon your work non-commercially.