Page 33 - Read Online
P. 33

Page 14 of 22                  Ernest et al. Complex Eng Syst 2023;3:4  I http://dx.doi.org/10.20517/ces.2022.54












































               Figure 10. RL performance comparison of the variant with a single FIS for siege tank control, the variant with a single FIS providing all control
               actions, and the original system that is utilized within this study.


                                       Table 2. Counterexample for Spec 1 failure prior to modification
                                                   Variable        Value
                                                   MarineHealth     1.0
                                                   MarineDamageRate  0.0
                                                   HealBid         0.3

               respectively. A singular rule in our RB will correspond to exactly when the inputs are at those values, and
               those values are the extremes of the normalized space for both inputs. Hence, upon investigation of our RB
               we would see that we have a rule in our chromosome of ”If Marine Health is Very High and Marine Damage
               Rate is None, then Healing Bid is Low”. By changing the output MF to ”Very Low” for this rule, we can easily
               solve this specification failure.

               Though not a requirement, it is also often very beneficial to develop a scenario within the simulation environ-
               ment that can help represent a potential case of a found counterexample. Observing the agent’s performance
               through these specifically designed scenarios can both provide insight to the control issue, as well as provide
               feedback to the solution of the problem once found. Note that removing the failure case from a specific sce-
               nario does not guarantee that the specification will always hold, but measures can be taken to ensure this
               within regions of interest and verified again using Formal Methods. In this case, it is not necessary due to the
               simplicity of the counterexample found, but was completed and is seen below in Figures 11 and 12.

               A scenario was developed in which there are two marines, a medivac, and two zerglings. The zerglings are at
               full health, but the marines are wounded. In particular, the marine at the top of the formation is moderately
   28   29   30   31   32   33   34   35   36   37   38