Page 242 - Read Online
P. 242

Liu et al. J. Mater. Inf. 2026, 6, 18                                             Page 7 of 29





               depth of each tree; min_samples_split specifies the minimum number of samples required for node splitting;
               and min_samples_leaf defines the minimum sample size required for leaf nodes. For GBRT, n_estimators
               determines the number of boosting iterations and model capacity. The learning rate, as a key regularization
               parameter, controls the step size of each iteration and works in conjunction with n_estimators - smaller
               learning rates require more trees, yielding more stable models with superior generalization. max_depth
               limits the complexity of individual weak learners by capping DT depth, ensuring gradual learning
               progression. min_samples_split acts as a node-level regularization constraint, preventing the model from
               learning noise by requiring a minimum number of samples for splitting. The main hyperparameters and
               their adopted values for the 12 ML models used in this work are summarized in Table 3. For model
               performance comparison, the hyperparameters of all models were set to their default values.

               Effective optimization of these hyperparameters balances model expressiveness and computational efficiency.
               Excessively high learning rates may cause premature convergence, while insufficient tree depth can restrict
               the model’s ability to capture nonlinear relationships. To systematically explore the hyperparameter space, a
               grid search strategy was employed to evaluate combinations of values within predefined ranges. This method
               identified configurations with high validation performance and strong robustness, indicated by less than a
               5% drop between training and testing performance. The grid search protocol thus proves effective in building
               reliable and generalizable models through structured exploration of the parameter space.


               In addition to point predictions, estimating the reliability of model outputs is crucial, particularly for
               material design under extreme conditions. This work leveraged the ensemble nature of ML algorithms to
               quantify predictive uncertainty. For the RF model (used for ductility prediction), the prediction uncertainty
               for a given input x was estimated by calculating the standard deviation (σ) of predictions from all N
               individual DTs. The 95% confidence interval (CI) was defined as y(x) ± 1.96σ(x). For the GBRT model (used
                                                                      −
               for strength prediction), a similar variance-based approach using quantile estimates was employed to
               determine confidence bounds.


               Multi-objective optimization algorithm
               Multi-objective optimization algorithms address the trade-off issues inherent in traditional single-objective
               design methods .
                            [43]

               In this work, a multi-objective optimization system for titanium alloys was established based on the NSGA-II
               framework. The system defines a 9-dimensional alloy element space as the design variables, with
               dual-objective optimization functions aimed at maximizing impact ductility and ductility. Domain
               knowledge-based ML models were integrated into the NSGA-II algorithm, which adopts an elitist strategy
               and is initialized using Latin hypercube sampling to ensure uniform coverage of the design space. The
               evolutionary search is driven by simulated binary crossover (crossover probability = 0.9; distribution index =
               15) to promote global exploration, combined with polynomial mutation (mutation probability = 0.25;
               distribution index = 15) to enhance local refinement. An innovative constraint-handling mechanism is
               introduced, incorporating component normalization X  = X ·  Í 0.3        and titanium compensation X′  =
                                                                  ˆ
                                                                   i
                                                                                                        i
                                                                       i
               X·                      . Engineering constraints (g  = Mo  - 2.5 ≤ 0, g  = Al  - 8.5 ≤ 0) are integrated into the Pareto
                 0.3 − (0.695 −     )
                                                    1
                i
                                                                        eq
                                                                    2
                                                         eq
                     Í
                            
               dominance relationship. Non-dominated sorting stratifies solutions based on Pareto dominance    i,j:f k (i)  ≺  f ,
                                                                                                         (j)
                                                                                                ∀
                                                                                                        k
               while crowding distance is used to quantify solution diversity. Elite retention balances convergence and
               exploration via arg  max (rank , -d ), with termination at 500 generations or upon adaptive stagnation
                                 ∈      ∪       i  i
               detection, specifically when ΔPF < 1% for 20 consecutive generations. This framework facilitates cross-scale
               mapping from material genes to macroscopic performance through data-driven optimization and
               physics-informed model reduction. The integration of constraints synergizes metallurgical principles with
               optimization theory, while maintaining computational efficiency for populations of 500 individuals. The
   237   238   239   240   241   242   243   244   245   246   247