Page 81 - Read Online
P. 81

Shu et al. J. Mater. Inf. 2025, 5, 36  https://dx.doi.org/10.20517/jmi.2025.13   Page 5 of 31

               Data preparation
               Data preparation is a crucial step in the ML process, as the quality and relevance of the data directly impact
                                               [52]
               the model performance and accuracy . Data for ML models can be obtained through various methods,
               including literature mining , computational data , experimental data , and database data [56,57] . While
                                                           [54]
                                       [53]
                                                                              [55]
               accurate data from literature or DFT calculations is highly valuable, it is often limited in quantity.
               Conversely, databases can quickly provide large volumes of data, though specific materials may not always
               be included. Experimental databases such as the Cambridge Structural Database (CSD) , the Inorganic
                                                                                           [58]
                                             [59]
                                                                                                   [60]
               Crystal Structure Database (ICSD) , PubChem, and the Crystallography Open Database (COD)  offer
               essential structural data for ML studies. For example, the ICSD contains over 240,000 crystal structures of
               inorganic compounds. Key computational databases include AFLOW , the Materials Project (MP) , the
                                                                                                    [62]
                                                                           [61]
               Computational 2D Materials Database (C2DB) , and the Open Quantum Materials Database (OQMD) ,
                                                       [63]
                                                                                                       [64]
               which provide computed properties such as optimized structures, electronic band structures, and densities
               of states, supporting efficient ML predictions. MP alone includes ~144,000 inorganic compounds and
               ~63,000 molecules. These resources are invaluable for advancing material predictions through ML. After
               acquiring the data, the initial step is to assess its quality to determine its suitability for building a ML model.
               This assessment involves checking the representativeness of the samples, identifying outliers or erroneous
               samples, ensuring consistent parameters for sample labels, and verifying that the distribution of label values
               is balanced and close to a normal distribution. Following the quality assessment, data cleaning is essential to
               remove noise, errors, and inconsistencies, ensuring the quality and reliability of data. To handle missing
               values, one can either delete samples or features with missing values or use interpolation methods (such as
               mean, median, or regression) to fill in the gaps. Normalizing and standardizing the data is crucial to
               eliminate scale differences between features, ensuring comparability and consistency across the dataset.
               These preprocessing steps are fundamental to prepare the data for effective ML, leading to more robust and
               accurate models.


               Feature engineering
               Feature engineering is a preprocessing step in ML, referring to the process of transforming raw data into
               features that better represent the underlying problem, thereby improving the predictive performance of the
               model. It aids in representing the underlying problem to the predictive model more effectively, thus
               enhancing the accuracy of the model on unseen data. Predictive models consist of predictor variables and
               outcome variables, and the feature engineering process selects the most useful predictor variables for the
               model. Feature engineering in ML primarily includes feature extraction, construction, and selection. Feature
               extraction is the process of extracting useful information from raw data. The methods for feature extraction
               vary depending on the type of data. For instance, extracting information about crystal elements, atomic
               positions, atomic interactions, and local structures can help the model understand material properties [57,65,66] .
               Feature construction involves creating new features through linear combinations of the original features to
               provide richer information and improve the model performance. Effective feature construction requires a
               deep understanding of the data and applying domain knowledge to innovate . In practical ML tasks, it is
                                                                                 [67]
               often necessary to repeatedly train ML models to evaluate the effectiveness of the current set of features and
               iterate through the three stages of feature engineering. Feature selection is selecting the most relevant subset
               of features from the original feature set by removing redundant, irrelevant, or noisy features. The goal is to
               choose the features with the highest predictive power from the original set [68,69] . Common feature selection
                                                                                  [72]
               methods include filter methods , wrapper methods , and embedded methods .
                                         [70]
                                                           [71]
               Model selection and training
               Before building a ML model, it is essential to clearly define the type of addressed task and select the most
               suitable model from multiple candidates for the specific problem. Different types of ML tasks, such as
               regression, classification, and clustering, may correspond to different model selection strategies. There is
   76   77   78   79   80   81   82   83   84   85   86