2.4.6. The Grid Search and Trials

A grid search was performed to find better hyperparameters for the NN and CNN-based models, since the NN-based models have many hyperparameters which determine the model’s behavior and means of learning, such as the number of layers and weights for each layer, type of activation function, and learning rate. Parameters tried in the grid search are listed in Table 2.

The hyperparameters of NN and CNN for the grid search.

The alternating optimization was conducted ten times and different initial weights were used in each trial.