Using Keras to Build and Train Neural Networks

In this notebook we will use a neural network to predict diabetes using the Pima Diabetes Dataset. We will start by training a Random Forest to get a performance baseline. Then we will use the Keras package to quickly build and train a neural network and compare the performance. We will see how different network structures affect the performance, training time, and level of overfitting (or underfitting).

UCI Pima Diabetes Dataset

Attributes: (all numeric-valued)

  1. Number of times pregnant
  2. Plasma glucose concentration a 2 hours in an oral glucose tolerance test
  3. Diastolic blood pressure (mm Hg)
  4. Triceps skin fold thickness (mm)
  5. 2-Hour serum insulin (mu U/ml)
  6. Body mass index (weight in kg/(height in m)^2)
  7. Diabetes pedigree function
  8. Age (years)
  9. Class variable (0 or 1)

The UCI Pima Diabetes Dataset which has 8 numerical predictors and a binary outcome.

In [1]:
#Preliminaries

from __future__ import absolute_import, division, print_function  # Python 2/3 compatibility

import warnings
warnings.filterwarnings("ignore")


import numpy as np
import pandas as pd
import matplotlib.pyplot as plt

from sklearn.model_selection import train_test_split
from sklearn.preprocessing import StandardScaler
from sklearn.metrics import confusion_matrix, precision_recall_curve, roc_auc_score, roc_curve, accuracy_score
from sklearn.ensemble import RandomForestClassifier

import seaborn as sns

%matplotlib inline
In [2]:
## Import Keras objects for Deep Learning

from keras.models  import Sequential, K
from keras.layers import Input, Dense, Flatten, Dropout, BatchNormalization
from keras.optimizers import Adam, SGD, RMSprop
Using TensorFlow backend.
In [3]:
## Load in the data set (Internet Access needed)

#url = "http://archive.ics.uci.edu/ml/machine-learning-databases/pima-indians-diabetes/pima-indians-diabetes.data"

url = r"C:\Users\byamu\Downloads\pimaindiansdiabetescsv\pima-indians-diabetes.csv"
names = ["times_pregnant", "glucose_tolerance_test", "blood_pressure", "skin_thickness", "insulin", 
         "bmi", "pedigree_function", "age", "has_diabetes"]
diabetes_df = pd.read_csv(url, names=names)
In [4]:
# Take a peek at the data -- if there are lots of "NaN" you may have internet connectivity issues
print(diabetes_df.shape)
diabetes_df.sample(5)
(768, 9)
Out[4]:
times_pregnant glucose_tolerance_test blood_pressure skin_thickness insulin bmi pedigree_function age has_diabetes
183 5 73 60 0 0 26.8 0.268 27 0
638 7 97 76 32 91 40.9 0.871 32 1
491 2 89 90 30 0 33.5 0.292 42 0
680 2 56 56 28 45 24.2 0.332 22 0
748 3 187 70 22 200 36.4 0.408 36 1
In [5]:
X = diabetes_df.iloc[:, :-1].values
y = diabetes_df["has_diabetes"].values
In [6]:
# Split the data to Train, and Test (75%, 25%)

X_train, X_test, y_train, y_test = train_test_split(X, y, test_size=0.25, random_state=11111)
In [7]:
np.mean(y), np.mean(1-y)
Out[7]:
(0.3489583333333333, 0.6510416666666666)

Above, we see that about 35% of the patients in this dataset have diabetes, while 65% do not. This means we can get an accuracy of 65% without any model - just declare that no one has diabetes. We will calculate the ROC-AUC score to evaluate performance of our model, and also look at the accuracy as well to see if we improved upon the 65% accuracy.

Exercise: Get a baseline performance using Random Forest

To begin, and get a baseline for classifier performance:

  1. Train a Random Forest model with 200 trees on the training data.
  2. Calculate the accuracy and roc_auc_score of the predictions.
In [8]:
## Train the RF Model
rf_model = RandomForestClassifier(n_estimators=200)
rf_model.fit(X_train, y_train)
Out[8]:
RandomForestClassifier(bootstrap=True, class_weight=None, criterion='gini',
            max_depth=None, max_features='auto', max_leaf_nodes=None,
            min_impurity_decrease=0.0, min_impurity_split=None,
            min_samples_leaf=1, min_samples_split=2,
            min_weight_fraction_leaf=0.0, n_estimators=200, n_jobs=None,
            oob_score=False, random_state=None, verbose=0,
            warm_start=False)
In [9]:
# Make predictions on the test set - both "hard" predictions, and the scores (percent of trees voting yes)
y_pred_class_rf = rf_model.predict(X_test)
y_pred_prob_rf = rf_model.predict_proba(X_test)


print('accuracy is {:.3f}'.format(accuracy_score(y_test,y_pred_class_rf)))
print('roc-auc is {:.3f}'.format(roc_auc_score(y_test,y_pred_prob_rf[:,1])))
accuracy is 0.766
roc-auc is 0.828
In [10]:
def plot_roc(y_test, y_pred, model_name):
    fpr, tpr, thr = roc_curve(y_test, y_pred)
    fig, ax = plt.subplots(figsize=(8, 8))
    ax.plot(fpr, tpr, 'k-')
    ax.plot([0, 1], [0, 1], 'k--', linewidth=.5)  # roc curve for random model
    ax.grid(True)
    ax.set(title='ROC Curve for {} on PIMA diabetes problem'.format(model_name),
           xlim=[-0.01, 1.01], ylim=[-0.01, 1.01])


plot_roc(y_test, y_pred_prob_rf[:, 1], 'RF')

Build a Single Hidden Layer Neural Network

We will use the Sequential model to quickly build a neural network. Our first network will be a single layer network. We have 8 variables, so we set the input shape to 8. Let's start by having a single hidden layer with 12 nodes.

In [11]:
## First let's normalize the data
## This aids the training of neural nets by providing numerical stability
## Random Forest does not need this as it finds a split only, as opposed to performing matrix multiplications


normalizer = StandardScaler()
X_train_norm = normalizer.fit_transform(X_train)
X_test_norm = normalizer.transform(X_test)
In [12]:
# Define the Model 
# Input size is 8-dimensional
# 1 hidden layer, 12 hidden nodes, sigmoid activation
# Final layer has just one node with a sigmoid activation (standard for binary classification)

model_1 = Sequential([
    Dense(12, input_shape=(8,), activation="relu"),
    Dense(1, activation="sigmoid")
])
WARNING:tensorflow:From C:\ProgramData\Anaconda3\lib\site-packages\tensorflow\python\framework\op_def_library.py:263: colocate_with (from tensorflow.python.framework.ops) is deprecated and will be removed in a future version.
Instructions for updating:
Colocations handled automatically by placer.
In [13]:
#  This is a nice tool to view the model you have created and count the parameters

model_1.summary()
_________________________________________________________________
Layer (type)                 Output Shape              Param #   
=================================================================
dense_1 (Dense)              (None, 12)                108       
_________________________________________________________________
dense_2 (Dense)              (None, 1)                 13        
=================================================================
Total params: 121
Trainable params: 121
Non-trainable params: 0
_________________________________________________________________

Comprehension question:

Why do we have 121 parameters? Does that make sense?

Let's fit our model for 200 epochs.

In [14]:
# Fit(Train) the Model

# Compile the model with Optimizer, Loss Function and Metrics
# Roc-Auc is not available in Keras as an off the shelf metric yet, so we will skip it here.

model_1.compile(SGD(lr = .003), "binary_crossentropy", metrics=["accuracy"])
run_hist_1 = model_1.fit(X_train_norm, y_train, validation_data=(X_test_norm, y_test), epochs=200)
# the fit function returns the run history. 
# It is very convenient, as it contains information about the model fit, iterations etc.
WARNING:tensorflow:From C:\ProgramData\Anaconda3\lib\site-packages\tensorflow\python\ops\math_ops.py:3066: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version.
Instructions for updating:
Use tf.cast instead.
Train on 576 samples, validate on 192 samples
Epoch 1/200
576/576 [==============================] - 2s 4ms/step - loss: 0.9456 - acc: 0.3316 - val_loss: 0.9652 - val_acc: 0.3698
Epoch 2/200
576/576 [==============================] - 0s 101us/step - loss: 0.9289 - acc: 0.3420 - val_loss: 0.9486 - val_acc: 0.3698
Epoch 3/200
576/576 [==============================] - 0s 149us/step - loss: 0.9131 - acc: 0.3472 - val_loss: 0.9328 - val_acc: 0.3750
Epoch 4/200
576/576 [==============================] - 0s 102us/step - loss: 0.8983 - acc: 0.3559 - val_loss: 0.9180 - val_acc: 0.3750
Epoch 5/200
576/576 [==============================] - 0s 113us/step - loss: 0.8844 - acc: 0.3663 - val_loss: 0.9040 - val_acc: 0.3802
Epoch 6/200
576/576 [==============================] - 0s 98us/step - loss: 0.8714 - acc: 0.3611 - val_loss: 0.8908 - val_acc: 0.3854
Epoch 7/200
576/576 [==============================] - 0s 96us/step - loss: 0.8590 - acc: 0.3681 - val_loss: 0.8783 - val_acc: 0.4010
Epoch 8/200
576/576 [==============================] - 0s 87us/step - loss: 0.8472 - acc: 0.3889 - val_loss: 0.8665 - val_acc: 0.4010
Epoch 9/200
576/576 [==============================] - 0s 94us/step - loss: 0.8360 - acc: 0.4010 - val_loss: 0.8552 - val_acc: 0.4115
Epoch 10/200
576/576 [==============================] - 0s 113us/step - loss: 0.8254 - acc: 0.4097 - val_loss: 0.8445 - val_acc: 0.4115
Epoch 11/200
576/576 [==============================] - 0s 104us/step - loss: 0.8154 - acc: 0.4184 - val_loss: 0.8343 - val_acc: 0.4115
Epoch 12/200
576/576 [==============================] - 0s 107us/step - loss: 0.8058 - acc: 0.4219 - val_loss: 0.8246 - val_acc: 0.4167
Epoch 13/200
576/576 [==============================] - 0s 103us/step - loss: 0.7968 - acc: 0.4323 - val_loss: 0.8153 - val_acc: 0.4323
Epoch 14/200
576/576 [==============================] - 0s 116us/step - loss: 0.7881 - acc: 0.4392 - val_loss: 0.8064 - val_acc: 0.4323
Epoch 15/200
576/576 [==============================] - 0s 108us/step - loss: 0.7798 - acc: 0.4549 - val_loss: 0.7978 - val_acc: 0.4427
Epoch 16/200
576/576 [==============================] - 0s 127us/step - loss: 0.7719 - acc: 0.4705 - val_loss: 0.7897 - val_acc: 0.4479
Epoch 17/200
576/576 [==============================] - 0s 165us/step - loss: 0.7644 - acc: 0.4826 - val_loss: 0.7819 - val_acc: 0.4427
Epoch 18/200
576/576 [==============================] - 0s 103us/step - loss: 0.7571 - acc: 0.4965 - val_loss: 0.7744 - val_acc: 0.4583
Epoch 19/200
576/576 [==============================] - 0s 98us/step - loss: 0.7502 - acc: 0.5139 - val_loss: 0.7672 - val_acc: 0.4948
Epoch 20/200
576/576 [==============================] - 0s 99us/step - loss: 0.7435 - acc: 0.5347 - val_loss: 0.7603 - val_acc: 0.5104
Epoch 21/200
576/576 [==============================] - 0s 101us/step - loss: 0.7371 - acc: 0.5556 - val_loss: 0.7537 - val_acc: 0.5312
Epoch 22/200
576/576 [==============================] - 0s 92us/step - loss: 0.7309 - acc: 0.5781 - val_loss: 0.7473 - val_acc: 0.5521
Epoch 23/200
576/576 [==============================] - 0s 96us/step - loss: 0.7250 - acc: 0.5920 - val_loss: 0.7411 - val_acc: 0.5625
Epoch 24/200
576/576 [==============================] - 0s 90us/step - loss: 0.7193 - acc: 0.5972 - val_loss: 0.7352 - val_acc: 0.5729
Epoch 25/200
576/576 [==============================] - 0s 136us/step - loss: 0.7138 - acc: 0.6007 - val_loss: 0.7295 - val_acc: 0.5833
Epoch 26/200
576/576 [==============================] - 0s 85us/step - loss: 0.7085 - acc: 0.6042 - val_loss: 0.7239 - val_acc: 0.5885
Epoch 27/200
576/576 [==============================] - 0s 87us/step - loss: 0.7034 - acc: 0.6146 - val_loss: 0.7186 - val_acc: 0.5990
Epoch 28/200
576/576 [==============================] - 0s 124us/step - loss: 0.6985 - acc: 0.6163 - val_loss: 0.7135 - val_acc: 0.6146
Epoch 29/200
576/576 [==============================] - 0s 95us/step - loss: 0.6938 - acc: 0.6233 - val_loss: 0.7086 - val_acc: 0.6250
Epoch 30/200
576/576 [==============================] - 0s 98us/step - loss: 0.6892 - acc: 0.6285 - val_loss: 0.7038 - val_acc: 0.6302
Epoch 31/200
576/576 [==============================] - 0s 91us/step - loss: 0.6848 - acc: 0.6285 - val_loss: 0.6992 - val_acc: 0.6458
Epoch 32/200
576/576 [==============================] - 0s 91us/step - loss: 0.6805 - acc: 0.6337 - val_loss: 0.6947 - val_acc: 0.6510
Epoch 33/200
576/576 [==============================] - 0s 109us/step - loss: 0.6763 - acc: 0.6372 - val_loss: 0.6904 - val_acc: 0.6510
Epoch 34/200
576/576 [==============================] - 0s 90us/step - loss: 0.6722 - acc: 0.6389 - val_loss: 0.6862 - val_acc: 0.6510
Epoch 35/200
576/576 [==============================] - 0s 103us/step - loss: 0.6683 - acc: 0.6389 - val_loss: 0.6821 - val_acc: 0.6510
Epoch 36/200
576/576 [==============================] - 0s 96us/step - loss: 0.6644 - acc: 0.6458 - val_loss: 0.6781 - val_acc: 0.6562
Epoch 37/200
576/576 [==============================] - 0s 108us/step - loss: 0.6607 - acc: 0.6476 - val_loss: 0.6742 - val_acc: 0.6667
Epoch 38/200
576/576 [==============================] - 0s 97us/step - loss: 0.6570 - acc: 0.6510 - val_loss: 0.6704 - val_acc: 0.6510
Epoch 39/200
576/576 [==============================] - 0s 139us/step - loss: 0.6535 - acc: 0.6562 - val_loss: 0.6667 - val_acc: 0.6615
Epoch 40/200
576/576 [==============================] - 0s 99us/step - loss: 0.6502 - acc: 0.6597 - val_loss: 0.6632 - val_acc: 0.6667
Epoch 41/200
576/576 [==============================] - 0s 100us/step - loss: 0.6467 - acc: 0.6632 - val_loss: 0.6597 - val_acc: 0.6719
Epoch 42/200
576/576 [==============================] - 0s 89us/step - loss: 0.6434 - acc: 0.6701 - val_loss: 0.6563 - val_acc: 0.6719
Epoch 43/200
576/576 [==============================] - 0s 87us/step - loss: 0.6403 - acc: 0.6719 - val_loss: 0.6530 - val_acc: 0.6771
Epoch 44/200
576/576 [==============================] - 0s 87us/step - loss: 0.6372 - acc: 0.6719 - val_loss: 0.6498 - val_acc: 0.6771
Epoch 45/200
576/576 [==============================] - 0s 87us/step - loss: 0.6342 - acc: 0.6719 - val_loss: 0.6467 - val_acc: 0.6771
Epoch 46/200
576/576 [==============================] - 0s 87us/step - loss: 0.6312 - acc: 0.6771 - val_loss: 0.6436 - val_acc: 0.6771
Epoch 47/200
576/576 [==============================] - 0s 89us/step - loss: 0.6284 - acc: 0.6840 - val_loss: 0.6407 - val_acc: 0.6771
Epoch 48/200
576/576 [==============================] - 0s 85us/step - loss: 0.6256 - acc: 0.6858 - val_loss: 0.6378 - val_acc: 0.6771
Epoch 49/200
576/576 [==============================] - 0s 103us/step - loss: 0.6230 - acc: 0.6875 - val_loss: 0.6351 - val_acc: 0.6771
Epoch 50/200
576/576 [==============================] - 0s 86us/step - loss: 0.6204 - acc: 0.6875 - val_loss: 0.6324 - val_acc: 0.6719
Epoch 51/200
576/576 [==============================] - 0s 104us/step - loss: 0.6178 - acc: 0.6892 - val_loss: 0.6297 - val_acc: 0.6719
Epoch 52/200
576/576 [==============================] - 0s 103us/step - loss: 0.6153 - acc: 0.6875 - val_loss: 0.6272 - val_acc: 0.6719
Epoch 53/200
576/576 [==============================] - 0s 94us/step - loss: 0.6129 - acc: 0.6840 - val_loss: 0.6247 - val_acc: 0.6719
Epoch 54/200
576/576 [==============================] - 0s 96us/step - loss: 0.6105 - acc: 0.6858 - val_loss: 0.6223 - val_acc: 0.6719
Epoch 55/200
576/576 [==============================] - 0s 111us/step - loss: 0.6082 - acc: 0.6840 - val_loss: 0.6199 - val_acc: 0.6771
Epoch 56/200
576/576 [==============================] - 0s 124us/step - loss: 0.6059 - acc: 0.6858 - val_loss: 0.6176 - val_acc: 0.6771
Epoch 57/200
576/576 [==============================] - 0s 125us/step - loss: 0.6036 - acc: 0.6875 - val_loss: 0.6153 - val_acc: 0.6771
Epoch 58/200
576/576 [==============================] - 0s 133us/step - loss: 0.6014 - acc: 0.6892 - val_loss: 0.6130 - val_acc: 0.6771
Epoch 59/200
576/576 [==============================] - 0s 91us/step - loss: 0.5993 - acc: 0.6892 - val_loss: 0.6108 - val_acc: 0.6771
Epoch 60/200
576/576 [==============================] - 0s 81us/step - loss: 0.5972 - acc: 0.6892 - val_loss: 0.6087 - val_acc: 0.6771
Epoch 61/200
576/576 [==============================] - 0s 100us/step - loss: 0.5952 - acc: 0.6910 - val_loss: 0.6066 - val_acc: 0.6771
Epoch 62/200
576/576 [==============================] - 0s 120us/step - loss: 0.5932 - acc: 0.6910 - val_loss: 0.6046 - val_acc: 0.6875
Epoch 63/200
576/576 [==============================] - 0s 93us/step - loss: 0.5912 - acc: 0.6910 - val_loss: 0.6026 - val_acc: 0.6875
Epoch 64/200
576/576 [==============================] - 0s 134us/step - loss: 0.5893 - acc: 0.6892 - val_loss: 0.6006 - val_acc: 0.6875
Epoch 65/200
576/576 [==============================] - 0s 86us/step - loss: 0.5874 - acc: 0.6962 - val_loss: 0.5988 - val_acc: 0.6875
Epoch 66/200
576/576 [==============================] - 0s 125us/step - loss: 0.5856 - acc: 0.6962 - val_loss: 0.5969 - val_acc: 0.6875
Epoch 67/200
576/576 [==============================] - 0s 146us/step - loss: 0.5838 - acc: 0.6962 - val_loss: 0.5951 - val_acc: 0.6927
Epoch 68/200
576/576 [==============================] - 0s 108us/step - loss: 0.5820 - acc: 0.6962 - val_loss: 0.5933 - val_acc: 0.6979
Epoch 69/200
576/576 [==============================] - 0s 119us/step - loss: 0.5802 - acc: 0.6962 - val_loss: 0.5916 - val_acc: 0.6979
Epoch 70/200
576/576 [==============================] - 0s 83us/step - loss: 0.5786 - acc: 0.6962 - val_loss: 0.5899 - val_acc: 0.6979
Epoch 71/200
576/576 [==============================] - 0s 165us/step - loss: 0.5769 - acc: 0.7031 - val_loss: 0.5882 - val_acc: 0.6979
Epoch 72/200
576/576 [==============================] - 0s 81us/step - loss: 0.5752 - acc: 0.7031 - val_loss: 0.5865 - val_acc: 0.6979
Epoch 73/200
576/576 [==============================] - 0s 87us/step - loss: 0.5736 - acc: 0.7031 - val_loss: 0.5849 - val_acc: 0.6979
Epoch 74/200
576/576 [==============================] - 0s 77us/step - loss: 0.5721 - acc: 0.7031 - val_loss: 0.5833 - val_acc: 0.6979
Epoch 75/200
576/576 [==============================] - 0s 81us/step - loss: 0.5705 - acc: 0.7031 - val_loss: 0.5818 - val_acc: 0.7031
Epoch 76/200
576/576 [==============================] - 0s 77us/step - loss: 0.5691 - acc: 0.7049 - val_loss: 0.5802 - val_acc: 0.7083
Epoch 77/200
576/576 [==============================] - 0s 86us/step - loss: 0.5676 - acc: 0.7083 - val_loss: 0.5787 - val_acc: 0.7083
Epoch 78/200
576/576 [==============================] - 0s 98us/step - loss: 0.5661 - acc: 0.7101 - val_loss: 0.5773 - val_acc: 0.7083
Epoch 79/200
576/576 [==============================] - ETA: 0s - loss: 0.5979 - acc: 0.750 - 0s 92us/step - loss: 0.5647 - acc: 0.7118 - val_loss: 0.5758 - val_acc: 0.7083
Epoch 80/200
576/576 [==============================] - 0s 124us/step - loss: 0.5633 - acc: 0.7066 - val_loss: 0.5744 - val_acc: 0.7083
Epoch 81/200
576/576 [==============================] - 0s 109us/step - loss: 0.5619 - acc: 0.7101 - val_loss: 0.5730 - val_acc: 0.7031
Epoch 82/200
576/576 [==============================] - 0s 99us/step - loss: 0.5605 - acc: 0.7118 - val_loss: 0.5717 - val_acc: 0.7083
Epoch 83/200
576/576 [==============================] - 0s 94us/step - loss: 0.5592 - acc: 0.7135 - val_loss: 0.5703 - val_acc: 0.7083
Epoch 84/200
576/576 [==============================] - ETA: 0s - loss: 0.4987 - acc: 0.781 - 0s 96us/step - loss: 0.5579 - acc: 0.7153 - val_loss: 0.5690 - val_acc: 0.7083
Epoch 85/200
576/576 [==============================] - 0s 109us/step - loss: 0.5566 - acc: 0.7135 - val_loss: 0.5677 - val_acc: 0.7083
Epoch 86/200
576/576 [==============================] - 0s 104us/step - loss: 0.5553 - acc: 0.7153 - val_loss: 0.5665 - val_acc: 0.7031
Epoch 87/200
576/576 [==============================] - 0s 108us/step - loss: 0.5541 - acc: 0.7135 - val_loss: 0.5653 - val_acc: 0.7031
Epoch 88/200
576/576 [==============================] - 0s 128us/step - loss: 0.5528 - acc: 0.7170 - val_loss: 0.5641 - val_acc: 0.7031
Epoch 89/200
576/576 [==============================] - 0s 134us/step - loss: 0.5516 - acc: 0.7170 - val_loss: 0.5629 - val_acc: 0.7031
Epoch 90/200
576/576 [==============================] - 0s 88us/step - loss: 0.5504 - acc: 0.7188 - val_loss: 0.5618 - val_acc: 0.7031
Epoch 91/200
576/576 [==============================] - 0s 118us/step - loss: 0.5493 - acc: 0.7188 - val_loss: 0.5606 - val_acc: 0.7031
Epoch 92/200
576/576 [==============================] - 0s 97us/step - loss: 0.5481 - acc: 0.7170 - val_loss: 0.5595 - val_acc: 0.7083
Epoch 93/200
576/576 [==============================] - 0s 83us/step - loss: 0.5470 - acc: 0.7222 - val_loss: 0.5584 - val_acc: 0.7188
Epoch 94/200
576/576 [==============================] - 0s 96us/step - loss: 0.5459 - acc: 0.7240 - val_loss: 0.5574 - val_acc: 0.7188
Epoch 95/200
576/576 [==============================] - 0s 126us/step - loss: 0.5448 - acc: 0.7257 - val_loss: 0.5563 - val_acc: 0.7188
Epoch 96/200
576/576 [==============================] - 0s 93us/step - loss: 0.5437 - acc: 0.7257 - val_loss: 0.5553 - val_acc: 0.7188
Epoch 97/200
576/576 [==============================] - 0s 96us/step - loss: 0.5426 - acc: 0.7274 - val_loss: 0.5543 - val_acc: 0.7188
Epoch 98/200
576/576 [==============================] - 0s 98us/step - loss: 0.5416 - acc: 0.7274 - val_loss: 0.5533 - val_acc: 0.7188
Epoch 99/200
576/576 [==============================] - 0s 93us/step - loss: 0.5406 - acc: 0.7274 - val_loss: 0.5523 - val_acc: 0.7188
Epoch 100/200
576/576 [==============================] - 0s 90us/step - loss: 0.5396 - acc: 0.7257 - val_loss: 0.5514 - val_acc: 0.7188
Epoch 101/200
576/576 [==============================] - 0s 101us/step - loss: 0.5386 - acc: 0.7274 - val_loss: 0.5504 - val_acc: 0.7188
Epoch 102/200
576/576 [==============================] - 0s 106us/step - loss: 0.5376 - acc: 0.7257 - val_loss: 0.5495 - val_acc: 0.7188
Epoch 103/200
576/576 [==============================] - 0s 146us/step - loss: 0.5366 - acc: 0.7309 - val_loss: 0.5486 - val_acc: 0.7188
Epoch 104/200
576/576 [==============================] - 0s 91us/step - loss: 0.5357 - acc: 0.7292 - val_loss: 0.5477 - val_acc: 0.7188
Epoch 105/200
576/576 [==============================] - 0s 92us/step - loss: 0.5347 - acc: 0.7292 - val_loss: 0.5469 - val_acc: 0.7292
Epoch 106/200
576/576 [==============================] - 0s 89us/step - loss: 0.5338 - acc: 0.7292 - val_loss: 0.5460 - val_acc: 0.7292
Epoch 107/200
576/576 [==============================] - 0s 99us/step - loss: 0.5329 - acc: 0.7309 - val_loss: 0.5452 - val_acc: 0.7292
Epoch 108/200
576/576 [==============================] - 0s 115us/step - loss: 0.5320 - acc: 0.7309 - val_loss: 0.5444 - val_acc: 0.7292
Epoch 109/200
576/576 [==============================] - 0s 88us/step - loss: 0.5312 - acc: 0.7326 - val_loss: 0.5436 - val_acc: 0.7292
Epoch 110/200
576/576 [==============================] - 0s 113us/step - loss: 0.5303 - acc: 0.7361 - val_loss: 0.5428 - val_acc: 0.7292
Epoch 111/200
576/576 [==============================] - 0s 106us/step - loss: 0.5294 - acc: 0.7378 - val_loss: 0.5420 - val_acc: 0.7344
Epoch 112/200
576/576 [==============================] - 0s 87us/step - loss: 0.5286 - acc: 0.7378 - val_loss: 0.5413 - val_acc: 0.7344
Epoch 113/200
576/576 [==============================] - 0s 91us/step - loss: 0.5278 - acc: 0.7378 - val_loss: 0.5405 - val_acc: 0.7344
Epoch 114/200
576/576 [==============================] - 0s 99us/step - loss: 0.5270 - acc: 0.7378 - val_loss: 0.5398 - val_acc: 0.7344
Epoch 115/200
576/576 [==============================] - 0s 88us/step - loss: 0.5261 - acc: 0.7413 - val_loss: 0.5391 - val_acc: 0.7396
Epoch 116/200
576/576 [==============================] - 0s 103us/step - loss: 0.5254 - acc: 0.7431 - val_loss: 0.5384 - val_acc: 0.7396
Epoch 117/200
576/576 [==============================] - 0s 114us/step - loss: 0.5246 - acc: 0.7448 - val_loss: 0.5377 - val_acc: 0.7396
Epoch 118/200
576/576 [==============================] - 0s 91us/step - loss: 0.5238 - acc: 0.7448 - val_loss: 0.5370 - val_acc: 0.7344
Epoch 119/200
576/576 [==============================] - 0s 125us/step - loss: 0.5231 - acc: 0.7465 - val_loss: 0.5363 - val_acc: 0.7344
Epoch 120/200
576/576 [==============================] - 0s 126us/step - loss: 0.5223 - acc: 0.7465 - val_loss: 0.5357 - val_acc: 0.7344
Epoch 121/200
576/576 [==============================] - 0s 105us/step - loss: 0.5216 - acc: 0.7465 - val_loss: 0.5350 - val_acc: 0.7344
Epoch 122/200
576/576 [==============================] - 0s 104us/step - loss: 0.5209 - acc: 0.7465 - val_loss: 0.5344 - val_acc: 0.7344
Epoch 123/200
576/576 [==============================] - 0s 98us/step - loss: 0.5202 - acc: 0.7483 - val_loss: 0.5338 - val_acc: 0.7396
Epoch 124/200
576/576 [==============================] - 0s 98us/step - loss: 0.5195 - acc: 0.7483 - val_loss: 0.5331 - val_acc: 0.7396
Epoch 125/200
576/576 [==============================] - 0s 131us/step - loss: 0.5188 - acc: 0.7483 - val_loss: 0.5325 - val_acc: 0.7396
Epoch 126/200
576/576 [==============================] - 0s 132us/step - loss: 0.5182 - acc: 0.7483 - val_loss: 0.5319 - val_acc: 0.7396
Epoch 127/200
576/576 [==============================] - 0s 101us/step - loss: 0.5175 - acc: 0.7483 - val_loss: 0.5313 - val_acc: 0.7344
Epoch 128/200
576/576 [==============================] - 0s 120us/step - loss: 0.5169 - acc: 0.7500 - val_loss: 0.5308 - val_acc: 0.7344
Epoch 129/200
576/576 [==============================] - 0s 98us/step - loss: 0.5162 - acc: 0.7500 - val_loss: 0.5302 - val_acc: 0.7344
Epoch 130/200
576/576 [==============================] - 0s 92us/step - loss: 0.5156 - acc: 0.7517 - val_loss: 0.5296 - val_acc: 0.7344
Epoch 131/200
576/576 [==============================] - 0s 109us/step - loss: 0.5149 - acc: 0.7517 - val_loss: 0.5291 - val_acc: 0.7344
Epoch 132/200
576/576 [==============================] - 0s 109us/step - loss: 0.5144 - acc: 0.7517 - val_loss: 0.5285 - val_acc: 0.7344
Epoch 133/200
576/576 [==============================] - 0s 126us/step - loss: 0.5138 - acc: 0.7517 - val_loss: 0.5280 - val_acc: 0.7344
Epoch 134/200
576/576 [==============================] - 0s 123us/step - loss: 0.5132 - acc: 0.7517 - val_loss: 0.5275 - val_acc: 0.7396
Epoch 135/200
576/576 [==============================] - 0s 99us/step - loss: 0.5126 - acc: 0.7517 - val_loss: 0.5269 - val_acc: 0.7396
Epoch 136/200
576/576 [==============================] - 0s 111us/step - loss: 0.5120 - acc: 0.7517 - val_loss: 0.5264 - val_acc: 0.7396
Epoch 137/200
576/576 [==============================] - 0s 101us/step - loss: 0.5115 - acc: 0.7517 - val_loss: 0.5259 - val_acc: 0.7396
Epoch 138/200
576/576 [==============================] - 0s 105us/step - loss: 0.5109 - acc: 0.7517 - val_loss: 0.5254 - val_acc: 0.7448
Epoch 139/200
576/576 [==============================] - 0s 97us/step - loss: 0.5103 - acc: 0.7517 - val_loss: 0.5249 - val_acc: 0.7448
Epoch 140/200
576/576 [==============================] - 0s 129us/step - loss: 0.5098 - acc: 0.7569 - val_loss: 0.5244 - val_acc: 0.7448
Epoch 141/200
576/576 [==============================] - 0s 98us/step - loss: 0.5092 - acc: 0.7535 - val_loss: 0.5239 - val_acc: 0.7448
Epoch 142/200
576/576 [==============================] - 0s 103us/step - loss: 0.5087 - acc: 0.7569 - val_loss: 0.5235 - val_acc: 0.7500
Epoch 143/200
576/576 [==============================] - 0s 108us/step - loss: 0.5082 - acc: 0.7569 - val_loss: 0.5230 - val_acc: 0.7500
Epoch 144/200
576/576 [==============================] - 0s 111us/step - loss: 0.5076 - acc: 0.7569 - val_loss: 0.5225 - val_acc: 0.7448
Epoch 145/200
576/576 [==============================] - 0s 110us/step - loss: 0.5072 - acc: 0.7587 - val_loss: 0.5221 - val_acc: 0.7448
Epoch 146/200
576/576 [==============================] - 0s 113us/step - loss: 0.5066 - acc: 0.7604 - val_loss: 0.5216 - val_acc: 0.7396
Epoch 147/200
576/576 [==============================] - 0s 113us/step - loss: 0.5061 - acc: 0.7604 - val_loss: 0.5212 - val_acc: 0.7396
Epoch 148/200
576/576 [==============================] - 0s 136us/step - loss: 0.5056 - acc: 0.7587 - val_loss: 0.5208 - val_acc: 0.7396
Epoch 149/200
576/576 [==============================] - 0s 99us/step - loss: 0.5051 - acc: 0.7604 - val_loss: 0.5203 - val_acc: 0.7396
Epoch 150/200
576/576 [==============================] - 0s 106us/step - loss: 0.5047 - acc: 0.7587 - val_loss: 0.5199 - val_acc: 0.7396
Epoch 151/200
576/576 [==============================] - 0s 108us/step - loss: 0.5042 - acc: 0.7587 - val_loss: 0.5195 - val_acc: 0.7396
Epoch 152/200
576/576 [==============================] - 0s 104us/step - loss: 0.5037 - acc: 0.7587 - val_loss: 0.5191 - val_acc: 0.7396
Epoch 153/200
576/576 [==============================] - 0s 101us/step - loss: 0.5032 - acc: 0.7604 - val_loss: 0.5187 - val_acc: 0.7396
Epoch 154/200
576/576 [==============================] - 0s 109us/step - loss: 0.5028 - acc: 0.7622 - val_loss: 0.5184 - val_acc: 0.7396
Epoch 155/200
576/576 [==============================] - 0s 159us/step - loss: 0.5023 - acc: 0.7622 - val_loss: 0.5180 - val_acc: 0.7344
Epoch 156/200
576/576 [==============================] - 0s 107us/step - loss: 0.5019 - acc: 0.7604 - val_loss: 0.5176 - val_acc: 0.7344
Epoch 157/200
576/576 [==============================] - 0s 136us/step - loss: 0.5015 - acc: 0.7587 - val_loss: 0.5173 - val_acc: 0.7344
Epoch 158/200
576/576 [==============================] - 0s 124us/step - loss: 0.5010 - acc: 0.7604 - val_loss: 0.5169 - val_acc: 0.7344
Epoch 159/200
576/576 [==============================] - 0s 110us/step - loss: 0.5006 - acc: 0.7604 - val_loss: 0.5165 - val_acc: 0.7344
Epoch 160/200
576/576 [==============================] - 0s 139us/step - loss: 0.5002 - acc: 0.7604 - val_loss: 0.5162 - val_acc: 0.7344
Epoch 161/200
576/576 [==============================] - 0s 123us/step - loss: 0.4997 - acc: 0.7604 - val_loss: 0.5159 - val_acc: 0.7344
Epoch 162/200
576/576 [==============================] - 0s 109us/step - loss: 0.4993 - acc: 0.7604 - val_loss: 0.5155 - val_acc: 0.7292
Epoch 163/200
576/576 [==============================] - 0s 91us/step - loss: 0.4989 - acc: 0.7639 - val_loss: 0.5152 - val_acc: 0.7292
Epoch 164/200
576/576 [==============================] - 0s 106us/step - loss: 0.4985 - acc: 0.7622 - val_loss: 0.5148 - val_acc: 0.7292
Epoch 165/200
576/576 [==============================] - 0s 96us/step - loss: 0.4981 - acc: 0.7622 - val_loss: 0.5145 - val_acc: 0.7292
Epoch 166/200
576/576 [==============================] - 0s 92us/step - loss: 0.4977 - acc: 0.7639 - val_loss: 0.5142 - val_acc: 0.7292
Epoch 167/200
576/576 [==============================] - ETA: 0s - loss: 0.5052 - acc: 0.687 - 0s 89us/step - loss: 0.4973 - acc: 0.7639 - val_loss: 0.5139 - val_acc: 0.7292
Epoch 168/200
576/576 [==============================] - 0s 92us/step - loss: 0.4969 - acc: 0.7622 - val_loss: 0.5135 - val_acc: 0.7292
Epoch 169/200
576/576 [==============================] - 0s 117us/step - loss: 0.4965 - acc: 0.7639 - val_loss: 0.5132 - val_acc: 0.7292
Epoch 170/200
576/576 [==============================] - 0s 90us/step - loss: 0.4962 - acc: 0.7639 - val_loss: 0.5129 - val_acc: 0.7292
Epoch 171/200
576/576 [==============================] - 0s 91us/step - loss: 0.4958 - acc: 0.7639 - val_loss: 0.5126 - val_acc: 0.7292
Epoch 172/200
576/576 [==============================] - 0s 94us/step - loss: 0.4954 - acc: 0.7639 - val_loss: 0.5123 - val_acc: 0.7292
Epoch 173/200
576/576 [==============================] - 0s 92us/step - loss: 0.4951 - acc: 0.7656 - val_loss: 0.5120 - val_acc: 0.7292
Epoch 174/200
576/576 [==============================] - 0s 124us/step - loss: 0.4947 - acc: 0.7656 - val_loss: 0.5117 - val_acc: 0.7292
Epoch 175/200
576/576 [==============================] - 0s 137us/step - loss: 0.4943 - acc: 0.7656 - val_loss: 0.5114 - val_acc: 0.7292
Epoch 176/200
576/576 [==============================] - 0s 109us/step - loss: 0.4940 - acc: 0.7639 - val_loss: 0.5111 - val_acc: 0.7292
Epoch 177/200
576/576 [==============================] - 0s 132us/step - loss: 0.4936 - acc: 0.7639 - val_loss: 0.5109 - val_acc: 0.7344
Epoch 178/200
576/576 [==============================] - 0s 139us/step - loss: 0.4933 - acc: 0.7656 - val_loss: 0.5106 - val_acc: 0.7344
Epoch 179/200
576/576 [==============================] - 0s 98us/step - loss: 0.4929 - acc: 0.7656 - val_loss: 0.5103 - val_acc: 0.7344
Epoch 180/200
576/576 [==============================] - 0s 116us/step - loss: 0.4926 - acc: 0.7674 - val_loss: 0.5101 - val_acc: 0.7292
Epoch 181/200
576/576 [==============================] - 0s 121us/step - loss: 0.4923 - acc: 0.7656 - val_loss: 0.5098 - val_acc: 0.7292
Epoch 182/200
576/576 [==============================] - 0s 112us/step - loss: 0.4919 - acc: 0.7656 - val_loss: 0.5096 - val_acc: 0.7344
Epoch 183/200
576/576 [==============================] - 0s 140us/step - loss: 0.4916 - acc: 0.7656 - val_loss: 0.5093 - val_acc: 0.7344
Epoch 184/200
576/576 [==============================] - 0s 97us/step - loss: 0.4913 - acc: 0.7656 - val_loss: 0.5091 - val_acc: 0.7344
Epoch 185/200
576/576 [==============================] - 0s 88us/step - loss: 0.4909 - acc: 0.7656 - val_loss: 0.5089 - val_acc: 0.7344
Epoch 186/200
576/576 [==============================] - 0s 90us/step - loss: 0.4906 - acc: 0.7656 - val_loss: 0.5086 - val_acc: 0.7344
Epoch 187/200
576/576 [==============================] - 0s 92us/step - loss: 0.4903 - acc: 0.7656 - val_loss: 0.5084 - val_acc: 0.7396
Epoch 188/200
576/576 [==============================] - 0s 84us/step - loss: 0.4900 - acc: 0.7674 - val_loss: 0.5082 - val_acc: 0.7396
Epoch 189/200
576/576 [==============================] - 0s 90us/step - loss: 0.4897 - acc: 0.7674 - val_loss: 0.5080 - val_acc: 0.7396
Epoch 190/200
576/576 [==============================] - 0s 93us/step - loss: 0.4894 - acc: 0.7674 - val_loss: 0.5078 - val_acc: 0.7448
Epoch 191/200
576/576 [==============================] - 0s 104us/step - loss: 0.4891 - acc: 0.7674 - val_loss: 0.5076 - val_acc: 0.7448
Epoch 192/200
576/576 [==============================] - 0s 103us/step - loss: 0.4888 - acc: 0.7708 - val_loss: 0.5074 - val_acc: 0.7552
Epoch 193/200
576/576 [==============================] - 0s 94us/step - loss: 0.4885 - acc: 0.7708 - val_loss: 0.5072 - val_acc: 0.7552
Epoch 194/200
576/576 [==============================] - 0s 86us/step - loss: 0.4882 - acc: 0.7708 - val_loss: 0.5070 - val_acc: 0.7552
Epoch 195/200
576/576 [==============================] - 0s 103us/step - loss: 0.4879 - acc: 0.7708 - val_loss: 0.5068 - val_acc: 0.7552
Epoch 196/200
576/576 [==============================] - 0s 140us/step - loss: 0.4876 - acc: 0.7708 - val_loss: 0.5066 - val_acc: 0.7552
Epoch 197/200
576/576 [==============================] - 0s 114us/step - loss: 0.4873 - acc: 0.7708 - val_loss: 0.5064 - val_acc: 0.7552
Epoch 198/200
576/576 [==============================] - 0s 153us/step - loss: 0.4871 - acc: 0.7708 - val_loss: 0.5062 - val_acc: 0.7552
Epoch 199/200
576/576 [==============================] - ETA: 0s - loss: 0.4920 - acc: 0.765 - 0s 133us/step - loss: 0.4868 - acc: 0.7708 - val_loss: 0.5060 - val_acc: 0.7552
Epoch 200/200
576/576 [==============================] - 0s 133us/step - loss: 0.4865 - acc: 0.7743 - val_loss: 0.5059 - val_acc: 0.7552
In [15]:
## Like we did for the Random Forest, we generate two kinds of predictions
#  One is a hard decision, the other is a probabilitistic score.

y_pred_class_nn_1 = model_1.predict_classes(X_test_norm)
y_pred_prob_nn_1 = model_1.predict(X_test_norm)
In [16]:
# Let's check out the outputs to get a feel for how keras apis work.
y_pred_class_nn_1[:10]
Out[16]:
array([[0],
       [1],
       [0],
       [0],
       [0],
       [0],
       [0],
       [0],
       [1],
       [0]])
In [17]:
y_pred_prob_nn_1[:10]
Out[17]:
array([[0.46282554],
       [0.6936019 ],
       [0.23778865],
       [0.24488184],
       [0.27853188],
       [0.41694868],
       [0.03225446],
       [0.36993736],
       [0.76904845],
       [0.20420143]], dtype=float32)
In [18]:
# Print model performance and plot the roc curve
print('accuracy is {:.3f}'.format(accuracy_score(y_test,y_pred_class_nn_1)))
print('roc-auc is {:.3f}'.format(roc_auc_score(y_test,y_pred_prob_nn_1)))

plot_roc(y_test, y_pred_prob_nn_1, 'NN')
accuracy is 0.755
roc-auc is 0.805

There may be some variation in exact numbers due to randomness, but you should get results in the same ballpark as the Random Forest - between 75% and 85% accuracy, between .8 and .9 for AUC.

Let's look at the run_hist_1 object that was created, specifically its history attribute.

In [19]:
run_hist_1.history.keys()
Out[19]:
dict_keys(['val_loss', 'val_acc', 'loss', 'acc'])

Let's plot the training loss and the validation loss over the different epochs and see how it looks.

In [20]:
fig, ax = plt.subplots()
ax.plot(run_hist_1.history["loss"],'r', marker='.', label="Train Loss")
ax.plot(run_hist_1.history["val_loss"],'b', marker='.', label="Validation Loss")
ax.legend()
Out[20]:
<matplotlib.legend.Legend at 0x2129ec97978>

Looks like the losses are still going down on both the training set and the validation set. This suggests that the model might benefit from further training. Let's train the model a little more and see what happens. Note that it will pick up from where it left off. Train for 1000 more epochs.

In [21]:
## Note that when we call "fit" again, it picks up where it left off
run_hist_1b = model_1.fit(X_train_norm, y_train, validation_data=(X_test_norm, y_test), epochs=1000)
Train on 576 samples, validate on 192 samples
Epoch 1/1000
576/576 [==============================] - 0s 92us/step - loss: 0.4721 - acc: 0.7622 - val_loss: 0.5196 - val_acc: 0.7552
Epoch 2/1000
576/576 [==============================] - 0s 92us/step - loss: 0.4718 - acc: 0.7622 - val_loss: 0.5195 - val_acc: 0.7552
Epoch 3/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4716 - acc: 0.7622 - val_loss: 0.5194 - val_acc: 0.7552
Epoch 4/1000
576/576 [==============================] - 0s 94us/step - loss: 0.4715 - acc: 0.7622 - val_loss: 0.5193 - val_acc: 0.7552
Epoch 5/1000
576/576 [==============================] - 0s 85us/step - loss: 0.4713 - acc: 0.7622 - val_loss: 0.5192 - val_acc: 0.7552
Epoch 6/1000
576/576 [==============================] - 0s 87us/step - loss: 0.4711 - acc: 0.7622 - val_loss: 0.5191 - val_acc: 0.7552
Epoch 7/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4708 - acc: 0.7622 - val_loss: 0.5190 - val_acc: 0.7552
Epoch 8/1000
576/576 [==============================] - 0s 87us/step - loss: 0.4706 - acc: 0.7622 - val_loss: 0.5189 - val_acc: 0.7552
Epoch 9/1000
576/576 [==============================] - 0s 88us/step - loss: 0.4704 - acc: 0.7622 - val_loss: 0.5189 - val_acc: 0.7552
Epoch 10/1000
576/576 [==============================] - 0s 92us/step - loss: 0.4702 - acc: 0.7622 - val_loss: 0.5188 - val_acc: 0.7552
Epoch 11/1000
576/576 [==============================] - 0s 90us/step - loss: 0.4700 - acc: 0.7622 - val_loss: 0.5187 - val_acc: 0.7552
Epoch 12/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4698 - acc: 0.7622 - val_loss: 0.5186 - val_acc: 0.7552
Epoch 13/1000
576/576 [==============================] - 0s 78us/step - loss: 0.4696 - acc: 0.7622 - val_loss: 0.5185 - val_acc: 0.7552
Epoch 14/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4694 - acc: 0.7639 - val_loss: 0.5184 - val_acc: 0.7604
Epoch 15/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4693 - acc: 0.7639 - val_loss: 0.5184 - val_acc: 0.7604
Epoch 16/1000
576/576 [==============================] - 0s 102us/step - loss: 0.4691 - acc: 0.7656 - val_loss: 0.5183 - val_acc: 0.7604
Epoch 17/1000
576/576 [==============================] - 0s 85us/step - loss: 0.4689 - acc: 0.7656 - val_loss: 0.5182 - val_acc: 0.7604
Epoch 18/1000
576/576 [==============================] - 0s 90us/step - loss: 0.4687 - acc: 0.7656 - val_loss: 0.5181 - val_acc: 0.7604
Epoch 19/1000
576/576 [==============================] - 0s 87us/step - loss: 0.4685 - acc: 0.7656 - val_loss: 0.5180 - val_acc: 0.7604
Epoch 20/1000
576/576 [==============================] - 0s 85us/step - loss: 0.4683 - acc: 0.7656 - val_loss: 0.5180 - val_acc: 0.7604
Epoch 21/1000
576/576 [==============================] - 0s 71us/step - loss: 0.4681 - acc: 0.7656 - val_loss: 0.5179 - val_acc: 0.7604
Epoch 22/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4680 - acc: 0.7656 - val_loss: 0.5178 - val_acc: 0.7604
Epoch 23/1000
576/576 [==============================] - 0s 90us/step - loss: 0.4678 - acc: 0.7656 - val_loss: 0.5178 - val_acc: 0.7604
Epoch 24/1000
576/576 [==============================] - 0s 69us/step - loss: 0.4676 - acc: 0.7656 - val_loss: 0.5177 - val_acc: 0.7604
Epoch 25/1000
576/576 [==============================] - 0s 71us/step - loss: 0.4674 - acc: 0.7674 - val_loss: 0.5176 - val_acc: 0.7604
Epoch 26/1000
576/576 [==============================] - 0s 73us/step - loss: 0.4672 - acc: 0.7674 - val_loss: 0.5176 - val_acc: 0.7656
Epoch 27/1000
576/576 [==============================] - 0s 73us/step - loss: 0.4671 - acc: 0.7674 - val_loss: 0.5175 - val_acc: 0.7656
Epoch 28/1000
576/576 [==============================] - 0s 73us/step - loss: 0.4669 - acc: 0.7674 - val_loss: 0.5174 - val_acc: 0.7656
Epoch 29/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4667 - acc: 0.7674 - val_loss: 0.5174 - val_acc: 0.7656
Epoch 30/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4666 - acc: 0.7674 - val_loss: 0.5173 - val_acc: 0.7656
Epoch 31/1000
576/576 [==============================] - 0s 78us/step - loss: 0.4664 - acc: 0.7674 - val_loss: 0.5173 - val_acc: 0.7656
Epoch 32/1000
576/576 [==============================] - 0s 78us/step - loss: 0.4662 - acc: 0.7674 - val_loss: 0.5172 - val_acc: 0.7656
Epoch 33/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4660 - acc: 0.7691 - val_loss: 0.5171 - val_acc: 0.7656
Epoch 34/1000
576/576 [==============================] - 0s 66us/step - loss: 0.4659 - acc: 0.7691 - val_loss: 0.5171 - val_acc: 0.7656
Epoch 35/1000
576/576 [==============================] - 0s 68us/step - loss: 0.4657 - acc: 0.7691 - val_loss: 0.5170 - val_acc: 0.7656
Epoch 36/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4655 - acc: 0.7674 - val_loss: 0.5170 - val_acc: 0.7656
Epoch 37/1000
576/576 [==============================] - 0s 83us/step - loss: 0.4653 - acc: 0.7674 - val_loss: 0.5170 - val_acc: 0.7656
Epoch 38/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4652 - acc: 0.7674 - val_loss: 0.5169 - val_acc: 0.7656
Epoch 39/1000
576/576 [==============================] - 0s 69us/step - loss: 0.4650 - acc: 0.7691 - val_loss: 0.5169 - val_acc: 0.7656
Epoch 40/1000
576/576 [==============================] - 0s 64us/step - loss: 0.4648 - acc: 0.7691 - val_loss: 0.5168 - val_acc: 0.7656
Epoch 41/1000
576/576 [==============================] - 0s 87us/step - loss: 0.4647 - acc: 0.7691 - val_loss: 0.5168 - val_acc: 0.7656
Epoch 42/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4645 - acc: 0.7708 - val_loss: 0.5167 - val_acc: 0.7656
Epoch 43/1000
576/576 [==============================] - 0s 87us/step - loss: 0.4643 - acc: 0.7708 - val_loss: 0.5167 - val_acc: 0.7656
Epoch 44/1000
576/576 [==============================] - 0s 78us/step - loss: 0.4642 - acc: 0.7708 - val_loss: 0.5166 - val_acc: 0.7656
Epoch 45/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4640 - acc: 0.7726 - val_loss: 0.5166 - val_acc: 0.7656
Epoch 46/1000
576/576 [==============================] - 0s 68us/step - loss: 0.4638 - acc: 0.7743 - val_loss: 0.5166 - val_acc: 0.7656
Epoch 47/1000
576/576 [==============================] - 0s 69us/step - loss: 0.4637 - acc: 0.7743 - val_loss: 0.5165 - val_acc: 0.7656
Epoch 48/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4635 - acc: 0.7743 - val_loss: 0.5165 - val_acc: 0.7656
Epoch 49/1000
576/576 [==============================] - 0s 68us/step - loss: 0.4634 - acc: 0.7743 - val_loss: 0.5165 - val_acc: 0.7656
Epoch 50/1000
576/576 [==============================] - 0s 69us/step - loss: 0.4632 - acc: 0.7708 - val_loss: 0.5164 - val_acc: 0.7656
Epoch 51/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4630 - acc: 0.7726 - val_loss: 0.5164 - val_acc: 0.7656
Epoch 52/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4629 - acc: 0.7726 - val_loss: 0.5163 - val_acc: 0.7656
Epoch 53/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4628 - acc: 0.7726 - val_loss: 0.5163 - val_acc: 0.7656
Epoch 54/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4626 - acc: 0.7708 - val_loss: 0.5163 - val_acc: 0.7656
Epoch 55/1000
576/576 [==============================] - 0s 71us/step - loss: 0.4625 - acc: 0.7743 - val_loss: 0.5162 - val_acc: 0.7656
Epoch 56/1000
576/576 [==============================] - 0s 71us/step - loss: 0.4623 - acc: 0.7726 - val_loss: 0.5162 - val_acc: 0.7656
Epoch 57/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4622 - acc: 0.7743 - val_loss: 0.5162 - val_acc: 0.7656
Epoch 58/1000
576/576 [==============================] - 0s 68us/step - loss: 0.4620 - acc: 0.7726 - val_loss: 0.5161 - val_acc: 0.7656
Epoch 59/1000
576/576 [==============================] - 0s 73us/step - loss: 0.4619 - acc: 0.7726 - val_loss: 0.5161 - val_acc: 0.7656
Epoch 60/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4617 - acc: 0.7726 - val_loss: 0.5161 - val_acc: 0.7656
Epoch 61/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4616 - acc: 0.7726 - val_loss: 0.5160 - val_acc: 0.7656
Epoch 62/1000
576/576 [==============================] - 0s 90us/step - loss: 0.4615 - acc: 0.7726 - val_loss: 0.5160 - val_acc: 0.7656
Epoch 63/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4613 - acc: 0.7726 - val_loss: 0.5160 - val_acc: 0.7656
Epoch 64/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4612 - acc: 0.7743 - val_loss: 0.5159 - val_acc: 0.7656
Epoch 65/1000
576/576 [==============================] - 0s 94us/step - loss: 0.4610 - acc: 0.7726 - val_loss: 0.5159 - val_acc: 0.7656
Epoch 66/1000
576/576 [==============================] - 0s 78us/step - loss: 0.4609 - acc: 0.7743 - val_loss: 0.5159 - val_acc: 0.7656
Epoch 67/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4607 - acc: 0.7743 - val_loss: 0.5158 - val_acc: 0.7656
Epoch 68/1000
576/576 [==============================] - 0s 71us/step - loss: 0.4606 - acc: 0.7743 - val_loss: 0.5158 - val_acc: 0.7656
Epoch 69/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4605 - acc: 0.7743 - val_loss: 0.5158 - val_acc: 0.7656
Epoch 70/1000
576/576 [==============================] - 0s 92us/step - loss: 0.4603 - acc: 0.7743 - val_loss: 0.5158 - val_acc: 0.7656
Epoch 71/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4602 - acc: 0.7726 - val_loss: 0.5157 - val_acc: 0.7656
Epoch 72/1000
576/576 [==============================] - 0s 85us/step - loss: 0.4601 - acc: 0.7760 - val_loss: 0.5157 - val_acc: 0.7656
Epoch 73/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4599 - acc: 0.7760 - val_loss: 0.5157 - val_acc: 0.7656
Epoch 74/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4598 - acc: 0.7760 - val_loss: 0.5156 - val_acc: 0.7656
Epoch 75/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4597 - acc: 0.7778 - val_loss: 0.5156 - val_acc: 0.7604
Epoch 76/1000
576/576 [==============================] - 0s 69us/step - loss: 0.4595 - acc: 0.7795 - val_loss: 0.5156 - val_acc: 0.7604
Epoch 77/1000
576/576 [==============================] - 0s 66us/step - loss: 0.4594 - acc: 0.7795 - val_loss: 0.5155 - val_acc: 0.7604
Epoch 78/1000
576/576 [==============================] - 0s 68us/step - loss: 0.4593 - acc: 0.7795 - val_loss: 0.5155 - val_acc: 0.7604
Epoch 79/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4591 - acc: 0.7795 - val_loss: 0.5155 - val_acc: 0.7604
Epoch 80/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4590 - acc: 0.7795 - val_loss: 0.5155 - val_acc: 0.7604
Epoch 81/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4589 - acc: 0.7795 - val_loss: 0.5154 - val_acc: 0.7604
Epoch 82/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4588 - acc: 0.7778 - val_loss: 0.5154 - val_acc: 0.7604
Epoch 83/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4586 - acc: 0.7778 - val_loss: 0.5154 - val_acc: 0.7604
Epoch 84/1000
576/576 [==============================] - 0s 83us/step - loss: 0.4585 - acc: 0.7778 - val_loss: 0.5153 - val_acc: 0.7604
Epoch 85/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4584 - acc: 0.7778 - val_loss: 0.5153 - val_acc: 0.7604
Epoch 86/1000
576/576 [==============================] - 0s 69us/step - loss: 0.4582 - acc: 0.7778 - val_loss: 0.5153 - val_acc: 0.7604
Epoch 87/1000
576/576 [==============================] - 0s 90us/step - loss: 0.4581 - acc: 0.7778 - val_loss: 0.5152 - val_acc: 0.7656
Epoch 88/1000
576/576 [==============================] - 0s 71us/step - loss: 0.4580 - acc: 0.7778 - val_loss: 0.5152 - val_acc: 0.7656
Epoch 89/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4578 - acc: 0.7778 - val_loss: 0.5152 - val_acc: 0.7656
Epoch 90/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4577 - acc: 0.7778 - val_loss: 0.5151 - val_acc: 0.7656
Epoch 91/1000
576/576 [==============================] - 0s 78us/step - loss: 0.4576 - acc: 0.7778 - val_loss: 0.5151 - val_acc: 0.7656
Epoch 92/1000
576/576 [==============================] - 0s 73us/step - loss: 0.4574 - acc: 0.7778 - val_loss: 0.5151 - val_acc: 0.7656
Epoch 93/1000
576/576 [==============================] - 0s 78us/step - loss: 0.4573 - acc: 0.7778 - val_loss: 0.5151 - val_acc: 0.7656
Epoch 94/1000
576/576 [==============================] - 0s 69us/step - loss: 0.4572 - acc: 0.7778 - val_loss: 0.5150 - val_acc: 0.7656
Epoch 95/1000
576/576 [==============================] - 0s 73us/step - loss: 0.4570 - acc: 0.7778 - val_loss: 0.5150 - val_acc: 0.7656
Epoch 96/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4569 - acc: 0.7778 - val_loss: 0.5150 - val_acc: 0.7656
Epoch 97/1000
576/576 [==============================] - 0s 71us/step - loss: 0.4568 - acc: 0.7778 - val_loss: 0.5149 - val_acc: 0.7656
Epoch 98/1000
576/576 [==============================] - 0s 71us/step - loss: 0.4566 - acc: 0.7778 - val_loss: 0.5149 - val_acc: 0.7656
Epoch 99/1000
576/576 [==============================] - 0s 71us/step - loss: 0.4565 - acc: 0.7778 - val_loss: 0.5149 - val_acc: 0.7656
Epoch 100/1000
576/576 [==============================] - 0s 85us/step - loss: 0.4563 - acc: 0.7778 - val_loss: 0.5148 - val_acc: 0.7708
Epoch 101/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4562 - acc: 0.7778 - val_loss: 0.5148 - val_acc: 0.7708
Epoch 102/1000
576/576 [==============================] - 0s 71us/step - loss: 0.4561 - acc: 0.7778 - val_loss: 0.5148 - val_acc: 0.7708
Epoch 103/1000
576/576 [==============================] - 0s 87us/step - loss: 0.4559 - acc: 0.7778 - val_loss: 0.5148 - val_acc: 0.7708
Epoch 104/1000
576/576 [==============================] - 0s 87us/step - loss: 0.4558 - acc: 0.7795 - val_loss: 0.5147 - val_acc: 0.7708
Epoch 105/1000
576/576 [==============================] - 0s 78us/step - loss: 0.4557 - acc: 0.7778 - val_loss: 0.5147 - val_acc: 0.7708
Epoch 106/1000
576/576 [==============================] - 0s 85us/step - loss: 0.4555 - acc: 0.7812 - val_loss: 0.5147 - val_acc: 0.7708
Epoch 107/1000
576/576 [==============================] - 0s 78us/step - loss: 0.4554 - acc: 0.7812 - val_loss: 0.5146 - val_acc: 0.7708
Epoch 108/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4553 - acc: 0.7812 - val_loss: 0.5146 - val_acc: 0.7708
Epoch 109/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4552 - acc: 0.7830 - val_loss: 0.5146 - val_acc: 0.7708
Epoch 110/1000
576/576 [==============================] - 0s 68us/step - loss: 0.4550 - acc: 0.7830 - val_loss: 0.5145 - val_acc: 0.7708
Epoch 111/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4549 - acc: 0.7812 - val_loss: 0.5145 - val_acc: 0.7656
Epoch 112/1000
576/576 [==============================] - 0s 78us/step - loss: 0.4548 - acc: 0.7830 - val_loss: 0.5145 - val_acc: 0.7656
Epoch 113/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4546 - acc: 0.7830 - val_loss: 0.5144 - val_acc: 0.7656
Epoch 114/1000
576/576 [==============================] - 0s 69us/step - loss: 0.4545 - acc: 0.7830 - val_loss: 0.5144 - val_acc: 0.7656
Epoch 115/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4544 - acc: 0.7830 - val_loss: 0.5144 - val_acc: 0.7656
Epoch 116/1000
576/576 [==============================] - 0s 73us/step - loss: 0.4543 - acc: 0.7830 - val_loss: 0.5143 - val_acc: 0.7656
Epoch 117/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4541 - acc: 0.7830 - val_loss: 0.5143 - val_acc: 0.7656
Epoch 118/1000
576/576 [==============================] - 0s 73us/step - loss: 0.4540 - acc: 0.7830 - val_loss: 0.5143 - val_acc: 0.7656
Epoch 119/1000
576/576 [==============================] - 0s 87us/step - loss: 0.4539 - acc: 0.7830 - val_loss: 0.5142 - val_acc: 0.7656
Epoch 120/1000
576/576 [==============================] - 0s 73us/step - loss: 0.4538 - acc: 0.7847 - val_loss: 0.5142 - val_acc: 0.7656
Epoch 121/1000
576/576 [==============================] - 0s 73us/step - loss: 0.4537 - acc: 0.7847 - val_loss: 0.5142 - val_acc: 0.7656
Epoch 122/1000
576/576 [==============================] - 0s 71us/step - loss: 0.4535 - acc: 0.7865 - val_loss: 0.5141 - val_acc: 0.7656
Epoch 123/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4534 - acc: 0.7865 - val_loss: 0.5141 - val_acc: 0.7656
Epoch 124/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4533 - acc: 0.7865 - val_loss: 0.5141 - val_acc: 0.7656
Epoch 125/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4532 - acc: 0.7865 - val_loss: 0.5140 - val_acc: 0.7656
Epoch 126/1000
576/576 [==============================] - 0s 92us/step - loss: 0.4531 - acc: 0.7865 - val_loss: 0.5140 - val_acc: 0.7656
Epoch 127/1000
576/576 [==============================] - 0s 125us/step - loss: 0.4530 - acc: 0.7865 - val_loss: 0.5140 - val_acc: 0.7656
Epoch 128/1000
576/576 [==============================] - 0s 94us/step - loss: 0.4528 - acc: 0.7865 - val_loss: 0.5139 - val_acc: 0.7656
Epoch 129/1000
576/576 [==============================] - 0s 92us/step - loss: 0.4527 - acc: 0.7865 - val_loss: 0.5139 - val_acc: 0.7656
Epoch 130/1000
576/576 [==============================] - 0s 78us/step - loss: 0.4526 - acc: 0.7865 - val_loss: 0.5138 - val_acc: 0.7656
Epoch 131/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4525 - acc: 0.7865 - val_loss: 0.5138 - val_acc: 0.7656
Epoch 132/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4524 - acc: 0.7865 - val_loss: 0.5138 - val_acc: 0.7656
Epoch 133/1000
576/576 [==============================] - 0s 73us/step - loss: 0.4523 - acc: 0.7865 - val_loss: 0.5137 - val_acc: 0.7656
Epoch 134/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4522 - acc: 0.7865 - val_loss: 0.5137 - val_acc: 0.7656
Epoch 135/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4520 - acc: 0.7865 - val_loss: 0.5137 - val_acc: 0.7656
Epoch 136/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4519 - acc: 0.7865 - val_loss: 0.5136 - val_acc: 0.7656
Epoch 137/1000
576/576 [==============================] - 0s 68us/step - loss: 0.4518 - acc: 0.7865 - val_loss: 0.5136 - val_acc: 0.7656
Epoch 138/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4518 - acc: 0.7865 - val_loss: 0.5135 - val_acc: 0.7656
Epoch 139/1000
576/576 [==============================] - 0s 83us/step - loss: 0.4516 - acc: 0.7865 - val_loss: 0.5135 - val_acc: 0.7656
Epoch 140/1000
576/576 [==============================] - 0s 78us/step - loss: 0.4516 - acc: 0.7865 - val_loss: 0.5134 - val_acc: 0.7656
Epoch 141/1000
576/576 [==============================] - 0s 87us/step - loss: 0.4514 - acc: 0.7865 - val_loss: 0.5134 - val_acc: 0.7656
Epoch 142/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4513 - acc: 0.7865 - val_loss: 0.5134 - val_acc: 0.7656
Epoch 143/1000
576/576 [==============================] - 0s 83us/step - loss: 0.4512 - acc: 0.7865 - val_loss: 0.5133 - val_acc: 0.7656
Epoch 144/1000
576/576 [==============================] - 0s 106us/step - loss: 0.4511 - acc: 0.7865 - val_loss: 0.5133 - val_acc: 0.7656
Epoch 145/1000
576/576 [==============================] - 0s 111us/step - loss: 0.4510 - acc: 0.7865 - val_loss: 0.5132 - val_acc: 0.7656
Epoch 146/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4509 - acc: 0.7865 - val_loss: 0.5132 - val_acc: 0.7656
Epoch 147/1000
576/576 [==============================] - 0s 71us/step - loss: 0.4508 - acc: 0.7865 - val_loss: 0.5131 - val_acc: 0.7656
Epoch 148/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4507 - acc: 0.7865 - val_loss: 0.5131 - val_acc: 0.7656
Epoch 149/1000
576/576 [==============================] - 0s 90us/step - loss: 0.4506 - acc: 0.7865 - val_loss: 0.5130 - val_acc: 0.7656
Epoch 150/1000
576/576 [==============================] - 0s 85us/step - loss: 0.4505 - acc: 0.7865 - val_loss: 0.5130 - val_acc: 0.7708
Epoch 151/1000
576/576 [==============================] - 0s 87us/step - loss: 0.4504 - acc: 0.7865 - val_loss: 0.5129 - val_acc: 0.7708
Epoch 152/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4503 - acc: 0.7865 - val_loss: 0.5129 - val_acc: 0.7708
Epoch 153/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4502 - acc: 0.7865 - val_loss: 0.5129 - val_acc: 0.7708
Epoch 154/1000
576/576 [==============================] - 0s 83us/step - loss: 0.4501 - acc: 0.7865 - val_loss: 0.5128 - val_acc: 0.7708
Epoch 155/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4500 - acc: 0.7865 - val_loss: 0.5128 - val_acc: 0.7708
Epoch 156/1000
576/576 [==============================] - 0s 68us/step - loss: 0.4499 - acc: 0.7865 - val_loss: 0.5127 - val_acc: 0.7708
Epoch 157/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4498 - acc: 0.7865 - val_loss: 0.5127 - val_acc: 0.7708
Epoch 158/1000
576/576 [==============================] - 0s 73us/step - loss: 0.4497 - acc: 0.7865 - val_loss: 0.5126 - val_acc: 0.7708
Epoch 159/1000
576/576 [==============================] - 0s 85us/step - loss: 0.4496 - acc: 0.7865 - val_loss: 0.5126 - val_acc: 0.7708
Epoch 160/1000
576/576 [==============================] - 0s 71us/step - loss: 0.4495 - acc: 0.7865 - val_loss: 0.5126 - val_acc: 0.7708
Epoch 161/1000
576/576 [==============================] - 0s 68us/step - loss: 0.4494 - acc: 0.7865 - val_loss: 0.5125 - val_acc: 0.7708
Epoch 162/1000
576/576 [==============================] - 0s 78us/step - loss: 0.4493 - acc: 0.7882 - val_loss: 0.5125 - val_acc: 0.7708
Epoch 163/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4492 - acc: 0.7865 - val_loss: 0.5124 - val_acc: 0.7708
Epoch 164/1000
576/576 [==============================] - 0s 69us/step - loss: 0.4491 - acc: 0.7882 - val_loss: 0.5124 - val_acc: 0.7708
Epoch 165/1000
576/576 [==============================] - 0s 73us/step - loss: 0.4490 - acc: 0.7865 - val_loss: 0.5124 - val_acc: 0.7708
Epoch 166/1000
576/576 [==============================] - 0s 83us/step - loss: 0.4489 - acc: 0.7882 - val_loss: 0.5123 - val_acc: 0.7708
Epoch 167/1000
576/576 [==============================] - 0s 78us/step - loss: 0.4488 - acc: 0.7882 - val_loss: 0.5123 - val_acc: 0.7708
Epoch 168/1000
576/576 [==============================] - 0s 64us/step - loss: 0.4487 - acc: 0.7882 - val_loss: 0.5122 - val_acc: 0.7708
Epoch 169/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4486 - acc: 0.7882 - val_loss: 0.5122 - val_acc: 0.7708
Epoch 170/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4485 - acc: 0.7882 - val_loss: 0.5122 - val_acc: 0.7708
Epoch 171/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4484 - acc: 0.7865 - val_loss: 0.5121 - val_acc: 0.7708
Epoch 172/1000
576/576 [==============================] - 0s 78us/step - loss: 0.4484 - acc: 0.7865 - val_loss: 0.5121 - val_acc: 0.7708
Epoch 173/1000
576/576 [==============================] - 0s 115us/step - loss: 0.4483 - acc: 0.7865 - val_loss: 0.5120 - val_acc: 0.7708
Epoch 174/1000
576/576 [==============================] - 0s 68us/step - loss: 0.4482 - acc: 0.7865 - val_loss: 0.5120 - val_acc: 0.7708
Epoch 175/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4481 - acc: 0.7882 - val_loss: 0.5120 - val_acc: 0.7656
Epoch 176/1000
576/576 [==============================] - 0s 71us/step - loss: 0.4480 - acc: 0.7865 - val_loss: 0.5119 - val_acc: 0.7656
Epoch 177/1000
576/576 [==============================] - 0s 69us/step - loss: 0.4479 - acc: 0.7865 - val_loss: 0.5119 - val_acc: 0.7656
Epoch 178/1000
576/576 [==============================] - 0s 69us/step - loss: 0.4478 - acc: 0.7882 - val_loss: 0.5119 - val_acc: 0.7656
Epoch 179/1000
576/576 [==============================] - 0s 71us/step - loss: 0.4477 - acc: 0.7882 - val_loss: 0.5118 - val_acc: 0.7656
Epoch 180/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4476 - acc: 0.7882 - val_loss: 0.5118 - val_acc: 0.7656
Epoch 181/1000
576/576 [==============================] - 0s 83us/step - loss: 0.4476 - acc: 0.7882 - val_loss: 0.5118 - val_acc: 0.7656
Epoch 182/1000
576/576 [==============================] - 0s 69us/step - loss: 0.4475 - acc: 0.7882 - val_loss: 0.5117 - val_acc: 0.7656
Epoch 183/1000
576/576 [==============================] - 0s 88us/step - loss: 0.4474 - acc: 0.7882 - val_loss: 0.5117 - val_acc: 0.7656
Epoch 184/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4473 - acc: 0.7882 - val_loss: 0.5117 - val_acc: 0.7656
Epoch 185/1000
576/576 [==============================] - 0s 73us/step - loss: 0.4472 - acc: 0.7882 - val_loss: 0.5116 - val_acc: 0.7656
Epoch 186/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4471 - acc: 0.7882 - val_loss: 0.5116 - val_acc: 0.7656
Epoch 187/1000
576/576 [==============================] - 0s 78us/step - loss: 0.4470 - acc: 0.7882 - val_loss: 0.5116 - val_acc: 0.7656
Epoch 188/1000
576/576 [==============================] - 0s 97us/step - loss: 0.4470 - acc: 0.7882 - val_loss: 0.5115 - val_acc: 0.7656
Epoch 189/1000
576/576 [==============================] - 0s 73us/step - loss: 0.4469 - acc: 0.7865 - val_loss: 0.5115 - val_acc: 0.7656
Epoch 190/1000
576/576 [==============================] - 0s 69us/step - loss: 0.4468 - acc: 0.7865 - val_loss: 0.5115 - val_acc: 0.7656
Epoch 191/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4467 - acc: 0.7865 - val_loss: 0.5115 - val_acc: 0.7656
Epoch 192/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4466 - acc: 0.7865 - val_loss: 0.5114 - val_acc: 0.7656
Epoch 193/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4465 - acc: 0.7865 - val_loss: 0.5114 - val_acc: 0.7656
Epoch 194/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4464 - acc: 0.7865 - val_loss: 0.5114 - val_acc: 0.7656
Epoch 195/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4464 - acc: 0.7865 - val_loss: 0.5113 - val_acc: 0.7656
Epoch 196/1000
576/576 [==============================] - 0s 83us/step - loss: 0.4463 - acc: 0.7882 - val_loss: 0.5113 - val_acc: 0.7656
Epoch 197/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4462 - acc: 0.7882 - val_loss: 0.5113 - val_acc: 0.7656
Epoch 198/1000
576/576 [==============================] - 0s 85us/step - loss: 0.4461 - acc: 0.7882 - val_loss: 0.5112 - val_acc: 0.7656
Epoch 199/1000
576/576 [==============================] - 0s 78us/step - loss: 0.4461 - acc: 0.7882 - val_loss: 0.5112 - val_acc: 0.7656
Epoch 200/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4460 - acc: 0.7865 - val_loss: 0.5112 - val_acc: 0.7656
Epoch 201/1000
576/576 [==============================] - 0s 69us/step - loss: 0.4459 - acc: 0.7865 - val_loss: 0.5111 - val_acc: 0.7656
Epoch 202/1000
576/576 [==============================] - 0s 87us/step - loss: 0.4459 - acc: 0.7882 - val_loss: 0.5111 - val_acc: 0.7656
Epoch 203/1000
576/576 [==============================] - 0s 78us/step - loss: 0.4457 - acc: 0.7882 - val_loss: 0.5111 - val_acc: 0.7656
Epoch 204/1000
576/576 [==============================] - 0s 85us/step - loss: 0.4457 - acc: 0.7882 - val_loss: 0.5111 - val_acc: 0.7656
Epoch 205/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4456 - acc: 0.7882 - val_loss: 0.5110 - val_acc: 0.7656
Epoch 206/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4455 - acc: 0.7882 - val_loss: 0.5110 - val_acc: 0.7656
Epoch 207/1000
576/576 [==============================] - 0s 69us/step - loss: 0.4454 - acc: 0.7882 - val_loss: 0.5110 - val_acc: 0.7656
Epoch 208/1000
576/576 [==============================] - 0s 83us/step - loss: 0.4453 - acc: 0.7882 - val_loss: 0.5109 - val_acc: 0.7656
Epoch 209/1000
576/576 [==============================] - 0s 83us/step - loss: 0.4453 - acc: 0.7882 - val_loss: 0.5109 - val_acc: 0.7656
Epoch 210/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4452 - acc: 0.7882 - val_loss: 0.5109 - val_acc: 0.7656
Epoch 211/1000
576/576 [==============================] - 0s 71us/step - loss: 0.4452 - acc: 0.7882 - val_loss: 0.5109 - val_acc: 0.7656
Epoch 212/1000
576/576 [==============================] - 0s 78us/step - loss: 0.4450 - acc: 0.7882 - val_loss: 0.5108 - val_acc: 0.7656
Epoch 213/1000
576/576 [==============================] - 0s 73us/step - loss: 0.4450 - acc: 0.7882 - val_loss: 0.5108 - val_acc: 0.7656
Epoch 214/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4449 - acc: 0.7882 - val_loss: 0.5108 - val_acc: 0.7656
Epoch 215/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4448 - acc: 0.7882 - val_loss: 0.5108 - val_acc: 0.7656
Epoch 216/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4448 - acc: 0.7882 - val_loss: 0.5107 - val_acc: 0.7656
Epoch 217/1000
576/576 [==============================] - 0s 73us/step - loss: 0.4447 - acc: 0.7882 - val_loss: 0.5107 - val_acc: 0.7656
Epoch 218/1000
576/576 [==============================] - 0s 97us/step - loss: 0.4446 - acc: 0.7882 - val_loss: 0.5107 - val_acc: 0.7656
Epoch 219/1000
576/576 [==============================] - 0s 88us/step - loss: 0.4445 - acc: 0.7882 - val_loss: 0.5107 - val_acc: 0.7656
Epoch 220/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4445 - acc: 0.7882 - val_loss: 0.5106 - val_acc: 0.7656
Epoch 221/1000
576/576 [==============================] - 0s 73us/step - loss: 0.4444 - acc: 0.7882 - val_loss: 0.5106 - val_acc: 0.7656
Epoch 222/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4443 - acc: 0.7882 - val_loss: 0.5106 - val_acc: 0.7656
Epoch 223/1000
576/576 [==============================] - 0s 71us/step - loss: 0.4442 - acc: 0.7882 - val_loss: 0.5106 - val_acc: 0.7656
Epoch 224/1000
576/576 [==============================] - 0s 92us/step - loss: 0.4442 - acc: 0.7882 - val_loss: 0.5105 - val_acc: 0.7604
Epoch 225/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4441 - acc: 0.7882 - val_loss: 0.5105 - val_acc: 0.7604
Epoch 226/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4440 - acc: 0.7882 - val_loss: 0.5105 - val_acc: 0.7604
Epoch 227/1000
576/576 [==============================] - 0s 88us/step - loss: 0.4439 - acc: 0.7882 - val_loss: 0.5105 - val_acc: 0.7604
Epoch 228/1000
576/576 [==============================] - 0s 88us/step - loss: 0.4439 - acc: 0.7882 - val_loss: 0.5105 - val_acc: 0.7604
Epoch 229/1000
576/576 [==============================] - 0s 69us/step - loss: 0.4438 - acc: 0.7882 - val_loss: 0.5104 - val_acc: 0.7604
Epoch 230/1000
576/576 [==============================] - 0s 87us/step - loss: 0.4438 - acc: 0.7882 - val_loss: 0.5104 - val_acc: 0.7604
Epoch 231/1000
576/576 [==============================] - 0s 66us/step - loss: 0.4437 - acc: 0.7882 - val_loss: 0.5104 - val_acc: 0.7604
Epoch 232/1000
576/576 [==============================] - 0s 66us/step - loss: 0.4436 - acc: 0.7882 - val_loss: 0.5104 - val_acc: 0.7604
Epoch 233/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4436 - acc: 0.7882 - val_loss: 0.5103 - val_acc: 0.7604
Epoch 234/1000
576/576 [==============================] - 0s 68us/step - loss: 0.4435 - acc: 0.7882 - val_loss: 0.5103 - val_acc: 0.7604
Epoch 235/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4435 - acc: 0.7882 - val_loss: 0.5103 - val_acc: 0.7604
Epoch 236/1000
576/576 [==============================] - 0s 85us/step - loss: 0.4434 - acc: 0.7882 - val_loss: 0.5103 - val_acc: 0.7604
Epoch 237/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4433 - acc: 0.7882 - val_loss: 0.5103 - val_acc: 0.7604
Epoch 238/1000
576/576 [==============================] - 0s 69us/step - loss: 0.4432 - acc: 0.7882 - val_loss: 0.5102 - val_acc: 0.7604
Epoch 239/1000
576/576 [==============================] - 0s 71us/step - loss: 0.4432 - acc: 0.7882 - val_loss: 0.5102 - val_acc: 0.7604
Epoch 240/1000
576/576 [==============================] - 0s 73us/step - loss: 0.4431 - acc: 0.7865 - val_loss: 0.5102 - val_acc: 0.7604
Epoch 241/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4430 - acc: 0.7865 - val_loss: 0.5102 - val_acc: 0.7604
Epoch 242/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4430 - acc: 0.7865 - val_loss: 0.5101 - val_acc: 0.7604
Epoch 243/1000
576/576 [==============================] - 0s 64us/step - loss: 0.4429 - acc: 0.7865 - val_loss: 0.5101 - val_acc: 0.7604
Epoch 244/1000
576/576 [==============================] - 0s 90us/step - loss: 0.4428 - acc: 0.7865 - val_loss: 0.5101 - val_acc: 0.7604
Epoch 245/1000
576/576 [==============================] - 0s 78us/step - loss: 0.4428 - acc: 0.7865 - val_loss: 0.5101 - val_acc: 0.7604
Epoch 246/1000
576/576 [==============================] - 0s 83us/step - loss: 0.4427 - acc: 0.7865 - val_loss: 0.5100 - val_acc: 0.7604
Epoch 247/1000
576/576 [==============================] - 0s 85us/step - loss: 0.4426 - acc: 0.7865 - val_loss: 0.5100 - val_acc: 0.7604
Epoch 248/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4426 - acc: 0.7865 - val_loss: 0.5100 - val_acc: 0.7604
Epoch 249/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4425 - acc: 0.7865 - val_loss: 0.5100 - val_acc: 0.7604
Epoch 250/1000
576/576 [==============================] - 0s 71us/step - loss: 0.4424 - acc: 0.7865 - val_loss: 0.5100 - val_acc: 0.7604
Epoch 251/1000
576/576 [==============================] - 0s 71us/step - loss: 0.4424 - acc: 0.7865 - val_loss: 0.5099 - val_acc: 0.7604
Epoch 252/1000
576/576 [==============================] - 0s 85us/step - loss: 0.4423 - acc: 0.7865 - val_loss: 0.5099 - val_acc: 0.7604
Epoch 253/1000
576/576 [==============================] - 0s 85us/step - loss: 0.4423 - acc: 0.7865 - val_loss: 0.5099 - val_acc: 0.7604
Epoch 254/1000
576/576 [==============================] - 0s 87us/step - loss: 0.4422 - acc: 0.7865 - val_loss: 0.5099 - val_acc: 0.7604
Epoch 255/1000
576/576 [==============================] - 0s 88us/step - loss: 0.4421 - acc: 0.7865 - val_loss: 0.5098 - val_acc: 0.7604
Epoch 256/1000
576/576 [==============================] - 0s 99us/step - loss: 0.4421 - acc: 0.7882 - val_loss: 0.5098 - val_acc: 0.7604
Epoch 257/1000
576/576 [==============================] - 0s 78us/step - loss: 0.4420 - acc: 0.7882 - val_loss: 0.5098 - val_acc: 0.7604
Epoch 258/1000
576/576 [==============================] - 0s 83us/step - loss: 0.4420 - acc: 0.7899 - val_loss: 0.5098 - val_acc: 0.7604
Epoch 259/1000
576/576 [==============================] - 0s 83us/step - loss: 0.4419 - acc: 0.7899 - val_loss: 0.5098 - val_acc: 0.7604
Epoch 260/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4418 - acc: 0.7899 - val_loss: 0.5097 - val_acc: 0.7604
Epoch 261/1000
576/576 [==============================] - 0s 83us/step - loss: 0.4417 - acc: 0.7899 - val_loss: 0.5097 - val_acc: 0.7604
Epoch 262/1000
576/576 [==============================] - 0s 95us/step - loss: 0.4417 - acc: 0.7882 - val_loss: 0.5097 - val_acc: 0.7604
Epoch 263/1000
576/576 [==============================] - 0s 83us/step - loss: 0.4416 - acc: 0.7882 - val_loss: 0.5097 - val_acc: 0.7604
Epoch 264/1000
576/576 [==============================] - 0s 95us/step - loss: 0.4415 - acc: 0.7899 - val_loss: 0.5096 - val_acc: 0.7604
Epoch 265/1000
576/576 [==============================] - 0s 87us/step - loss: 0.4415 - acc: 0.7899 - val_loss: 0.5096 - val_acc: 0.7604
Epoch 266/1000
576/576 [==============================] - 0s 99us/step - loss: 0.4414 - acc: 0.7899 - val_loss: 0.5096 - val_acc: 0.7604
Epoch 267/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4413 - acc: 0.7899 - val_loss: 0.5096 - val_acc: 0.7604
Epoch 268/1000
576/576 [==============================] - 0s 85us/step - loss: 0.4412 - acc: 0.7899 - val_loss: 0.5096 - val_acc: 0.7604
Epoch 269/1000
576/576 [==============================] - 0s 78us/step - loss: 0.4412 - acc: 0.7899 - val_loss: 0.5095 - val_acc: 0.7604
Epoch 270/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4411 - acc: 0.7899 - val_loss: 0.5095 - val_acc: 0.7604
Epoch 271/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4410 - acc: 0.7899 - val_loss: 0.5095 - val_acc: 0.7604
Epoch 272/1000
576/576 [==============================] - 0s 90us/step - loss: 0.4410 - acc: 0.7899 - val_loss: 0.5095 - val_acc: 0.7604
Epoch 273/1000
576/576 [==============================] - 0s 85us/step - loss: 0.4409 - acc: 0.7899 - val_loss: 0.5095 - val_acc: 0.7604
Epoch 274/1000
576/576 [==============================] - 0s 90us/step - loss: 0.4408 - acc: 0.7899 - val_loss: 0.5095 - val_acc: 0.7604
Epoch 275/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4408 - acc: 0.7899 - val_loss: 0.5094 - val_acc: 0.7604
Epoch 276/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4407 - acc: 0.7899 - val_loss: 0.5094 - val_acc: 0.7604
Epoch 277/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4406 - acc: 0.7899 - val_loss: 0.5094 - val_acc: 0.7604
Epoch 278/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4406 - acc: 0.7899 - val_loss: 0.5094 - val_acc: 0.7604
Epoch 279/1000
576/576 [==============================] - 0s 85us/step - loss: 0.4405 - acc: 0.7899 - val_loss: 0.5094 - val_acc: 0.7604
Epoch 280/1000
576/576 [==============================] - 0s 83us/step - loss: 0.4404 - acc: 0.7899 - val_loss: 0.5094 - val_acc: 0.7604
Epoch 281/1000
576/576 [==============================] - 0s 85us/step - loss: 0.4404 - acc: 0.7899 - val_loss: 0.5094 - val_acc: 0.7604
Epoch 282/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4403 - acc: 0.7899 - val_loss: 0.5093 - val_acc: 0.7604
Epoch 283/1000
576/576 [==============================] - 0s 83us/step - loss: 0.4402 - acc: 0.7899 - val_loss: 0.5093 - val_acc: 0.7604
Epoch 284/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4402 - acc: 0.7917 - val_loss: 0.5093 - val_acc: 0.7604
Epoch 285/1000
576/576 [==============================] - 0s 83us/step - loss: 0.4401 - acc: 0.7917 - val_loss: 0.5093 - val_acc: 0.7604
Epoch 286/1000
576/576 [==============================] - 0s 85us/step - loss: 0.4400 - acc: 0.7917 - val_loss: 0.5093 - val_acc: 0.7604
Epoch 287/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4400 - acc: 0.7917 - val_loss: 0.5093 - val_acc: 0.7604
Epoch 288/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4399 - acc: 0.7917 - val_loss: 0.5093 - val_acc: 0.7604
Epoch 289/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4398 - acc: 0.7899 - val_loss: 0.5093 - val_acc: 0.7604
Epoch 290/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4397 - acc: 0.7917 - val_loss: 0.5093 - val_acc: 0.7604
Epoch 291/1000
576/576 [==============================] - 0s 71us/step - loss: 0.4397 - acc: 0.7917 - val_loss: 0.5092 - val_acc: 0.7604
Epoch 292/1000
576/576 [==============================] - 0s 94us/step - loss: 0.4396 - acc: 0.7917 - val_loss: 0.5092 - val_acc: 0.7604
Epoch 293/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4396 - acc: 0.7917 - val_loss: 0.5092 - val_acc: 0.7604
Epoch 294/1000
576/576 [==============================] - ETA: 0s - loss: 0.3637 - acc: 0.875 - 0s 78us/step - loss: 0.4395 - acc: 0.7917 - val_loss: 0.5092 - val_acc: 0.7604
Epoch 295/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4395 - acc: 0.7917 - val_loss: 0.5092 - val_acc: 0.7604
Epoch 296/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4394 - acc: 0.7917 - val_loss: 0.5092 - val_acc: 0.7604
Epoch 297/1000
576/576 [==============================] - 0s 71us/step - loss: 0.4393 - acc: 0.7917 - val_loss: 0.5092 - val_acc: 0.7604
Epoch 298/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4392 - acc: 0.7917 - val_loss: 0.5092 - val_acc: 0.7604
Epoch 299/1000
576/576 [==============================] - 0s 83us/step - loss: 0.4392 - acc: 0.7917 - val_loss: 0.5092 - val_acc: 0.7604
Epoch 300/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4391 - acc: 0.7899 - val_loss: 0.5092 - val_acc: 0.7604
Epoch 301/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4391 - acc: 0.7917 - val_loss: 0.5092 - val_acc: 0.7604
Epoch 302/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4390 - acc: 0.7934 - val_loss: 0.5092 - val_acc: 0.7604
Epoch 303/1000
576/576 [==============================] - 0s 83us/step - loss: 0.4389 - acc: 0.7917 - val_loss: 0.5092 - val_acc: 0.7604
Epoch 304/1000
576/576 [==============================] - 0s 92us/step - loss: 0.4389 - acc: 0.7934 - val_loss: 0.5092 - val_acc: 0.7604
Epoch 305/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4388 - acc: 0.7917 - val_loss: 0.5092 - val_acc: 0.7604
Epoch 306/1000
576/576 [==============================] - 0s 90us/step - loss: 0.4388 - acc: 0.7917 - val_loss: 0.5092 - val_acc: 0.7604
Epoch 307/1000
576/576 [==============================] - 0s 88us/step - loss: 0.4387 - acc: 0.7934 - val_loss: 0.5092 - val_acc: 0.7604
Epoch 308/1000
576/576 [==============================] - 0s 87us/step - loss: 0.4386 - acc: 0.7917 - val_loss: 0.5092 - val_acc: 0.7604
Epoch 309/1000
576/576 [==============================] - 0s 87us/step - loss: 0.4385 - acc: 0.7934 - val_loss: 0.5092 - val_acc: 0.7604
Epoch 310/1000
576/576 [==============================] - 0s 88us/step - loss: 0.4385 - acc: 0.7934 - val_loss: 0.5091 - val_acc: 0.7604
Epoch 311/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4384 - acc: 0.7917 - val_loss: 0.5092 - val_acc: 0.7604
Epoch 312/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4384 - acc: 0.7917 - val_loss: 0.5092 - val_acc: 0.7604
Epoch 313/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4383 - acc: 0.7917 - val_loss: 0.5092 - val_acc: 0.7604
Epoch 314/1000
576/576 [==============================] - 0s 78us/step - loss: 0.4382 - acc: 0.7917 - val_loss: 0.5091 - val_acc: 0.7604
Epoch 315/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4382 - acc: 0.7917 - val_loss: 0.5091 - val_acc: 0.7604
Epoch 316/1000
576/576 [==============================] - 0s 83us/step - loss: 0.4382 - acc: 0.7917 - val_loss: 0.5091 - val_acc: 0.7552
Epoch 317/1000
576/576 [==============================] - 0s 90us/step - loss: 0.4381 - acc: 0.7917 - val_loss: 0.5091 - val_acc: 0.7552
Epoch 318/1000
576/576 [==============================] - 0s 87us/step - loss: 0.4380 - acc: 0.7917 - val_loss: 0.5091 - val_acc: 0.7552
Epoch 319/1000
576/576 [==============================] - 0s 73us/step - loss: 0.4380 - acc: 0.7917 - val_loss: 0.5091 - val_acc: 0.7552
Epoch 320/1000
576/576 [==============================] - 0s 71us/step - loss: 0.4379 - acc: 0.7917 - val_loss: 0.5092 - val_acc: 0.7552
Epoch 321/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4379 - acc: 0.7917 - val_loss: 0.5092 - val_acc: 0.7552
Epoch 322/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4377 - acc: 0.7917 - val_loss: 0.5092 - val_acc: 0.7552
Epoch 323/1000
576/576 [==============================] - 0s 88us/step - loss: 0.4377 - acc: 0.7917 - val_loss: 0.5092 - val_acc: 0.7552
Epoch 324/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4377 - acc: 0.7917 - val_loss: 0.5092 - val_acc: 0.7552
Epoch 325/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4376 - acc: 0.7917 - val_loss: 0.5092 - val_acc: 0.7552
Epoch 326/1000
576/576 [==============================] - 0s 83us/step - loss: 0.4376 - acc: 0.7917 - val_loss: 0.5092 - val_acc: 0.7552
Epoch 327/1000
576/576 [==============================] - 0s 101us/step - loss: 0.4375 - acc: 0.7917 - val_loss: 0.5092 - val_acc: 0.7552
Epoch 328/1000
576/576 [==============================] - 0s 101us/step - loss: 0.4374 - acc: 0.7917 - val_loss: 0.5092 - val_acc: 0.7552
Epoch 329/1000
576/576 [==============================] - 0s 87us/step - loss: 0.4374 - acc: 0.7917 - val_loss: 0.5092 - val_acc: 0.7552
Epoch 330/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4373 - acc: 0.7917 - val_loss: 0.5092 - val_acc: 0.7552
Epoch 331/1000
576/576 [==============================] - 0s 101us/step - loss: 0.4373 - acc: 0.7917 - val_loss: 0.5092 - val_acc: 0.7552
Epoch 332/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4372 - acc: 0.7917 - val_loss: 0.5092 - val_acc: 0.7552
Epoch 333/1000
576/576 [==============================] - 0s 85us/step - loss: 0.4372 - acc: 0.7917 - val_loss: 0.5092 - val_acc: 0.7552
Epoch 334/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4371 - acc: 0.7917 - val_loss: 0.5092 - val_acc: 0.7552
Epoch 335/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4370 - acc: 0.7917 - val_loss: 0.5092 - val_acc: 0.7552
Epoch 336/1000
576/576 [==============================] - 0s 88us/step - loss: 0.4370 - acc: 0.7917 - val_loss: 0.5092 - val_acc: 0.7552
Epoch 337/1000
576/576 [==============================] - 0s 90us/step - loss: 0.4369 - acc: 0.7917 - val_loss: 0.5092 - val_acc: 0.7552
Epoch 338/1000
576/576 [==============================] - 0s 90us/step - loss: 0.4369 - acc: 0.7917 - val_loss: 0.5092 - val_acc: 0.7552
Epoch 339/1000
576/576 [==============================] - 0s 66us/step - loss: 0.4368 - acc: 0.7917 - val_loss: 0.5092 - val_acc: 0.7552
Epoch 340/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4368 - acc: 0.7917 - val_loss: 0.5092 - val_acc: 0.7552
Epoch 341/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4367 - acc: 0.7917 - val_loss: 0.5092 - val_acc: 0.7552
Epoch 342/1000
576/576 [==============================] - 0s 68us/step - loss: 0.4367 - acc: 0.7917 - val_loss: 0.5092 - val_acc: 0.7552
Epoch 343/1000
576/576 [==============================] - 0s 78us/step - loss: 0.4366 - acc: 0.7917 - val_loss: 0.5092 - val_acc: 0.7552
Epoch 344/1000
576/576 [==============================] - 0s 90us/step - loss: 0.4366 - acc: 0.7917 - val_loss: 0.5092 - val_acc: 0.7552
Epoch 345/1000
576/576 [==============================] - 0s 85us/step - loss: 0.4365 - acc: 0.7917 - val_loss: 0.5092 - val_acc: 0.7552
Epoch 346/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4364 - acc: 0.7917 - val_loss: 0.5092 - val_acc: 0.7552
Epoch 347/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4364 - acc: 0.7917 - val_loss: 0.5092 - val_acc: 0.7552
Epoch 348/1000
576/576 [==============================] - 0s 97us/step - loss: 0.4363 - acc: 0.7917 - val_loss: 0.5092 - val_acc: 0.7552
Epoch 349/1000
576/576 [==============================] - 0s 73us/step - loss: 0.4363 - acc: 0.7917 - val_loss: 0.5092 - val_acc: 0.7552
Epoch 350/1000
576/576 [==============================] - 0s 85us/step - loss: 0.4362 - acc: 0.7917 - val_loss: 0.5092 - val_acc: 0.7552
Epoch 351/1000
576/576 [==============================] - 0s 78us/step - loss: 0.4362 - acc: 0.7917 - val_loss: 0.5092 - val_acc: 0.7552
Epoch 352/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4361 - acc: 0.7917 - val_loss: 0.5092 - val_acc: 0.7552
Epoch 353/1000
576/576 [==============================] - 0s 92us/step - loss: 0.4361 - acc: 0.7917 - val_loss: 0.5092 - val_acc: 0.7552
Epoch 354/1000
576/576 [==============================] - 0s 85us/step - loss: 0.4360 - acc: 0.7917 - val_loss: 0.5092 - val_acc: 0.7552
Epoch 355/1000
576/576 [==============================] - 0s 73us/step - loss: 0.4360 - acc: 0.7917 - val_loss: 0.5092 - val_acc: 0.7552
Epoch 356/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4359 - acc: 0.7917 - val_loss: 0.5092 - val_acc: 0.7552
Epoch 357/1000
576/576 [==============================] - 0s 78us/step - loss: 0.4358 - acc: 0.7917 - val_loss: 0.5092 - val_acc: 0.7552
Epoch 358/1000
576/576 [==============================] - 0s 78us/step - loss: 0.4358 - acc: 0.7917 - val_loss: 0.5092 - val_acc: 0.7552
Epoch 359/1000
576/576 [==============================] - 0s 68us/step - loss: 0.4357 - acc: 0.7917 - val_loss: 0.5092 - val_acc: 0.7552
Epoch 360/1000
576/576 [==============================] - 0s 78us/step - loss: 0.4357 - acc: 0.7917 - val_loss: 0.5092 - val_acc: 0.7552
Epoch 361/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4356 - acc: 0.7917 - val_loss: 0.5092 - val_acc: 0.7552
Epoch 362/1000
576/576 [==============================] - 0s 71us/step - loss: 0.4356 - acc: 0.7899 - val_loss: 0.5092 - val_acc: 0.7552
Epoch 363/1000
576/576 [==============================] - 0s 85us/step - loss: 0.4355 - acc: 0.7899 - val_loss: 0.5092 - val_acc: 0.7552
Epoch 364/1000
576/576 [==============================] - 0s 90us/step - loss: 0.4355 - acc: 0.7899 - val_loss: 0.5092 - val_acc: 0.7552
Epoch 365/1000
576/576 [==============================] - 0s 90us/step - loss: 0.4354 - acc: 0.7899 - val_loss: 0.5092 - val_acc: 0.7552
Epoch 366/1000
576/576 [==============================] - 0s 87us/step - loss: 0.4354 - acc: 0.7899 - val_loss: 0.5092 - val_acc: 0.7552
Epoch 367/1000
576/576 [==============================] - 0s 85us/step - loss: 0.4353 - acc: 0.7899 - val_loss: 0.5093 - val_acc: 0.7552
Epoch 368/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4352 - acc: 0.7899 - val_loss: 0.5093 - val_acc: 0.7552
Epoch 369/1000
576/576 [==============================] - 0s 87us/step - loss: 0.4352 - acc: 0.7899 - val_loss: 0.5093 - val_acc: 0.7552
Epoch 370/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4351 - acc: 0.7899 - val_loss: 0.5093 - val_acc: 0.7552
Epoch 371/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4351 - acc: 0.7899 - val_loss: 0.5093 - val_acc: 0.7552
Epoch 372/1000
576/576 [==============================] - 0s 83us/step - loss: 0.4351 - acc: 0.7917 - val_loss: 0.5093 - val_acc: 0.7552
Epoch 373/1000
576/576 [==============================] - 0s 92us/step - loss: 0.4350 - acc: 0.7899 - val_loss: 0.5093 - val_acc: 0.7552
Epoch 374/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4349 - acc: 0.7899 - val_loss: 0.5093 - val_acc: 0.7552
Epoch 375/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4349 - acc: 0.7899 - val_loss: 0.5093 - val_acc: 0.7552
Epoch 376/1000
576/576 [==============================] - 0s 85us/step - loss: 0.4349 - acc: 0.7917 - val_loss: 0.5093 - val_acc: 0.7552
Epoch 377/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4348 - acc: 0.7899 - val_loss: 0.5093 - val_acc: 0.7552
Epoch 378/1000
576/576 [==============================] - 0s 83us/step - loss: 0.4347 - acc: 0.7917 - val_loss: 0.5093 - val_acc: 0.7552
Epoch 379/1000
576/576 [==============================] - 0s 87us/step - loss: 0.4347 - acc: 0.7899 - val_loss: 0.5093 - val_acc: 0.7552
Epoch 380/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4347 - acc: 0.7917 - val_loss: 0.5093 - val_acc: 0.7552
Epoch 381/1000
576/576 [==============================] - 0s 87us/step - loss: 0.4346 - acc: 0.7899 - val_loss: 0.5093 - val_acc: 0.7552
Epoch 382/1000
576/576 [==============================] - 0s 78us/step - loss: 0.4346 - acc: 0.7917 - val_loss: 0.5094 - val_acc: 0.7552
Epoch 383/1000
576/576 [==============================] - 0s 83us/step - loss: 0.4345 - acc: 0.7917 - val_loss: 0.5094 - val_acc: 0.7552
Epoch 384/1000
576/576 [==============================] - 0s 88us/step - loss: 0.4345 - acc: 0.7917 - val_loss: 0.5094 - val_acc: 0.7552
Epoch 385/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4345 - acc: 0.7917 - val_loss: 0.5094 - val_acc: 0.7552
Epoch 386/1000
576/576 [==============================] - 0s 85us/step - loss: 0.4344 - acc: 0.7917 - val_loss: 0.5094 - val_acc: 0.7552
Epoch 387/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4343 - acc: 0.7899 - val_loss: 0.5094 - val_acc: 0.7552
Epoch 388/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4343 - acc: 0.7917 - val_loss: 0.5094 - val_acc: 0.7552
Epoch 389/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4342 - acc: 0.7917 - val_loss: 0.5094 - val_acc: 0.7552
Epoch 390/1000
576/576 [==============================] - 0s 69us/step - loss: 0.4342 - acc: 0.7917 - val_loss: 0.5094 - val_acc: 0.7552
Epoch 391/1000
576/576 [==============================] - 0s 78us/step - loss: 0.4341 - acc: 0.7882 - val_loss: 0.5094 - val_acc: 0.7552
Epoch 392/1000
576/576 [==============================] - 0s 64us/step - loss: 0.4341 - acc: 0.7899 - val_loss: 0.5094 - val_acc: 0.7552
Epoch 393/1000
576/576 [==============================] - 0s 68us/step - loss: 0.4340 - acc: 0.7882 - val_loss: 0.5094 - val_acc: 0.7552
Epoch 394/1000
576/576 [==============================] - 0s 73us/step - loss: 0.4340 - acc: 0.7882 - val_loss: 0.5094 - val_acc: 0.7552
Epoch 395/1000
576/576 [==============================] - 0s 95us/step - loss: 0.4339 - acc: 0.7899 - val_loss: 0.5094 - val_acc: 0.7552
Epoch 396/1000
576/576 [==============================] - 0s 73us/step - loss: 0.4339 - acc: 0.7882 - val_loss: 0.5094 - val_acc: 0.7552
Epoch 397/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4338 - acc: 0.7882 - val_loss: 0.5094 - val_acc: 0.7552
Epoch 398/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4338 - acc: 0.7882 - val_loss: 0.5095 - val_acc: 0.7552
Epoch 399/1000
576/576 [==============================] - 0s 83us/step - loss: 0.4337 - acc: 0.7882 - val_loss: 0.5095 - val_acc: 0.7552
Epoch 400/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4337 - acc: 0.7882 - val_loss: 0.5095 - val_acc: 0.7552
Epoch 401/1000
576/576 [==============================] - 0s 71us/step - loss: 0.4336 - acc: 0.7882 - val_loss: 0.5095 - val_acc: 0.7552
Epoch 402/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4336 - acc: 0.7882 - val_loss: 0.5095 - val_acc: 0.7552
Epoch 403/1000
576/576 [==============================] - 0s 73us/step - loss: 0.4336 - acc: 0.7882 - val_loss: 0.5095 - val_acc: 0.7552
Epoch 404/1000
576/576 [==============================] - 0s 85us/step - loss: 0.4335 - acc: 0.7882 - val_loss: 0.5095 - val_acc: 0.7552
Epoch 405/1000
576/576 [==============================] - 0s 191us/step - loss: 0.4335 - acc: 0.7882 - val_loss: 0.5095 - val_acc: 0.7552
Epoch 406/1000
576/576 [==============================] - 0s 78us/step - loss: 0.4334 - acc: 0.7899 - val_loss: 0.5095 - val_acc: 0.7552
Epoch 407/1000
576/576 [==============================] - 0s 66us/step - loss: 0.4334 - acc: 0.7899 - val_loss: 0.5095 - val_acc: 0.7552
Epoch 408/1000
576/576 [==============================] - 0s 73us/step - loss: 0.4333 - acc: 0.7882 - val_loss: 0.5095 - val_acc: 0.7552
Epoch 409/1000
576/576 [==============================] - 0s 88us/step - loss: 0.4333 - acc: 0.7899 - val_loss: 0.5095 - val_acc: 0.7552
Epoch 410/1000
576/576 [==============================] - 0s 68us/step - loss: 0.4332 - acc: 0.7899 - val_loss: 0.5095 - val_acc: 0.7552
Epoch 411/1000
576/576 [==============================] - 0s 73us/step - loss: 0.4332 - acc: 0.7899 - val_loss: 0.5095 - val_acc: 0.7552
Epoch 412/1000
576/576 [==============================] - 0s 73us/step - loss: 0.4331 - acc: 0.7899 - val_loss: 0.5095 - val_acc: 0.7552
Epoch 413/1000
576/576 [==============================] - 0s 71us/step - loss: 0.4331 - acc: 0.7899 - val_loss: 0.5096 - val_acc: 0.7552
Epoch 414/1000
576/576 [==============================] - 0s 66us/step - loss: 0.4330 - acc: 0.7899 - val_loss: 0.5096 - val_acc: 0.7552
Epoch 415/1000
576/576 [==============================] - 0s 69us/step - loss: 0.4330 - acc: 0.7899 - val_loss: 0.5096 - val_acc: 0.7552
Epoch 416/1000
576/576 [==============================] - 0s 69us/step - loss: 0.4329 - acc: 0.7899 - val_loss: 0.5096 - val_acc: 0.7552
Epoch 417/1000
576/576 [==============================] - 0s 73us/step - loss: 0.4329 - acc: 0.7899 - val_loss: 0.5096 - val_acc: 0.7552
Epoch 418/1000
576/576 [==============================] - 0s 71us/step - loss: 0.4328 - acc: 0.7899 - val_loss: 0.5096 - val_acc: 0.7552
Epoch 419/1000
576/576 [==============================] - 0s 62us/step - loss: 0.4328 - acc: 0.7899 - val_loss: 0.5096 - val_acc: 0.7552
Epoch 420/1000
576/576 [==============================] - 0s 71us/step - loss: 0.4327 - acc: 0.7899 - val_loss: 0.5096 - val_acc: 0.7552
Epoch 421/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4327 - acc: 0.7899 - val_loss: 0.5096 - val_acc: 0.7552
Epoch 422/1000
576/576 [==============================] - 0s 68us/step - loss: 0.4326 - acc: 0.7899 - val_loss: 0.5096 - val_acc: 0.7552
Epoch 423/1000
576/576 [==============================] - 0s 95us/step - loss: 0.4326 - acc: 0.7899 - val_loss: 0.5096 - val_acc: 0.7552
Epoch 424/1000
576/576 [==============================] - 0s 92us/step - loss: 0.4326 - acc: 0.7899 - val_loss: 0.5096 - val_acc: 0.7552
Epoch 425/1000
576/576 [==============================] - 0s 69us/step - loss: 0.4325 - acc: 0.7899 - val_loss: 0.5096 - val_acc: 0.7552
Epoch 426/1000
576/576 [==============================] - 0s 87us/step - loss: 0.4325 - acc: 0.7899 - val_loss: 0.5096 - val_acc: 0.7552
Epoch 427/1000
576/576 [==============================] - 0s 85us/step - loss: 0.4324 - acc: 0.7899 - val_loss: 0.5096 - val_acc: 0.7552
Epoch 428/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4324 - acc: 0.7899 - val_loss: 0.5096 - val_acc: 0.7552
Epoch 429/1000
576/576 [==============================] - 0s 94us/step - loss: 0.4323 - acc: 0.7899 - val_loss: 0.5096 - val_acc: 0.7552
Epoch 430/1000
576/576 [==============================] - 0s 87us/step - loss: 0.4323 - acc: 0.7899 - val_loss: 0.5096 - val_acc: 0.7552
Epoch 431/1000
576/576 [==============================] - 0s 87us/step - loss: 0.4322 - acc: 0.7899 - val_loss: 0.5096 - val_acc: 0.7552
Epoch 432/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4322 - acc: 0.7899 - val_loss: 0.5096 - val_acc: 0.7552
Epoch 433/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4322 - acc: 0.7899 - val_loss: 0.5096 - val_acc: 0.7552
Epoch 434/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4321 - acc: 0.7899 - val_loss: 0.5096 - val_acc: 0.7552
Epoch 435/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4320 - acc: 0.7899 - val_loss: 0.5096 - val_acc: 0.7552
Epoch 436/1000
576/576 [==============================] - 0s 66us/step - loss: 0.4320 - acc: 0.7917 - val_loss: 0.5096 - val_acc: 0.7552
Epoch 437/1000
576/576 [==============================] - 0s 83us/step - loss: 0.4320 - acc: 0.7899 - val_loss: 0.5096 - val_acc: 0.7552
Epoch 438/1000
576/576 [==============================] - 0s 68us/step - loss: 0.4319 - acc: 0.7899 - val_loss: 0.5096 - val_acc: 0.7552
Epoch 439/1000
576/576 [==============================] - 0s 78us/step - loss: 0.4319 - acc: 0.7899 - val_loss: 0.5096 - val_acc: 0.7552
Epoch 440/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4318 - acc: 0.7899 - val_loss: 0.5096 - val_acc: 0.7552
Epoch 441/1000
576/576 [==============================] - 0s 69us/step - loss: 0.4318 - acc: 0.7917 - val_loss: 0.5096 - val_acc: 0.7552
Epoch 442/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4317 - acc: 0.7917 - val_loss: 0.5096 - val_acc: 0.7552
Epoch 443/1000
576/576 [==============================] - 0s 97us/step - loss: 0.4317 - acc: 0.7899 - val_loss: 0.5097 - val_acc: 0.7552
Epoch 444/1000
576/576 [==============================] - 0s 95us/step - loss: 0.4316 - acc: 0.7899 - val_loss: 0.5097 - val_acc: 0.7552
Epoch 445/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4316 - acc: 0.7899 - val_loss: 0.5097 - val_acc: 0.7552
Epoch 446/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4316 - acc: 0.7917 - val_loss: 0.5097 - val_acc: 0.7552
Epoch 447/1000
576/576 [==============================] - 0s 69us/step - loss: 0.4315 - acc: 0.7917 - val_loss: 0.5097 - val_acc: 0.7552
Epoch 448/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4315 - acc: 0.7917 - val_loss: 0.5097 - val_acc: 0.7552
Epoch 449/1000
576/576 [==============================] - 0s 78us/step - loss: 0.4315 - acc: 0.7899 - val_loss: 0.5097 - val_acc: 0.7552
Epoch 450/1000
576/576 [==============================] - 0s 73us/step - loss: 0.4314 - acc: 0.7917 - val_loss: 0.5097 - val_acc: 0.7552
Epoch 451/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4314 - acc: 0.7917 - val_loss: 0.5097 - val_acc: 0.7552
Epoch 452/1000
576/576 [==============================] - 0s 78us/step - loss: 0.4313 - acc: 0.7917 - val_loss: 0.5097 - val_acc: 0.7552
Epoch 453/1000
576/576 [==============================] - 0s 73us/step - loss: 0.4313 - acc: 0.7934 - val_loss: 0.5097 - val_acc: 0.7552
Epoch 454/1000
576/576 [==============================] - 0s 73us/step - loss: 0.4313 - acc: 0.7917 - val_loss: 0.5097 - val_acc: 0.7552
Epoch 455/1000
576/576 [==============================] - 0s 69us/step - loss: 0.4312 - acc: 0.7934 - val_loss: 0.5098 - val_acc: 0.7552
Epoch 456/1000
576/576 [==============================] - 0s 73us/step - loss: 0.4312 - acc: 0.7934 - val_loss: 0.5098 - val_acc: 0.7552
Epoch 457/1000
576/576 [==============================] - 0s 73us/step - loss: 0.4311 - acc: 0.7934 - val_loss: 0.5098 - val_acc: 0.7552
Epoch 458/1000
576/576 [==============================] - 0s 69us/step - loss: 0.4311 - acc: 0.7934 - val_loss: 0.5098 - val_acc: 0.7552
Epoch 459/1000
576/576 [==============================] - 0s 78us/step - loss: 0.4311 - acc: 0.7951 - val_loss: 0.5098 - val_acc: 0.7552
Epoch 460/1000
576/576 [==============================] - 0s 64us/step - loss: 0.4310 - acc: 0.7934 - val_loss: 0.5098 - val_acc: 0.7552
Epoch 461/1000
576/576 [==============================] - 0s 83us/step - loss: 0.4310 - acc: 0.7951 - val_loss: 0.5098 - val_acc: 0.7552
Epoch 462/1000
576/576 [==============================] - 0s 68us/step - loss: 0.4309 - acc: 0.7951 - val_loss: 0.5098 - val_acc: 0.7552
Epoch 463/1000
576/576 [==============================] - 0s 71us/step - loss: 0.4309 - acc: 0.7951 - val_loss: 0.5098 - val_acc: 0.7552
Epoch 464/1000
576/576 [==============================] - 0s 83us/step - loss: 0.4308 - acc: 0.7934 - val_loss: 0.5098 - val_acc: 0.7552
Epoch 465/1000
576/576 [==============================] - 0s 73us/step - loss: 0.4308 - acc: 0.7934 - val_loss: 0.5098 - val_acc: 0.7552
Epoch 466/1000
576/576 [==============================] - 0s 83us/step - loss: 0.4308 - acc: 0.7951 - val_loss: 0.5098 - val_acc: 0.7552
Epoch 467/1000
576/576 [==============================] - 0s 68us/step - loss: 0.4307 - acc: 0.7934 - val_loss: 0.5098 - val_acc: 0.7552
Epoch 468/1000
576/576 [==============================] - 0s 69us/step - loss: 0.4307 - acc: 0.7951 - val_loss: 0.5098 - val_acc: 0.7552
Epoch 469/1000
576/576 [==============================] - 0s 71us/step - loss: 0.4306 - acc: 0.7951 - val_loss: 0.5099 - val_acc: 0.7552
Epoch 470/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4306 - acc: 0.7951 - val_loss: 0.5099 - val_acc: 0.7552
Epoch 471/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4306 - acc: 0.7951 - val_loss: 0.5099 - val_acc: 0.7552
Epoch 472/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4305 - acc: 0.7951 - val_loss: 0.5099 - val_acc: 0.7552
Epoch 473/1000
576/576 [==============================] - 0s 73us/step - loss: 0.4305 - acc: 0.7951 - val_loss: 0.5099 - val_acc: 0.7552
Epoch 474/1000
576/576 [==============================] - 0s 69us/step - loss: 0.4305 - acc: 0.7951 - val_loss: 0.5099 - val_acc: 0.7552
Epoch 475/1000
576/576 [==============================] - 0s 71us/step - loss: 0.4304 - acc: 0.7951 - val_loss: 0.5099 - val_acc: 0.7552
Epoch 476/1000
576/576 [==============================] - 0s 73us/step - loss: 0.4304 - acc: 0.7951 - val_loss: 0.5099 - val_acc: 0.7552
Epoch 477/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4303 - acc: 0.7934 - val_loss: 0.5099 - val_acc: 0.7552
Epoch 478/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4303 - acc: 0.7951 - val_loss: 0.5099 - val_acc: 0.7552
Epoch 479/1000
576/576 [==============================] - 0s 69us/step - loss: 0.4303 - acc: 0.7951 - val_loss: 0.5099 - val_acc: 0.7552
Epoch 480/1000
576/576 [==============================] - 0s 69us/step - loss: 0.4302 - acc: 0.7951 - val_loss: 0.5099 - val_acc: 0.7552
Epoch 481/1000
576/576 [==============================] - 0s 73us/step - loss: 0.4302 - acc: 0.7951 - val_loss: 0.5099 - val_acc: 0.7552
Epoch 482/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4302 - acc: 0.7951 - val_loss: 0.5099 - val_acc: 0.7552
Epoch 483/1000
576/576 [==============================] - 0s 73us/step - loss: 0.4301 - acc: 0.7934 - val_loss: 0.5100 - val_acc: 0.7552
Epoch 484/1000
576/576 [==============================] - 0s 73us/step - loss: 0.4300 - acc: 0.7934 - val_loss: 0.5100 - val_acc: 0.7552
Epoch 485/1000
576/576 [==============================] - 0s 94us/step - loss: 0.4300 - acc: 0.7934 - val_loss: 0.5100 - val_acc: 0.7552
Epoch 486/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4300 - acc: 0.7934 - val_loss: 0.5100 - val_acc: 0.7552
Epoch 487/1000
576/576 [==============================] - 0s 87us/step - loss: 0.4300 - acc: 0.7934 - val_loss: 0.5100 - val_acc: 0.7552
Epoch 488/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4299 - acc: 0.7934 - val_loss: 0.5100 - val_acc: 0.7552
Epoch 489/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4299 - acc: 0.7934 - val_loss: 0.5100 - val_acc: 0.7552
Epoch 490/1000
576/576 [==============================] - 0s 78us/step - loss: 0.4298 - acc: 0.7934 - val_loss: 0.5100 - val_acc: 0.7552
Epoch 491/1000
576/576 [==============================] - 0s 85us/step - loss: 0.4298 - acc: 0.7899 - val_loss: 0.5100 - val_acc: 0.7552
Epoch 492/1000
576/576 [==============================] - 0s 88us/step - loss: 0.4298 - acc: 0.7934 - val_loss: 0.5100 - val_acc: 0.7552
Epoch 493/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4297 - acc: 0.7917 - val_loss: 0.5100 - val_acc: 0.7552
Epoch 494/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4297 - acc: 0.7917 - val_loss: 0.5100 - val_acc: 0.7552
Epoch 495/1000
576/576 [==============================] - 0s 71us/step - loss: 0.4296 - acc: 0.7934 - val_loss: 0.5101 - val_acc: 0.7552
Epoch 496/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4296 - acc: 0.7917 - val_loss: 0.5101 - val_acc: 0.7552
Epoch 497/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4296 - acc: 0.7917 - val_loss: 0.5101 - val_acc: 0.7552
Epoch 498/1000
576/576 [==============================] - 0s 78us/step - loss: 0.4295 - acc: 0.7917 - val_loss: 0.5101 - val_acc: 0.7552
Epoch 499/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4295 - acc: 0.7917 - val_loss: 0.5101 - val_acc: 0.7552
Epoch 500/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4294 - acc: 0.7917 - val_loss: 0.5101 - val_acc: 0.7552
Epoch 501/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4294 - acc: 0.7917 - val_loss: 0.5101 - val_acc: 0.7552
Epoch 502/1000
576/576 [==============================] - 0s 73us/step - loss: 0.4293 - acc: 0.7899 - val_loss: 0.5101 - val_acc: 0.7552
Epoch 503/1000
576/576 [==============================] - 0s 85us/step - loss: 0.4293 - acc: 0.7917 - val_loss: 0.5101 - val_acc: 0.7552
Epoch 504/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4293 - acc: 0.7917 - val_loss: 0.5102 - val_acc: 0.7552
Epoch 505/1000
576/576 [==============================] - 0s 71us/step - loss: 0.4293 - acc: 0.7917 - val_loss: 0.5102 - val_acc: 0.7552
Epoch 506/1000
576/576 [==============================] - 0s 87us/step - loss: 0.4292 - acc: 0.7917 - val_loss: 0.5102 - val_acc: 0.7552
Epoch 507/1000
576/576 [==============================] - 0s 73us/step - loss: 0.4292 - acc: 0.7934 - val_loss: 0.5102 - val_acc: 0.7552
Epoch 508/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4291 - acc: 0.7917 - val_loss: 0.5102 - val_acc: 0.7552
Epoch 509/1000
576/576 [==============================] - 0s 73us/step - loss: 0.4291 - acc: 0.7934 - val_loss: 0.5102 - val_acc: 0.7552
Epoch 510/1000
576/576 [==============================] - 0s 69us/step - loss: 0.4291 - acc: 0.7917 - val_loss: 0.5102 - val_acc: 0.7552
Epoch 511/1000
576/576 [==============================] - 0s 78us/step - loss: 0.4290 - acc: 0.7934 - val_loss: 0.5103 - val_acc: 0.7552
Epoch 512/1000
576/576 [==============================] - 0s 85us/step - loss: 0.4290 - acc: 0.7934 - val_loss: 0.5103 - val_acc: 0.7552
Epoch 513/1000
576/576 [==============================] - 0s 83us/step - loss: 0.4289 - acc: 0.7917 - val_loss: 0.5103 - val_acc: 0.7552
Epoch 514/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4289 - acc: 0.7934 - val_loss: 0.5103 - val_acc: 0.7552
Epoch 515/1000
576/576 [==============================] - 0s 68us/step - loss: 0.4289 - acc: 0.7917 - val_loss: 0.5103 - val_acc: 0.7552
Epoch 516/1000
576/576 [==============================] - 0s 71us/step - loss: 0.4288 - acc: 0.7934 - val_loss: 0.5103 - val_acc: 0.7552
Epoch 517/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4288 - acc: 0.7917 - val_loss: 0.5103 - val_acc: 0.7552
Epoch 518/1000
576/576 [==============================] - 0s 88us/step - loss: 0.4288 - acc: 0.7934 - val_loss: 0.5104 - val_acc: 0.7552
Epoch 519/1000
576/576 [==============================] - 0s 83us/step - loss: 0.4287 - acc: 0.7934 - val_loss: 0.5104 - val_acc: 0.7552
Epoch 520/1000
576/576 [==============================] - 0s 73us/step - loss: 0.4287 - acc: 0.7917 - val_loss: 0.5104 - val_acc: 0.7552
Epoch 521/1000
576/576 [==============================] - 0s 69us/step - loss: 0.4286 - acc: 0.7917 - val_loss: 0.5104 - val_acc: 0.7552
Epoch 522/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4286 - acc: 0.7917 - val_loss: 0.5104 - val_acc: 0.7552
Epoch 523/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4286 - acc: 0.7934 - val_loss: 0.5104 - val_acc: 0.7552
Epoch 524/1000
576/576 [==============================] - 0s 71us/step - loss: 0.4285 - acc: 0.7917 - val_loss: 0.5104 - val_acc: 0.7552
Epoch 525/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4285 - acc: 0.7934 - val_loss: 0.5104 - val_acc: 0.7552
Epoch 526/1000
576/576 [==============================] - 0s 73us/step - loss: 0.4284 - acc: 0.7934 - val_loss: 0.5105 - val_acc: 0.7552
Epoch 527/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4284 - acc: 0.7917 - val_loss: 0.5105 - val_acc: 0.7552
Epoch 528/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4284 - acc: 0.7917 - val_loss: 0.5105 - val_acc: 0.7552
Epoch 529/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4283 - acc: 0.7934 - val_loss: 0.5105 - val_acc: 0.7552
Epoch 530/1000
576/576 [==============================] - 0s 71us/step - loss: 0.4283 - acc: 0.7917 - val_loss: 0.5105 - val_acc: 0.7552
Epoch 531/1000
576/576 [==============================] - 0s 71us/step - loss: 0.4283 - acc: 0.7917 - val_loss: 0.5105 - val_acc: 0.7552
Epoch 532/1000
576/576 [==============================] - 0s 73us/step - loss: 0.4282 - acc: 0.7917 - val_loss: 0.5105 - val_acc: 0.7552
Epoch 533/1000
576/576 [==============================] - 0s 68us/step - loss: 0.4282 - acc: 0.7934 - val_loss: 0.5106 - val_acc: 0.7552
Epoch 534/1000
576/576 [==============================] - 0s 69us/step - loss: 0.4282 - acc: 0.7934 - val_loss: 0.5106 - val_acc: 0.7552
Epoch 535/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4281 - acc: 0.7917 - val_loss: 0.5106 - val_acc: 0.7552
Epoch 536/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4281 - acc: 0.7934 - val_loss: 0.5106 - val_acc: 0.7552
Epoch 537/1000
576/576 [==============================] - 0s 71us/step - loss: 0.4280 - acc: 0.7934 - val_loss: 0.5106 - val_acc: 0.7552
Epoch 538/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4280 - acc: 0.7917 - val_loss: 0.5106 - val_acc: 0.7552
Epoch 539/1000
576/576 [==============================] - 0s 78us/step - loss: 0.4280 - acc: 0.7917 - val_loss: 0.5106 - val_acc: 0.7552
Epoch 540/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4279 - acc: 0.7917 - val_loss: 0.5106 - val_acc: 0.7552
Epoch 541/1000
576/576 [==============================] - 0s 90us/step - loss: 0.4279 - acc: 0.7917 - val_loss: 0.5106 - val_acc: 0.7552
Epoch 542/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4278 - acc: 0.7934 - val_loss: 0.5106 - val_acc: 0.7552
Epoch 543/1000
576/576 [==============================] - 0s 68us/step - loss: 0.4278 - acc: 0.7934 - val_loss: 0.5107 - val_acc: 0.7552
Epoch 544/1000
576/576 [==============================] - 0s 83us/step - loss: 0.4278 - acc: 0.7917 - val_loss: 0.5107 - val_acc: 0.7552
Epoch 545/1000
576/576 [==============================] - 0s 85us/step - loss: 0.4277 - acc: 0.7917 - val_loss: 0.5107 - val_acc: 0.7552
Epoch 546/1000
576/576 [==============================] - 0s 88us/step - loss: 0.4277 - acc: 0.7934 - val_loss: 0.5107 - val_acc: 0.7552
Epoch 547/1000
576/576 [==============================] - 0s 90us/step - loss: 0.4276 - acc: 0.7934 - val_loss: 0.5107 - val_acc: 0.7552
Epoch 548/1000
576/576 [==============================] - 0s 94us/step - loss: 0.4276 - acc: 0.7934 - val_loss: 0.5107 - val_acc: 0.7552
Epoch 549/1000
576/576 [==============================] - 0s 87us/step - loss: 0.4275 - acc: 0.7917 - val_loss: 0.5107 - val_acc: 0.7552
Epoch 550/1000
576/576 [==============================] - 0s 90us/step - loss: 0.4275 - acc: 0.7917 - val_loss: 0.5107 - val_acc: 0.7552
Epoch 551/1000
576/576 [==============================] - 0s 83us/step - loss: 0.4275 - acc: 0.7917 - val_loss: 0.5107 - val_acc: 0.7552
Epoch 552/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4274 - acc: 0.7934 - val_loss: 0.5107 - val_acc: 0.7552
Epoch 553/1000
576/576 [==============================] - 0s 73us/step - loss: 0.4274 - acc: 0.7917 - val_loss: 0.5107 - val_acc: 0.7552
Epoch 554/1000
576/576 [==============================] - 0s 78us/step - loss: 0.4274 - acc: 0.7899 - val_loss: 0.5107 - val_acc: 0.7552
Epoch 555/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4273 - acc: 0.7899 - val_loss: 0.5107 - val_acc: 0.7552
Epoch 556/1000
576/576 [==============================] - 0s 88us/step - loss: 0.4273 - acc: 0.7899 - val_loss: 0.5107 - val_acc: 0.7552
Epoch 557/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4272 - acc: 0.7917 - val_loss: 0.5107 - val_acc: 0.7552
Epoch 558/1000
576/576 [==============================] - 0s 78us/step - loss: 0.4272 - acc: 0.7917 - val_loss: 0.5107 - val_acc: 0.7552
Epoch 559/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4272 - acc: 0.7899 - val_loss: 0.5107 - val_acc: 0.7552
Epoch 560/1000
576/576 [==============================] - 0s 69us/step - loss: 0.4271 - acc: 0.7899 - val_loss: 0.5107 - val_acc: 0.7552
Epoch 561/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4271 - acc: 0.7917 - val_loss: 0.5107 - val_acc: 0.7500
Epoch 562/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4271 - acc: 0.7899 - val_loss: 0.5107 - val_acc: 0.7500
Epoch 563/1000
576/576 [==============================] - 0s 73us/step - loss: 0.4270 - acc: 0.7882 - val_loss: 0.5107 - val_acc: 0.7500
Epoch 564/1000
576/576 [==============================] - 0s 71us/step - loss: 0.4270 - acc: 0.7899 - val_loss: 0.5108 - val_acc: 0.7500
Epoch 565/1000
576/576 [==============================] - 0s 78us/step - loss: 0.4269 - acc: 0.7899 - val_loss: 0.5108 - val_acc: 0.7500
Epoch 566/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4269 - acc: 0.7882 - val_loss: 0.5108 - val_acc: 0.7500
Epoch 567/1000
576/576 [==============================] - 0s 66us/step - loss: 0.4269 - acc: 0.7882 - val_loss: 0.5108 - val_acc: 0.7500
Epoch 568/1000
576/576 [==============================] - 0s 83us/step - loss: 0.4268 - acc: 0.7899 - val_loss: 0.5108 - val_acc: 0.7500
Epoch 569/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4268 - acc: 0.7899 - val_loss: 0.5108 - val_acc: 0.7500
Epoch 570/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4268 - acc: 0.7917 - val_loss: 0.5108 - val_acc: 0.7500
Epoch 571/1000
576/576 [==============================] - 0s 71us/step - loss: 0.4267 - acc: 0.7917 - val_loss: 0.5108 - val_acc: 0.7500
Epoch 572/1000
576/576 [==============================] - 0s 73us/step - loss: 0.4266 - acc: 0.7899 - val_loss: 0.5108 - val_acc: 0.7500
Epoch 573/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4266 - acc: 0.7899 - val_loss: 0.5108 - val_acc: 0.7500
Epoch 574/1000
576/576 [==============================] - 0s 106us/step - loss: 0.4266 - acc: 0.7917 - val_loss: 0.5108 - val_acc: 0.7500
Epoch 575/1000
576/576 [==============================] - 0s 87us/step - loss: 0.4266 - acc: 0.7899 - val_loss: 0.5108 - val_acc: 0.7500
Epoch 576/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4265 - acc: 0.7917 - val_loss: 0.5108 - val_acc: 0.7500
Epoch 577/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4265 - acc: 0.7899 - val_loss: 0.5108 - val_acc: 0.7500
Epoch 578/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4264 - acc: 0.7899 - val_loss: 0.5108 - val_acc: 0.7500
Epoch 579/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4264 - acc: 0.7917 - val_loss: 0.5108 - val_acc: 0.7500
Epoch 580/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4263 - acc: 0.7917 - val_loss: 0.5108 - val_acc: 0.7500
Epoch 581/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4263 - acc: 0.7917 - val_loss: 0.5108 - val_acc: 0.7500
Epoch 582/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4263 - acc: 0.7917 - val_loss: 0.5108 - val_acc: 0.7500
Epoch 583/1000
576/576 [==============================] - 0s 87us/step - loss: 0.4262 - acc: 0.7917 - val_loss: 0.5108 - val_acc: 0.7500
Epoch 584/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4262 - acc: 0.7917 - val_loss: 0.5108 - val_acc: 0.7500
Epoch 585/1000
576/576 [==============================] - 0s 85us/step - loss: 0.4262 - acc: 0.7917 - val_loss: 0.5109 - val_acc: 0.7500
Epoch 586/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4262 - acc: 0.7917 - val_loss: 0.5109 - val_acc: 0.7500
Epoch 587/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4261 - acc: 0.7917 - val_loss: 0.5109 - val_acc: 0.7500
Epoch 588/1000
576/576 [==============================] - 0s 78us/step - loss: 0.4260 - acc: 0.7917 - val_loss: 0.5109 - val_acc: 0.7500
Epoch 589/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4260 - acc: 0.7917 - val_loss: 0.5109 - val_acc: 0.7500
Epoch 590/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4260 - acc: 0.7917 - val_loss: 0.5109 - val_acc: 0.7500
Epoch 591/1000
576/576 [==============================] - 0s 87us/step - loss: 0.4260 - acc: 0.7917 - val_loss: 0.5109 - val_acc: 0.7500
Epoch 592/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4259 - acc: 0.7917 - val_loss: 0.5109 - val_acc: 0.7500
Epoch 593/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4259 - acc: 0.7917 - val_loss: 0.5109 - val_acc: 0.7500
Epoch 594/1000
576/576 [==============================] - 0s 78us/step - loss: 0.4258 - acc: 0.7917 - val_loss: 0.5109 - val_acc: 0.7500
Epoch 595/1000
576/576 [==============================] - 0s 94us/step - loss: 0.4258 - acc: 0.7917 - val_loss: 0.5109 - val_acc: 0.7500
Epoch 596/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4258 - acc: 0.7917 - val_loss: 0.5109 - val_acc: 0.7500
Epoch 597/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4257 - acc: 0.7917 - val_loss: 0.5109 - val_acc: 0.7500
Epoch 598/1000
576/576 [==============================] - 0s 85us/step - loss: 0.4257 - acc: 0.7917 - val_loss: 0.5109 - val_acc: 0.7500
Epoch 599/1000
576/576 [==============================] - 0s 73us/step - loss: 0.4256 - acc: 0.7917 - val_loss: 0.5109 - val_acc: 0.7500
Epoch 600/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4256 - acc: 0.7917 - val_loss: 0.5109 - val_acc: 0.7500
Epoch 601/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4255 - acc: 0.7917 - val_loss: 0.5109 - val_acc: 0.7500
Epoch 602/1000
576/576 [==============================] - 0s 85us/step - loss: 0.4256 - acc: 0.7917 - val_loss: 0.5109 - val_acc: 0.7500
Epoch 603/1000
576/576 [==============================] - 0s 83us/step - loss: 0.4255 - acc: 0.7917 - val_loss: 0.5110 - val_acc: 0.7500
Epoch 604/1000
576/576 [==============================] - 0s 92us/step - loss: 0.4255 - acc: 0.7917 - val_loss: 0.5110 - val_acc: 0.7500
Epoch 605/1000
576/576 [==============================] - 0s 95us/step - loss: 0.4254 - acc: 0.7917 - val_loss: 0.5110 - val_acc: 0.7500
Epoch 606/1000
576/576 [==============================] - 0s 87us/step - loss: 0.4254 - acc: 0.7917 - val_loss: 0.5110 - val_acc: 0.7500
Epoch 607/1000
576/576 [==============================] - 0s 90us/step - loss: 0.4254 - acc: 0.7917 - val_loss: 0.5110 - val_acc: 0.7500
Epoch 608/1000
576/576 [==============================] - 0s 95us/step - loss: 0.4253 - acc: 0.7917 - val_loss: 0.5110 - val_acc: 0.7500
Epoch 609/1000
576/576 [==============================] - 0s 101us/step - loss: 0.4253 - acc: 0.7917 - val_loss: 0.5110 - val_acc: 0.7500
Epoch 610/1000
576/576 [==============================] - 0s 85us/step - loss: 0.4252 - acc: 0.7917 - val_loss: 0.5110 - val_acc: 0.7500
Epoch 611/1000
576/576 [==============================] - 0s 85us/step - loss: 0.4252 - acc: 0.7917 - val_loss: 0.5110 - val_acc: 0.7500
Epoch 612/1000
576/576 [==============================] - 0s 132us/step - loss: 0.4252 - acc: 0.7917 - val_loss: 0.5110 - val_acc: 0.7500
Epoch 613/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4251 - acc: 0.7917 - val_loss: 0.5111 - val_acc: 0.7500
Epoch 614/1000
576/576 [==============================] - 0s 85us/step - loss: 0.4251 - acc: 0.7917 - val_loss: 0.5111 - val_acc: 0.7500
Epoch 615/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4251 - acc: 0.7917 - val_loss: 0.5111 - val_acc: 0.7500
Epoch 616/1000
576/576 [==============================] - 0s 92us/step - loss: 0.4250 - acc: 0.7917 - val_loss: 0.5111 - val_acc: 0.7500
Epoch 617/1000
576/576 [==============================] - 0s 88us/step - loss: 0.4250 - acc: 0.7917 - val_loss: 0.5111 - val_acc: 0.7500
Epoch 618/1000
576/576 [==============================] - 0s 87us/step - loss: 0.4250 - acc: 0.7917 - val_loss: 0.5111 - val_acc: 0.7500
Epoch 619/1000
576/576 [==============================] - 0s 85us/step - loss: 0.4249 - acc: 0.7917 - val_loss: 0.5111 - val_acc: 0.7500
Epoch 620/1000
576/576 [==============================] - 0s 88us/step - loss: 0.4249 - acc: 0.7917 - val_loss: 0.5111 - val_acc: 0.7500
Epoch 621/1000
576/576 [==============================] - 0s 87us/step - loss: 0.4248 - acc: 0.7917 - val_loss: 0.5111 - val_acc: 0.7500
Epoch 622/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4248 - acc: 0.7917 - val_loss: 0.5111 - val_acc: 0.7500
Epoch 623/1000
576/576 [==============================] - 0s 78us/step - loss: 0.4248 - acc: 0.7917 - val_loss: 0.5111 - val_acc: 0.7500
Epoch 624/1000
576/576 [==============================] - 0s 83us/step - loss: 0.4247 - acc: 0.7917 - val_loss: 0.5111 - val_acc: 0.7500
Epoch 625/1000
576/576 [==============================] - 0s 92us/step - loss: 0.4247 - acc: 0.7917 - val_loss: 0.5111 - val_acc: 0.7500
Epoch 626/1000
576/576 [==============================] - 0s 78us/step - loss: 0.4247 - acc: 0.7917 - val_loss: 0.5111 - val_acc: 0.7500
Epoch 627/1000
576/576 [==============================] - 0s 78us/step - loss: 0.4246 - acc: 0.7917 - val_loss: 0.5111 - val_acc: 0.7500
Epoch 628/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4246 - acc: 0.7917 - val_loss: 0.5111 - val_acc: 0.7500
Epoch 629/1000
576/576 [==============================] - 0s 88us/step - loss: 0.4246 - acc: 0.7917 - val_loss: 0.5112 - val_acc: 0.7500
Epoch 630/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4245 - acc: 0.7917 - val_loss: 0.5112 - val_acc: 0.7500
Epoch 631/1000
576/576 [==============================] - 0s 85us/step - loss: 0.4245 - acc: 0.7917 - val_loss: 0.5112 - val_acc: 0.7552
Epoch 632/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4245 - acc: 0.7917 - val_loss: 0.5112 - val_acc: 0.7552
Epoch 633/1000
576/576 [==============================] - 0s 85us/step - loss: 0.4244 - acc: 0.7917 - val_loss: 0.5112 - val_acc: 0.7552
Epoch 634/1000
576/576 [==============================] - 0s 85us/step - loss: 0.4244 - acc: 0.7917 - val_loss: 0.5112 - val_acc: 0.7552
Epoch 635/1000
576/576 [==============================] - 0s 97us/step - loss: 0.4243 - acc: 0.7917 - val_loss: 0.5112 - val_acc: 0.7552
Epoch 636/1000
576/576 [==============================] - 0s 83us/step - loss: 0.4243 - acc: 0.7917 - val_loss: 0.5112 - val_acc: 0.7552
Epoch 637/1000
576/576 [==============================] - 0s 85us/step - loss: 0.4243 - acc: 0.7899 - val_loss: 0.5112 - val_acc: 0.7552
Epoch 638/1000
576/576 [==============================] - 0s 85us/step - loss: 0.4243 - acc: 0.7917 - val_loss: 0.5112 - val_acc: 0.7552
Epoch 639/1000
576/576 [==============================] - 0s 87us/step - loss: 0.4242 - acc: 0.7917 - val_loss: 0.5112 - val_acc: 0.7552
Epoch 640/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4242 - acc: 0.7917 - val_loss: 0.5112 - val_acc: 0.7552
Epoch 641/1000
576/576 [==============================] - 0s 85us/step - loss: 0.4241 - acc: 0.7917 - val_loss: 0.5112 - val_acc: 0.7552
Epoch 642/1000
576/576 [==============================] - 0s 95us/step - loss: 0.4241 - acc: 0.7917 - val_loss: 0.5113 - val_acc: 0.7552
Epoch 643/1000
576/576 [==============================] - 0s 78us/step - loss: 0.4241 - acc: 0.7917 - val_loss: 0.5113 - val_acc: 0.7552
Epoch 644/1000
576/576 [==============================] - 0s 85us/step - loss: 0.4241 - acc: 0.7917 - val_loss: 0.5113 - val_acc: 0.7552
Epoch 645/1000
576/576 [==============================] - 0s 78us/step - loss: 0.4240 - acc: 0.7917 - val_loss: 0.5113 - val_acc: 0.7552
Epoch 646/1000
576/576 [==============================] - 0s 83us/step - loss: 0.4240 - acc: 0.7917 - val_loss: 0.5113 - val_acc: 0.7552
Epoch 647/1000
576/576 [==============================] - 0s 78us/step - loss: 0.4239 - acc: 0.7917 - val_loss: 0.5113 - val_acc: 0.7552
Epoch 648/1000
576/576 [==============================] - 0s 88us/step - loss: 0.4239 - acc: 0.7917 - val_loss: 0.5113 - val_acc: 0.7552
Epoch 649/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4239 - acc: 0.7917 - val_loss: 0.5113 - val_acc: 0.7500
Epoch 650/1000
576/576 [==============================] - 0s 87us/step - loss: 0.4239 - acc: 0.7917 - val_loss: 0.5113 - val_acc: 0.7500
Epoch 651/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4238 - acc: 0.7917 - val_loss: 0.5113 - val_acc: 0.7500
Epoch 652/1000
576/576 [==============================] - 0s 83us/step - loss: 0.4238 - acc: 0.7917 - val_loss: 0.5113 - val_acc: 0.7500
Epoch 653/1000
576/576 [==============================] - 0s 83us/step - loss: 0.4238 - acc: 0.7917 - val_loss: 0.5113 - val_acc: 0.7500
Epoch 654/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4238 - acc: 0.7899 - val_loss: 0.5113 - val_acc: 0.7500
Epoch 655/1000
576/576 [==============================] - 0s 87us/step - loss: 0.4236 - acc: 0.7917 - val_loss: 0.5113 - val_acc: 0.7500
Epoch 656/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4236 - acc: 0.7917 - val_loss: 0.5114 - val_acc: 0.7500
Epoch 657/1000
576/576 [==============================] - 0s 78us/step - loss: 0.4236 - acc: 0.7934 - val_loss: 0.5114 - val_acc: 0.7500
Epoch 658/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4236 - acc: 0.7917 - val_loss: 0.5114 - val_acc: 0.7500
Epoch 659/1000
576/576 [==============================] - 0s 92us/step - loss: 0.4235 - acc: 0.7917 - val_loss: 0.5114 - val_acc: 0.7500
Epoch 660/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4235 - acc: 0.7934 - val_loss: 0.5114 - val_acc: 0.7500
Epoch 661/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4235 - acc: 0.7917 - val_loss: 0.5114 - val_acc: 0.7500
Epoch 662/1000
576/576 [==============================] - 0s 85us/step - loss: 0.4235 - acc: 0.7934 - val_loss: 0.5114 - val_acc: 0.7500
Epoch 663/1000
576/576 [==============================] - 0s 92us/step - loss: 0.4234 - acc: 0.7934 - val_loss: 0.5114 - val_acc: 0.7500
Epoch 664/1000
576/576 [==============================] - 0s 94us/step - loss: 0.4234 - acc: 0.7917 - val_loss: 0.5114 - val_acc: 0.7500
Epoch 665/1000
576/576 [==============================] - 0s 95us/step - loss: 0.4233 - acc: 0.7917 - val_loss: 0.5114 - val_acc: 0.7500
Epoch 666/1000
576/576 [==============================] - 0s 95us/step - loss: 0.4233 - acc: 0.7934 - val_loss: 0.5114 - val_acc: 0.7500
Epoch 667/1000
576/576 [==============================] - 0s 92us/step - loss: 0.4233 - acc: 0.7934 - val_loss: 0.5114 - val_acc: 0.7500
Epoch 668/1000
576/576 [==============================] - 0s 90us/step - loss: 0.4232 - acc: 0.7934 - val_loss: 0.5114 - val_acc: 0.7500
Epoch 669/1000
576/576 [==============================] - 0s 83us/step - loss: 0.4232 - acc: 0.7917 - val_loss: 0.5114 - val_acc: 0.7500
Epoch 670/1000
576/576 [==============================] - 0s 78us/step - loss: 0.4232 - acc: 0.7917 - val_loss: 0.5114 - val_acc: 0.7500
Epoch 671/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4231 - acc: 0.7934 - val_loss: 0.5114 - val_acc: 0.7500
Epoch 672/1000
576/576 [==============================] - 0s 78us/step - loss: 0.4231 - acc: 0.7934 - val_loss: 0.5115 - val_acc: 0.7500
Epoch 673/1000
576/576 [==============================] - 0s 83us/step - loss: 0.4230 - acc: 0.7917 - val_loss: 0.5115 - val_acc: 0.7500
Epoch 674/1000
576/576 [==============================] - 0s 83us/step - loss: 0.4230 - acc: 0.7934 - val_loss: 0.5115 - val_acc: 0.7500
Epoch 675/1000
576/576 [==============================] - 0s 90us/step - loss: 0.4230 - acc: 0.7917 - val_loss: 0.5115 - val_acc: 0.7500
Epoch 676/1000
576/576 [==============================] - 0s 78us/step - loss: 0.4230 - acc: 0.7934 - val_loss: 0.5115 - val_acc: 0.7500
Epoch 677/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4229 - acc: 0.7934 - val_loss: 0.5115 - val_acc: 0.7500
Epoch 678/1000
576/576 [==============================] - 0s 71us/step - loss: 0.4229 - acc: 0.7934 - val_loss: 0.5115 - val_acc: 0.7500
Epoch 679/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4229 - acc: 0.7934 - val_loss: 0.5115 - val_acc: 0.7500
Epoch 680/1000
576/576 [==============================] - 0s 71us/step - loss: 0.4228 - acc: 0.7934 - val_loss: 0.5115 - val_acc: 0.7500
Epoch 681/1000
576/576 [==============================] - 0s 83us/step - loss: 0.4228 - acc: 0.7934 - val_loss: 0.5115 - val_acc: 0.7500
Epoch 682/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4228 - acc: 0.7934 - val_loss: 0.5115 - val_acc: 0.7500
Epoch 683/1000
576/576 [==============================] - 0s 95us/step - loss: 0.4227 - acc: 0.7934 - val_loss: 0.5116 - val_acc: 0.7500
Epoch 684/1000
576/576 [==============================] - 0s 71us/step - loss: 0.4227 - acc: 0.7934 - val_loss: 0.5116 - val_acc: 0.7500
Epoch 685/1000
576/576 [==============================] - 0s 71us/step - loss: 0.4227 - acc: 0.7934 - val_loss: 0.5116 - val_acc: 0.7500
Epoch 686/1000
576/576 [==============================] - 0s 66us/step - loss: 0.4226 - acc: 0.7934 - val_loss: 0.5116 - val_acc: 0.7500
Epoch 687/1000
576/576 [==============================] - 0s 68us/step - loss: 0.4226 - acc: 0.7934 - val_loss: 0.5116 - val_acc: 0.7500
Epoch 688/1000
576/576 [==============================] - 0s 71us/step - loss: 0.4226 - acc: 0.7934 - val_loss: 0.5116 - val_acc: 0.7500
Epoch 689/1000
576/576 [==============================] - 0s 71us/step - loss: 0.4225 - acc: 0.7934 - val_loss: 0.5117 - val_acc: 0.7500
Epoch 690/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4226 - acc: 0.7934 - val_loss: 0.5117 - val_acc: 0.7500
Epoch 691/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4225 - acc: 0.7934 - val_loss: 0.5117 - val_acc: 0.7500
Epoch 692/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4225 - acc: 0.7934 - val_loss: 0.5117 - val_acc: 0.7500
Epoch 693/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4224 - acc: 0.7934 - val_loss: 0.5117 - val_acc: 0.7500
Epoch 694/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4224 - acc: 0.7934 - val_loss: 0.5117 - val_acc: 0.7500
Epoch 695/1000
576/576 [==============================] - 0s 83us/step - loss: 0.4224 - acc: 0.7917 - val_loss: 0.5117 - val_acc: 0.7500
Epoch 696/1000
576/576 [==============================] - 0s 73us/step - loss: 0.4224 - acc: 0.7917 - val_loss: 0.5118 - val_acc: 0.7500
Epoch 697/1000
576/576 [==============================] - 0s 69us/step - loss: 0.4223 - acc: 0.7917 - val_loss: 0.5118 - val_acc: 0.7500
Epoch 698/1000
576/576 [==============================] - 0s 78us/step - loss: 0.4223 - acc: 0.7917 - val_loss: 0.5118 - val_acc: 0.7500
Epoch 699/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4223 - acc: 0.7917 - val_loss: 0.5118 - val_acc: 0.7500
Epoch 700/1000
576/576 [==============================] - 0s 66us/step - loss: 0.4222 - acc: 0.7917 - val_loss: 0.5118 - val_acc: 0.7500
Epoch 701/1000
576/576 [==============================] - 0s 83us/step - loss: 0.4222 - acc: 0.7917 - val_loss: 0.5118 - val_acc: 0.7500
Epoch 702/1000
576/576 [==============================] - 0s 83us/step - loss: 0.4222 - acc: 0.7917 - val_loss: 0.5118 - val_acc: 0.7500
Epoch 703/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4221 - acc: 0.7917 - val_loss: 0.5118 - val_acc: 0.7500
Epoch 704/1000
576/576 [==============================] - 0s 71us/step - loss: 0.4221 - acc: 0.7917 - val_loss: 0.5119 - val_acc: 0.7500
Epoch 705/1000
576/576 [==============================] - 0s 88us/step - loss: 0.4221 - acc: 0.7917 - val_loss: 0.5119 - val_acc: 0.7500
Epoch 706/1000
576/576 [==============================] - 0s 90us/step - loss: 0.4220 - acc: 0.7917 - val_loss: 0.5119 - val_acc: 0.7500
Epoch 707/1000
576/576 [==============================] - 0s 73us/step - loss: 0.4220 - acc: 0.7917 - val_loss: 0.5119 - val_acc: 0.7500
Epoch 708/1000
576/576 [==============================] - 0s 69us/step - loss: 0.4220 - acc: 0.7917 - val_loss: 0.5119 - val_acc: 0.7500
Epoch 709/1000
576/576 [==============================] - 0s 69us/step - loss: 0.4219 - acc: 0.7917 - val_loss: 0.5119 - val_acc: 0.7500
Epoch 710/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4219 - acc: 0.7917 - val_loss: 0.5119 - val_acc: 0.7500
Epoch 711/1000
576/576 [==============================] - 0s 78us/step - loss: 0.4219 - acc: 0.7917 - val_loss: 0.5120 - val_acc: 0.7500
Epoch 712/1000
576/576 [==============================] - 0s 73us/step - loss: 0.4218 - acc: 0.7917 - val_loss: 0.5120 - val_acc: 0.7500
Epoch 713/1000
576/576 [==============================] - 0s 68us/step - loss: 0.4218 - acc: 0.7917 - val_loss: 0.5120 - val_acc: 0.7500
Epoch 714/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4218 - acc: 0.7917 - val_loss: 0.5120 - val_acc: 0.7500
Epoch 715/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4217 - acc: 0.7917 - val_loss: 0.5120 - val_acc: 0.7500
Epoch 716/1000
576/576 [==============================] - ETA: 0s - loss: 0.3854 - acc: 0.843 - 0s 69us/step - loss: 0.4217 - acc: 0.7917 - val_loss: 0.5120 - val_acc: 0.7500
Epoch 717/1000
576/576 [==============================] - 0s 73us/step - loss: 0.4217 - acc: 0.7917 - val_loss: 0.5121 - val_acc: 0.7500
Epoch 718/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4217 - acc: 0.7917 - val_loss: 0.5121 - val_acc: 0.7500
Epoch 719/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4216 - acc: 0.7917 - val_loss: 0.5121 - val_acc: 0.7500
Epoch 720/1000
576/576 [==============================] - 0s 69us/step - loss: 0.4216 - acc: 0.7917 - val_loss: 0.5121 - val_acc: 0.7500
Epoch 721/1000
576/576 [==============================] - 0s 71us/step - loss: 0.4216 - acc: 0.7917 - val_loss: 0.5121 - val_acc: 0.7500
Epoch 722/1000
576/576 [==============================] - 0s 85us/step - loss: 0.4215 - acc: 0.7917 - val_loss: 0.5121 - val_acc: 0.7500
Epoch 723/1000
576/576 [==============================] - 0s 85us/step - loss: 0.4215 - acc: 0.7917 - val_loss: 0.5121 - val_acc: 0.7500
Epoch 724/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4215 - acc: 0.7917 - val_loss: 0.5121 - val_acc: 0.7500
Epoch 725/1000
576/576 [==============================] - 0s 87us/step - loss: 0.4214 - acc: 0.7917 - val_loss: 0.5122 - val_acc: 0.7500
Epoch 726/1000
576/576 [==============================] - 0s 85us/step - loss: 0.4214 - acc: 0.7917 - val_loss: 0.5122 - val_acc: 0.7500
Epoch 727/1000
576/576 [==============================] - 0s 85us/step - loss: 0.4213 - acc: 0.7917 - val_loss: 0.5122 - val_acc: 0.7500
Epoch 728/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4213 - acc: 0.7917 - val_loss: 0.5122 - val_acc: 0.7500
Epoch 729/1000
576/576 [==============================] - 0s 85us/step - loss: 0.4213 - acc: 0.7917 - val_loss: 0.5122 - val_acc: 0.7500
Epoch 730/1000
576/576 [==============================] - 0s 69us/step - loss: 0.4213 - acc: 0.7917 - val_loss: 0.5122 - val_acc: 0.7500
Epoch 731/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4212 - acc: 0.7917 - val_loss: 0.5123 - val_acc: 0.7500
Epoch 732/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4212 - acc: 0.7917 - val_loss: 0.5123 - val_acc: 0.7500
Epoch 733/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4211 - acc: 0.7917 - val_loss: 0.5123 - val_acc: 0.7500
Epoch 734/1000
576/576 [==============================] - 0s 71us/step - loss: 0.4211 - acc: 0.7917 - val_loss: 0.5123 - val_acc: 0.7500
Epoch 735/1000
576/576 [==============================] - 0s 71us/step - loss: 0.4211 - acc: 0.7917 - val_loss: 0.5123 - val_acc: 0.7500
Epoch 736/1000
576/576 [==============================] - 0s 73us/step - loss: 0.4210 - acc: 0.7917 - val_loss: 0.5123 - val_acc: 0.7500
Epoch 737/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4210 - acc: 0.7899 - val_loss: 0.5123 - val_acc: 0.7500
Epoch 738/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4210 - acc: 0.7917 - val_loss: 0.5123 - val_acc: 0.7500
Epoch 739/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4209 - acc: 0.7917 - val_loss: 0.5124 - val_acc: 0.7500
Epoch 740/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4209 - acc: 0.7899 - val_loss: 0.5124 - val_acc: 0.7500
Epoch 741/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4209 - acc: 0.7899 - val_loss: 0.5124 - val_acc: 0.7500
Epoch 742/1000
576/576 [==============================] - 0s 87us/step - loss: 0.4208 - acc: 0.7917 - val_loss: 0.5124 - val_acc: 0.7500
Epoch 743/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4208 - acc: 0.7917 - val_loss: 0.5124 - val_acc: 0.7500
Epoch 744/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4208 - acc: 0.7917 - val_loss: 0.5124 - val_acc: 0.7500
Epoch 745/1000
576/576 [==============================] - 0s 99us/step - loss: 0.4208 - acc: 0.7917 - val_loss: 0.5124 - val_acc: 0.7500
Epoch 746/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4207 - acc: 0.7899 - val_loss: 0.5125 - val_acc: 0.7500
Epoch 747/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4207 - acc: 0.7917 - val_loss: 0.5125 - val_acc: 0.7500
Epoch 748/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4206 - acc: 0.7917 - val_loss: 0.5125 - val_acc: 0.7500
Epoch 749/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4206 - acc: 0.7917 - val_loss: 0.5125 - val_acc: 0.7500
Epoch 750/1000
576/576 [==============================] - 0s 88us/step - loss: 0.4206 - acc: 0.7899 - val_loss: 0.5125 - val_acc: 0.7500
Epoch 751/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4205 - acc: 0.7917 - val_loss: 0.5125 - val_acc: 0.7500
Epoch 752/1000
576/576 [==============================] - 0s 73us/step - loss: 0.4205 - acc: 0.7899 - val_loss: 0.5125 - val_acc: 0.7500
Epoch 753/1000
576/576 [==============================] - 0s 68us/step - loss: 0.4205 - acc: 0.7899 - val_loss: 0.5125 - val_acc: 0.7500
Epoch 754/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4205 - acc: 0.7917 - val_loss: 0.5126 - val_acc: 0.7500
Epoch 755/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4204 - acc: 0.7899 - val_loss: 0.5126 - val_acc: 0.7500
Epoch 756/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4204 - acc: 0.7917 - val_loss: 0.5126 - val_acc: 0.7500
Epoch 757/1000
576/576 [==============================] - 0s 73us/step - loss: 0.4204 - acc: 0.7899 - val_loss: 0.5126 - val_acc: 0.7500
Epoch 758/1000
576/576 [==============================] - 0s 71us/step - loss: 0.4203 - acc: 0.7899 - val_loss: 0.5126 - val_acc: 0.7500
Epoch 759/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4203 - acc: 0.7917 - val_loss: 0.5126 - val_acc: 0.7500
Epoch 760/1000
576/576 [==============================] - 0s 78us/step - loss: 0.4202 - acc: 0.7899 - val_loss: 0.5126 - val_acc: 0.7500
Epoch 761/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4202 - acc: 0.7899 - val_loss: 0.5127 - val_acc: 0.7500
Epoch 762/1000
576/576 [==============================] - 0s 73us/step - loss: 0.4202 - acc: 0.7934 - val_loss: 0.5127 - val_acc: 0.7500
Epoch 763/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4202 - acc: 0.7899 - val_loss: 0.5127 - val_acc: 0.7500
Epoch 764/1000
576/576 [==============================] - 0s 71us/step - loss: 0.4202 - acc: 0.7882 - val_loss: 0.5127 - val_acc: 0.7500
Epoch 765/1000
576/576 [==============================] - 0s 66us/step - loss: 0.4201 - acc: 0.7899 - val_loss: 0.5127 - val_acc: 0.7448
Epoch 766/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4201 - acc: 0.7899 - val_loss: 0.5127 - val_acc: 0.7448
Epoch 767/1000
576/576 [==============================] - 0s 64us/step - loss: 0.4200 - acc: 0.7899 - val_loss: 0.5127 - val_acc: 0.7448
Epoch 768/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4200 - acc: 0.7917 - val_loss: 0.5128 - val_acc: 0.7448
Epoch 769/1000
576/576 [==============================] - 0s 69us/step - loss: 0.4200 - acc: 0.7934 - val_loss: 0.5128 - val_acc: 0.7448
Epoch 770/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4200 - acc: 0.7899 - val_loss: 0.5128 - val_acc: 0.7448
Epoch 771/1000
576/576 [==============================] - 0s 85us/step - loss: 0.4199 - acc: 0.7899 - val_loss: 0.5128 - val_acc: 0.7448
Epoch 772/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4199 - acc: 0.7917 - val_loss: 0.5128 - val_acc: 0.7448
Epoch 773/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4199 - acc: 0.7917 - val_loss: 0.5128 - val_acc: 0.7448
Epoch 774/1000
576/576 [==============================] - 0s 69us/step - loss: 0.4199 - acc: 0.7899 - val_loss: 0.5128 - val_acc: 0.7448
Epoch 775/1000
576/576 [==============================] - 0s 69us/step - loss: 0.4198 - acc: 0.7899 - val_loss: 0.5129 - val_acc: 0.7448
Epoch 776/1000
576/576 [==============================] - 0s 68us/step - loss: 0.4198 - acc: 0.7917 - val_loss: 0.5129 - val_acc: 0.7448
Epoch 777/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4198 - acc: 0.7899 - val_loss: 0.5129 - val_acc: 0.7448
Epoch 778/1000
576/576 [==============================] - 0s 64us/step - loss: 0.4197 - acc: 0.7917 - val_loss: 0.5129 - val_acc: 0.7448
Epoch 779/1000
576/576 [==============================] - 0s 73us/step - loss: 0.4197 - acc: 0.7899 - val_loss: 0.5129 - val_acc: 0.7448
Epoch 780/1000
576/576 [==============================] - 0s 64us/step - loss: 0.4197 - acc: 0.7899 - val_loss: 0.5129 - val_acc: 0.7448
Epoch 781/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4197 - acc: 0.7899 - val_loss: 0.5129 - val_acc: 0.7448
Epoch 782/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4197 - acc: 0.7917 - val_loss: 0.5130 - val_acc: 0.7448
Epoch 783/1000
576/576 [==============================] - 0s 88us/step - loss: 0.4196 - acc: 0.7899 - val_loss: 0.5130 - val_acc: 0.7448
Epoch 784/1000
576/576 [==============================] - 0s 97us/step - loss: 0.4196 - acc: 0.7899 - val_loss: 0.5130 - val_acc: 0.7448
Epoch 785/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4195 - acc: 0.7899 - val_loss: 0.5130 - val_acc: 0.7448
Epoch 786/1000
576/576 [==============================] - 0s 85us/step - loss: 0.4195 - acc: 0.7899 - val_loss: 0.5130 - val_acc: 0.7448
Epoch 787/1000
576/576 [==============================] - 0s 90us/step - loss: 0.4195 - acc: 0.7899 - val_loss: 0.5130 - val_acc: 0.7448
Epoch 788/1000
576/576 [==============================] - 0s 94us/step - loss: 0.4195 - acc: 0.7899 - val_loss: 0.5130 - val_acc: 0.7448
Epoch 789/1000
576/576 [==============================] - 0s 83us/step - loss: 0.4195 - acc: 0.7899 - val_loss: 0.5130 - val_acc: 0.7448
Epoch 790/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4194 - acc: 0.7899 - val_loss: 0.5130 - val_acc: 0.7448
Epoch 791/1000
576/576 [==============================] - 0s 83us/step - loss: 0.4194 - acc: 0.7899 - val_loss: 0.5130 - val_acc: 0.7448
Epoch 792/1000
576/576 [==============================] - 0s 92us/step - loss: 0.4194 - acc: 0.7899 - val_loss: 0.5131 - val_acc: 0.7448
Epoch 793/1000
576/576 [==============================] - 0s 78us/step - loss: 0.4194 - acc: 0.7899 - val_loss: 0.5131 - val_acc: 0.7448
Epoch 794/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4194 - acc: 0.7899 - val_loss: 0.5131 - val_acc: 0.7448
Epoch 795/1000
576/576 [==============================] - 0s 73us/step - loss: 0.4193 - acc: 0.7899 - val_loss: 0.5131 - val_acc: 0.7448
Epoch 796/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4193 - acc: 0.7899 - val_loss: 0.5131 - val_acc: 0.7448
Epoch 797/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4192 - acc: 0.7899 - val_loss: 0.5131 - val_acc: 0.7448
Epoch 798/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4192 - acc: 0.7899 - val_loss: 0.5131 - val_acc: 0.7448
Epoch 799/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4192 - acc: 0.7899 - val_loss: 0.5131 - val_acc: 0.7448
Epoch 800/1000
576/576 [==============================] - 0s 73us/step - loss: 0.4192 - acc: 0.7899 - val_loss: 0.5132 - val_acc: 0.7448
Epoch 801/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4192 - acc: 0.7899 - val_loss: 0.5132 - val_acc: 0.7448
Epoch 802/1000
576/576 [==============================] - 0s 69us/step - loss: 0.4192 - acc: 0.7917 - val_loss: 0.5132 - val_acc: 0.7448
Epoch 803/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4191 - acc: 0.7899 - val_loss: 0.5132 - val_acc: 0.7448
Epoch 804/1000
576/576 [==============================] - 0s 95us/step - loss: 0.4191 - acc: 0.7917 - val_loss: 0.5132 - val_acc: 0.7448
Epoch 805/1000
576/576 [==============================] - 0s 73us/step - loss: 0.4190 - acc: 0.7899 - val_loss: 0.5132 - val_acc: 0.7500
Epoch 806/1000
576/576 [==============================] - 0s 78us/step - loss: 0.4190 - acc: 0.7899 - val_loss: 0.5132 - val_acc: 0.7500
Epoch 807/1000
576/576 [==============================] - 0s 85us/step - loss: 0.4190 - acc: 0.7899 - val_loss: 0.5132 - val_acc: 0.7500
Epoch 808/1000
576/576 [==============================] - 0s 85us/step - loss: 0.4190 - acc: 0.7899 - val_loss: 0.5132 - val_acc: 0.7500
Epoch 809/1000
576/576 [==============================] - 0s 68us/step - loss: 0.4190 - acc: 0.7899 - val_loss: 0.5132 - val_acc: 0.7500
Epoch 810/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4190 - acc: 0.7899 - val_loss: 0.5132 - val_acc: 0.7500
Epoch 811/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4189 - acc: 0.7899 - val_loss: 0.5133 - val_acc: 0.7500
Epoch 812/1000
576/576 [==============================] - 0s 83us/step - loss: 0.4189 - acc: 0.7899 - val_loss: 0.5133 - val_acc: 0.7500
Epoch 813/1000
576/576 [==============================] - 0s 87us/step - loss: 0.4189 - acc: 0.7899 - val_loss: 0.5133 - val_acc: 0.7500
Epoch 814/1000
576/576 [==============================] - 0s 71us/step - loss: 0.4189 - acc: 0.7899 - val_loss: 0.5133 - val_acc: 0.7500
Epoch 815/1000
576/576 [==============================] - 0s 69us/step - loss: 0.4189 - acc: 0.7899 - val_loss: 0.5133 - val_acc: 0.7500
Epoch 816/1000
576/576 [==============================] - 0s 71us/step - loss: 0.4188 - acc: 0.7899 - val_loss: 0.5133 - val_acc: 0.7500
Epoch 817/1000
576/576 [==============================] - 0s 68us/step - loss: 0.4188 - acc: 0.7899 - val_loss: 0.5133 - val_acc: 0.7500
Epoch 818/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4188 - acc: 0.7899 - val_loss: 0.5133 - val_acc: 0.7500
Epoch 819/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4188 - acc: 0.7899 - val_loss: 0.5133 - val_acc: 0.7500
Epoch 820/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4188 - acc: 0.7899 - val_loss: 0.5133 - val_acc: 0.7500
Epoch 821/1000
576/576 [==============================] - 0s 73us/step - loss: 0.4187 - acc: 0.7899 - val_loss: 0.5133 - val_acc: 0.7500
Epoch 822/1000
576/576 [==============================] - 0s 73us/step - loss: 0.4187 - acc: 0.7882 - val_loss: 0.5133 - val_acc: 0.7500
Epoch 823/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4186 - acc: 0.7882 - val_loss: 0.5133 - val_acc: 0.7500
Epoch 824/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4186 - acc: 0.7899 - val_loss: 0.5134 - val_acc: 0.7500
Epoch 825/1000
576/576 [==============================] - 0s 85us/step - loss: 0.4186 - acc: 0.7899 - val_loss: 0.5134 - val_acc: 0.7500
Epoch 826/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4186 - acc: 0.7899 - val_loss: 0.5134 - val_acc: 0.7500
Epoch 827/1000
576/576 [==============================] - 0s 66us/step - loss: 0.4185 - acc: 0.7899 - val_loss: 0.5134 - val_acc: 0.7500
Epoch 828/1000
576/576 [==============================] - 0s 83us/step - loss: 0.4186 - acc: 0.7899 - val_loss: 0.5134 - val_acc: 0.7500
Epoch 829/1000
576/576 [==============================] - 0s 73us/step - loss: 0.4185 - acc: 0.7899 - val_loss: 0.5134 - val_acc: 0.7500
Epoch 830/1000
576/576 [==============================] - 0s 83us/step - loss: 0.4185 - acc: 0.7899 - val_loss: 0.5134 - val_acc: 0.7500
Epoch 831/1000
576/576 [==============================] - 0s 83us/step - loss: 0.4185 - acc: 0.7917 - val_loss: 0.5134 - val_acc: 0.7500
Epoch 832/1000
576/576 [==============================] - 0s 78us/step - loss: 0.4184 - acc: 0.7882 - val_loss: 0.5134 - val_acc: 0.7500
Epoch 833/1000
576/576 [==============================] - 0s 73us/step - loss: 0.4184 - acc: 0.7899 - val_loss: 0.5134 - val_acc: 0.7500
Epoch 834/1000
576/576 [==============================] - 0s 71us/step - loss: 0.4184 - acc: 0.7882 - val_loss: 0.5134 - val_acc: 0.7500
Epoch 835/1000
576/576 [==============================] - 0s 85us/step - loss: 0.4183 - acc: 0.7899 - val_loss: 0.5134 - val_acc: 0.7500
Epoch 836/1000
576/576 [==============================] - 0s 68us/step - loss: 0.4183 - acc: 0.7882 - val_loss: 0.5134 - val_acc: 0.7500
Epoch 837/1000
576/576 [==============================] - 0s 68us/step - loss: 0.4183 - acc: 0.7882 - val_loss: 0.5134 - val_acc: 0.7500
Epoch 838/1000
576/576 [==============================] - 0s 69us/step - loss: 0.4183 - acc: 0.7882 - val_loss: 0.5134 - val_acc: 0.7500
Epoch 839/1000
576/576 [==============================] - 0s 78us/step - loss: 0.4183 - acc: 0.7882 - val_loss: 0.5135 - val_acc: 0.7500
Epoch 840/1000
576/576 [==============================] - 0s 71us/step - loss: 0.4182 - acc: 0.7882 - val_loss: 0.5135 - val_acc: 0.7500
Epoch 841/1000
576/576 [==============================] - 0s 64us/step - loss: 0.4182 - acc: 0.7882 - val_loss: 0.5135 - val_acc: 0.7500
Epoch 842/1000
576/576 [==============================] - 0s 78us/step - loss: 0.4182 - acc: 0.7882 - val_loss: 0.5135 - val_acc: 0.7500
Epoch 843/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4182 - acc: 0.7882 - val_loss: 0.5135 - val_acc: 0.7500
Epoch 844/1000
576/576 [==============================] - 0s 83us/step - loss: 0.4182 - acc: 0.7899 - val_loss: 0.5135 - val_acc: 0.7500
Epoch 845/1000
576/576 [==============================] - 0s 83us/step - loss: 0.4181 - acc: 0.7882 - val_loss: 0.5135 - val_acc: 0.7500
Epoch 846/1000
576/576 [==============================] - 0s 87us/step - loss: 0.4181 - acc: 0.7882 - val_loss: 0.5135 - val_acc: 0.7500
Epoch 847/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4181 - acc: 0.7882 - val_loss: 0.5135 - val_acc: 0.7500
Epoch 848/1000
576/576 [==============================] - 0s 78us/step - loss: 0.4181 - acc: 0.7882 - val_loss: 0.5135 - val_acc: 0.7500
Epoch 849/1000
576/576 [==============================] - 0s 88us/step - loss: 0.4180 - acc: 0.7882 - val_loss: 0.5135 - val_acc: 0.7500
Epoch 850/1000
576/576 [==============================] - 0s 85us/step - loss: 0.4180 - acc: 0.7882 - val_loss: 0.5135 - val_acc: 0.7500
Epoch 851/1000
576/576 [==============================] - 0s 83us/step - loss: 0.4180 - acc: 0.7882 - val_loss: 0.5135 - val_acc: 0.7500
Epoch 852/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4179 - acc: 0.7882 - val_loss: 0.5135 - val_acc: 0.7500
Epoch 853/1000
576/576 [==============================] - 0s 83us/step - loss: 0.4179 - acc: 0.7882 - val_loss: 0.5136 - val_acc: 0.7500
Epoch 854/1000
576/576 [==============================] - 0s 87us/step - loss: 0.4179 - acc: 0.7882 - val_loss: 0.5136 - val_acc: 0.7500
Epoch 855/1000
576/576 [==============================] - 0s 83us/step - loss: 0.4179 - acc: 0.7882 - val_loss: 0.5136 - val_acc: 0.7500
Epoch 856/1000
576/576 [==============================] - 0s 94us/step - loss: 0.4179 - acc: 0.7882 - val_loss: 0.5136 - val_acc: 0.7500
Epoch 857/1000
576/576 [==============================] - 0s 101us/step - loss: 0.4178 - acc: 0.7882 - val_loss: 0.5136 - val_acc: 0.7500
Epoch 858/1000
576/576 [==============================] - 0s 57us/step - loss: 0.4178 - acc: 0.7882 - val_loss: 0.5136 - val_acc: 0.7500
Epoch 859/1000
576/576 [==============================] - 0s 56us/step - loss: 0.4178 - acc: 0.7882 - val_loss: 0.5136 - val_acc: 0.7500
Epoch 860/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4178 - acc: 0.7882 - val_loss: 0.5136 - val_acc: 0.7500
Epoch 861/1000
576/576 [==============================] - 0s 71us/step - loss: 0.4178 - acc: 0.7882 - val_loss: 0.5136 - val_acc: 0.7500
Epoch 862/1000
576/576 [==============================] - 0s 71us/step - loss: 0.4177 - acc: 0.7899 - val_loss: 0.5136 - val_acc: 0.7500
Epoch 863/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4177 - acc: 0.7899 - val_loss: 0.5136 - val_acc: 0.7500
Epoch 864/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4177 - acc: 0.7882 - val_loss: 0.5136 - val_acc: 0.7500
Epoch 865/1000
576/576 [==============================] - ETA: 0s - loss: 0.4656 - acc: 0.718 - 0s 73us/step - loss: 0.4176 - acc: 0.7882 - val_loss: 0.5136 - val_acc: 0.7500
Epoch 866/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4176 - acc: 0.7899 - val_loss: 0.5136 - val_acc: 0.7500
Epoch 867/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4176 - acc: 0.7882 - val_loss: 0.5136 - val_acc: 0.7500
Epoch 868/1000
576/576 [==============================] - 0s 73us/step - loss: 0.4176 - acc: 0.7882 - val_loss: 0.5137 - val_acc: 0.7500
Epoch 869/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4175 - acc: 0.7882 - val_loss: 0.5137 - val_acc: 0.7500
Epoch 870/1000
576/576 [==============================] - 0s 85us/step - loss: 0.4175 - acc: 0.7882 - val_loss: 0.5137 - val_acc: 0.7500
Epoch 871/1000
576/576 [==============================] - 0s 92us/step - loss: 0.4175 - acc: 0.7882 - val_loss: 0.5137 - val_acc: 0.7500
Epoch 872/1000
576/576 [==============================] - 0s 97us/step - loss: 0.4175 - acc: 0.7882 - val_loss: 0.5137 - val_acc: 0.7500
Epoch 873/1000
576/576 [==============================] - 0s 88us/step - loss: 0.4174 - acc: 0.7899 - val_loss: 0.5137 - val_acc: 0.7500
Epoch 874/1000
576/576 [==============================] - 0s 92us/step - loss: 0.4174 - acc: 0.7882 - val_loss: 0.5137 - val_acc: 0.7500
Epoch 875/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4174 - acc: 0.7899 - val_loss: 0.5137 - val_acc: 0.7500
Epoch 876/1000
576/576 [==============================] - 0s 90us/step - loss: 0.4174 - acc: 0.7882 - val_loss: 0.5137 - val_acc: 0.7500
Epoch 877/1000
576/576 [==============================] - 0s 106us/step - loss: 0.4173 - acc: 0.7899 - val_loss: 0.5137 - val_acc: 0.7500
Epoch 878/1000
576/576 [==============================] - 0s 109us/step - loss: 0.4173 - acc: 0.7882 - val_loss: 0.5137 - val_acc: 0.7500
Epoch 879/1000
576/576 [==============================] - 0s 90us/step - loss: 0.4173 - acc: 0.7882 - val_loss: 0.5138 - val_acc: 0.7500
Epoch 880/1000
576/576 [==============================] - 0s 83us/step - loss: 0.4173 - acc: 0.7882 - val_loss: 0.5138 - val_acc: 0.7500
Epoch 881/1000
576/576 [==============================] - 0s 87us/step - loss: 0.4173 - acc: 0.7899 - val_loss: 0.5138 - val_acc: 0.7500
Epoch 882/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4172 - acc: 0.7899 - val_loss: 0.5138 - val_acc: 0.7500
Epoch 883/1000
576/576 [==============================] - 0s 115us/step - loss: 0.4172 - acc: 0.7899 - val_loss: 0.5138 - val_acc: 0.7500
Epoch 884/1000
576/576 [==============================] - 0s 78us/step - loss: 0.4172 - acc: 0.7882 - val_loss: 0.5138 - val_acc: 0.7500
Epoch 885/1000
576/576 [==============================] - 0s 85us/step - loss: 0.4172 - acc: 0.7899 - val_loss: 0.5138 - val_acc: 0.7552
Epoch 886/1000
576/576 [==============================] - 0s 78us/step - loss: 0.4171 - acc: 0.7899 - val_loss: 0.5138 - val_acc: 0.7552
Epoch 887/1000
576/576 [==============================] - 0s 95us/step - loss: 0.4171 - acc: 0.7899 - val_loss: 0.5138 - val_acc: 0.7552
Epoch 888/1000
576/576 [==============================] - 0s 71us/step - loss: 0.4171 - acc: 0.7899 - val_loss: 0.5138 - val_acc: 0.7552
Epoch 889/1000
576/576 [==============================] - 0s 68us/step - loss: 0.4171 - acc: 0.7899 - val_loss: 0.5139 - val_acc: 0.7552
Epoch 890/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4171 - acc: 0.7899 - val_loss: 0.5139 - val_acc: 0.7552
Epoch 891/1000
576/576 [==============================] - 0s 78us/step - loss: 0.4170 - acc: 0.7899 - val_loss: 0.5139 - val_acc: 0.7552
Epoch 892/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4170 - acc: 0.7899 - val_loss: 0.5139 - val_acc: 0.7552
Epoch 893/1000
576/576 [==============================] - 0s 73us/step - loss: 0.4170 - acc: 0.7899 - val_loss: 0.5139 - val_acc: 0.7552
Epoch 894/1000
576/576 [==============================] - 0s 88us/step - loss: 0.4169 - acc: 0.7899 - val_loss: 0.5139 - val_acc: 0.7552
Epoch 895/1000
576/576 [==============================] - 0s 90us/step - loss: 0.4170 - acc: 0.7899 - val_loss: 0.5139 - val_acc: 0.7552
Epoch 896/1000
576/576 [==============================] - 0s 97us/step - loss: 0.4169 - acc: 0.7899 - val_loss: 0.5139 - val_acc: 0.7552
Epoch 897/1000
576/576 [==============================] - 0s 73us/step - loss: 0.4169 - acc: 0.7899 - val_loss: 0.5139 - val_acc: 0.7552
Epoch 898/1000
576/576 [==============================] - 0s 73us/step - loss: 0.4169 - acc: 0.7899 - val_loss: 0.5140 - val_acc: 0.7552
Epoch 899/1000
576/576 [==============================] - 0s 71us/step - loss: 0.4169 - acc: 0.7899 - val_loss: 0.5140 - val_acc: 0.7552
Epoch 900/1000
576/576 [==============================] - 0s 69us/step - loss: 0.4169 - acc: 0.7899 - val_loss: 0.5140 - val_acc: 0.7552
Epoch 901/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4168 - acc: 0.7899 - val_loss: 0.5140 - val_acc: 0.7552
Epoch 902/1000
576/576 [==============================] - 0s 85us/step - loss: 0.4168 - acc: 0.7917 - val_loss: 0.5140 - val_acc: 0.7552
Epoch 903/1000
576/576 [==============================] - 0s 85us/step - loss: 0.4168 - acc: 0.7899 - val_loss: 0.5140 - val_acc: 0.7552
Epoch 904/1000
576/576 [==============================] - 0s 88us/step - loss: 0.4168 - acc: 0.7899 - val_loss: 0.5140 - val_acc: 0.7552
Epoch 905/1000
576/576 [==============================] - 0s 88us/step - loss: 0.4168 - acc: 0.7899 - val_loss: 0.5140 - val_acc: 0.7552
Epoch 906/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4167 - acc: 0.7899 - val_loss: 0.5141 - val_acc: 0.7552
Epoch 907/1000
576/576 [==============================] - 0s 85us/step - loss: 0.4167 - acc: 0.7899 - val_loss: 0.5141 - val_acc: 0.7552
Epoch 908/1000
576/576 [==============================] - 0s 87us/step - loss: 0.4167 - acc: 0.7899 - val_loss: 0.5141 - val_acc: 0.7552
Epoch 909/1000
576/576 [==============================] - 0s 95us/step - loss: 0.4167 - acc: 0.7899 - val_loss: 0.5141 - val_acc: 0.7552
Epoch 910/1000
576/576 [==============================] - 0s 90us/step - loss: 0.4167 - acc: 0.7899 - val_loss: 0.5141 - val_acc: 0.7552
Epoch 911/1000
576/576 [==============================] - 0s 94us/step - loss: 0.4166 - acc: 0.7899 - val_loss: 0.5141 - val_acc: 0.7552
Epoch 912/1000
576/576 [==============================] - 0s 83us/step - loss: 0.4166 - acc: 0.7917 - val_loss: 0.5141 - val_acc: 0.7552
Epoch 913/1000
576/576 [==============================] - 0s 85us/step - loss: 0.4166 - acc: 0.7882 - val_loss: 0.5141 - val_acc: 0.7552
Epoch 914/1000
576/576 [==============================] - 0s 85us/step - loss: 0.4166 - acc: 0.7917 - val_loss: 0.5141 - val_acc: 0.7552
Epoch 915/1000
576/576 [==============================] - 0s 92us/step - loss: 0.4165 - acc: 0.7899 - val_loss: 0.5141 - val_acc: 0.7552
Epoch 916/1000
576/576 [==============================] - 0s 90us/step - loss: 0.4165 - acc: 0.7899 - val_loss: 0.5142 - val_acc: 0.7552
Epoch 917/1000
576/576 [==============================] - 0s 87us/step - loss: 0.4165 - acc: 0.7899 - val_loss: 0.5142 - val_acc: 0.7552
Epoch 918/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4165 - acc: 0.7899 - val_loss: 0.5142 - val_acc: 0.7552
Epoch 919/1000
576/576 [==============================] - 0s 85us/step - loss: 0.4165 - acc: 0.7917 - val_loss: 0.5142 - val_acc: 0.7552
Epoch 920/1000
576/576 [==============================] - 0s 87us/step - loss: 0.4165 - acc: 0.7882 - val_loss: 0.5142 - val_acc: 0.7552
Epoch 921/1000
576/576 [==============================] - 0s 85us/step - loss: 0.4165 - acc: 0.7882 - val_loss: 0.5142 - val_acc: 0.7552
Epoch 922/1000
576/576 [==============================] - 0s 94us/step - loss: 0.4164 - acc: 0.7917 - val_loss: 0.5142 - val_acc: 0.7552
Epoch 923/1000
576/576 [==============================] - 0s 83us/step - loss: 0.4164 - acc: 0.7899 - val_loss: 0.5142 - val_acc: 0.7552
Epoch 924/1000
576/576 [==============================] - 0s 83us/step - loss: 0.4164 - acc: 0.7899 - val_loss: 0.5142 - val_acc: 0.7552
Epoch 925/1000
576/576 [==============================] - 0s 94us/step - loss: 0.4164 - acc: 0.7899 - val_loss: 0.5142 - val_acc: 0.7552
Epoch 926/1000
576/576 [==============================] - 0s 73us/step - loss: 0.4164 - acc: 0.7899 - val_loss: 0.5142 - val_acc: 0.7552
Epoch 927/1000
576/576 [==============================] - 0s 88us/step - loss: 0.4163 - acc: 0.7899 - val_loss: 0.5143 - val_acc: 0.7552
Epoch 928/1000
576/576 [==============================] - 0s 88us/step - loss: 0.4163 - acc: 0.7899 - val_loss: 0.5143 - val_acc: 0.7552
Epoch 929/1000
576/576 [==============================] - 0s 90us/step - loss: 0.4163 - acc: 0.7882 - val_loss: 0.5143 - val_acc: 0.7552
Epoch 930/1000
576/576 [==============================] - 0s 90us/step - loss: 0.4163 - acc: 0.7882 - val_loss: 0.5143 - val_acc: 0.7552
Epoch 931/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4163 - acc: 0.7882 - val_loss: 0.5143 - val_acc: 0.7552
Epoch 932/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4162 - acc: 0.7882 - val_loss: 0.5143 - val_acc: 0.7552
Epoch 933/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4162 - acc: 0.7882 - val_loss: 0.5143 - val_acc: 0.7552
Epoch 934/1000
576/576 [==============================] - 0s 83us/step - loss: 0.4162 - acc: 0.7882 - val_loss: 0.5143 - val_acc: 0.7552
Epoch 935/1000
576/576 [==============================] - 0s 78us/step - loss: 0.4162 - acc: 0.7865 - val_loss: 0.5143 - val_acc: 0.7552
Epoch 936/1000
576/576 [==============================] - 0s 90us/step - loss: 0.4161 - acc: 0.7882 - val_loss: 0.5143 - val_acc: 0.7552
Epoch 937/1000
576/576 [==============================] - 0s 83us/step - loss: 0.4161 - acc: 0.7934 - val_loss: 0.5144 - val_acc: 0.7552
Epoch 938/1000
576/576 [==============================] - 0s 85us/step - loss: 0.4161 - acc: 0.7865 - val_loss: 0.5144 - val_acc: 0.7552
Epoch 939/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4161 - acc: 0.7899 - val_loss: 0.5144 - val_acc: 0.7552
Epoch 940/1000
576/576 [==============================] - 0s 88us/step - loss: 0.4161 - acc: 0.7882 - val_loss: 0.5144 - val_acc: 0.7552
Epoch 941/1000
576/576 [==============================] - 0s 78us/step - loss: 0.4161 - acc: 0.7899 - val_loss: 0.5144 - val_acc: 0.7552
Epoch 942/1000
576/576 [==============================] - 0s 71us/step - loss: 0.4161 - acc: 0.7899 - val_loss: 0.5144 - val_acc: 0.7552
Epoch 943/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4160 - acc: 0.7899 - val_loss: 0.5144 - val_acc: 0.7552
Epoch 944/1000
576/576 [==============================] - 0s 87us/step - loss: 0.4160 - acc: 0.7882 - val_loss: 0.5144 - val_acc: 0.7552
Epoch 945/1000
576/576 [==============================] - 0s 94us/step - loss: 0.4160 - acc: 0.7882 - val_loss: 0.5144 - val_acc: 0.7552
Epoch 946/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4160 - acc: 0.7865 - val_loss: 0.5145 - val_acc: 0.7552
Epoch 947/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4159 - acc: 0.7865 - val_loss: 0.5145 - val_acc: 0.7552
Epoch 948/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4159 - acc: 0.7882 - val_loss: 0.5145 - val_acc: 0.7552
Epoch 949/1000
576/576 [==============================] - 0s 106us/step - loss: 0.4159 - acc: 0.7882 - val_loss: 0.5145 - val_acc: 0.7552
Epoch 950/1000
576/576 [==============================] - 0s 87us/step - loss: 0.4159 - acc: 0.7899 - val_loss: 0.5145 - val_acc: 0.7552
Epoch 951/1000
576/576 [==============================] - 0s 99us/step - loss: 0.4159 - acc: 0.7865 - val_loss: 0.5145 - val_acc: 0.7552
Epoch 952/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4158 - acc: 0.7865 - val_loss: 0.5145 - val_acc: 0.7552
Epoch 953/1000
576/576 [==============================] - 0s 87us/step - loss: 0.4158 - acc: 0.7882 - val_loss: 0.5146 - val_acc: 0.7552
Epoch 954/1000
576/576 [==============================] - 0s 88us/step - loss: 0.4158 - acc: 0.7899 - val_loss: 0.5146 - val_acc: 0.7552
Epoch 955/1000
576/576 [==============================] - 0s 87us/step - loss: 0.4158 - acc: 0.7882 - val_loss: 0.5146 - val_acc: 0.7552
Epoch 956/1000
576/576 [==============================] - 0s 87us/step - loss: 0.4158 - acc: 0.7899 - val_loss: 0.5146 - val_acc: 0.7552
Epoch 957/1000
576/576 [==============================] - 0s 85us/step - loss: 0.4158 - acc: 0.7899 - val_loss: 0.5146 - val_acc: 0.7552
Epoch 958/1000
576/576 [==============================] - 0s 87us/step - loss: 0.4157 - acc: 0.7882 - val_loss: 0.5146 - val_acc: 0.7552
Epoch 959/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4157 - acc: 0.7882 - val_loss: 0.5146 - val_acc: 0.7552
Epoch 960/1000
576/576 [==============================] - 0s 83us/step - loss: 0.4157 - acc: 0.7899 - val_loss: 0.5146 - val_acc: 0.7552
Epoch 961/1000
576/576 [==============================] - 0s 85us/step - loss: 0.4157 - acc: 0.7882 - val_loss: 0.5147 - val_acc: 0.7552
Epoch 962/1000
576/576 [==============================] - 0s 87us/step - loss: 0.4157 - acc: 0.7882 - val_loss: 0.5147 - val_acc: 0.7552
Epoch 963/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4157 - acc: 0.7865 - val_loss: 0.5147 - val_acc: 0.7552
Epoch 964/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4156 - acc: 0.7917 - val_loss: 0.5147 - val_acc: 0.7552
Epoch 965/1000
576/576 [==============================] - 0s 87us/step - loss: 0.4156 - acc: 0.7899 - val_loss: 0.5147 - val_acc: 0.7552
Epoch 966/1000
576/576 [==============================] - 0s 90us/step - loss: 0.4156 - acc: 0.7882 - val_loss: 0.5147 - val_acc: 0.7552
Epoch 967/1000
576/576 [==============================] - 0s 88us/step - loss: 0.4155 - acc: 0.7882 - val_loss: 0.5147 - val_acc: 0.7552
Epoch 968/1000
576/576 [==============================] - 0s 88us/step - loss: 0.4155 - acc: 0.7882 - val_loss: 0.5147 - val_acc: 0.7552
Epoch 969/1000
576/576 [==============================] - 0s 90us/step - loss: 0.4156 - acc: 0.7882 - val_loss: 0.5148 - val_acc: 0.7552
Epoch 970/1000
576/576 [==============================] - 0s 85us/step - loss: 0.4155 - acc: 0.7882 - val_loss: 0.5148 - val_acc: 0.7552
Epoch 971/1000
576/576 [==============================] - 0s 83us/step - loss: 0.4155 - acc: 0.7899 - val_loss: 0.5148 - val_acc: 0.7552
Epoch 972/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4155 - acc: 0.7917 - val_loss: 0.5148 - val_acc: 0.7552
Epoch 973/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4154 - acc: 0.7865 - val_loss: 0.5148 - val_acc: 0.7552
Epoch 974/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4154 - acc: 0.7882 - val_loss: 0.5148 - val_acc: 0.7552
Epoch 975/1000
576/576 [==============================] - 0s 88us/step - loss: 0.4154 - acc: 0.7882 - val_loss: 0.5148 - val_acc: 0.7552
Epoch 976/1000
576/576 [==============================] - 0s 83us/step - loss: 0.4154 - acc: 0.7865 - val_loss: 0.5148 - val_acc: 0.7552
Epoch 977/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4154 - acc: 0.7882 - val_loss: 0.5148 - val_acc: 0.7552
Epoch 978/1000
576/576 [==============================] - 0s 88us/step - loss: 0.4154 - acc: 0.7865 - val_loss: 0.5149 - val_acc: 0.7552
Epoch 979/1000
576/576 [==============================] - 0s 87us/step - loss: 0.4154 - acc: 0.7882 - val_loss: 0.5149 - val_acc: 0.7552
Epoch 980/1000
576/576 [==============================] - 0s 85us/step - loss: 0.4153 - acc: 0.7882 - val_loss: 0.5149 - val_acc: 0.7552
Epoch 981/1000
576/576 [==============================] - 0s 87us/step - loss: 0.4153 - acc: 0.7899 - val_loss: 0.5149 - val_acc: 0.7552
Epoch 982/1000
576/576 [==============================] - 0s 85us/step - loss: 0.4153 - acc: 0.7899 - val_loss: 0.5149 - val_acc: 0.7552
Epoch 983/1000
576/576 [==============================] - 0s 85us/step - loss: 0.4152 - acc: 0.7882 - val_loss: 0.5149 - val_acc: 0.7552
Epoch 984/1000
576/576 [==============================] - 0s 83us/step - loss: 0.4153 - acc: 0.7865 - val_loss: 0.5149 - val_acc: 0.7552
Epoch 985/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4152 - acc: 0.7865 - val_loss: 0.5149 - val_acc: 0.7552
Epoch 986/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4152 - acc: 0.7882 - val_loss: 0.5149 - val_acc: 0.7552
Epoch 987/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4152 - acc: 0.7847 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 988/1000
576/576 [==============================] - 0s 87us/step - loss: 0.4152 - acc: 0.7865 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 989/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4151 - acc: 0.7847 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 990/1000
576/576 [==============================] - 0s 87us/step - loss: 0.4151 - acc: 0.7882 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 991/1000
576/576 [==============================] - 0s 87us/step - loss: 0.4151 - acc: 0.7882 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 992/1000
576/576 [==============================] - 0s 88us/step - loss: 0.4151 - acc: 0.7865 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 993/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4151 - acc: 0.7847 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 994/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4150 - acc: 0.7847 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 995/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4150 - acc: 0.7865 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 996/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4150 - acc: 0.7847 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 997/1000
576/576 [==============================] - 0s 80us/step - loss: 0.4150 - acc: 0.7882 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 998/1000
576/576 [==============================] - 0s 82us/step - loss: 0.4150 - acc: 0.7847 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 999/1000
576/576 [==============================] - 0s 76us/step - loss: 0.4150 - acc: 0.7847 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1000/1000
576/576 [==============================] - 0s 75us/step - loss: 0.4149 - acc: 0.7847 - val_loss: 0.5151 - val_acc: 0.7552
In [22]:
n = len(run_hist_1.history["loss"])
m = len(run_hist_1b.history['loss'])
fig, ax = plt.subplots(figsize=(16, 8))

ax.plot(range(n), run_hist_1.history["loss"],'r', marker='.', label="Train Loss - Run 1")
ax.plot(range(n, n+m), run_hist_1b.history["loss"], 'hotpink', marker='.', label="Train Loss - Run 2")

ax.plot(range(n), run_hist_1.history["val_loss"],'b', marker='.', label="Validation Loss - Run 1")
ax.plot(range(n, n+m), run_hist_1b.history["val_loss"], 'LightSkyBlue', marker='.',  label="Validation Loss - Run 2")

ax.legend()
Out[22]:
<matplotlib.legend.Legend at 0x2129ed45ac8>

Note that this graph begins where the other left off. While the training loss is still going down, it looks like the validation loss has stabilized (or even gotten worse!). This suggests that our network will not benefit from further training. What is the appropriate number of epochs?

In [ ]:
 
In [ ]:
 

Exercise

Now it's your turn. Do the following in the cells below:

  • Build a model with two hidden layers, each with 6 nodes
  • Use the "relu" activation function for the hidden layers, and "sigmoid" for the final layer
  • Use a learning rate of .003 and train for 1500 epochs
  • Graph the trajectory of the loss functions, accuracy on both train and test set
  • Plot the roc curve for the predictions

Experiment with different learning rates, numbers of epochs, and network structures

In [23]:
# Type your code here to with layer 1,2 having activation relu and layer 3 with activation sigmoid

#Build a model with two hidden layers, each with 6 nodes


model_ex = Sequential([
    Dense(6, input_shape=(8,), activation="relu"),
    Dense(6, activation="relu"),
    Dense(1, activation="sigmoid")
])
In [24]:
# Type your code here to plot the loss accuracy and ROC curve

# Use a learning rate of .003 and train for 1500 epochs 
model_ex.compile(SGD(lr = .003), "binary_crossentropy", metrics=["accuracy"])
run_hist_ex = model_ex.fit(X_train_norm, y_train, validation_data=(X_test_norm, y_test), epochs=1500)
4*1
Train on 576 samples, validate on 192 samples
Epoch 1/1500
576/576 [==============================] - 1s 1ms/step - loss: 0.7472 - acc: 0.5833 - val_loss: 0.7033 - val_acc: 0.5781
Epoch 2/1500
576/576 [==============================] - 0s 90us/step - loss: 0.7402 - acc: 0.6024 - val_loss: 0.6977 - val_acc: 0.5938
Epoch 3/1500
576/576 [==============================] - 0s 87us/step - loss: 0.7338 - acc: 0.6163 - val_loss: 0.6925 - val_acc: 0.5938
Epoch 4/1500
576/576 [==============================] - 0s 90us/step - loss: 0.7279 - acc: 0.6233 - val_loss: 0.6876 - val_acc: 0.6042
Epoch 5/1500
576/576 [==============================] - 0s 92us/step - loss: 0.7223 - acc: 0.6337 - val_loss: 0.6831 - val_acc: 0.6146
Epoch 6/1500
576/576 [==============================] - 0s 82us/step - loss: 0.7171 - acc: 0.6424 - val_loss: 0.6788 - val_acc: 0.6302
Epoch 7/1500
576/576 [==============================] - 0s 78us/step - loss: 0.7122 - acc: 0.6528 - val_loss: 0.6748 - val_acc: 0.6458
Epoch 8/1500
576/576 [==============================] - 0s 118us/step - loss: 0.7077 - acc: 0.6510 - val_loss: 0.6711 - val_acc: 0.6719
Epoch 9/1500
576/576 [==============================] - 0s 95us/step - loss: 0.7034 - acc: 0.6649 - val_loss: 0.6676 - val_acc: 0.6771
Epoch 10/1500
576/576 [==============================] - 0s 92us/step - loss: 0.6993 - acc: 0.6649 - val_loss: 0.6643 - val_acc: 0.6875
Epoch 11/1500
576/576 [==============================] - 0s 99us/step - loss: 0.6954 - acc: 0.6701 - val_loss: 0.6612 - val_acc: 0.6875
Epoch 12/1500
576/576 [==============================] - 0s 99us/step - loss: 0.6918 - acc: 0.6684 - val_loss: 0.6583 - val_acc: 0.6927
Epoch 13/1500
576/576 [==============================] - 0s 135us/step - loss: 0.6884 - acc: 0.6701 - val_loss: 0.6555 - val_acc: 0.6979
Epoch 14/1500
576/576 [==============================] - 0s 83us/step - loss: 0.6851 - acc: 0.6719 - val_loss: 0.6529 - val_acc: 0.6823
Epoch 15/1500
576/576 [==============================] - 0s 85us/step - loss: 0.6820 - acc: 0.6753 - val_loss: 0.6504 - val_acc: 0.6927
Epoch 16/1500
576/576 [==============================] - 0s 87us/step - loss: 0.6791 - acc: 0.6771 - val_loss: 0.6480 - val_acc: 0.6979
Epoch 17/1500
576/576 [==============================] - 0s 92us/step - loss: 0.6763 - acc: 0.6788 - val_loss: 0.6457 - val_acc: 0.7135
Epoch 18/1500
576/576 [==============================] - 0s 99us/step - loss: 0.6736 - acc: 0.6840 - val_loss: 0.6435 - val_acc: 0.7188
Epoch 19/1500
576/576 [==============================] - 0s 88us/step - loss: 0.6710 - acc: 0.6875 - val_loss: 0.6414 - val_acc: 0.7188
Epoch 20/1500
576/576 [==============================] - 0s 88us/step - loss: 0.6686 - acc: 0.6875 - val_loss: 0.6395 - val_acc: 0.7240
Epoch 21/1500
576/576 [==============================] - 0s 87us/step - loss: 0.6662 - acc: 0.6927 - val_loss: 0.6376 - val_acc: 0.7344
Epoch 22/1500
576/576 [==============================] - 0s 83us/step - loss: 0.6640 - acc: 0.7014 - val_loss: 0.6357 - val_acc: 0.7292
Epoch 23/1500
576/576 [==============================] - 0s 88us/step - loss: 0.6618 - acc: 0.7014 - val_loss: 0.6340 - val_acc: 0.7292
Epoch 24/1500
576/576 [==============================] - 0s 90us/step - loss: 0.6597 - acc: 0.7031 - val_loss: 0.6323 - val_acc: 0.7448
Epoch 25/1500
576/576 [==============================] - 0s 78us/step - loss: 0.6578 - acc: 0.7066 - val_loss: 0.6307 - val_acc: 0.7448
Epoch 26/1500
576/576 [==============================] - 0s 87us/step - loss: 0.6559 - acc: 0.7101 - val_loss: 0.6291 - val_acc: 0.7448
Epoch 27/1500
576/576 [==============================] - 0s 82us/step - loss: 0.6540 - acc: 0.7101 - val_loss: 0.6276 - val_acc: 0.7448
Epoch 28/1500
576/576 [==============================] - 0s 88us/step - loss: 0.6523 - acc: 0.7118 - val_loss: 0.6262 - val_acc: 0.7396
Epoch 29/1500
576/576 [==============================] - 0s 85us/step - loss: 0.6506 - acc: 0.7118 - val_loss: 0.6248 - val_acc: 0.7448
Epoch 30/1500
576/576 [==============================] - 0s 73us/step - loss: 0.6490 - acc: 0.7153 - val_loss: 0.6235 - val_acc: 0.7396
Epoch 31/1500
576/576 [==============================] - 0s 80us/step - loss: 0.6474 - acc: 0.7153 - val_loss: 0.6222 - val_acc: 0.7396
Epoch 32/1500
576/576 [==============================] - 0s 87us/step - loss: 0.6459 - acc: 0.7135 - val_loss: 0.6209 - val_acc: 0.7500
Epoch 33/1500
576/576 [==============================] - 0s 80us/step - loss: 0.6445 - acc: 0.7170 - val_loss: 0.6197 - val_acc: 0.7552
Epoch 34/1500
576/576 [==============================] - 0s 82us/step - loss: 0.6431 - acc: 0.7170 - val_loss: 0.6186 - val_acc: 0.7552
Epoch 35/1500
576/576 [==============================] - 0s 88us/step - loss: 0.6417 - acc: 0.7188 - val_loss: 0.6174 - val_acc: 0.7604
Epoch 36/1500
576/576 [==============================] - 0s 97us/step - loss: 0.6403 - acc: 0.7205 - val_loss: 0.6163 - val_acc: 0.7604
Epoch 37/1500
576/576 [==============================] - 0s 90us/step - loss: 0.6390 - acc: 0.7205 - val_loss: 0.6152 - val_acc: 0.7604
Epoch 38/1500
576/576 [==============================] - 0s 82us/step - loss: 0.6378 - acc: 0.7222 - val_loss: 0.6142 - val_acc: 0.7604
Epoch 39/1500
576/576 [==============================] - 0s 82us/step - loss: 0.6366 - acc: 0.7205 - val_loss: 0.6132 - val_acc: 0.7604
Epoch 40/1500
576/576 [==============================] - 0s 83us/step - loss: 0.6354 - acc: 0.7205 - val_loss: 0.6122 - val_acc: 0.7604
Epoch 41/1500
576/576 [==============================] - 0s 78us/step - loss: 0.6342 - acc: 0.7188 - val_loss: 0.6112 - val_acc: 0.7604
Epoch 42/1500
576/576 [==============================] - 0s 85us/step - loss: 0.6331 - acc: 0.7188 - val_loss: 0.6103 - val_acc: 0.7604
Epoch 43/1500
576/576 [==============================] - 0s 87us/step - loss: 0.6320 - acc: 0.7222 - val_loss: 0.6094 - val_acc: 0.7552
Epoch 44/1500
576/576 [==============================] - 0s 83us/step - loss: 0.6310 - acc: 0.7240 - val_loss: 0.6085 - val_acc: 0.7500
Epoch 45/1500
576/576 [==============================] - 0s 82us/step - loss: 0.6299 - acc: 0.7240 - val_loss: 0.6077 - val_acc: 0.7396
Epoch 46/1500
576/576 [==============================] - 0s 95us/step - loss: 0.6289 - acc: 0.7240 - val_loss: 0.6068 - val_acc: 0.7396
Epoch 47/1500
576/576 [==============================] - 0s 94us/step - loss: 0.6279 - acc: 0.7257 - val_loss: 0.6060 - val_acc: 0.7396
Epoch 48/1500
576/576 [==============================] - 0s 83us/step - loss: 0.6269 - acc: 0.7257 - val_loss: 0.6052 - val_acc: 0.7448
Epoch 49/1500
576/576 [==============================] - 0s 69us/step - loss: 0.6260 - acc: 0.7240 - val_loss: 0.6044 - val_acc: 0.7552
Epoch 50/1500
576/576 [==============================] - 0s 71us/step - loss: 0.6250 - acc: 0.7240 - val_loss: 0.6036 - val_acc: 0.7552
Epoch 51/1500
576/576 [==============================] - 0s 71us/step - loss: 0.6241 - acc: 0.7240 - val_loss: 0.6028 - val_acc: 0.7552
Epoch 52/1500
576/576 [==============================] - 0s 83us/step - loss: 0.6233 - acc: 0.7240 - val_loss: 0.6020 - val_acc: 0.7552
Epoch 53/1500
576/576 [==============================] - 0s 76us/step - loss: 0.6224 - acc: 0.7205 - val_loss: 0.6013 - val_acc: 0.7500
Epoch 54/1500
576/576 [==============================] - 0s 71us/step - loss: 0.6215 - acc: 0.7222 - val_loss: 0.6006 - val_acc: 0.7500
Epoch 55/1500
576/576 [==============================] - 0s 68us/step - loss: 0.6207 - acc: 0.7222 - val_loss: 0.5999 - val_acc: 0.7500
Epoch 56/1500
576/576 [==============================] - 0s 80us/step - loss: 0.6198 - acc: 0.7222 - val_loss: 0.5992 - val_acc: 0.7500
Epoch 57/1500
576/576 [==============================] - 0s 80us/step - loss: 0.6191 - acc: 0.7222 - val_loss: 0.5985 - val_acc: 0.7448
Epoch 58/1500
576/576 [==============================] - 0s 85us/step - loss: 0.6183 - acc: 0.7205 - val_loss: 0.5979 - val_acc: 0.7448
Epoch 59/1500
576/576 [==============================] - 0s 82us/step - loss: 0.6175 - acc: 0.7188 - val_loss: 0.5972 - val_acc: 0.7448
Epoch 60/1500
576/576 [==============================] - 0s 76us/step - loss: 0.6167 - acc: 0.7205 - val_loss: 0.5966 - val_acc: 0.7448
Epoch 61/1500
576/576 [==============================] - 0s 76us/step - loss: 0.6160 - acc: 0.7222 - val_loss: 0.5960 - val_acc: 0.7396
Epoch 62/1500
576/576 [==============================] - 0s 78us/step - loss: 0.6153 - acc: 0.7222 - val_loss: 0.5953 - val_acc: 0.7396
Epoch 63/1500
576/576 [==============================] - 0s 75us/step - loss: 0.6145 - acc: 0.7257 - val_loss: 0.5947 - val_acc: 0.7396
Epoch 64/1500
576/576 [==============================] - 0s 82us/step - loss: 0.6138 - acc: 0.7257 - val_loss: 0.5941 - val_acc: 0.7396
Epoch 65/1500
576/576 [==============================] - 0s 94us/step - loss: 0.6131 - acc: 0.7257 - val_loss: 0.5935 - val_acc: 0.7396
Epoch 66/1500
576/576 [==============================] - 0s 87us/step - loss: 0.6125 - acc: 0.7274 - val_loss: 0.5929 - val_acc: 0.7396
Epoch 67/1500
576/576 [==============================] - 0s 87us/step - loss: 0.6117 - acc: 0.7240 - val_loss: 0.5924 - val_acc: 0.7396
Epoch 68/1500
576/576 [==============================] - 0s 88us/step - loss: 0.6111 - acc: 0.7240 - val_loss: 0.5918 - val_acc: 0.7396
Epoch 69/1500
576/576 [==============================] - 0s 85us/step - loss: 0.6105 - acc: 0.7257 - val_loss: 0.5912 - val_acc: 0.7396
Epoch 70/1500
576/576 [==============================] - 0s 82us/step - loss: 0.6098 - acc: 0.7257 - val_loss: 0.5907 - val_acc: 0.7396
Epoch 71/1500
576/576 [==============================] - 0s 78us/step - loss: 0.6092 - acc: 0.7257 - val_loss: 0.5902 - val_acc: 0.7396
Epoch 72/1500
576/576 [==============================] - 0s 75us/step - loss: 0.6086 - acc: 0.7257 - val_loss: 0.5897 - val_acc: 0.7396
Epoch 73/1500
576/576 [==============================] - 0s 83us/step - loss: 0.6080 - acc: 0.7240 - val_loss: 0.5891 - val_acc: 0.7448
Epoch 74/1500
576/576 [==============================] - 0s 83us/step - loss: 0.6073 - acc: 0.7240 - val_loss: 0.5886 - val_acc: 0.7500
Epoch 75/1500
576/576 [==============================] - 0s 88us/step - loss: 0.6067 - acc: 0.7257 - val_loss: 0.5881 - val_acc: 0.7500
Epoch 76/1500
576/576 [==============================] - 0s 87us/step - loss: 0.6061 - acc: 0.7257 - val_loss: 0.5876 - val_acc: 0.7500
Epoch 77/1500
576/576 [==============================] - 0s 76us/step - loss: 0.6055 - acc: 0.7257 - val_loss: 0.5871 - val_acc: 0.7500
Epoch 78/1500
576/576 [==============================] - 0s 80us/step - loss: 0.6049 - acc: 0.7257 - val_loss: 0.5866 - val_acc: 0.7500
Epoch 79/1500
576/576 [==============================] - 0s 87us/step - loss: 0.6043 - acc: 0.7257 - val_loss: 0.5861 - val_acc: 0.7500
Epoch 80/1500
576/576 [==============================] - 0s 82us/step - loss: 0.6038 - acc: 0.7257 - val_loss: 0.5857 - val_acc: 0.7500
Epoch 81/1500
576/576 [==============================] - 0s 83us/step - loss: 0.6032 - acc: 0.7257 - val_loss: 0.5852 - val_acc: 0.7448
Epoch 82/1500
576/576 [==============================] - 0s 95us/step - loss: 0.6026 - acc: 0.7257 - val_loss: 0.5847 - val_acc: 0.7448
Epoch 83/1500
576/576 [==============================] - 0s 83us/step - loss: 0.6020 - acc: 0.7257 - val_loss: 0.5843 - val_acc: 0.7448
Epoch 84/1500
576/576 [==============================] - 0s 78us/step - loss: 0.6015 - acc: 0.7257 - val_loss: 0.5838 - val_acc: 0.7448
Epoch 85/1500
576/576 [==============================] - 0s 73us/step - loss: 0.6010 - acc: 0.7257 - val_loss: 0.5833 - val_acc: 0.7448
Epoch 86/1500
576/576 [==============================] - 0s 83us/step - loss: 0.6004 - acc: 0.7257 - val_loss: 0.5829 - val_acc: 0.7448
Epoch 87/1500
576/576 [==============================] - 0s 80us/step - loss: 0.5999 - acc: 0.7257 - val_loss: 0.5824 - val_acc: 0.7448
Epoch 88/1500
576/576 [==============================] - 0s 73us/step - loss: 0.5993 - acc: 0.7274 - val_loss: 0.5820 - val_acc: 0.7448
Epoch 89/1500
576/576 [==============================] - 0s 82us/step - loss: 0.5988 - acc: 0.7274 - val_loss: 0.5816 - val_acc: 0.7448
Epoch 90/1500
576/576 [==============================] - 0s 88us/step - loss: 0.5983 - acc: 0.7274 - val_loss: 0.5811 - val_acc: 0.7448
Epoch 91/1500
576/576 [==============================] - 0s 76us/step - loss: 0.5978 - acc: 0.7274 - val_loss: 0.5807 - val_acc: 0.7448
Epoch 92/1500
576/576 [==============================] - 0s 71us/step - loss: 0.5973 - acc: 0.7274 - val_loss: 0.5802 - val_acc: 0.7448
Epoch 93/1500
576/576 [==============================] - 0s 73us/step - loss: 0.5968 - acc: 0.7274 - val_loss: 0.5798 - val_acc: 0.7448
Epoch 94/1500
576/576 [==============================] - 0s 87us/step - loss: 0.5963 - acc: 0.7274 - val_loss: 0.5794 - val_acc: 0.7448
Epoch 95/1500
576/576 [==============================] - 0s 75us/step - loss: 0.5958 - acc: 0.7257 - val_loss: 0.5789 - val_acc: 0.7448
Epoch 96/1500
576/576 [==============================] - 0s 69us/step - loss: 0.5953 - acc: 0.7257 - val_loss: 0.5785 - val_acc: 0.7448
Epoch 97/1500
576/576 [==============================] - 0s 73us/step - loss: 0.5947 - acc: 0.7257 - val_loss: 0.5781 - val_acc: 0.7448
Epoch 98/1500
576/576 [==============================] - 0s 73us/step - loss: 0.5942 - acc: 0.7240 - val_loss: 0.5776 - val_acc: 0.7500
Epoch 99/1500
576/576 [==============================] - 0s 73us/step - loss: 0.5937 - acc: 0.7240 - val_loss: 0.5772 - val_acc: 0.7500
Epoch 100/1500
576/576 [==============================] - 0s 73us/step - loss: 0.5932 - acc: 0.7240 - val_loss: 0.5768 - val_acc: 0.7500
Epoch 101/1500
576/576 [==============================] - 0s 82us/step - loss: 0.5928 - acc: 0.7222 - val_loss: 0.5764 - val_acc: 0.7552
Epoch 102/1500
576/576 [==============================] - 0s 87us/step - loss: 0.5923 - acc: 0.7222 - val_loss: 0.5760 - val_acc: 0.7552
Epoch 103/1500
576/576 [==============================] - 0s 68us/step - loss: 0.5918 - acc: 0.7222 - val_loss: 0.5756 - val_acc: 0.7552
Epoch 104/1500
576/576 [==============================] - 0s 85us/step - loss: 0.5913 - acc: 0.7240 - val_loss: 0.5752 - val_acc: 0.7552
Epoch 105/1500
576/576 [==============================] - 0s 83us/step - loss: 0.5909 - acc: 0.7240 - val_loss: 0.5747 - val_acc: 0.7552
Epoch 106/1500
576/576 [==============================] - 0s 85us/step - loss: 0.5904 - acc: 0.7240 - val_loss: 0.5743 - val_acc: 0.7552
Epoch 107/1500
576/576 [==============================] - 0s 102us/step - loss: 0.5899 - acc: 0.7240 - val_loss: 0.5739 - val_acc: 0.7604
Epoch 108/1500
576/576 [==============================] - 0s 90us/step - loss: 0.5895 - acc: 0.7240 - val_loss: 0.5735 - val_acc: 0.7604
Epoch 109/1500
576/576 [==============================] - 0s 87us/step - loss: 0.5890 - acc: 0.7240 - val_loss: 0.5732 - val_acc: 0.7604
Epoch 110/1500
576/576 [==============================] - 0s 78us/step - loss: 0.5886 - acc: 0.7222 - val_loss: 0.5728 - val_acc: 0.7604
Epoch 111/1500
576/576 [==============================] - 0s 71us/step - loss: 0.5881 - acc: 0.7222 - val_loss: 0.5724 - val_acc: 0.7604
Epoch 112/1500
576/576 [==============================] - 0s 76us/step - loss: 0.5876 - acc: 0.7240 - val_loss: 0.5720 - val_acc: 0.7604
Epoch 113/1500
576/576 [==============================] - 0s 78us/step - loss: 0.5872 - acc: 0.7222 - val_loss: 0.5716 - val_acc: 0.7604
Epoch 114/1500
576/576 [==============================] - 0s 76us/step - loss: 0.5868 - acc: 0.7257 - val_loss: 0.5712 - val_acc: 0.7604
Epoch 115/1500
576/576 [==============================] - 0s 64us/step - loss: 0.5863 - acc: 0.7274 - val_loss: 0.5708 - val_acc: 0.7604
Epoch 116/1500
576/576 [==============================] - 0s 76us/step - loss: 0.5859 - acc: 0.7257 - val_loss: 0.5704 - val_acc: 0.7604
Epoch 117/1500
576/576 [==============================] - 0s 68us/step - loss: 0.5855 - acc: 0.7240 - val_loss: 0.5701 - val_acc: 0.7604
Epoch 118/1500
576/576 [==============================] - 0s 73us/step - loss: 0.5850 - acc: 0.7240 - val_loss: 0.5697 - val_acc: 0.7604
Epoch 119/1500
576/576 [==============================] - 0s 82us/step - loss: 0.5846 - acc: 0.7222 - val_loss: 0.5693 - val_acc: 0.7604
Epoch 120/1500
576/576 [==============================] - 0s 78us/step - loss: 0.5841 - acc: 0.7222 - val_loss: 0.5689 - val_acc: 0.7604
Epoch 121/1500
576/576 [==============================] - 0s 76us/step - loss: 0.5837 - acc: 0.7222 - val_loss: 0.5686 - val_acc: 0.7604
Epoch 122/1500
576/576 [==============================] - 0s 71us/step - loss: 0.5833 - acc: 0.7240 - val_loss: 0.5682 - val_acc: 0.7604
Epoch 123/1500
576/576 [==============================] - 0s 83us/step - loss: 0.5829 - acc: 0.7240 - val_loss: 0.5678 - val_acc: 0.7604
Epoch 124/1500
576/576 [==============================] - 0s 88us/step - loss: 0.5825 - acc: 0.7240 - val_loss: 0.5675 - val_acc: 0.7604
Epoch 125/1500
576/576 [==============================] - 0s 108us/step - loss: 0.5821 - acc: 0.7257 - val_loss: 0.5671 - val_acc: 0.7604
Epoch 126/1500
576/576 [==============================] - 0s 83us/step - loss: 0.5817 - acc: 0.7257 - val_loss: 0.5668 - val_acc: 0.7604
Epoch 127/1500
576/576 [==============================] - 0s 90us/step - loss: 0.5812 - acc: 0.7257 - val_loss: 0.5664 - val_acc: 0.7604
Epoch 128/1500
576/576 [==============================] - 0s 82us/step - loss: 0.5809 - acc: 0.7274 - val_loss: 0.5661 - val_acc: 0.7604
Epoch 129/1500
576/576 [==============================] - 0s 83us/step - loss: 0.5805 - acc: 0.7274 - val_loss: 0.5657 - val_acc: 0.7604
Epoch 130/1500
576/576 [==============================] - 0s 95us/step - loss: 0.5800 - acc: 0.7274 - val_loss: 0.5654 - val_acc: 0.7656
Epoch 131/1500
576/576 [==============================] - 0s 78us/step - loss: 0.5796 - acc: 0.7274 - val_loss: 0.5650 - val_acc: 0.7656
Epoch 132/1500
576/576 [==============================] - 0s 76us/step - loss: 0.5792 - acc: 0.7292 - val_loss: 0.5647 - val_acc: 0.7656
Epoch 133/1500
576/576 [==============================] - 0s 78us/step - loss: 0.5788 - acc: 0.7274 - val_loss: 0.5643 - val_acc: 0.7656
Epoch 134/1500
576/576 [==============================] - 0s 73us/step - loss: 0.5784 - acc: 0.7274 - val_loss: 0.5640 - val_acc: 0.7656
Epoch 135/1500
576/576 [==============================] - 0s 78us/step - loss: 0.5780 - acc: 0.7274 - val_loss: 0.5636 - val_acc: 0.7656
Epoch 136/1500
576/576 [==============================] - 0s 76us/step - loss: 0.5776 - acc: 0.7274 - val_loss: 0.5633 - val_acc: 0.7656
Epoch 137/1500
576/576 [==============================] - 0s 90us/step - loss: 0.5772 - acc: 0.7274 - val_loss: 0.5630 - val_acc: 0.7656
Epoch 138/1500
576/576 [==============================] - 0s 83us/step - loss: 0.5768 - acc: 0.7274 - val_loss: 0.5626 - val_acc: 0.7656
Epoch 139/1500
576/576 [==============================] - 0s 87us/step - loss: 0.5764 - acc: 0.7292 - val_loss: 0.5623 - val_acc: 0.7656
Epoch 140/1500
576/576 [==============================] - 0s 97us/step - loss: 0.5760 - acc: 0.7292 - val_loss: 0.5620 - val_acc: 0.7656
Epoch 141/1500
576/576 [==============================] - 0s 83us/step - loss: 0.5756 - acc: 0.7292 - val_loss: 0.5616 - val_acc: 0.7656
Epoch 142/1500
576/576 [==============================] - 0s 88us/step - loss: 0.5752 - acc: 0.7292 - val_loss: 0.5613 - val_acc: 0.7656
Epoch 143/1500
576/576 [==============================] - 0s 71us/step - loss: 0.5748 - acc: 0.7292 - val_loss: 0.5610 - val_acc: 0.7656
Epoch 144/1500
576/576 [==============================] - 0s 75us/step - loss: 0.5744 - acc: 0.7309 - val_loss: 0.5606 - val_acc: 0.7656
Epoch 145/1500
576/576 [==============================] - 0s 71us/step - loss: 0.5740 - acc: 0.7309 - val_loss: 0.5603 - val_acc: 0.7656
Epoch 146/1500
576/576 [==============================] - 0s 94us/step - loss: 0.5736 - acc: 0.7309 - val_loss: 0.5600 - val_acc: 0.7656
Epoch 147/1500
576/576 [==============================] - 0s 85us/step - loss: 0.5732 - acc: 0.7309 - val_loss: 0.5596 - val_acc: 0.7656
Epoch 148/1500
576/576 [==============================] - 0s 71us/step - loss: 0.5727 - acc: 0.7309 - val_loss: 0.5593 - val_acc: 0.7656
Epoch 149/1500
576/576 [==============================] - 0s 78us/step - loss: 0.5723 - acc: 0.7326 - val_loss: 0.5589 - val_acc: 0.7656
Epoch 150/1500
576/576 [==============================] - 0s 88us/step - loss: 0.5719 - acc: 0.7344 - val_loss: 0.5586 - val_acc: 0.7656
Epoch 151/1500
576/576 [==============================] - 0s 104us/step - loss: 0.5715 - acc: 0.7344 - val_loss: 0.5583 - val_acc: 0.7656
Epoch 152/1500
576/576 [==============================] - 0s 88us/step - loss: 0.5711 - acc: 0.7344 - val_loss: 0.5579 - val_acc: 0.7656
Epoch 153/1500
576/576 [==============================] - 0s 90us/step - loss: 0.5707 - acc: 0.7344 - val_loss: 0.5576 - val_acc: 0.7656
Epoch 154/1500
576/576 [==============================] - 0s 90us/step - loss: 0.5703 - acc: 0.7344 - val_loss: 0.5573 - val_acc: 0.7656
Epoch 155/1500
576/576 [==============================] - 0s 80us/step - loss: 0.5699 - acc: 0.7344 - val_loss: 0.5570 - val_acc: 0.7656
Epoch 156/1500
576/576 [==============================] - 0s 80us/step - loss: 0.5695 - acc: 0.7361 - val_loss: 0.5566 - val_acc: 0.7656
Epoch 157/1500
576/576 [==============================] - 0s 88us/step - loss: 0.5691 - acc: 0.7361 - val_loss: 0.5563 - val_acc: 0.7656
Epoch 158/1500
576/576 [==============================] - 0s 83us/step - loss: 0.5687 - acc: 0.7361 - val_loss: 0.5560 - val_acc: 0.7656
Epoch 159/1500
576/576 [==============================] - 0s 99us/step - loss: 0.5683 - acc: 0.7361 - val_loss: 0.5556 - val_acc: 0.7656
Epoch 160/1500
576/576 [==============================] - 0s 88us/step - loss: 0.5679 - acc: 0.7361 - val_loss: 0.5553 - val_acc: 0.7656
Epoch 161/1500
576/576 [==============================] - 0s 97us/step - loss: 0.5675 - acc: 0.7344 - val_loss: 0.5550 - val_acc: 0.7656
Epoch 162/1500
576/576 [==============================] - 0s 83us/step - loss: 0.5671 - acc: 0.7344 - val_loss: 0.5546 - val_acc: 0.7656
Epoch 163/1500
576/576 [==============================] - 0s 88us/step - loss: 0.5667 - acc: 0.7344 - val_loss: 0.5543 - val_acc: 0.7656
Epoch 164/1500
576/576 [==============================] - 0s 83us/step - loss: 0.5663 - acc: 0.7326 - val_loss: 0.5540 - val_acc: 0.7656
Epoch 165/1500
576/576 [==============================] - 0s 95us/step - loss: 0.5659 - acc: 0.7326 - val_loss: 0.5536 - val_acc: 0.7656
Epoch 166/1500
576/576 [==============================] - 0s 87us/step - loss: 0.5656 - acc: 0.7326 - val_loss: 0.5533 - val_acc: 0.7656
Epoch 167/1500
576/576 [==============================] - 0s 88us/step - loss: 0.5652 - acc: 0.7326 - val_loss: 0.5530 - val_acc: 0.7656
Epoch 168/1500
576/576 [==============================] - 0s 85us/step - loss: 0.5648 - acc: 0.7326 - val_loss: 0.5527 - val_acc: 0.7656
Epoch 169/1500
576/576 [==============================] - 0s 97us/step - loss: 0.5644 - acc: 0.7326 - val_loss: 0.5523 - val_acc: 0.7656
Epoch 170/1500
576/576 [==============================] - 0s 83us/step - loss: 0.5641 - acc: 0.7326 - val_loss: 0.5520 - val_acc: 0.7656
Epoch 171/1500
576/576 [==============================] - 0s 78us/step - loss: 0.5637 - acc: 0.7326 - val_loss: 0.5517 - val_acc: 0.7656
Epoch 172/1500
576/576 [==============================] - 0s 83us/step - loss: 0.5633 - acc: 0.7326 - val_loss: 0.5514 - val_acc: 0.7656
Epoch 173/1500
576/576 [==============================] - 0s 82us/step - loss: 0.5629 - acc: 0.7326 - val_loss: 0.5511 - val_acc: 0.7656
Epoch 174/1500
576/576 [==============================] - 0s 80us/step - loss: 0.5626 - acc: 0.7326 - val_loss: 0.5507 - val_acc: 0.7656
Epoch 175/1500
576/576 [==============================] - 0s 88us/step - loss: 0.5622 - acc: 0.7326 - val_loss: 0.5504 - val_acc: 0.7656
Epoch 176/1500
576/576 [==============================] - 0s 80us/step - loss: 0.5618 - acc: 0.7344 - val_loss: 0.5501 - val_acc: 0.7656
Epoch 177/1500
576/576 [==============================] - 0s 78us/step - loss: 0.5615 - acc: 0.7344 - val_loss: 0.5498 - val_acc: 0.7656
Epoch 178/1500
576/576 [==============================] - 0s 83us/step - loss: 0.5611 - acc: 0.7326 - val_loss: 0.5494 - val_acc: 0.7656
Epoch 179/1500
576/576 [==============================] - 0s 90us/step - loss: 0.5607 - acc: 0.7344 - val_loss: 0.5491 - val_acc: 0.7656
Epoch 180/1500
576/576 [==============================] - 0s 85us/step - loss: 0.5603 - acc: 0.7361 - val_loss: 0.5488 - val_acc: 0.7656
Epoch 181/1500
576/576 [==============================] - 0s 90us/step - loss: 0.5600 - acc: 0.7361 - val_loss: 0.5485 - val_acc: 0.7656
Epoch 182/1500
576/576 [==============================] - 0s 78us/step - loss: 0.5596 - acc: 0.7361 - val_loss: 0.5481 - val_acc: 0.7656
Epoch 183/1500
576/576 [==============================] - 0s 83us/step - loss: 0.5592 - acc: 0.7361 - val_loss: 0.5478 - val_acc: 0.7656
Epoch 184/1500
576/576 [==============================] - 0s 87us/step - loss: 0.5589 - acc: 0.7361 - val_loss: 0.5475 - val_acc: 0.7656
Epoch 185/1500
576/576 [==============================] - 0s 83us/step - loss: 0.5585 - acc: 0.7361 - val_loss: 0.5472 - val_acc: 0.7656
Epoch 186/1500
576/576 [==============================] - 0s 99us/step - loss: 0.5581 - acc: 0.7361 - val_loss: 0.5469 - val_acc: 0.7656
Epoch 187/1500
576/576 [==============================] - 0s 97us/step - loss: 0.5578 - acc: 0.7361 - val_loss: 0.5466 - val_acc: 0.7656
Epoch 188/1500
576/576 [==============================] - 0s 102us/step - loss: 0.5574 - acc: 0.7361 - val_loss: 0.5462 - val_acc: 0.7656
Epoch 189/1500
576/576 [==============================] - 0s 97us/step - loss: 0.5570 - acc: 0.7344 - val_loss: 0.5459 - val_acc: 0.7656
Epoch 190/1500
576/576 [==============================] - 0s 85us/step - loss: 0.5566 - acc: 0.7344 - val_loss: 0.5456 - val_acc: 0.7656
Epoch 191/1500
576/576 [==============================] - 0s 94us/step - loss: 0.5562 - acc: 0.7361 - val_loss: 0.5453 - val_acc: 0.7604
Epoch 192/1500
576/576 [==============================] - 0s 80us/step - loss: 0.5559 - acc: 0.7344 - val_loss: 0.5450 - val_acc: 0.7604
Epoch 193/1500
576/576 [==============================] - 0s 83us/step - loss: 0.5555 - acc: 0.7326 - val_loss: 0.5447 - val_acc: 0.7604
Epoch 194/1500
576/576 [==============================] - 0s 90us/step - loss: 0.5552 - acc: 0.7344 - val_loss: 0.5444 - val_acc: 0.7604
Epoch 195/1500
576/576 [==============================] - 0s 83us/step - loss: 0.5548 - acc: 0.7361 - val_loss: 0.5441 - val_acc: 0.7604
Epoch 196/1500
576/576 [==============================] - 0s 82us/step - loss: 0.5545 - acc: 0.7344 - val_loss: 0.5438 - val_acc: 0.7656
Epoch 197/1500
576/576 [==============================] - 0s 97us/step - loss: 0.5542 - acc: 0.7326 - val_loss: 0.5435 - val_acc: 0.7656
Epoch 198/1500
576/576 [==============================] - 0s 88us/step - loss: 0.5538 - acc: 0.7344 - val_loss: 0.5433 - val_acc: 0.7604
Epoch 199/1500
576/576 [==============================] - 0s 90us/step - loss: 0.5534 - acc: 0.7344 - val_loss: 0.5430 - val_acc: 0.7604
Epoch 200/1500
576/576 [==============================] - 0s 90us/step - loss: 0.5531 - acc: 0.7344 - val_loss: 0.5427 - val_acc: 0.7604
Epoch 201/1500
576/576 [==============================] - 0s 88us/step - loss: 0.5528 - acc: 0.7344 - val_loss: 0.5424 - val_acc: 0.7604
Epoch 202/1500
576/576 [==============================] - 0s 87us/step - loss: 0.5524 - acc: 0.7361 - val_loss: 0.5421 - val_acc: 0.7604
Epoch 203/1500
576/576 [==============================] - 0s 83us/step - loss: 0.5520 - acc: 0.7344 - val_loss: 0.5418 - val_acc: 0.7604
Epoch 204/1500
576/576 [==============================] - 0s 85us/step - loss: 0.5517 - acc: 0.7361 - val_loss: 0.5415 - val_acc: 0.7604
Epoch 205/1500
576/576 [==============================] - 0s 108us/step - loss: 0.5513 - acc: 0.7361 - val_loss: 0.5413 - val_acc: 0.7604
Epoch 206/1500
576/576 [==============================] - 0s 78us/step - loss: 0.5510 - acc: 0.7361 - val_loss: 0.5410 - val_acc: 0.7604
Epoch 207/1500
576/576 [==============================] - 0s 115us/step - loss: 0.5507 - acc: 0.7361 - val_loss: 0.5407 - val_acc: 0.7552
Epoch 208/1500
576/576 [==============================] - 0s 104us/step - loss: 0.5503 - acc: 0.7378 - val_loss: 0.5404 - val_acc: 0.7552
Epoch 209/1500
576/576 [==============================] - 0s 90us/step - loss: 0.5500 - acc: 0.7378 - val_loss: 0.5402 - val_acc: 0.7552
Epoch 210/1500
576/576 [==============================] - 0s 92us/step - loss: 0.5496 - acc: 0.7378 - val_loss: 0.5399 - val_acc: 0.7552
Epoch 211/1500
576/576 [==============================] - 0s 83us/step - loss: 0.5493 - acc: 0.7378 - val_loss: 0.5396 - val_acc: 0.7552
Epoch 212/1500
576/576 [==============================] - 0s 80us/step - loss: 0.5489 - acc: 0.7378 - val_loss: 0.5394 - val_acc: 0.7552
Epoch 213/1500
576/576 [==============================] - 0s 101us/step - loss: 0.5486 - acc: 0.7396 - val_loss: 0.5391 - val_acc: 0.7552
Epoch 214/1500
576/576 [==============================] - 0s 83us/step - loss: 0.5482 - acc: 0.7396 - val_loss: 0.5389 - val_acc: 0.7552
Epoch 215/1500
576/576 [==============================] - 0s 90us/step - loss: 0.5479 - acc: 0.7396 - val_loss: 0.5386 - val_acc: 0.7552
Epoch 216/1500
576/576 [==============================] - 0s 85us/step - loss: 0.5476 - acc: 0.7378 - val_loss: 0.5383 - val_acc: 0.7552
Epoch 217/1500
576/576 [==============================] - 0s 99us/step - loss: 0.5472 - acc: 0.7378 - val_loss: 0.5381 - val_acc: 0.7552
Epoch 218/1500
576/576 [==============================] - 0s 90us/step - loss: 0.5469 - acc: 0.7378 - val_loss: 0.5378 - val_acc: 0.7552
Epoch 219/1500
576/576 [==============================] - 0s 95us/step - loss: 0.5466 - acc: 0.7378 - val_loss: 0.5376 - val_acc: 0.7552
Epoch 220/1500
576/576 [==============================] - 0s 87us/step - loss: 0.5462 - acc: 0.7378 - val_loss: 0.5374 - val_acc: 0.7552
Epoch 221/1500
576/576 [==============================] - 0s 76us/step - loss: 0.5459 - acc: 0.7378 - val_loss: 0.5371 - val_acc: 0.7552
Epoch 222/1500
576/576 [==============================] - 0s 83us/step - loss: 0.5455 - acc: 0.7378 - val_loss: 0.5369 - val_acc: 0.7552
Epoch 223/1500
576/576 [==============================] - 0s 85us/step - loss: 0.5452 - acc: 0.7378 - val_loss: 0.5366 - val_acc: 0.7552
Epoch 224/1500
576/576 [==============================] - 0s 78us/step - loss: 0.5449 - acc: 0.7378 - val_loss: 0.5364 - val_acc: 0.7552
Epoch 225/1500
576/576 [==============================] - 0s 80us/step - loss: 0.5445 - acc: 0.7378 - val_loss: 0.5361 - val_acc: 0.7552
Epoch 226/1500
576/576 [==============================] - 0s 82us/step - loss: 0.5442 - acc: 0.7378 - val_loss: 0.5359 - val_acc: 0.7552
Epoch 227/1500
576/576 [==============================] - 0s 85us/step - loss: 0.5439 - acc: 0.7396 - val_loss: 0.5357 - val_acc: 0.7552
Epoch 228/1500
576/576 [==============================] - 0s 83us/step - loss: 0.5436 - acc: 0.7396 - val_loss: 0.5354 - val_acc: 0.7552
Epoch 229/1500
576/576 [==============================] - 0s 85us/step - loss: 0.5433 - acc: 0.7396 - val_loss: 0.5352 - val_acc: 0.7552
Epoch 230/1500
576/576 [==============================] - 0s 88us/step - loss: 0.5430 - acc: 0.7396 - val_loss: 0.5349 - val_acc: 0.7552
Epoch 231/1500
576/576 [==============================] - 0s 78us/step - loss: 0.5427 - acc: 0.7396 - val_loss: 0.5347 - val_acc: 0.7552
Epoch 232/1500
576/576 [==============================] - 0s 78us/step - loss: 0.5424 - acc: 0.7396 - val_loss: 0.5345 - val_acc: 0.7552
Epoch 233/1500
576/576 [==============================] - 0s 92us/step - loss: 0.5421 - acc: 0.7396 - val_loss: 0.5343 - val_acc: 0.7552
Epoch 234/1500
576/576 [==============================] - 0s 71us/step - loss: 0.5417 - acc: 0.7396 - val_loss: 0.5340 - val_acc: 0.7552
Epoch 235/1500
576/576 [==============================] - 0s 68us/step - loss: 0.5414 - acc: 0.7396 - val_loss: 0.5338 - val_acc: 0.7552
Epoch 236/1500
576/576 [==============================] - 0s 92us/step - loss: 0.5411 - acc: 0.7396 - val_loss: 0.5336 - val_acc: 0.7552
Epoch 237/1500
576/576 [==============================] - 0s 82us/step - loss: 0.5408 - acc: 0.7396 - val_loss: 0.5334 - val_acc: 0.7552
Epoch 238/1500
576/576 [==============================] - 0s 78us/step - loss: 0.5405 - acc: 0.7396 - val_loss: 0.5332 - val_acc: 0.7604
Epoch 239/1500
576/576 [==============================] - 0s 80us/step - loss: 0.5402 - acc: 0.7413 - val_loss: 0.5330 - val_acc: 0.7604
Epoch 240/1500
576/576 [==============================] - 0s 80us/step - loss: 0.5399 - acc: 0.7413 - val_loss: 0.5328 - val_acc: 0.7604
Epoch 241/1500
576/576 [==============================] - 0s 80us/step - loss: 0.5396 - acc: 0.7413 - val_loss: 0.5326 - val_acc: 0.7604
Epoch 242/1500
576/576 [==============================] - 0s 71us/step - loss: 0.5393 - acc: 0.7413 - val_loss: 0.5324 - val_acc: 0.7604
Epoch 243/1500
576/576 [==============================] - 0s 69us/step - loss: 0.5391 - acc: 0.7396 - val_loss: 0.5321 - val_acc: 0.7604
Epoch 244/1500
576/576 [==============================] - 0s 85us/step - loss: 0.5388 - acc: 0.7396 - val_loss: 0.5319 - val_acc: 0.7604
Epoch 245/1500
576/576 [==============================] - 0s 80us/step - loss: 0.5385 - acc: 0.7413 - val_loss: 0.5317 - val_acc: 0.7552
Epoch 246/1500
576/576 [==============================] - 0s 83us/step - loss: 0.5382 - acc: 0.7413 - val_loss: 0.5315 - val_acc: 0.7552
Epoch 247/1500
576/576 [==============================] - 0s 87us/step - loss: 0.5379 - acc: 0.7396 - val_loss: 0.5313 - val_acc: 0.7552
Epoch 248/1500
576/576 [==============================] - 0s 102us/step - loss: 0.5376 - acc: 0.7396 - val_loss: 0.5311 - val_acc: 0.7552
Epoch 249/1500
576/576 [==============================] - 0s 80us/step - loss: 0.5373 - acc: 0.7413 - val_loss: 0.5309 - val_acc: 0.7552
Epoch 250/1500
576/576 [==============================] - 0s 82us/step - loss: 0.5370 - acc: 0.7413 - val_loss: 0.5307 - val_acc: 0.7552
Epoch 251/1500
576/576 [==============================] - 0s 78us/step - loss: 0.5368 - acc: 0.7413 - val_loss: 0.5305 - val_acc: 0.7552
Epoch 252/1500
576/576 [==============================] - 0s 76us/step - loss: 0.5365 - acc: 0.7431 - val_loss: 0.5303 - val_acc: 0.7552
Epoch 253/1500
576/576 [==============================] - 0s 88us/step - loss: 0.5362 - acc: 0.7431 - val_loss: 0.5301 - val_acc: 0.7552
Epoch 254/1500
576/576 [==============================] - 0s 92us/step - loss: 0.5359 - acc: 0.7413 - val_loss: 0.5299 - val_acc: 0.7552
Epoch 255/1500
576/576 [==============================] - 0s 76us/step - loss: 0.5357 - acc: 0.7413 - val_loss: 0.5297 - val_acc: 0.7552
Epoch 256/1500
576/576 [==============================] - 0s 76us/step - loss: 0.5354 - acc: 0.7431 - val_loss: 0.5295 - val_acc: 0.7552
Epoch 257/1500
576/576 [==============================] - 0s 76us/step - loss: 0.5351 - acc: 0.7413 - val_loss: 0.5293 - val_acc: 0.7552
Epoch 258/1500
576/576 [==============================] - 0s 82us/step - loss: 0.5349 - acc: 0.7448 - val_loss: 0.5291 - val_acc: 0.7552
Epoch 259/1500
576/576 [==============================] - 0s 73us/step - loss: 0.5346 - acc: 0.7431 - val_loss: 0.5289 - val_acc: 0.7552
Epoch 260/1500
576/576 [==============================] - 0s 94us/step - loss: 0.5343 - acc: 0.7465 - val_loss: 0.5288 - val_acc: 0.7552
Epoch 261/1500
576/576 [==============================] - 0s 82us/step - loss: 0.5340 - acc: 0.7431 - val_loss: 0.5286 - val_acc: 0.7552
Epoch 262/1500
576/576 [==============================] - 0s 80us/step - loss: 0.5338 - acc: 0.7448 - val_loss: 0.5284 - val_acc: 0.7552
Epoch 263/1500
576/576 [==============================] - 0s 76us/step - loss: 0.5335 - acc: 0.7448 - val_loss: 0.5282 - val_acc: 0.7552
Epoch 264/1500
576/576 [==============================] - 0s 88us/step - loss: 0.5332 - acc: 0.7448 - val_loss: 0.5280 - val_acc: 0.7552
Epoch 265/1500
576/576 [==============================] - 0s 80us/step - loss: 0.5330 - acc: 0.7448 - val_loss: 0.5278 - val_acc: 0.7552
Epoch 266/1500
576/576 [==============================] - 0s 85us/step - loss: 0.5327 - acc: 0.7448 - val_loss: 0.5276 - val_acc: 0.7604
Epoch 267/1500
576/576 [==============================] - 0s 76us/step - loss: 0.5324 - acc: 0.7448 - val_loss: 0.5274 - val_acc: 0.7604
Epoch 268/1500
576/576 [==============================] - 0s 85us/step - loss: 0.5322 - acc: 0.7448 - val_loss: 0.5273 - val_acc: 0.7604
Epoch 269/1500
576/576 [==============================] - 0s 78us/step - loss: 0.5319 - acc: 0.7465 - val_loss: 0.5271 - val_acc: 0.7604
Epoch 270/1500
576/576 [==============================] - 0s 78us/step - loss: 0.5316 - acc: 0.7465 - val_loss: 0.5269 - val_acc: 0.7604
Epoch 271/1500
576/576 [==============================] - 0s 76us/step - loss: 0.5314 - acc: 0.7465 - val_loss: 0.5267 - val_acc: 0.7604
Epoch 272/1500
576/576 [==============================] - 0s 73us/step - loss: 0.5311 - acc: 0.7465 - val_loss: 0.5265 - val_acc: 0.7604
Epoch 273/1500
576/576 [==============================] - 0s 83us/step - loss: 0.5308 - acc: 0.7465 - val_loss: 0.5263 - val_acc: 0.7604
Epoch 274/1500
576/576 [==============================] - 0s 76us/step - loss: 0.5306 - acc: 0.7465 - val_loss: 0.5261 - val_acc: 0.7604
Epoch 275/1500
576/576 [==============================] - 0s 83us/step - loss: 0.5303 - acc: 0.7465 - val_loss: 0.5259 - val_acc: 0.7604
Epoch 276/1500
576/576 [==============================] - 0s 83us/step - loss: 0.5300 - acc: 0.7465 - val_loss: 0.5258 - val_acc: 0.7604
Epoch 277/1500
576/576 [==============================] - 0s 75us/step - loss: 0.5298 - acc: 0.7448 - val_loss: 0.5256 - val_acc: 0.7604
Epoch 278/1500
576/576 [==============================] - 0s 85us/step - loss: 0.5296 - acc: 0.7448 - val_loss: 0.5254 - val_acc: 0.7656
Epoch 279/1500
576/576 [==============================] - 0s 85us/step - loss: 0.5293 - acc: 0.7448 - val_loss: 0.5252 - val_acc: 0.7656
Epoch 280/1500
576/576 [==============================] - 0s 76us/step - loss: 0.5290 - acc: 0.7448 - val_loss: 0.5250 - val_acc: 0.7656
Epoch 281/1500
576/576 [==============================] - 0s 76us/step - loss: 0.5288 - acc: 0.7448 - val_loss: 0.5248 - val_acc: 0.7708
Epoch 282/1500
576/576 [==============================] - 0s 73us/step - loss: 0.5285 - acc: 0.7448 - val_loss: 0.5246 - val_acc: 0.7708
Epoch 283/1500
576/576 [==============================] - 0s 78us/step - loss: 0.5282 - acc: 0.7448 - val_loss: 0.5245 - val_acc: 0.7708
Epoch 284/1500
576/576 [==============================] - 0s 76us/step - loss: 0.5280 - acc: 0.7431 - val_loss: 0.5243 - val_acc: 0.7708
Epoch 285/1500
576/576 [==============================] - 0s 82us/step - loss: 0.5277 - acc: 0.7431 - val_loss: 0.5241 - val_acc: 0.7708
Epoch 286/1500
576/576 [==============================] - 0s 75us/step - loss: 0.5275 - acc: 0.7431 - val_loss: 0.5239 - val_acc: 0.7708
Epoch 287/1500
576/576 [==============================] - 0s 73us/step - loss: 0.5272 - acc: 0.7431 - val_loss: 0.5237 - val_acc: 0.7708
Epoch 288/1500
576/576 [==============================] - 0s 80us/step - loss: 0.5270 - acc: 0.7431 - val_loss: 0.5236 - val_acc: 0.7708
Epoch 289/1500
576/576 [==============================] - 0s 78us/step - loss: 0.5267 - acc: 0.7431 - val_loss: 0.5234 - val_acc: 0.7708
Epoch 290/1500
576/576 [==============================] - 0s 82us/step - loss: 0.5265 - acc: 0.7431 - val_loss: 0.5233 - val_acc: 0.7708
Epoch 291/1500
576/576 [==============================] - 0s 71us/step - loss: 0.5263 - acc: 0.7431 - val_loss: 0.5231 - val_acc: 0.7708
Epoch 292/1500
576/576 [==============================] - 0s 71us/step - loss: 0.5260 - acc: 0.7431 - val_loss: 0.5230 - val_acc: 0.7708
Epoch 293/1500
576/576 [==============================] - 0s 76us/step - loss: 0.5258 - acc: 0.7431 - val_loss: 0.5228 - val_acc: 0.7708
Epoch 294/1500
576/576 [==============================] - 0s 83us/step - loss: 0.5256 - acc: 0.7448 - val_loss: 0.5227 - val_acc: 0.7708
Epoch 295/1500
576/576 [==============================] - 0s 69us/step - loss: 0.5254 - acc: 0.7448 - val_loss: 0.5225 - val_acc: 0.7760
Epoch 296/1500
576/576 [==============================] - 0s 76us/step - loss: 0.5251 - acc: 0.7431 - val_loss: 0.5224 - val_acc: 0.7760
Epoch 297/1500
576/576 [==============================] - 0s 88us/step - loss: 0.5249 - acc: 0.7448 - val_loss: 0.5222 - val_acc: 0.7760
Epoch 298/1500
576/576 [==============================] - 0s 78us/step - loss: 0.5247 - acc: 0.7448 - val_loss: 0.5221 - val_acc: 0.7760
Epoch 299/1500
576/576 [==============================] - 0s 83us/step - loss: 0.5244 - acc: 0.7448 - val_loss: 0.5219 - val_acc: 0.7760
Epoch 300/1500
576/576 [==============================] - 0s 75us/step - loss: 0.5242 - acc: 0.7465 - val_loss: 0.5218 - val_acc: 0.7760
Epoch 301/1500
576/576 [==============================] - 0s 66us/step - loss: 0.5239 - acc: 0.7465 - val_loss: 0.5216 - val_acc: 0.7760
Epoch 302/1500
576/576 [==============================] - 0s 68us/step - loss: 0.5237 - acc: 0.7448 - val_loss: 0.5215 - val_acc: 0.7760
Epoch 303/1500
576/576 [==============================] - 0s 104us/step - loss: 0.5234 - acc: 0.7448 - val_loss: 0.5214 - val_acc: 0.7760
Epoch 304/1500
576/576 [==============================] - 0s 115us/step - loss: 0.5232 - acc: 0.7431 - val_loss: 0.5212 - val_acc: 0.7760
Epoch 305/1500
576/576 [==============================] - 0s 90us/step - loss: 0.5230 - acc: 0.7431 - val_loss: 0.5211 - val_acc: 0.7760
Epoch 306/1500
576/576 [==============================] - 0s 99us/step - loss: 0.5227 - acc: 0.7431 - val_loss: 0.5209 - val_acc: 0.7760
Epoch 307/1500
576/576 [==============================] - 0s 94us/step - loss: 0.5225 - acc: 0.7448 - val_loss: 0.5208 - val_acc: 0.7708
Epoch 308/1500
576/576 [==============================] - 0s 90us/step - loss: 0.5223 - acc: 0.7448 - val_loss: 0.5206 - val_acc: 0.7708
Epoch 309/1500
576/576 [==============================] - 0s 95us/step - loss: 0.5220 - acc: 0.7431 - val_loss: 0.5205 - val_acc: 0.7708
Epoch 310/1500
576/576 [==============================] - 0s 92us/step - loss: 0.5218 - acc: 0.7448 - val_loss: 0.5204 - val_acc: 0.7708
Epoch 311/1500
576/576 [==============================] - 0s 78us/step - loss: 0.5216 - acc: 0.7431 - val_loss: 0.5202 - val_acc: 0.7708
Epoch 312/1500
576/576 [==============================] - 0s 76us/step - loss: 0.5213 - acc: 0.7431 - val_loss: 0.5201 - val_acc: 0.7708
Epoch 313/1500
576/576 [==============================] - 0s 87us/step - loss: 0.5211 - acc: 0.7483 - val_loss: 0.5200 - val_acc: 0.7708
Epoch 314/1500
576/576 [==============================] - 0s 80us/step - loss: 0.5209 - acc: 0.7465 - val_loss: 0.5198 - val_acc: 0.7708
Epoch 315/1500
576/576 [==============================] - 0s 76us/step - loss: 0.5207 - acc: 0.7465 - val_loss: 0.5197 - val_acc: 0.7708
Epoch 316/1500
576/576 [==============================] - 0s 92us/step - loss: 0.5204 - acc: 0.7483 - val_loss: 0.5195 - val_acc: 0.7708
Epoch 317/1500
576/576 [==============================] - 0s 85us/step - loss: 0.5202 - acc: 0.7483 - val_loss: 0.5194 - val_acc: 0.7708
Epoch 318/1500
576/576 [==============================] - 0s 78us/step - loss: 0.5200 - acc: 0.7500 - val_loss: 0.5193 - val_acc: 0.7708
Epoch 319/1500
576/576 [==============================] - 0s 83us/step - loss: 0.5198 - acc: 0.7465 - val_loss: 0.5191 - val_acc: 0.7760
Epoch 320/1500
576/576 [==============================] - 0s 78us/step - loss: 0.5196 - acc: 0.7483 - val_loss: 0.5190 - val_acc: 0.7760
Epoch 321/1500
576/576 [==============================] - 0s 80us/step - loss: 0.5194 - acc: 0.7483 - val_loss: 0.5189 - val_acc: 0.7760
Epoch 322/1500
576/576 [==============================] - 0s 87us/step - loss: 0.5191 - acc: 0.7483 - val_loss: 0.5187 - val_acc: 0.7760
Epoch 323/1500
576/576 [==============================] - 0s 83us/step - loss: 0.5189 - acc: 0.7483 - val_loss: 0.5186 - val_acc: 0.7760
Epoch 324/1500
576/576 [==============================] - 0s 75us/step - loss: 0.5187 - acc: 0.7500 - val_loss: 0.5185 - val_acc: 0.7760
Epoch 325/1500
576/576 [==============================] - 0s 87us/step - loss: 0.5184 - acc: 0.7483 - val_loss: 0.5183 - val_acc: 0.7760
Epoch 326/1500
576/576 [==============================] - 0s 76us/step - loss: 0.5182 - acc: 0.7500 - val_loss: 0.5182 - val_acc: 0.7760
Epoch 327/1500
576/576 [==============================] - 0s 82us/step - loss: 0.5180 - acc: 0.7500 - val_loss: 0.5181 - val_acc: 0.7760
Epoch 328/1500
576/576 [==============================] - 0s 69us/step - loss: 0.5178 - acc: 0.7483 - val_loss: 0.5179 - val_acc: 0.7760
Epoch 329/1500
576/576 [==============================] - 0s 75us/step - loss: 0.5176 - acc: 0.7483 - val_loss: 0.5178 - val_acc: 0.7760
Epoch 330/1500
576/576 [==============================] - 0s 80us/step - loss: 0.5174 - acc: 0.7483 - val_loss: 0.5177 - val_acc: 0.7760
Epoch 331/1500
576/576 [==============================] - 0s 83us/step - loss: 0.5171 - acc: 0.7517 - val_loss: 0.5176 - val_acc: 0.7760
Epoch 332/1500
576/576 [==============================] - 0s 87us/step - loss: 0.5169 - acc: 0.7517 - val_loss: 0.5174 - val_acc: 0.7760
Epoch 333/1500
576/576 [==============================] - 0s 76us/step - loss: 0.5167 - acc: 0.7500 - val_loss: 0.5173 - val_acc: 0.7760
Epoch 334/1500
576/576 [==============================] - 0s 68us/step - loss: 0.5165 - acc: 0.7483 - val_loss: 0.5172 - val_acc: 0.7760
Epoch 335/1500
576/576 [==============================] - 0s 83us/step - loss: 0.5163 - acc: 0.7500 - val_loss: 0.5171 - val_acc: 0.7760
Epoch 336/1500
576/576 [==============================] - 0s 83us/step - loss: 0.5161 - acc: 0.7517 - val_loss: 0.5169 - val_acc: 0.7760
Epoch 337/1500
576/576 [==============================] - 0s 87us/step - loss: 0.5159 - acc: 0.7500 - val_loss: 0.5168 - val_acc: 0.7760
Epoch 338/1500
576/576 [==============================] - 0s 78us/step - loss: 0.5157 - acc: 0.7483 - val_loss: 0.5167 - val_acc: 0.7760
Epoch 339/1500
576/576 [==============================] - 0s 69us/step - loss: 0.5154 - acc: 0.7500 - val_loss: 0.5166 - val_acc: 0.7760
Epoch 340/1500
576/576 [==============================] - 0s 73us/step - loss: 0.5152 - acc: 0.7517 - val_loss: 0.5165 - val_acc: 0.7760
Epoch 341/1500
576/576 [==============================] - 0s 78us/step - loss: 0.5150 - acc: 0.7535 - val_loss: 0.5164 - val_acc: 0.7760
Epoch 342/1500
576/576 [==============================] - 0s 76us/step - loss: 0.5148 - acc: 0.7552 - val_loss: 0.5162 - val_acc: 0.7760
Epoch 343/1500
576/576 [==============================] - 0s 75us/step - loss: 0.5146 - acc: 0.7535 - val_loss: 0.5161 - val_acc: 0.7760
Epoch 344/1500
576/576 [==============================] - 0s 73us/step - loss: 0.5144 - acc: 0.7535 - val_loss: 0.5160 - val_acc: 0.7760
Epoch 345/1500
576/576 [==============================] - 0s 82us/step - loss: 0.5142 - acc: 0.7535 - val_loss: 0.5159 - val_acc: 0.7760
Epoch 346/1500
576/576 [==============================] - 0s 78us/step - loss: 0.5140 - acc: 0.7552 - val_loss: 0.5158 - val_acc: 0.7708
Epoch 347/1500
576/576 [==============================] - 0s 75us/step - loss: 0.5138 - acc: 0.7569 - val_loss: 0.5157 - val_acc: 0.7708
Epoch 348/1500
576/576 [==============================] - 0s 78us/step - loss: 0.5136 - acc: 0.7569 - val_loss: 0.5156 - val_acc: 0.7708
Epoch 349/1500
576/576 [==============================] - 0s 83us/step - loss: 0.5134 - acc: 0.7552 - val_loss: 0.5155 - val_acc: 0.7708
Epoch 350/1500
576/576 [==============================] - 0s 69us/step - loss: 0.5132 - acc: 0.7569 - val_loss: 0.5154 - val_acc: 0.7708
Epoch 351/1500
576/576 [==============================] - 0s 78us/step - loss: 0.5130 - acc: 0.7535 - val_loss: 0.5152 - val_acc: 0.7708
Epoch 352/1500
576/576 [==============================] - 0s 83us/step - loss: 0.5128 - acc: 0.7535 - val_loss: 0.5151 - val_acc: 0.7708
Epoch 353/1500
576/576 [==============================] - 0s 92us/step - loss: 0.5126 - acc: 0.7535 - val_loss: 0.5150 - val_acc: 0.7708
Epoch 354/1500
576/576 [==============================] - 0s 75us/step - loss: 0.5124 - acc: 0.7535 - val_loss: 0.5149 - val_acc: 0.7708
Epoch 355/1500
576/576 [==============================] - 0s 69us/step - loss: 0.5122 - acc: 0.7535 - val_loss: 0.5148 - val_acc: 0.7708
Epoch 356/1500
576/576 [==============================] - 0s 75us/step - loss: 0.5120 - acc: 0.7535 - val_loss: 0.5147 - val_acc: 0.7708
Epoch 357/1500
576/576 [==============================] - 0s 73us/step - loss: 0.5118 - acc: 0.7535 - val_loss: 0.5146 - val_acc: 0.7708
Epoch 358/1500
576/576 [==============================] - 0s 82us/step - loss: 0.5116 - acc: 0.7535 - val_loss: 0.5145 - val_acc: 0.7708
Epoch 359/1500
576/576 [==============================] - 0s 90us/step - loss: 0.5114 - acc: 0.7535 - val_loss: 0.5144 - val_acc: 0.7708
Epoch 360/1500
576/576 [==============================] - 0s 78us/step - loss: 0.5112 - acc: 0.7552 - val_loss: 0.5143 - val_acc: 0.7708
Epoch 361/1500
576/576 [==============================] - 0s 71us/step - loss: 0.5110 - acc: 0.7552 - val_loss: 0.5142 - val_acc: 0.7708
Epoch 362/1500
576/576 [==============================] - 0s 75us/step - loss: 0.5108 - acc: 0.7552 - val_loss: 0.5141 - val_acc: 0.7708
Epoch 363/1500
576/576 [==============================] - 0s 68us/step - loss: 0.5106 - acc: 0.7535 - val_loss: 0.5140 - val_acc: 0.7708
Epoch 364/1500
576/576 [==============================] - 0s 75us/step - loss: 0.5105 - acc: 0.7535 - val_loss: 0.5139 - val_acc: 0.7708
Epoch 365/1500
576/576 [==============================] - 0s 75us/step - loss: 0.5103 - acc: 0.7552 - val_loss: 0.5138 - val_acc: 0.7656
Epoch 366/1500
576/576 [==============================] - 0s 80us/step - loss: 0.5101 - acc: 0.7552 - val_loss: 0.5137 - val_acc: 0.7656
Epoch 367/1500
576/576 [==============================] - 0s 97us/step - loss: 0.5099 - acc: 0.7535 - val_loss: 0.5136 - val_acc: 0.7656
Epoch 368/1500
576/576 [==============================] - 0s 87us/step - loss: 0.5097 - acc: 0.7552 - val_loss: 0.5135 - val_acc: 0.7656
Epoch 369/1500
576/576 [==============================] - 0s 78us/step - loss: 0.5095 - acc: 0.7535 - val_loss: 0.5134 - val_acc: 0.7656
Epoch 370/1500
576/576 [==============================] - 0s 88us/step - loss: 0.5093 - acc: 0.7535 - val_loss: 0.5133 - val_acc: 0.7656
Epoch 371/1500
576/576 [==============================] - 0s 76us/step - loss: 0.5091 - acc: 0.7552 - val_loss: 0.5132 - val_acc: 0.7656
Epoch 372/1500
576/576 [==============================] - 0s 87us/step - loss: 0.5090 - acc: 0.7535 - val_loss: 0.5131 - val_acc: 0.7708
Epoch 373/1500
576/576 [==============================] - 0s 97us/step - loss: 0.5088 - acc: 0.7535 - val_loss: 0.5130 - val_acc: 0.7708
Epoch 374/1500
576/576 [==============================] - 0s 90us/step - loss: 0.5086 - acc: 0.7552 - val_loss: 0.5129 - val_acc: 0.7708
Epoch 375/1500
576/576 [==============================] - 0s 76us/step - loss: 0.5084 - acc: 0.7569 - val_loss: 0.5128 - val_acc: 0.7708
Epoch 376/1500
576/576 [==============================] - 0s 90us/step - loss: 0.5082 - acc: 0.7569 - val_loss: 0.5127 - val_acc: 0.7708
Epoch 377/1500
576/576 [==============================] - 0s 78us/step - loss: 0.5080 - acc: 0.7569 - val_loss: 0.5126 - val_acc: 0.7708
Epoch 378/1500
576/576 [==============================] - 0s 78us/step - loss: 0.5079 - acc: 0.7587 - val_loss: 0.5125 - val_acc: 0.7708
Epoch 379/1500
576/576 [==============================] - 0s 78us/step - loss: 0.5077 - acc: 0.7569 - val_loss: 0.5124 - val_acc: 0.7708
Epoch 380/1500
576/576 [==============================] - 0s 83us/step - loss: 0.5075 - acc: 0.7569 - val_loss: 0.5124 - val_acc: 0.7760
Epoch 381/1500
576/576 [==============================] - 0s 82us/step - loss: 0.5073 - acc: 0.7569 - val_loss: 0.5123 - val_acc: 0.7760
Epoch 382/1500
576/576 [==============================] - 0s 80us/step - loss: 0.5072 - acc: 0.7587 - val_loss: 0.5122 - val_acc: 0.7760
Epoch 383/1500
576/576 [==============================] - 0s 88us/step - loss: 0.5070 - acc: 0.7587 - val_loss: 0.5121 - val_acc: 0.7760
Epoch 384/1500
576/576 [==============================] - 0s 85us/step - loss: 0.5069 - acc: 0.7569 - val_loss: 0.5120 - val_acc: 0.7760
Epoch 385/1500
576/576 [==============================] - 0s 85us/step - loss: 0.5066 - acc: 0.7569 - val_loss: 0.5119 - val_acc: 0.7760
Epoch 386/1500
576/576 [==============================] - 0s 78us/step - loss: 0.5065 - acc: 0.7569 - val_loss: 0.5118 - val_acc: 0.7760
Epoch 387/1500
576/576 [==============================] - 0s 76us/step - loss: 0.5063 - acc: 0.7587 - val_loss: 0.5117 - val_acc: 0.7760
Epoch 388/1500
576/576 [==============================] - 0s 78us/step - loss: 0.5062 - acc: 0.7569 - val_loss: 0.5116 - val_acc: 0.7760
Epoch 389/1500
576/576 [==============================] - 0s 73us/step - loss: 0.5060 - acc: 0.7587 - val_loss: 0.5115 - val_acc: 0.7760
Epoch 390/1500
576/576 [==============================] - 0s 78us/step - loss: 0.5058 - acc: 0.7587 - val_loss: 0.5114 - val_acc: 0.7760
Epoch 391/1500
576/576 [==============================] - 0s 78us/step - loss: 0.5056 - acc: 0.7587 - val_loss: 0.5113 - val_acc: 0.7760
Epoch 392/1500
576/576 [==============================] - 0s 78us/step - loss: 0.5054 - acc: 0.7587 - val_loss: 0.5113 - val_acc: 0.7760
Epoch 393/1500
576/576 [==============================] - 0s 94us/step - loss: 0.5053 - acc: 0.7587 - val_loss: 0.5112 - val_acc: 0.7760
Epoch 394/1500
576/576 [==============================] - 0s 95us/step - loss: 0.5051 - acc: 0.7587 - val_loss: 0.5111 - val_acc: 0.7760
Epoch 395/1500
576/576 [==============================] - 0s 87us/step - loss: 0.5050 - acc: 0.7604 - val_loss: 0.5110 - val_acc: 0.7760
Epoch 396/1500
576/576 [==============================] - 0s 88us/step - loss: 0.5048 - acc: 0.7604 - val_loss: 0.5109 - val_acc: 0.7760
Epoch 397/1500
576/576 [==============================] - 0s 83us/step - loss: 0.5047 - acc: 0.7604 - val_loss: 0.5108 - val_acc: 0.7760
Epoch 398/1500
576/576 [==============================] - 0s 73us/step - loss: 0.5044 - acc: 0.7604 - val_loss: 0.5107 - val_acc: 0.7760
Epoch 399/1500
576/576 [==============================] - 0s 80us/step - loss: 0.5043 - acc: 0.7604 - val_loss: 0.5107 - val_acc: 0.7760
Epoch 400/1500
576/576 [==============================] - 0s 97us/step - loss: 0.5041 - acc: 0.7604 - val_loss: 0.5106 - val_acc: 0.7760
Epoch 401/1500
576/576 [==============================] - 0s 80us/step - loss: 0.5039 - acc: 0.7604 - val_loss: 0.5105 - val_acc: 0.7760
Epoch 402/1500
576/576 [==============================] - 0s 73us/step - loss: 0.5038 - acc: 0.7604 - val_loss: 0.5104 - val_acc: 0.7760
Epoch 403/1500
576/576 [==============================] - 0s 73us/step - loss: 0.5036 - acc: 0.7604 - val_loss: 0.5103 - val_acc: 0.7760
Epoch 404/1500
576/576 [==============================] - 0s 80us/step - loss: 0.5035 - acc: 0.7604 - val_loss: 0.5103 - val_acc: 0.7760
Epoch 405/1500
576/576 [==============================] - 0s 73us/step - loss: 0.5033 - acc: 0.7639 - val_loss: 0.5102 - val_acc: 0.7760
Epoch 406/1500
576/576 [==============================] - 0s 71us/step - loss: 0.5032 - acc: 0.7639 - val_loss: 0.5101 - val_acc: 0.7760
Epoch 407/1500
576/576 [==============================] - 0s 69us/step - loss: 0.5030 - acc: 0.7639 - val_loss: 0.5100 - val_acc: 0.7760
Epoch 408/1500
576/576 [==============================] - 0s 73us/step - loss: 0.5028 - acc: 0.7639 - val_loss: 0.5100 - val_acc: 0.7760
Epoch 409/1500
576/576 [==============================] - 0s 80us/step - loss: 0.5026 - acc: 0.7639 - val_loss: 0.5099 - val_acc: 0.7760
Epoch 410/1500
576/576 [==============================] - 0s 73us/step - loss: 0.5025 - acc: 0.7639 - val_loss: 0.5098 - val_acc: 0.7760
Epoch 411/1500
576/576 [==============================] - 0s 88us/step - loss: 0.5023 - acc: 0.7639 - val_loss: 0.5097 - val_acc: 0.7760
Epoch 412/1500
576/576 [==============================] - 0s 85us/step - loss: 0.5021 - acc: 0.7639 - val_loss: 0.5097 - val_acc: 0.7760
Epoch 413/1500
576/576 [==============================] - 0s 87us/step - loss: 0.5020 - acc: 0.7639 - val_loss: 0.5096 - val_acc: 0.7760
Epoch 414/1500
576/576 [==============================] - 0s 75us/step - loss: 0.5019 - acc: 0.7639 - val_loss: 0.5095 - val_acc: 0.7812
Epoch 415/1500
576/576 [==============================] - 0s 90us/step - loss: 0.5017 - acc: 0.7639 - val_loss: 0.5095 - val_acc: 0.7760
Epoch 416/1500
576/576 [==============================] - 0s 71us/step - loss: 0.5015 - acc: 0.7639 - val_loss: 0.5094 - val_acc: 0.7760
Epoch 417/1500
576/576 [==============================] - 0s 71us/step - loss: 0.5014 - acc: 0.7639 - val_loss: 0.5094 - val_acc: 0.7760
Epoch 418/1500
576/576 [==============================] - 0s 88us/step - loss: 0.5012 - acc: 0.7639 - val_loss: 0.5093 - val_acc: 0.7760
Epoch 419/1500
576/576 [==============================] - 0s 73us/step - loss: 0.5010 - acc: 0.7639 - val_loss: 0.5092 - val_acc: 0.7760
Epoch 420/1500
576/576 [==============================] - 0s 78us/step - loss: 0.5009 - acc: 0.7639 - val_loss: 0.5092 - val_acc: 0.7760
Epoch 421/1500
576/576 [==============================] - 0s 64us/step - loss: 0.5007 - acc: 0.7639 - val_loss: 0.5091 - val_acc: 0.7760
Epoch 422/1500
576/576 [==============================] - 0s 75us/step - loss: 0.5006 - acc: 0.7639 - val_loss: 0.5091 - val_acc: 0.7760
Epoch 423/1500
576/576 [==============================] - 0s 76us/step - loss: 0.5004 - acc: 0.7639 - val_loss: 0.5090 - val_acc: 0.7760
Epoch 424/1500
576/576 [==============================] - 0s 73us/step - loss: 0.5003 - acc: 0.7639 - val_loss: 0.5089 - val_acc: 0.7760
Epoch 425/1500
576/576 [==============================] - 0s 83us/step - loss: 0.5001 - acc: 0.7656 - val_loss: 0.5089 - val_acc: 0.7760
Epoch 426/1500
576/576 [==============================] - 0s 85us/step - loss: 0.5000 - acc: 0.7674 - val_loss: 0.5088 - val_acc: 0.7760
Epoch 427/1500
576/576 [==============================] - ETA: 0s - loss: 0.5241 - acc: 0.734 - 0s 137us/step - loss: 0.4998 - acc: 0.7691 - val_loss: 0.5088 - val_acc: 0.7760
Epoch 428/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4997 - acc: 0.7691 - val_loss: 0.5087 - val_acc: 0.7760
Epoch 429/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4995 - acc: 0.7691 - val_loss: 0.5086 - val_acc: 0.7760
Epoch 430/1500
576/576 [==============================] - 0s 87us/step - loss: 0.4993 - acc: 0.7691 - val_loss: 0.5086 - val_acc: 0.7760
Epoch 431/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4992 - acc: 0.7691 - val_loss: 0.5085 - val_acc: 0.7760
Epoch 432/1500
576/576 [==============================] - 0s 71us/step - loss: 0.4990 - acc: 0.7691 - val_loss: 0.5085 - val_acc: 0.7760
Epoch 433/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4989 - acc: 0.7691 - val_loss: 0.5084 - val_acc: 0.7812
Epoch 434/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4988 - acc: 0.7691 - val_loss: 0.5084 - val_acc: 0.7812
Epoch 435/1500
576/576 [==============================] - 0s 90us/step - loss: 0.4986 - acc: 0.7691 - val_loss: 0.5083 - val_acc: 0.7812
Epoch 436/1500
576/576 [==============================] - 0s 90us/step - loss: 0.4984 - acc: 0.7691 - val_loss: 0.5082 - val_acc: 0.7812
Epoch 437/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4983 - acc: 0.7691 - val_loss: 0.5082 - val_acc: 0.7812
Epoch 438/1500
576/576 [==============================] - 0s 87us/step - loss: 0.4981 - acc: 0.7691 - val_loss: 0.5081 - val_acc: 0.7812
Epoch 439/1500
576/576 [==============================] - 0s 75us/step - loss: 0.4980 - acc: 0.7691 - val_loss: 0.5081 - val_acc: 0.7812
Epoch 440/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4979 - acc: 0.7691 - val_loss: 0.5080 - val_acc: 0.7812
Epoch 441/1500
576/576 [==============================] - 0s 76us/step - loss: 0.4977 - acc: 0.7708 - val_loss: 0.5080 - val_acc: 0.7812
Epoch 442/1500
576/576 [==============================] - 0s 90us/step - loss: 0.4975 - acc: 0.7708 - val_loss: 0.5079 - val_acc: 0.7812
Epoch 443/1500
576/576 [==============================] - 0s 69us/step - loss: 0.4974 - acc: 0.7708 - val_loss: 0.5079 - val_acc: 0.7812
Epoch 444/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4973 - acc: 0.7708 - val_loss: 0.5078 - val_acc: 0.7812
Epoch 445/1500
576/576 [==============================] - 0s 75us/step - loss: 0.4971 - acc: 0.7708 - val_loss: 0.5078 - val_acc: 0.7812
Epoch 446/1500
576/576 [==============================] - 0s 71us/step - loss: 0.4969 - acc: 0.7726 - val_loss: 0.5077 - val_acc: 0.7812
Epoch 447/1500
576/576 [==============================] - 0s 75us/step - loss: 0.4968 - acc: 0.7708 - val_loss: 0.5076 - val_acc: 0.7812
Epoch 448/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4966 - acc: 0.7726 - val_loss: 0.5076 - val_acc: 0.7812
Epoch 449/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4965 - acc: 0.7726 - val_loss: 0.5075 - val_acc: 0.7812
Epoch 450/1500
576/576 [==============================] - 0s 73us/step - loss: 0.4963 - acc: 0.7708 - val_loss: 0.5075 - val_acc: 0.7812
Epoch 451/1500
576/576 [==============================] - 0s 76us/step - loss: 0.4962 - acc: 0.7708 - val_loss: 0.5074 - val_acc: 0.7812
Epoch 452/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4961 - acc: 0.7726 - val_loss: 0.5074 - val_acc: 0.7812
Epoch 453/1500
576/576 [==============================] - 0s 90us/step - loss: 0.4959 - acc: 0.7708 - val_loss: 0.5073 - val_acc: 0.7812
Epoch 454/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4958 - acc: 0.7708 - val_loss: 0.5072 - val_acc: 0.7812
Epoch 455/1500
576/576 [==============================] - 0s 94us/step - loss: 0.4956 - acc: 0.7726 - val_loss: 0.5072 - val_acc: 0.7812
Epoch 456/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4954 - acc: 0.7726 - val_loss: 0.5071 - val_acc: 0.7812
Epoch 457/1500
576/576 [==============================] - 0s 101us/step - loss: 0.4953 - acc: 0.7743 - val_loss: 0.5071 - val_acc: 0.7812
Epoch 458/1500
576/576 [==============================] - 0s 71us/step - loss: 0.4952 - acc: 0.7760 - val_loss: 0.5070 - val_acc: 0.7812
Epoch 459/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4950 - acc: 0.7760 - val_loss: 0.5070 - val_acc: 0.7812
Epoch 460/1500
576/576 [==============================] - 0s 76us/step - loss: 0.4949 - acc: 0.7760 - val_loss: 0.5070 - val_acc: 0.7812
Epoch 461/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4947 - acc: 0.7760 - val_loss: 0.5069 - val_acc: 0.7812
Epoch 462/1500
576/576 [==============================] - 0s 90us/step - loss: 0.4946 - acc: 0.7760 - val_loss: 0.5069 - val_acc: 0.7812
Epoch 463/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4944 - acc: 0.7760 - val_loss: 0.5068 - val_acc: 0.7812
Epoch 464/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4943 - acc: 0.7760 - val_loss: 0.5068 - val_acc: 0.7812
Epoch 465/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4942 - acc: 0.7760 - val_loss: 0.5067 - val_acc: 0.7812
Epoch 466/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4940 - acc: 0.7760 - val_loss: 0.5067 - val_acc: 0.7812
Epoch 467/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4939 - acc: 0.7760 - val_loss: 0.5067 - val_acc: 0.7812
Epoch 468/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4937 - acc: 0.7760 - val_loss: 0.5066 - val_acc: 0.7812
Epoch 469/1500
576/576 [==============================] - 0s 73us/step - loss: 0.4936 - acc: 0.7760 - val_loss: 0.5066 - val_acc: 0.7812
Epoch 470/1500
576/576 [==============================] - 0s 87us/step - loss: 0.4935 - acc: 0.7760 - val_loss: 0.5066 - val_acc: 0.7812
Epoch 471/1500
576/576 [==============================] - 0s 90us/step - loss: 0.4933 - acc: 0.7760 - val_loss: 0.5065 - val_acc: 0.7812
Epoch 472/1500
576/576 [==============================] - 0s 92us/step - loss: 0.4932 - acc: 0.7760 - val_loss: 0.5065 - val_acc: 0.7812
Epoch 473/1500
576/576 [==============================] - 0s 92us/step - loss: 0.4930 - acc: 0.7760 - val_loss: 0.5065 - val_acc: 0.7812
Epoch 474/1500
576/576 [==============================] - 0s 101us/step - loss: 0.4929 - acc: 0.7760 - val_loss: 0.5064 - val_acc: 0.7812
Epoch 475/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4928 - acc: 0.7760 - val_loss: 0.5064 - val_acc: 0.7812
Epoch 476/1500
576/576 [==============================] - 0s 90us/step - loss: 0.4926 - acc: 0.7760 - val_loss: 0.5064 - val_acc: 0.7812
Epoch 477/1500
576/576 [==============================] - 0s 101us/step - loss: 0.4925 - acc: 0.7760 - val_loss: 0.5063 - val_acc: 0.7812
Epoch 478/1500
576/576 [==============================] - 0s 92us/step - loss: 0.4924 - acc: 0.7760 - val_loss: 0.5063 - val_acc: 0.7812
Epoch 479/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4922 - acc: 0.7760 - val_loss: 0.5063 - val_acc: 0.7812
Epoch 480/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4921 - acc: 0.7760 - val_loss: 0.5062 - val_acc: 0.7812
Epoch 481/1500
576/576 [==============================] - 0s 87us/step - loss: 0.4919 - acc: 0.7760 - val_loss: 0.5062 - val_acc: 0.7812
Epoch 482/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4918 - acc: 0.7760 - val_loss: 0.5062 - val_acc: 0.7812
Epoch 483/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4916 - acc: 0.7760 - val_loss: 0.5062 - val_acc: 0.7812
Epoch 484/1500
576/576 [==============================] - 0s 90us/step - loss: 0.4915 - acc: 0.7778 - val_loss: 0.5062 - val_acc: 0.7812
Epoch 485/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4914 - acc: 0.7760 - val_loss: 0.5061 - val_acc: 0.7812
Epoch 486/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4912 - acc: 0.7778 - val_loss: 0.5061 - val_acc: 0.7812
Epoch 487/1500
576/576 [==============================] - 0s 90us/step - loss: 0.4911 - acc: 0.7795 - val_loss: 0.5061 - val_acc: 0.7812
Epoch 488/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4909 - acc: 0.7795 - val_loss: 0.5061 - val_acc: 0.7812
Epoch 489/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4908 - acc: 0.7778 - val_loss: 0.5061 - val_acc: 0.7812
Epoch 490/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4907 - acc: 0.7795 - val_loss: 0.5061 - val_acc: 0.7812
Epoch 491/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4906 - acc: 0.7795 - val_loss: 0.5061 - val_acc: 0.7812
Epoch 492/1500
576/576 [==============================] - 0s 108us/step - loss: 0.4904 - acc: 0.7778 - val_loss: 0.5061 - val_acc: 0.7812
Epoch 493/1500
576/576 [==============================] - 0s 97us/step - loss: 0.4902 - acc: 0.7812 - val_loss: 0.5061 - val_acc: 0.7812
Epoch 494/1500
576/576 [==============================] - 0s 101us/step - loss: 0.4901 - acc: 0.7812 - val_loss: 0.5061 - val_acc: 0.7812
Epoch 495/1500
576/576 [==============================] - 0s 90us/step - loss: 0.4900 - acc: 0.7847 - val_loss: 0.5061 - val_acc: 0.7812
Epoch 496/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4898 - acc: 0.7847 - val_loss: 0.5061 - val_acc: 0.7812
Epoch 497/1500
576/576 [==============================] - 0s 92us/step - loss: 0.4897 - acc: 0.7847 - val_loss: 0.5061 - val_acc: 0.7812
Epoch 498/1500
576/576 [==============================] - 0s 92us/step - loss: 0.4896 - acc: 0.7847 - val_loss: 0.5061 - val_acc: 0.7812
Epoch 499/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4894 - acc: 0.7847 - val_loss: 0.5061 - val_acc: 0.7812
Epoch 500/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4893 - acc: 0.7830 - val_loss: 0.5060 - val_acc: 0.7812
Epoch 501/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4892 - acc: 0.7847 - val_loss: 0.5060 - val_acc: 0.7812
Epoch 502/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4890 - acc: 0.7847 - val_loss: 0.5060 - val_acc: 0.7812
Epoch 503/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4889 - acc: 0.7830 - val_loss: 0.5060 - val_acc: 0.7812
Epoch 504/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4888 - acc: 0.7865 - val_loss: 0.5060 - val_acc: 0.7812
Epoch 505/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4886 - acc: 0.7865 - val_loss: 0.5060 - val_acc: 0.7812
Epoch 506/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4885 - acc: 0.7865 - val_loss: 0.5060 - val_acc: 0.7865
Epoch 507/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4884 - acc: 0.7865 - val_loss: 0.5060 - val_acc: 0.7865
Epoch 508/1500
576/576 [==============================] - 0s 94us/step - loss: 0.4883 - acc: 0.7865 - val_loss: 0.5059 - val_acc: 0.7865
Epoch 509/1500
576/576 [==============================] - 0s 94us/step - loss: 0.4881 - acc: 0.7865 - val_loss: 0.5059 - val_acc: 0.7865
Epoch 510/1500
576/576 [==============================] - 0s 90us/step - loss: 0.4880 - acc: 0.7865 - val_loss: 0.5059 - val_acc: 0.7865
Epoch 511/1500
576/576 [==============================] - 0s 90us/step - loss: 0.4879 - acc: 0.7865 - val_loss: 0.5059 - val_acc: 0.7865
Epoch 512/1500
576/576 [==============================] - 0s 87us/step - loss: 0.4877 - acc: 0.7865 - val_loss: 0.5059 - val_acc: 0.7865
Epoch 513/1500
576/576 [==============================] - 0s 87us/step - loss: 0.4876 - acc: 0.7865 - val_loss: 0.5059 - val_acc: 0.7865
Epoch 514/1500
576/576 [==============================] - 0s 87us/step - loss: 0.4875 - acc: 0.7865 - val_loss: 0.5058 - val_acc: 0.7865
Epoch 515/1500
576/576 [==============================] - 0s 87us/step - loss: 0.4874 - acc: 0.7865 - val_loss: 0.5058 - val_acc: 0.7865
Epoch 516/1500
576/576 [==============================] - 0s 90us/step - loss: 0.4872 - acc: 0.7865 - val_loss: 0.5058 - val_acc: 0.7865
Epoch 517/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4871 - acc: 0.7865 - val_loss: 0.5058 - val_acc: 0.7865
Epoch 518/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4870 - acc: 0.7865 - val_loss: 0.5058 - val_acc: 0.7865
Epoch 519/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4868 - acc: 0.7865 - val_loss: 0.5058 - val_acc: 0.7865
Epoch 520/1500
576/576 [==============================] - 0s 92us/step - loss: 0.4866 - acc: 0.7882 - val_loss: 0.5058 - val_acc: 0.7865
Epoch 521/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4865 - acc: 0.7882 - val_loss: 0.5058 - val_acc: 0.7865
Epoch 522/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4864 - acc: 0.7882 - val_loss: 0.5057 - val_acc: 0.7865
Epoch 523/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4862 - acc: 0.7882 - val_loss: 0.5057 - val_acc: 0.7865
Epoch 524/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4862 - acc: 0.7882 - val_loss: 0.5057 - val_acc: 0.7865
Epoch 525/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4859 - acc: 0.7882 - val_loss: 0.5057 - val_acc: 0.7865
Epoch 526/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4858 - acc: 0.7882 - val_loss: 0.5057 - val_acc: 0.7865
Epoch 527/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4857 - acc: 0.7882 - val_loss: 0.5057 - val_acc: 0.7865
Epoch 528/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4856 - acc: 0.7865 - val_loss: 0.5057 - val_acc: 0.7865
Epoch 529/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4854 - acc: 0.7865 - val_loss: 0.5057 - val_acc: 0.7865
Epoch 530/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4853 - acc: 0.7865 - val_loss: 0.5057 - val_acc: 0.7865
Epoch 531/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4851 - acc: 0.7865 - val_loss: 0.5057 - val_acc: 0.7865
Epoch 532/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4850 - acc: 0.7865 - val_loss: 0.5056 - val_acc: 0.7865
Epoch 533/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4849 - acc: 0.7865 - val_loss: 0.5056 - val_acc: 0.7865
Epoch 534/1500
576/576 [==============================] - 0s 75us/step - loss: 0.4847 - acc: 0.7865 - val_loss: 0.5056 - val_acc: 0.7865
Epoch 535/1500
576/576 [==============================] - 0s 92us/step - loss: 0.4846 - acc: 0.7865 - val_loss: 0.5056 - val_acc: 0.7865
Epoch 536/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4845 - acc: 0.7865 - val_loss: 0.5056 - val_acc: 0.7865
Epoch 537/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4844 - acc: 0.7865 - val_loss: 0.5056 - val_acc: 0.7865
Epoch 538/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4843 - acc: 0.7865 - val_loss: 0.5056 - val_acc: 0.7865
Epoch 539/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4841 - acc: 0.7865 - val_loss: 0.5056 - val_acc: 0.7865
Epoch 540/1500
576/576 [==============================] - 0s 90us/step - loss: 0.4840 - acc: 0.7865 - val_loss: 0.5056 - val_acc: 0.7865
Epoch 541/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4839 - acc: 0.7865 - val_loss: 0.5056 - val_acc: 0.7865
Epoch 542/1500
576/576 [==============================] - 0s 68us/step - loss: 0.4838 - acc: 0.7865 - val_loss: 0.5055 - val_acc: 0.7865
Epoch 543/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4836 - acc: 0.7865 - val_loss: 0.5055 - val_acc: 0.7865
Epoch 544/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4835 - acc: 0.7865 - val_loss: 0.5055 - val_acc: 0.7865
Epoch 545/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4834 - acc: 0.7865 - val_loss: 0.5055 - val_acc: 0.7865
Epoch 546/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4833 - acc: 0.7865 - val_loss: 0.5055 - val_acc: 0.7865
Epoch 547/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4831 - acc: 0.7865 - val_loss: 0.5055 - val_acc: 0.7865
Epoch 548/1500
576/576 [==============================] - 0s 95us/step - loss: 0.4830 - acc: 0.7865 - val_loss: 0.5055 - val_acc: 0.7865
Epoch 549/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4829 - acc: 0.7865 - val_loss: 0.5055 - val_acc: 0.7865
Epoch 550/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4828 - acc: 0.7865 - val_loss: 0.5055 - val_acc: 0.7865
Epoch 551/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4826 - acc: 0.7865 - val_loss: 0.5055 - val_acc: 0.7812
Epoch 552/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4825 - acc: 0.7865 - val_loss: 0.5055 - val_acc: 0.7812
Epoch 553/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4823 - acc: 0.7847 - val_loss: 0.5055 - val_acc: 0.7812
Epoch 554/1500
576/576 [==============================] - 0s 75us/step - loss: 0.4823 - acc: 0.7865 - val_loss: 0.5055 - val_acc: 0.7812
Epoch 555/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4821 - acc: 0.7865 - val_loss: 0.5055 - val_acc: 0.7812
Epoch 556/1500
576/576 [==============================] - 0s 76us/step - loss: 0.4820 - acc: 0.7865 - val_loss: 0.5055 - val_acc: 0.7812
Epoch 557/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4819 - acc: 0.7865 - val_loss: 0.5055 - val_acc: 0.7865
Epoch 558/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4818 - acc: 0.7865 - val_loss: 0.5055 - val_acc: 0.7865
Epoch 559/1500
576/576 [==============================] - 0s 68us/step - loss: 0.4816 - acc: 0.7847 - val_loss: 0.5055 - val_acc: 0.7865
Epoch 560/1500
576/576 [==============================] - 0s 76us/step - loss: 0.4815 - acc: 0.7847 - val_loss: 0.5055 - val_acc: 0.7865
Epoch 561/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4814 - acc: 0.7847 - val_loss: 0.5055 - val_acc: 0.7865
Epoch 562/1500
576/576 [==============================] - 0s 87us/step - loss: 0.4813 - acc: 0.7865 - val_loss: 0.5055 - val_acc: 0.7865
Epoch 563/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4812 - acc: 0.7847 - val_loss: 0.5055 - val_acc: 0.7865
Epoch 564/1500
576/576 [==============================] - 0s 75us/step - loss: 0.4811 - acc: 0.7847 - val_loss: 0.5054 - val_acc: 0.7865
Epoch 565/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4810 - acc: 0.7847 - val_loss: 0.5054 - val_acc: 0.7865
Epoch 566/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4809 - acc: 0.7882 - val_loss: 0.5054 - val_acc: 0.7865
Epoch 567/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4808 - acc: 0.7865 - val_loss: 0.5054 - val_acc: 0.7917
Epoch 568/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4807 - acc: 0.7865 - val_loss: 0.5054 - val_acc: 0.7917
Epoch 569/1500
576/576 [==============================] - 0s 90us/step - loss: 0.4806 - acc: 0.7865 - val_loss: 0.5054 - val_acc: 0.7917
Epoch 570/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4804 - acc: 0.7882 - val_loss: 0.5054 - val_acc: 0.7917
Epoch 571/1500
576/576 [==============================] - 0s 75us/step - loss: 0.4803 - acc: 0.7847 - val_loss: 0.5053 - val_acc: 0.7917
Epoch 572/1500
576/576 [==============================] - 0s 73us/step - loss: 0.4803 - acc: 0.7865 - val_loss: 0.5053 - val_acc: 0.7917
Epoch 573/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4801 - acc: 0.7882 - val_loss: 0.5053 - val_acc: 0.7917
Epoch 574/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4801 - acc: 0.7865 - val_loss: 0.5053 - val_acc: 0.7917
Epoch 575/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4800 - acc: 0.7865 - val_loss: 0.5053 - val_acc: 0.7917
Epoch 576/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4798 - acc: 0.7865 - val_loss: 0.5053 - val_acc: 0.7917
Epoch 577/1500
576/576 [==============================] - 0s 76us/step - loss: 0.4797 - acc: 0.7882 - val_loss: 0.5053 - val_acc: 0.7917
Epoch 578/1500
576/576 [==============================] - 0s 75us/step - loss: 0.4796 - acc: 0.7882 - val_loss: 0.5053 - val_acc: 0.7917
Epoch 579/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4795 - acc: 0.7865 - val_loss: 0.5053 - val_acc: 0.7917
Epoch 580/1500
576/576 [==============================] - 0s 73us/step - loss: 0.4794 - acc: 0.7865 - val_loss: 0.5053 - val_acc: 0.7917
Epoch 581/1500
576/576 [==============================] - 0s 71us/step - loss: 0.4793 - acc: 0.7865 - val_loss: 0.5053 - val_acc: 0.7917
Epoch 582/1500
576/576 [==============================] - 0s 87us/step - loss: 0.4792 - acc: 0.7865 - val_loss: 0.5053 - val_acc: 0.7917
Epoch 583/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4791 - acc: 0.7865 - val_loss: 0.5053 - val_acc: 0.7917
Epoch 584/1500
576/576 [==============================] - 0s 75us/step - loss: 0.4790 - acc: 0.7847 - val_loss: 0.5053 - val_acc: 0.7917
Epoch 585/1500
576/576 [==============================] - 0s 95us/step - loss: 0.4790 - acc: 0.7865 - val_loss: 0.5053 - val_acc: 0.7917
Epoch 586/1500
576/576 [==============================] - 0s 75us/step - loss: 0.4789 - acc: 0.7865 - val_loss: 0.5053 - val_acc: 0.7917
Epoch 587/1500
576/576 [==============================] - 0s 73us/step - loss: 0.4788 - acc: 0.7865 - val_loss: 0.5053 - val_acc: 0.7865
Epoch 588/1500
576/576 [==============================] - 0s 87us/step - loss: 0.4787 - acc: 0.7847 - val_loss: 0.5053 - val_acc: 0.7865
Epoch 589/1500
576/576 [==============================] - 0s 69us/step - loss: 0.4786 - acc: 0.7847 - val_loss: 0.5053 - val_acc: 0.7865
Epoch 590/1500
576/576 [==============================] - 0s 75us/step - loss: 0.4785 - acc: 0.7847 - val_loss: 0.5053 - val_acc: 0.7865
Epoch 591/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4785 - acc: 0.7865 - val_loss: 0.5053 - val_acc: 0.7865
Epoch 592/1500
576/576 [==============================] - 0s 68us/step - loss: 0.4784 - acc: 0.7847 - val_loss: 0.5053 - val_acc: 0.7865
Epoch 593/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4783 - acc: 0.7865 - val_loss: 0.5053 - val_acc: 0.7865
Epoch 594/1500
576/576 [==============================] - 0s 76us/step - loss: 0.4783 - acc: 0.7865 - val_loss: 0.5053 - val_acc: 0.7865
Epoch 595/1500
576/576 [==============================] - 0s 75us/step - loss: 0.4781 - acc: 0.7847 - val_loss: 0.5054 - val_acc: 0.7865
Epoch 596/1500
576/576 [==============================] - 0s 76us/step - loss: 0.4780 - acc: 0.7847 - val_loss: 0.5054 - val_acc: 0.7865
Epoch 597/1500
576/576 [==============================] - 0s 76us/step - loss: 0.4779 - acc: 0.7882 - val_loss: 0.5054 - val_acc: 0.7865
Epoch 598/1500
576/576 [==============================] - 0s 75us/step - loss: 0.4778 - acc: 0.7847 - val_loss: 0.5054 - val_acc: 0.7865
Epoch 599/1500
576/576 [==============================] - 0s 71us/step - loss: 0.4777 - acc: 0.7847 - val_loss: 0.5055 - val_acc: 0.7865
Epoch 600/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4776 - acc: 0.7847 - val_loss: 0.5055 - val_acc: 0.7865
Epoch 601/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4776 - acc: 0.7847 - val_loss: 0.5055 - val_acc: 0.7865
Epoch 602/1500
576/576 [==============================] - 0s 75us/step - loss: 0.4775 - acc: 0.7847 - val_loss: 0.5055 - val_acc: 0.7865
Epoch 603/1500
576/576 [==============================] - 0s 73us/step - loss: 0.4774 - acc: 0.7847 - val_loss: 0.5056 - val_acc: 0.7865
Epoch 604/1500
576/576 [==============================] - 0s 90us/step - loss: 0.4773 - acc: 0.7830 - val_loss: 0.5056 - val_acc: 0.7865
Epoch 605/1500
576/576 [==============================] - 0s 104us/step - loss: 0.4772 - acc: 0.7847 - val_loss: 0.5056 - val_acc: 0.7865
Epoch 606/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4771 - acc: 0.7847 - val_loss: 0.5057 - val_acc: 0.7865
Epoch 607/1500
576/576 [==============================] - 0s 87us/step - loss: 0.4770 - acc: 0.7847 - val_loss: 0.5057 - val_acc: 0.7865
Epoch 608/1500
576/576 [==============================] - 0s 90us/step - loss: 0.4769 - acc: 0.7847 - val_loss: 0.5057 - val_acc: 0.7917
Epoch 609/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4768 - acc: 0.7847 - val_loss: 0.5058 - val_acc: 0.7917
Epoch 610/1500
576/576 [==============================] - 0s 97us/step - loss: 0.4767 - acc: 0.7847 - val_loss: 0.5058 - val_acc: 0.7917
Epoch 611/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4767 - acc: 0.7847 - val_loss: 0.5058 - val_acc: 0.7917
Epoch 612/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4766 - acc: 0.7830 - val_loss: 0.5058 - val_acc: 0.7917
Epoch 613/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4765 - acc: 0.7830 - val_loss: 0.5059 - val_acc: 0.7917
Epoch 614/1500
576/576 [==============================] - 0s 92us/step - loss: 0.4764 - acc: 0.7830 - val_loss: 0.5059 - val_acc: 0.7917
Epoch 615/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4763 - acc: 0.7830 - val_loss: 0.5059 - val_acc: 0.7917
Epoch 616/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4762 - acc: 0.7830 - val_loss: 0.5060 - val_acc: 0.7917
Epoch 617/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4761 - acc: 0.7830 - val_loss: 0.5060 - val_acc: 0.7917
Epoch 618/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4761 - acc: 0.7830 - val_loss: 0.5060 - val_acc: 0.7917
Epoch 619/1500
576/576 [==============================] - 0s 71us/step - loss: 0.4760 - acc: 0.7830 - val_loss: 0.5061 - val_acc: 0.7917
Epoch 620/1500
576/576 [==============================] - 0s 73us/step - loss: 0.4759 - acc: 0.7830 - val_loss: 0.5061 - val_acc: 0.7917
Epoch 621/1500
576/576 [==============================] - 0s 76us/step - loss: 0.4758 - acc: 0.7830 - val_loss: 0.5062 - val_acc: 0.7917
Epoch 622/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4757 - acc: 0.7830 - val_loss: 0.5062 - val_acc: 0.7917
Epoch 623/1500
576/576 [==============================] - 0s 87us/step - loss: 0.4757 - acc: 0.7830 - val_loss: 0.5062 - val_acc: 0.7917
Epoch 624/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4756 - acc: 0.7830 - val_loss: 0.5063 - val_acc: 0.7917
Epoch 625/1500
576/576 [==============================] - 0s 75us/step - loss: 0.4755 - acc: 0.7830 - val_loss: 0.5063 - val_acc: 0.7917
Epoch 626/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4754 - acc: 0.7830 - val_loss: 0.5064 - val_acc: 0.7917
Epoch 627/1500
576/576 [==============================] - 0s 92us/step - loss: 0.4753 - acc: 0.7830 - val_loss: 0.5064 - val_acc: 0.7917
Epoch 628/1500
576/576 [==============================] - 0s 73us/step - loss: 0.4753 - acc: 0.7830 - val_loss: 0.5065 - val_acc: 0.7917
Epoch 629/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4752 - acc: 0.7830 - val_loss: 0.5065 - val_acc: 0.7917
Epoch 630/1500
576/576 [==============================] - 0s 73us/step - loss: 0.4751 - acc: 0.7847 - val_loss: 0.5065 - val_acc: 0.7917
Epoch 631/1500
576/576 [==============================] - 0s 76us/step - loss: 0.4750 - acc: 0.7830 - val_loss: 0.5066 - val_acc: 0.7917
Epoch 632/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4749 - acc: 0.7847 - val_loss: 0.5066 - val_acc: 0.7917
Epoch 633/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4749 - acc: 0.7830 - val_loss: 0.5066 - val_acc: 0.7917
Epoch 634/1500
576/576 [==============================] - 0s 75us/step - loss: 0.4748 - acc: 0.7830 - val_loss: 0.5066 - val_acc: 0.7917
Epoch 635/1500
576/576 [==============================] - 0s 75us/step - loss: 0.4748 - acc: 0.7830 - val_loss: 0.5067 - val_acc: 0.7917
Epoch 636/1500
576/576 [==============================] - 0s 73us/step - loss: 0.4747 - acc: 0.7847 - val_loss: 0.5067 - val_acc: 0.7917
Epoch 637/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4746 - acc: 0.7847 - val_loss: 0.5067 - val_acc: 0.7917
Epoch 638/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4745 - acc: 0.7847 - val_loss: 0.5067 - val_acc: 0.7917
Epoch 639/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4745 - acc: 0.7847 - val_loss: 0.5067 - val_acc: 0.7917
Epoch 640/1500
576/576 [==============================] - 0s 66us/step - loss: 0.4744 - acc: 0.7847 - val_loss: 0.5068 - val_acc: 0.7917
Epoch 641/1500
576/576 [==============================] - 0s 75us/step - loss: 0.4744 - acc: 0.7847 - val_loss: 0.5068 - val_acc: 0.7917
Epoch 642/1500
576/576 [==============================] - 0s 71us/step - loss: 0.4743 - acc: 0.7847 - val_loss: 0.5068 - val_acc: 0.7917
Epoch 643/1500
576/576 [==============================] - 0s 73us/step - loss: 0.4742 - acc: 0.7847 - val_loss: 0.5068 - val_acc: 0.7917
Epoch 644/1500
576/576 [==============================] - 0s 75us/step - loss: 0.4742 - acc: 0.7847 - val_loss: 0.5068 - val_acc: 0.7917
Epoch 645/1500
576/576 [==============================] - 0s 99us/step - loss: 0.4741 - acc: 0.7847 - val_loss: 0.5069 - val_acc: 0.7917
Epoch 646/1500
576/576 [==============================] - 0s 75us/step - loss: 0.4740 - acc: 0.7865 - val_loss: 0.5069 - val_acc: 0.7917
Epoch 647/1500
576/576 [==============================] - 0s 69us/step - loss: 0.4740 - acc: 0.7865 - val_loss: 0.5069 - val_acc: 0.7917
Epoch 648/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4739 - acc: 0.7847 - val_loss: 0.5069 - val_acc: 0.7917
Epoch 649/1500
576/576 [==============================] - 0s 87us/step - loss: 0.4738 - acc: 0.7847 - val_loss: 0.5069 - val_acc: 0.7917
Epoch 650/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4737 - acc: 0.7865 - val_loss: 0.5070 - val_acc: 0.7917
Epoch 651/1500
576/576 [==============================] - 0s 92us/step - loss: 0.4737 - acc: 0.7830 - val_loss: 0.5070 - val_acc: 0.7917
Epoch 652/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4736 - acc: 0.7847 - val_loss: 0.5070 - val_acc: 0.7917
Epoch 653/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4736 - acc: 0.7865 - val_loss: 0.5070 - val_acc: 0.7917
Epoch 654/1500
576/576 [==============================] - 0s 90us/step - loss: 0.4735 - acc: 0.7847 - val_loss: 0.5070 - val_acc: 0.7917
Epoch 655/1500
576/576 [==============================] - 0s 108us/step - loss: 0.4734 - acc: 0.7847 - val_loss: 0.5070 - val_acc: 0.7917
Epoch 656/1500
576/576 [==============================] - 0s 87us/step - loss: 0.4734 - acc: 0.7865 - val_loss: 0.5071 - val_acc: 0.7917
Epoch 657/1500
576/576 [==============================] - 0s 73us/step - loss: 0.4733 - acc: 0.7847 - val_loss: 0.5071 - val_acc: 0.7917
Epoch 658/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4732 - acc: 0.7865 - val_loss: 0.5071 - val_acc: 0.7917
Epoch 659/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4732 - acc: 0.7847 - val_loss: 0.5071 - val_acc: 0.7865
Epoch 660/1500
576/576 [==============================] - 0s 75us/step - loss: 0.4731 - acc: 0.7865 - val_loss: 0.5071 - val_acc: 0.7865
Epoch 661/1500
576/576 [==============================] - 0s 69us/step - loss: 0.4731 - acc: 0.7865 - val_loss: 0.5072 - val_acc: 0.7865
Epoch 662/1500
576/576 [==============================] - 0s 71us/step - loss: 0.4730 - acc: 0.7865 - val_loss: 0.5072 - val_acc: 0.7865
Epoch 663/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4729 - acc: 0.7847 - val_loss: 0.5072 - val_acc: 0.7865
Epoch 664/1500
576/576 [==============================] - 0s 92us/step - loss: 0.4729 - acc: 0.7847 - val_loss: 0.5072 - val_acc: 0.7865
Epoch 665/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4728 - acc: 0.7847 - val_loss: 0.5073 - val_acc: 0.7865
Epoch 666/1500
576/576 [==============================] - 0s 76us/step - loss: 0.4727 - acc: 0.7847 - val_loss: 0.5073 - val_acc: 0.7865
Epoch 667/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4727 - acc: 0.7847 - val_loss: 0.5073 - val_acc: 0.7865
Epoch 668/1500
576/576 [==============================] - 0s 95us/step - loss: 0.4726 - acc: 0.7847 - val_loss: 0.5073 - val_acc: 0.7865
Epoch 669/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4726 - acc: 0.7847 - val_loss: 0.5073 - val_acc: 0.7865
Epoch 670/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4725 - acc: 0.7865 - val_loss: 0.5074 - val_acc: 0.7865
Epoch 671/1500
576/576 [==============================] - 0s 76us/step - loss: 0.4724 - acc: 0.7830 - val_loss: 0.5074 - val_acc: 0.7865
Epoch 672/1500
576/576 [==============================] - 0s 73us/step - loss: 0.4724 - acc: 0.7847 - val_loss: 0.5074 - val_acc: 0.7865
Epoch 673/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4724 - acc: 0.7865 - val_loss: 0.5074 - val_acc: 0.7865
Epoch 674/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4722 - acc: 0.7847 - val_loss: 0.5074 - val_acc: 0.7865
Epoch 675/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4722 - acc: 0.7847 - val_loss: 0.5075 - val_acc: 0.7865
Epoch 676/1500
576/576 [==============================] - 0s 75us/step - loss: 0.4722 - acc: 0.7847 - val_loss: 0.5075 - val_acc: 0.7865
Epoch 677/1500
576/576 [==============================] - 0s 75us/step - loss: 0.4721 - acc: 0.7847 - val_loss: 0.5075 - val_acc: 0.7865
Epoch 678/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4720 - acc: 0.7847 - val_loss: 0.5075 - val_acc: 0.7865
Epoch 679/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4720 - acc: 0.7847 - val_loss: 0.5075 - val_acc: 0.7865
Epoch 680/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4718 - acc: 0.7847 - val_loss: 0.5075 - val_acc: 0.7865
Epoch 681/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4718 - acc: 0.7847 - val_loss: 0.5076 - val_acc: 0.7865
Epoch 682/1500
576/576 [==============================] - 0s 75us/step - loss: 0.4717 - acc: 0.7847 - val_loss: 0.5076 - val_acc: 0.7865
Epoch 683/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4717 - acc: 0.7847 - val_loss: 0.5076 - val_acc: 0.7812
Epoch 684/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4716 - acc: 0.7847 - val_loss: 0.5076 - val_acc: 0.7812
Epoch 685/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4716 - acc: 0.7847 - val_loss: 0.5076 - val_acc: 0.7812
Epoch 686/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4715 - acc: 0.7865 - val_loss: 0.5076 - val_acc: 0.7812
Epoch 687/1500
576/576 [==============================] - 0s 76us/step - loss: 0.4715 - acc: 0.7830 - val_loss: 0.5077 - val_acc: 0.7812
Epoch 688/1500
576/576 [==============================] - 0s 95us/step - loss: 0.4714 - acc: 0.7847 - val_loss: 0.5077 - val_acc: 0.7812
Epoch 689/1500
576/576 [==============================] - 0s 99us/step - loss: 0.4714 - acc: 0.7847 - val_loss: 0.5077 - val_acc: 0.7812
Epoch 690/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4713 - acc: 0.7865 - val_loss: 0.5077 - val_acc: 0.7812
Epoch 691/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4713 - acc: 0.7847 - val_loss: 0.5077 - val_acc: 0.7812
Epoch 692/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4712 - acc: 0.7847 - val_loss: 0.5077 - val_acc: 0.7812
Epoch 693/1500
576/576 [==============================] - 0s 69us/step - loss: 0.4711 - acc: 0.7847 - val_loss: 0.5077 - val_acc: 0.7812
Epoch 694/1500
576/576 [==============================] - 0s 75us/step - loss: 0.4710 - acc: 0.7847 - val_loss: 0.5077 - val_acc: 0.7812
Epoch 695/1500
576/576 [==============================] - 0s 71us/step - loss: 0.4710 - acc: 0.7847 - val_loss: 0.5077 - val_acc: 0.7812
Epoch 696/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4710 - acc: 0.7847 - val_loss: 0.5077 - val_acc: 0.7812
Epoch 697/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4709 - acc: 0.7847 - val_loss: 0.5077 - val_acc: 0.7812
Epoch 698/1500
576/576 [==============================] - 0s 73us/step - loss: 0.4709 - acc: 0.7865 - val_loss: 0.5077 - val_acc: 0.7812
Epoch 699/1500
576/576 [==============================] - 0s 73us/step - loss: 0.4708 - acc: 0.7847 - val_loss: 0.5077 - val_acc: 0.7812
Epoch 700/1500
576/576 [==============================] - 0s 71us/step - loss: 0.4707 - acc: 0.7847 - val_loss: 0.5077 - val_acc: 0.7812
Epoch 701/1500
576/576 [==============================] - 0s 99us/step - loss: 0.4707 - acc: 0.7865 - val_loss: 0.5078 - val_acc: 0.7812
Epoch 702/1500
576/576 [==============================] - 0s 75us/step - loss: 0.4706 - acc: 0.7847 - val_loss: 0.5078 - val_acc: 0.7812
Epoch 703/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4706 - acc: 0.7847 - val_loss: 0.5078 - val_acc: 0.7812
Epoch 704/1500
576/576 [==============================] - 0s 87us/step - loss: 0.4706 - acc: 0.7847 - val_loss: 0.5078 - val_acc: 0.7812
Epoch 705/1500
576/576 [==============================] - 0s 73us/step - loss: 0.4705 - acc: 0.7847 - val_loss: 0.5078 - val_acc: 0.7812
Epoch 706/1500
576/576 [==============================] - 0s 68us/step - loss: 0.4704 - acc: 0.7830 - val_loss: 0.5078 - val_acc: 0.7812
Epoch 707/1500
576/576 [==============================] - 0s 97us/step - loss: 0.4703 - acc: 0.7847 - val_loss: 0.5078 - val_acc: 0.7812
Epoch 708/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4703 - acc: 0.7847 - val_loss: 0.5078 - val_acc: 0.7812
Epoch 709/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4703 - acc: 0.7865 - val_loss: 0.5078 - val_acc: 0.7812
Epoch 710/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4702 - acc: 0.7865 - val_loss: 0.5078 - val_acc: 0.7812
Epoch 711/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4702 - acc: 0.7847 - val_loss: 0.5078 - val_acc: 0.7812
Epoch 712/1500
576/576 [==============================] - 0s 92us/step - loss: 0.4701 - acc: 0.7847 - val_loss: 0.5078 - val_acc: 0.7812
Epoch 713/1500
576/576 [==============================] - 0s 87us/step - loss: 0.4701 - acc: 0.7847 - val_loss: 0.5078 - val_acc: 0.7812
Epoch 714/1500
576/576 [==============================] - 0s 71us/step - loss: 0.4700 - acc: 0.7847 - val_loss: 0.5078 - val_acc: 0.7812
Epoch 715/1500
576/576 [==============================] - 0s 73us/step - loss: 0.4699 - acc: 0.7865 - val_loss: 0.5078 - val_acc: 0.7812
Epoch 716/1500
576/576 [==============================] - 0s 75us/step - loss: 0.4699 - acc: 0.7847 - val_loss: 0.5078 - val_acc: 0.7812
Epoch 717/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4699 - acc: 0.7847 - val_loss: 0.5078 - val_acc: 0.7812
Epoch 718/1500
576/576 [==============================] - 0s 76us/step - loss: 0.4698 - acc: 0.7847 - val_loss: 0.5078 - val_acc: 0.7812
Epoch 719/1500
576/576 [==============================] - 0s 75us/step - loss: 0.4698 - acc: 0.7847 - val_loss: 0.5078 - val_acc: 0.7812
Epoch 720/1500
576/576 [==============================] - 0s 66us/step - loss: 0.4697 - acc: 0.7847 - val_loss: 0.5079 - val_acc: 0.7812
Epoch 721/1500
576/576 [==============================] - 0s 73us/step - loss: 0.4697 - acc: 0.7847 - val_loss: 0.5079 - val_acc: 0.7812
Epoch 722/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4696 - acc: 0.7865 - val_loss: 0.5079 - val_acc: 0.7812
Epoch 723/1500
576/576 [==============================] - 0s 71us/step - loss: 0.4696 - acc: 0.7847 - val_loss: 0.5079 - val_acc: 0.7812
Epoch 724/1500
576/576 [==============================] - 0s 99us/step - loss: 0.4695 - acc: 0.7830 - val_loss: 0.5079 - val_acc: 0.7812
Epoch 725/1500
576/576 [==============================] - 0s 109us/step - loss: 0.4695 - acc: 0.7847 - val_loss: 0.5079 - val_acc: 0.7812
Epoch 726/1500
576/576 [==============================] - 0s 90us/step - loss: 0.4694 - acc: 0.7847 - val_loss: 0.5079 - val_acc: 0.7812
Epoch 727/1500
576/576 [==============================] - 0s 90us/step - loss: 0.4694 - acc: 0.7830 - val_loss: 0.5080 - val_acc: 0.7812
Epoch 728/1500
576/576 [==============================] - 0s 97us/step - loss: 0.4693 - acc: 0.7830 - val_loss: 0.5080 - val_acc: 0.7812
Epoch 729/1500
576/576 [==============================] - 0s 95us/step - loss: 0.4693 - acc: 0.7847 - val_loss: 0.5080 - val_acc: 0.7812
Epoch 730/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4692 - acc: 0.7830 - val_loss: 0.5080 - val_acc: 0.7812
Epoch 731/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4692 - acc: 0.7847 - val_loss: 0.5080 - val_acc: 0.7812
Epoch 732/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4691 - acc: 0.7847 - val_loss: 0.5080 - val_acc: 0.7812
Epoch 733/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4690 - acc: 0.7847 - val_loss: 0.5080 - val_acc: 0.7812
Epoch 734/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4690 - acc: 0.7830 - val_loss: 0.5081 - val_acc: 0.7812
Epoch 735/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4689 - acc: 0.7830 - val_loss: 0.5081 - val_acc: 0.7812
Epoch 736/1500
576/576 [==============================] - 0s 73us/step - loss: 0.4689 - acc: 0.7847 - val_loss: 0.5081 - val_acc: 0.7812
Epoch 737/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4688 - acc: 0.7847 - val_loss: 0.5081 - val_acc: 0.7812
Epoch 738/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4688 - acc: 0.7830 - val_loss: 0.5081 - val_acc: 0.7812
Epoch 739/1500
576/576 [==============================] - 0s 73us/step - loss: 0.4687 - acc: 0.7830 - val_loss: 0.5081 - val_acc: 0.7812
Epoch 740/1500
576/576 [==============================] - 0s 75us/step - loss: 0.4687 - acc: 0.7847 - val_loss: 0.5081 - val_acc: 0.7812
Epoch 741/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4686 - acc: 0.7830 - val_loss: 0.5082 - val_acc: 0.7812
Epoch 742/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4686 - acc: 0.7830 - val_loss: 0.5082 - val_acc: 0.7812
Epoch 743/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4685 - acc: 0.7847 - val_loss: 0.5082 - val_acc: 0.7812
Epoch 744/1500
576/576 [==============================] - 0s 87us/step - loss: 0.4685 - acc: 0.7830 - val_loss: 0.5082 - val_acc: 0.7812
Epoch 745/1500
576/576 [==============================] - 0s 87us/step - loss: 0.4684 - acc: 0.7847 - val_loss: 0.5082 - val_acc: 0.7812
Epoch 746/1500
576/576 [==============================] - 0s 75us/step - loss: 0.4684 - acc: 0.7847 - val_loss: 0.5082 - val_acc: 0.7812
Epoch 747/1500
576/576 [==============================] - 0s 92us/step - loss: 0.4684 - acc: 0.7865 - val_loss: 0.5082 - val_acc: 0.7812
Epoch 748/1500
576/576 [==============================] - 0s 71us/step - loss: 0.4683 - acc: 0.7830 - val_loss: 0.5083 - val_acc: 0.7812
Epoch 749/1500
576/576 [==============================] - 0s 87us/step - loss: 0.4682 - acc: 0.7830 - val_loss: 0.5083 - val_acc: 0.7812
Epoch 750/1500
576/576 [==============================] - 0s 75us/step - loss: 0.4682 - acc: 0.7830 - val_loss: 0.5083 - val_acc: 0.7812
Epoch 751/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4681 - acc: 0.7830 - val_loss: 0.5083 - val_acc: 0.7812
Epoch 752/1500
576/576 [==============================] - 0s 75us/step - loss: 0.4681 - acc: 0.7812 - val_loss: 0.5083 - val_acc: 0.7812
Epoch 753/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4681 - acc: 0.7830 - val_loss: 0.5083 - val_acc: 0.7812
Epoch 754/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4681 - acc: 0.7830 - val_loss: 0.5083 - val_acc: 0.7812
Epoch 755/1500
576/576 [==============================] - 0s 87us/step - loss: 0.4679 - acc: 0.7812 - val_loss: 0.5084 - val_acc: 0.7812
Epoch 756/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4679 - acc: 0.7830 - val_loss: 0.5084 - val_acc: 0.7812
Epoch 757/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4679 - acc: 0.7812 - val_loss: 0.5084 - val_acc: 0.7812
Epoch 758/1500
576/576 [==============================] - 0s 75us/step - loss: 0.4678 - acc: 0.7812 - val_loss: 0.5084 - val_acc: 0.7812
Epoch 759/1500
576/576 [==============================] - 0s 69us/step - loss: 0.4678 - acc: 0.7830 - val_loss: 0.5084 - val_acc: 0.7812
Epoch 760/1500
576/576 [==============================] - 0s 75us/step - loss: 0.4677 - acc: 0.7830 - val_loss: 0.5085 - val_acc: 0.7812
Epoch 761/1500
576/576 [==============================] - 0s 75us/step - loss: 0.4677 - acc: 0.7812 - val_loss: 0.5085 - val_acc: 0.7812
Epoch 762/1500
576/576 [==============================] - 0s 92us/step - loss: 0.4677 - acc: 0.7830 - val_loss: 0.5085 - val_acc: 0.7812
Epoch 763/1500
576/576 [==============================] - 0s 73us/step - loss: 0.4676 - acc: 0.7830 - val_loss: 0.5085 - val_acc: 0.7812
Epoch 764/1500
576/576 [==============================] - 0s 73us/step - loss: 0.4676 - acc: 0.7830 - val_loss: 0.5085 - val_acc: 0.7812
Epoch 765/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4675 - acc: 0.7830 - val_loss: 0.5085 - val_acc: 0.7812
Epoch 766/1500
576/576 [==============================] - 0s 71us/step - loss: 0.4674 - acc: 0.7812 - val_loss: 0.5086 - val_acc: 0.7812
Epoch 767/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4674 - acc: 0.7830 - val_loss: 0.5086 - val_acc: 0.7812
Epoch 768/1500
576/576 [==============================] - 0s 68us/step - loss: 0.4673 - acc: 0.7812 - val_loss: 0.5086 - val_acc: 0.7812
Epoch 769/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4673 - acc: 0.7830 - val_loss: 0.5086 - val_acc: 0.7812
Epoch 770/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4672 - acc: 0.7830 - val_loss: 0.5086 - val_acc: 0.7812
Epoch 771/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4672 - acc: 0.7830 - val_loss: 0.5086 - val_acc: 0.7812
Epoch 772/1500
576/576 [==============================] - 0s 101us/step - loss: 0.4672 - acc: 0.7812 - val_loss: 0.5087 - val_acc: 0.7812
Epoch 773/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4671 - acc: 0.7812 - val_loss: 0.5087 - val_acc: 0.7812
Epoch 774/1500
576/576 [==============================] - 0s 90us/step - loss: 0.4670 - acc: 0.7812 - val_loss: 0.5087 - val_acc: 0.7812
Epoch 775/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4671 - acc: 0.7812 - val_loss: 0.5087 - val_acc: 0.7812
Epoch 776/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4670 - acc: 0.7812 - val_loss: 0.5087 - val_acc: 0.7812
Epoch 777/1500
576/576 [==============================] - 0s 75us/step - loss: 0.4669 - acc: 0.7830 - val_loss: 0.5087 - val_acc: 0.7812
Epoch 778/1500
576/576 [==============================] - 0s 76us/step - loss: 0.4669 - acc: 0.7830 - val_loss: 0.5087 - val_acc: 0.7812
Epoch 779/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4668 - acc: 0.7812 - val_loss: 0.5088 - val_acc: 0.7812
Epoch 780/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4668 - acc: 0.7812 - val_loss: 0.5088 - val_acc: 0.7812
Epoch 781/1500
576/576 [==============================] - 0s 73us/step - loss: 0.4667 - acc: 0.7812 - val_loss: 0.5088 - val_acc: 0.7812
Epoch 782/1500
576/576 [==============================] - 0s 92us/step - loss: 0.4667 - acc: 0.7812 - val_loss: 0.5088 - val_acc: 0.7812
Epoch 783/1500
576/576 [==============================] - 0s 90us/step - loss: 0.4667 - acc: 0.7812 - val_loss: 0.5088 - val_acc: 0.7812
Epoch 784/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4666 - acc: 0.7830 - val_loss: 0.5088 - val_acc: 0.7812
Epoch 785/1500
576/576 [==============================] - 0s 94us/step - loss: 0.4666 - acc: 0.7812 - val_loss: 0.5089 - val_acc: 0.7812
Epoch 786/1500
576/576 [==============================] - 0s 87us/step - loss: 0.4665 - acc: 0.7812 - val_loss: 0.5089 - val_acc: 0.7812
Epoch 787/1500
576/576 [==============================] - 0s 94us/step - loss: 0.4664 - acc: 0.7812 - val_loss: 0.5089 - val_acc: 0.7812
Epoch 788/1500
576/576 [==============================] - 0s 101us/step - loss: 0.4664 - acc: 0.7812 - val_loss: 0.5089 - val_acc: 0.7812
Epoch 789/1500
576/576 [==============================] - 0s 87us/step - loss: 0.4664 - acc: 0.7830 - val_loss: 0.5089 - val_acc: 0.7812
Epoch 790/1500
576/576 [==============================] - 0s 92us/step - loss: 0.4663 - acc: 0.7812 - val_loss: 0.5089 - val_acc: 0.7812
Epoch 791/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4662 - acc: 0.7812 - val_loss: 0.5089 - val_acc: 0.7812
Epoch 792/1500
576/576 [==============================] - 0s 95us/step - loss: 0.4662 - acc: 0.7830 - val_loss: 0.5090 - val_acc: 0.7812
Epoch 793/1500
576/576 [==============================] - 0s 106us/step - loss: 0.4662 - acc: 0.7812 - val_loss: 0.5090 - val_acc: 0.7812
Epoch 794/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4661 - acc: 0.7830 - val_loss: 0.5090 - val_acc: 0.7812
Epoch 795/1500
576/576 [==============================] - 0s 87us/step - loss: 0.4661 - acc: 0.7812 - val_loss: 0.5090 - val_acc: 0.7812
Epoch 796/1500
576/576 [==============================] - 0s 90us/step - loss: 0.4660 - acc: 0.7830 - val_loss: 0.5090 - val_acc: 0.7812
Epoch 797/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4660 - acc: 0.7830 - val_loss: 0.5090 - val_acc: 0.7812
Epoch 798/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4659 - acc: 0.7830 - val_loss: 0.5090 - val_acc: 0.7812
Epoch 799/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4659 - acc: 0.7812 - val_loss: 0.5091 - val_acc: 0.7812
Epoch 800/1500
576/576 [==============================] - 0s 95us/step - loss: 0.4658 - acc: 0.7830 - val_loss: 0.5091 - val_acc: 0.7812
Epoch 801/1500
576/576 [==============================] - 0s 90us/step - loss: 0.4658 - acc: 0.7812 - val_loss: 0.5091 - val_acc: 0.7812
Epoch 802/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4657 - acc: 0.7812 - val_loss: 0.5091 - val_acc: 0.7812
Epoch 803/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4657 - acc: 0.7847 - val_loss: 0.5091 - val_acc: 0.7812
Epoch 804/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4657 - acc: 0.7812 - val_loss: 0.5091 - val_acc: 0.7812
Epoch 805/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4657 - acc: 0.7847 - val_loss: 0.5091 - val_acc: 0.7812
Epoch 806/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4656 - acc: 0.7830 - val_loss: 0.5091 - val_acc: 0.7812
Epoch 807/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4655 - acc: 0.7830 - val_loss: 0.5091 - val_acc: 0.7812
Epoch 808/1500
576/576 [==============================] - 0s 87us/step - loss: 0.4655 - acc: 0.7847 - val_loss: 0.5091 - val_acc: 0.7812
Epoch 809/1500
576/576 [==============================] - 0s 87us/step - loss: 0.4655 - acc: 0.7812 - val_loss: 0.5091 - val_acc: 0.7812
Epoch 810/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4654 - acc: 0.7847 - val_loss: 0.5091 - val_acc: 0.7812
Epoch 811/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4654 - acc: 0.7847 - val_loss: 0.5091 - val_acc: 0.7812
Epoch 812/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4653 - acc: 0.7847 - val_loss: 0.5091 - val_acc: 0.7812
Epoch 813/1500
576/576 [==============================] - 0s 99us/step - loss: 0.4652 - acc: 0.7847 - val_loss: 0.5091 - val_acc: 0.7812
Epoch 814/1500
576/576 [==============================] - 0s 87us/step - loss: 0.4652 - acc: 0.7847 - val_loss: 0.5091 - val_acc: 0.7812
Epoch 815/1500
576/576 [==============================] - 0s 90us/step - loss: 0.4651 - acc: 0.7830 - val_loss: 0.5091 - val_acc: 0.7812
Epoch 816/1500
576/576 [==============================] - 0s 113us/step - loss: 0.4651 - acc: 0.7847 - val_loss: 0.5091 - val_acc: 0.7812
Epoch 817/1500
576/576 [==============================] - 0s 76us/step - loss: 0.4651 - acc: 0.7847 - val_loss: 0.5091 - val_acc: 0.7812
Epoch 818/1500
576/576 [==============================] - 0s 94us/step - loss: 0.4650 - acc: 0.7830 - val_loss: 0.5091 - val_acc: 0.7812
Epoch 819/1500
576/576 [==============================] - 0s 95us/step - loss: 0.4650 - acc: 0.7830 - val_loss: 0.5091 - val_acc: 0.7812
Epoch 820/1500
576/576 [==============================] - 0s 90us/step - loss: 0.4650 - acc: 0.7830 - val_loss: 0.5091 - val_acc: 0.7812
Epoch 821/1500
576/576 [==============================] - 0s 121us/step - loss: 0.4649 - acc: 0.7847 - val_loss: 0.5092 - val_acc: 0.7812
Epoch 822/1500
576/576 [==============================] - 0s 101us/step - loss: 0.4649 - acc: 0.7847 - val_loss: 0.5092 - val_acc: 0.7812
Epoch 823/1500
576/576 [==============================] - 0s 92us/step - loss: 0.4648 - acc: 0.7847 - val_loss: 0.5092 - val_acc: 0.7812
Epoch 824/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4648 - acc: 0.7830 - val_loss: 0.5092 - val_acc: 0.7812
Epoch 825/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4647 - acc: 0.7847 - val_loss: 0.5092 - val_acc: 0.7812
Epoch 826/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4647 - acc: 0.7847 - val_loss: 0.5092 - val_acc: 0.7812
Epoch 827/1500
576/576 [==============================] - 0s 87us/step - loss: 0.4646 - acc: 0.7847 - val_loss: 0.5092 - val_acc: 0.7812
Epoch 828/1500
576/576 [==============================] - 0s 87us/step - loss: 0.4646 - acc: 0.7847 - val_loss: 0.5092 - val_acc: 0.7760
Epoch 829/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4645 - acc: 0.7847 - val_loss: 0.5092 - val_acc: 0.7760
Epoch 830/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4644 - acc: 0.7847 - val_loss: 0.5093 - val_acc: 0.7760
Epoch 831/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4644 - acc: 0.7847 - val_loss: 0.5093 - val_acc: 0.7760
Epoch 832/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4644 - acc: 0.7847 - val_loss: 0.5093 - val_acc: 0.7760
Epoch 833/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4643 - acc: 0.7847 - val_loss: 0.5093 - val_acc: 0.7760
Epoch 834/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4643 - acc: 0.7847 - val_loss: 0.5093 - val_acc: 0.7760
Epoch 835/1500
576/576 [==============================] - 0s 90us/step - loss: 0.4643 - acc: 0.7847 - val_loss: 0.5093 - val_acc: 0.7760
Epoch 836/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4642 - acc: 0.7847 - val_loss: 0.5093 - val_acc: 0.7760
Epoch 837/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4642 - acc: 0.7847 - val_loss: 0.5094 - val_acc: 0.7760
Epoch 838/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4641 - acc: 0.7830 - val_loss: 0.5094 - val_acc: 0.7760
Epoch 839/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4641 - acc: 0.7847 - val_loss: 0.5094 - val_acc: 0.7760
Epoch 840/1500
576/576 [==============================] - 0s 87us/step - loss: 0.4641 - acc: 0.7847 - val_loss: 0.5094 - val_acc: 0.7760
Epoch 841/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4640 - acc: 0.7847 - val_loss: 0.5094 - val_acc: 0.7760
Epoch 842/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4639 - acc: 0.7830 - val_loss: 0.5094 - val_acc: 0.7760
Epoch 843/1500
576/576 [==============================] - 0s 90us/step - loss: 0.4639 - acc: 0.7847 - val_loss: 0.5094 - val_acc: 0.7760
Epoch 844/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4639 - acc: 0.7847 - val_loss: 0.5094 - val_acc: 0.7760
Epoch 845/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4638 - acc: 0.7847 - val_loss: 0.5095 - val_acc: 0.7760
Epoch 846/1500
576/576 [==============================] - 0s 99us/step - loss: 0.4638 - acc: 0.7847 - val_loss: 0.5095 - val_acc: 0.7760
Epoch 847/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4637 - acc: 0.7830 - val_loss: 0.5095 - val_acc: 0.7760
Epoch 848/1500
576/576 [==============================] - 0s 87us/step - loss: 0.4637 - acc: 0.7847 - val_loss: 0.5095 - val_acc: 0.7760
Epoch 849/1500
576/576 [==============================] - 0s 87us/step - loss: 0.4636 - acc: 0.7830 - val_loss: 0.5095 - val_acc: 0.7760
Epoch 850/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4636 - acc: 0.7847 - val_loss: 0.5095 - val_acc: 0.7760
Epoch 851/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4636 - acc: 0.7847 - val_loss: 0.5095 - val_acc: 0.7760
Epoch 852/1500
576/576 [==============================] - 0s 90us/step - loss: 0.4635 - acc: 0.7847 - val_loss: 0.5095 - val_acc: 0.7760
Epoch 853/1500
576/576 [==============================] - 0s 101us/step - loss: 0.4635 - acc: 0.7847 - val_loss: 0.5096 - val_acc: 0.7760
Epoch 854/1500
576/576 [==============================] - 0s 87us/step - loss: 0.4634 - acc: 0.7830 - val_loss: 0.5096 - val_acc: 0.7760
Epoch 855/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4634 - acc: 0.7847 - val_loss: 0.5096 - val_acc: 0.7760
Epoch 856/1500
576/576 [==============================] - 0s 87us/step - loss: 0.4633 - acc: 0.7847 - val_loss: 0.5096 - val_acc: 0.7760
Epoch 857/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4633 - acc: 0.7847 - val_loss: 0.5096 - val_acc: 0.7760
Epoch 858/1500
576/576 [==============================] - 0s 90us/step - loss: 0.4633 - acc: 0.7847 - val_loss: 0.5096 - val_acc: 0.7760
Epoch 859/1500
576/576 [==============================] - 0s 99us/step - loss: 0.4632 - acc: 0.7830 - val_loss: 0.5097 - val_acc: 0.7760
Epoch 860/1500
576/576 [==============================] - 0s 92us/step - loss: 0.4632 - acc: 0.7847 - val_loss: 0.5097 - val_acc: 0.7760
Epoch 861/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4631 - acc: 0.7830 - val_loss: 0.5097 - val_acc: 0.7760
Epoch 862/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4631 - acc: 0.7830 - val_loss: 0.5097 - val_acc: 0.7760
Epoch 863/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4630 - acc: 0.7847 - val_loss: 0.5098 - val_acc: 0.7760
Epoch 864/1500
576/576 [==============================] - 0s 90us/step - loss: 0.4629 - acc: 0.7847 - val_loss: 0.5098 - val_acc: 0.7760
Epoch 865/1500
576/576 [==============================] - 0s 102us/step - loss: 0.4628 - acc: 0.7847 - val_loss: 0.5098 - val_acc: 0.7760
Epoch 866/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4629 - acc: 0.7830 - val_loss: 0.5098 - val_acc: 0.7760
Epoch 867/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4628 - acc: 0.7847 - val_loss: 0.5099 - val_acc: 0.7760
Epoch 868/1500
576/576 [==============================] - 0s 71us/step - loss: 0.4627 - acc: 0.7830 - val_loss: 0.5099 - val_acc: 0.7760
Epoch 869/1500
576/576 [==============================] - 0s 76us/step - loss: 0.4627 - acc: 0.7847 - val_loss: 0.5099 - val_acc: 0.7760
Epoch 870/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4628 - acc: 0.7847 - val_loss: 0.5100 - val_acc: 0.7760
Epoch 871/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4626 - acc: 0.7847 - val_loss: 0.5100 - val_acc: 0.7760
Epoch 872/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4625 - acc: 0.7847 - val_loss: 0.5100 - val_acc: 0.7760
Epoch 873/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4625 - acc: 0.7830 - val_loss: 0.5101 - val_acc: 0.7760
Epoch 874/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4624 - acc: 0.7847 - val_loss: 0.5101 - val_acc: 0.7760
Epoch 875/1500
576/576 [==============================] - 0s 76us/step - loss: 0.4624 - acc: 0.7830 - val_loss: 0.5101 - val_acc: 0.7760
Epoch 876/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4624 - acc: 0.7830 - val_loss: 0.5101 - val_acc: 0.7760
Epoch 877/1500
576/576 [==============================] - 0s 87us/step - loss: 0.4622 - acc: 0.7830 - val_loss: 0.5102 - val_acc: 0.7760
Epoch 878/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4622 - acc: 0.7830 - val_loss: 0.5102 - val_acc: 0.7760
Epoch 879/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4621 - acc: 0.7830 - val_loss: 0.5102 - val_acc: 0.7760
Epoch 880/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4621 - acc: 0.7830 - val_loss: 0.5103 - val_acc: 0.7708
Epoch 881/1500
576/576 [==============================] - 0s 69us/step - loss: 0.4621 - acc: 0.7830 - val_loss: 0.5103 - val_acc: 0.7708
Epoch 882/1500
576/576 [==============================] - 0s 75us/step - loss: 0.4620 - acc: 0.7830 - val_loss: 0.5103 - val_acc: 0.7708
Epoch 883/1500
576/576 [==============================] - 0s 76us/step - loss: 0.4619 - acc: 0.7830 - val_loss: 0.5103 - val_acc: 0.7708
Epoch 884/1500
576/576 [==============================] - 0s 73us/step - loss: 0.4619 - acc: 0.7830 - val_loss: 0.5104 - val_acc: 0.7708
Epoch 885/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4619 - acc: 0.7830 - val_loss: 0.5104 - val_acc: 0.7708
Epoch 886/1500
576/576 [==============================] - 0s 69us/step - loss: 0.4618 - acc: 0.7830 - val_loss: 0.5104 - val_acc: 0.7708
Epoch 887/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4617 - acc: 0.7830 - val_loss: 0.5104 - val_acc: 0.7708
Epoch 888/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4616 - acc: 0.7830 - val_loss: 0.5105 - val_acc: 0.7708
Epoch 889/1500
576/576 [==============================] - 0s 73us/step - loss: 0.4616 - acc: 0.7830 - val_loss: 0.5105 - val_acc: 0.7708
Epoch 890/1500
576/576 [==============================] - 0s 76us/step - loss: 0.4616 - acc: 0.7830 - val_loss: 0.5105 - val_acc: 0.7708
Epoch 891/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4616 - acc: 0.7830 - val_loss: 0.5105 - val_acc: 0.7708
Epoch 892/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4615 - acc: 0.7830 - val_loss: 0.5105 - val_acc: 0.7708
Epoch 893/1500
576/576 [==============================] - 0s 90us/step - loss: 0.4614 - acc: 0.7830 - val_loss: 0.5106 - val_acc: 0.7708
Epoch 894/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4614 - acc: 0.7830 - val_loss: 0.5106 - val_acc: 0.7708
Epoch 895/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4613 - acc: 0.7830 - val_loss: 0.5106 - val_acc: 0.7708
Epoch 896/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4613 - acc: 0.7830 - val_loss: 0.5106 - val_acc: 0.7708
Epoch 897/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4613 - acc: 0.7830 - val_loss: 0.5106 - val_acc: 0.7708
Epoch 898/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4612 - acc: 0.7830 - val_loss: 0.5107 - val_acc: 0.7708
Epoch 899/1500
576/576 [==============================] - 0s 76us/step - loss: 0.4611 - acc: 0.7830 - val_loss: 0.5107 - val_acc: 0.7708
Epoch 900/1500
576/576 [==============================] - 0s 87us/step - loss: 0.4611 - acc: 0.7830 - val_loss: 0.5107 - val_acc: 0.7708
Epoch 901/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4611 - acc: 0.7830 - val_loss: 0.5107 - val_acc: 0.7708
Epoch 902/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4610 - acc: 0.7830 - val_loss: 0.5107 - val_acc: 0.7708
Epoch 903/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4610 - acc: 0.7830 - val_loss: 0.5107 - val_acc: 0.7708
Epoch 904/1500
576/576 [==============================] - 0s 87us/step - loss: 0.4609 - acc: 0.7830 - val_loss: 0.5107 - val_acc: 0.7708
Epoch 905/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4608 - acc: 0.7830 - val_loss: 0.5108 - val_acc: 0.7708
Epoch 906/1500
576/576 [==============================] - 0s 94us/step - loss: 0.4608 - acc: 0.7830 - val_loss: 0.5108 - val_acc: 0.7708
Epoch 907/1500
576/576 [==============================] - 0s 101us/step - loss: 0.4607 - acc: 0.7830 - val_loss: 0.5108 - val_acc: 0.7708
Epoch 908/1500
576/576 [==============================] - 0s 99us/step - loss: 0.4607 - acc: 0.7830 - val_loss: 0.5108 - val_acc: 0.7708
Epoch 909/1500
576/576 [==============================] - 0s 92us/step - loss: 0.4606 - acc: 0.7830 - val_loss: 0.5108 - val_acc: 0.7708
Epoch 910/1500
576/576 [==============================] - 0s 90us/step - loss: 0.4606 - acc: 0.7830 - val_loss: 0.5109 - val_acc: 0.7656
Epoch 911/1500
576/576 [==============================] - 0s 87us/step - loss: 0.4606 - acc: 0.7830 - val_loss: 0.5109 - val_acc: 0.7656
Epoch 912/1500
576/576 [==============================] - 0s 94us/step - loss: 0.4605 - acc: 0.7830 - val_loss: 0.5109 - val_acc: 0.7656
Epoch 913/1500
576/576 [==============================] - 0s 76us/step - loss: 0.4605 - acc: 0.7830 - val_loss: 0.5109 - val_acc: 0.7656
Epoch 914/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4604 - acc: 0.7830 - val_loss: 0.5109 - val_acc: 0.7656
Epoch 915/1500
576/576 [==============================] - 0s 92us/step - loss: 0.4604 - acc: 0.7830 - val_loss: 0.5110 - val_acc: 0.7656
Epoch 916/1500
576/576 [==============================] - 0s 90us/step - loss: 0.4603 - acc: 0.7830 - val_loss: 0.5110 - val_acc: 0.7656
Epoch 917/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4603 - acc: 0.7830 - val_loss: 0.5110 - val_acc: 0.7656
Epoch 918/1500
576/576 [==============================] - 0s 71us/step - loss: 0.4602 - acc: 0.7830 - val_loss: 0.5110 - val_acc: 0.7656
Epoch 919/1500
576/576 [==============================] - 0s 92us/step - loss: 0.4602 - acc: 0.7830 - val_loss: 0.5110 - val_acc: 0.7656
Epoch 920/1500
576/576 [==============================] - 0s 76us/step - loss: 0.4602 - acc: 0.7830 - val_loss: 0.5111 - val_acc: 0.7656
Epoch 921/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4601 - acc: 0.7830 - val_loss: 0.5111 - val_acc: 0.7656
Epoch 922/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4600 - acc: 0.7830 - val_loss: 0.5111 - val_acc: 0.7656
Epoch 923/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4600 - acc: 0.7830 - val_loss: 0.5111 - val_acc: 0.7656
Epoch 924/1500
576/576 [==============================] - 0s 76us/step - loss: 0.4600 - acc: 0.7830 - val_loss: 0.5111 - val_acc: 0.7656
Epoch 925/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4599 - acc: 0.7830 - val_loss: 0.5112 - val_acc: 0.7656
Epoch 926/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4598 - acc: 0.7830 - val_loss: 0.5112 - val_acc: 0.7656
Epoch 927/1500
576/576 [==============================] - 0s 76us/step - loss: 0.4598 - acc: 0.7830 - val_loss: 0.5112 - val_acc: 0.7656
Epoch 928/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4597 - acc: 0.7830 - val_loss: 0.5113 - val_acc: 0.7656
Epoch 929/1500
576/576 [==============================] - 0s 76us/step - loss: 0.4597 - acc: 0.7830 - val_loss: 0.5113 - val_acc: 0.7656
Epoch 930/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4597 - acc: 0.7830 - val_loss: 0.5113 - val_acc: 0.7656
Epoch 931/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4596 - acc: 0.7830 - val_loss: 0.5114 - val_acc: 0.7656
Epoch 932/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4596 - acc: 0.7830 - val_loss: 0.5114 - val_acc: 0.7656
Epoch 933/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4595 - acc: 0.7830 - val_loss: 0.5114 - val_acc: 0.7656
Epoch 934/1500
576/576 [==============================] - 0s 75us/step - loss: 0.4595 - acc: 0.7830 - val_loss: 0.5115 - val_acc: 0.7656
Epoch 935/1500
576/576 [==============================] - 0s 73us/step - loss: 0.4594 - acc: 0.7830 - val_loss: 0.5115 - val_acc: 0.7656
Epoch 936/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4594 - acc: 0.7830 - val_loss: 0.5115 - val_acc: 0.7656
Epoch 937/1500
576/576 [==============================] - 0s 73us/step - loss: 0.4593 - acc: 0.7830 - val_loss: 0.5115 - val_acc: 0.7656
Epoch 938/1500
576/576 [==============================] - 0s 73us/step - loss: 0.4593 - acc: 0.7830 - val_loss: 0.5116 - val_acc: 0.7656
Epoch 939/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4592 - acc: 0.7830 - val_loss: 0.5116 - val_acc: 0.7656
Epoch 940/1500
576/576 [==============================] - 0s 76us/step - loss: 0.4592 - acc: 0.7830 - val_loss: 0.5116 - val_acc: 0.7656
Epoch 941/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4591 - acc: 0.7830 - val_loss: 0.5117 - val_acc: 0.7656
Epoch 942/1500
576/576 [==============================] - 0s 75us/step - loss: 0.4591 - acc: 0.7830 - val_loss: 0.5117 - val_acc: 0.7656
Epoch 943/1500
576/576 [==============================] - 0s 69us/step - loss: 0.4591 - acc: 0.7830 - val_loss: 0.5117 - val_acc: 0.7656
Epoch 944/1500
576/576 [==============================] - 0s 71us/step - loss: 0.4590 - acc: 0.7830 - val_loss: 0.5117 - val_acc: 0.7656
Epoch 945/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4590 - acc: 0.7830 - val_loss: 0.5118 - val_acc: 0.7656
Epoch 946/1500
576/576 [==============================] - 0s 68us/step - loss: 0.4589 - acc: 0.7830 - val_loss: 0.5118 - val_acc: 0.7656
Epoch 947/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4589 - acc: 0.7847 - val_loss: 0.5118 - val_acc: 0.7656
Epoch 948/1500
576/576 [==============================] - 0s 76us/step - loss: 0.4589 - acc: 0.7847 - val_loss: 0.5118 - val_acc: 0.7656
Epoch 949/1500
576/576 [==============================] - 0s 76us/step - loss: 0.4588 - acc: 0.7830 - val_loss: 0.5119 - val_acc: 0.7656
Epoch 950/1500
576/576 [==============================] - 0s 73us/step - loss: 0.4588 - acc: 0.7847 - val_loss: 0.5119 - val_acc: 0.7656
Epoch 951/1500
576/576 [==============================] - 0s 69us/step - loss: 0.4587 - acc: 0.7830 - val_loss: 0.5119 - val_acc: 0.7656
Epoch 952/1500
576/576 [==============================] - 0s 75us/step - loss: 0.4587 - acc: 0.7847 - val_loss: 0.5119 - val_acc: 0.7656
Epoch 953/1500
576/576 [==============================] - 0s 64us/step - loss: 0.4586 - acc: 0.7847 - val_loss: 0.5119 - val_acc: 0.7656
Epoch 954/1500
576/576 [==============================] - 0s 76us/step - loss: 0.4585 - acc: 0.7847 - val_loss: 0.5120 - val_acc: 0.7656
Epoch 955/1500
576/576 [==============================] - 0s 92us/step - loss: 0.4585 - acc: 0.7847 - val_loss: 0.5120 - val_acc: 0.7656
Epoch 956/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4585 - acc: 0.7847 - val_loss: 0.5120 - val_acc: 0.7656
Epoch 957/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4585 - acc: 0.7847 - val_loss: 0.5120 - val_acc: 0.7656
Epoch 958/1500
576/576 [==============================] - 0s 76us/step - loss: 0.4584 - acc: 0.7847 - val_loss: 0.5120 - val_acc: 0.7656
Epoch 959/1500
576/576 [==============================] - 0s 73us/step - loss: 0.4583 - acc: 0.7847 - val_loss: 0.5121 - val_acc: 0.7656
Epoch 960/1500
576/576 [==============================] - 0s 73us/step - loss: 0.4583 - acc: 0.7847 - val_loss: 0.5121 - val_acc: 0.7656
Epoch 961/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4582 - acc: 0.7847 - val_loss: 0.5121 - val_acc: 0.7656
Epoch 962/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4582 - acc: 0.7847 - val_loss: 0.5121 - val_acc: 0.7656
Epoch 963/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4581 - acc: 0.7847 - val_loss: 0.5122 - val_acc: 0.7604
Epoch 964/1500
576/576 [==============================] - 0s 90us/step - loss: 0.4581 - acc: 0.7847 - val_loss: 0.5122 - val_acc: 0.7552
Epoch 965/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4580 - acc: 0.7847 - val_loss: 0.5122 - val_acc: 0.7552
Epoch 966/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4580 - acc: 0.7847 - val_loss: 0.5122 - val_acc: 0.7604
Epoch 967/1500
576/576 [==============================] - 0s 73us/step - loss: 0.4580 - acc: 0.7847 - val_loss: 0.5122 - val_acc: 0.7604
Epoch 968/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4579 - acc: 0.7847 - val_loss: 0.5122 - val_acc: 0.7552
Epoch 969/1500
576/576 [==============================] - 0s 92us/step - loss: 0.4578 - acc: 0.7847 - val_loss: 0.5123 - val_acc: 0.7552
Epoch 970/1500
576/576 [==============================] - 0s 75us/step - loss: 0.4578 - acc: 0.7847 - val_loss: 0.5123 - val_acc: 0.7552
Epoch 971/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4577 - acc: 0.7847 - val_loss: 0.5123 - val_acc: 0.7552
Epoch 972/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4577 - acc: 0.7847 - val_loss: 0.5123 - val_acc: 0.7552
Epoch 973/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4577 - acc: 0.7847 - val_loss: 0.5123 - val_acc: 0.7552
Epoch 974/1500
576/576 [==============================] - 0s 76us/step - loss: 0.4577 - acc: 0.7847 - val_loss: 0.5124 - val_acc: 0.7552
Epoch 975/1500
576/576 [==============================] - 0s 94us/step - loss: 0.4576 - acc: 0.7865 - val_loss: 0.5124 - val_acc: 0.7552
Epoch 976/1500
576/576 [==============================] - 0s 97us/step - loss: 0.4576 - acc: 0.7847 - val_loss: 0.5124 - val_acc: 0.7552
Epoch 977/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4575 - acc: 0.7847 - val_loss: 0.5124 - val_acc: 0.7552
Epoch 978/1500
576/576 [==============================] - 0s 92us/step - loss: 0.4575 - acc: 0.7847 - val_loss: 0.5125 - val_acc: 0.7552
Epoch 979/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4574 - acc: 0.7847 - val_loss: 0.5125 - val_acc: 0.7552
Epoch 980/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4574 - acc: 0.7847 - val_loss: 0.5125 - val_acc: 0.7552
Epoch 981/1500
576/576 [==============================] - 0s 71us/step - loss: 0.4573 - acc: 0.7847 - val_loss: 0.5125 - val_acc: 0.7552
Epoch 982/1500
576/576 [==============================] - 0s 92us/step - loss: 0.4573 - acc: 0.7847 - val_loss: 0.5126 - val_acc: 0.7552
Epoch 983/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4573 - acc: 0.7847 - val_loss: 0.5126 - val_acc: 0.7552
Epoch 984/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4572 - acc: 0.7847 - val_loss: 0.5126 - val_acc: 0.7500
Epoch 985/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4571 - acc: 0.7847 - val_loss: 0.5127 - val_acc: 0.7500
Epoch 986/1500
576/576 [==============================] - 0s 87us/step - loss: 0.4571 - acc: 0.7847 - val_loss: 0.5127 - val_acc: 0.7500
Epoch 987/1500
576/576 [==============================] - 0s 76us/step - loss: 0.4571 - acc: 0.7847 - val_loss: 0.5127 - val_acc: 0.7500
Epoch 988/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4570 - acc: 0.7847 - val_loss: 0.5128 - val_acc: 0.7500
Epoch 989/1500
576/576 [==============================] - 0s 106us/step - loss: 0.4569 - acc: 0.7847 - val_loss: 0.5128 - val_acc: 0.7500
Epoch 990/1500
576/576 [==============================] - 0s 75us/step - loss: 0.4569 - acc: 0.7847 - val_loss: 0.5128 - val_acc: 0.7500
Epoch 991/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4569 - acc: 0.7847 - val_loss: 0.5128 - val_acc: 0.7500
Epoch 992/1500
576/576 [==============================] - 0s 75us/step - loss: 0.4568 - acc: 0.7847 - val_loss: 0.5129 - val_acc: 0.7500
Epoch 993/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4568 - acc: 0.7847 - val_loss: 0.5129 - val_acc: 0.7500
Epoch 994/1500
576/576 [==============================] - 0s 76us/step - loss: 0.4567 - acc: 0.7847 - val_loss: 0.5129 - val_acc: 0.7500
Epoch 995/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4567 - acc: 0.7847 - val_loss: 0.5130 - val_acc: 0.7500
Epoch 996/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4566 - acc: 0.7847 - val_loss: 0.5130 - val_acc: 0.7500
Epoch 997/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4566 - acc: 0.7847 - val_loss: 0.5130 - val_acc: 0.7500
Epoch 998/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4565 - acc: 0.7847 - val_loss: 0.5131 - val_acc: 0.7500
Epoch 999/1500
576/576 [==============================] - 0s 75us/step - loss: 0.4565 - acc: 0.7847 - val_loss: 0.5131 - val_acc: 0.7500
Epoch 1000/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4564 - acc: 0.7847 - val_loss: 0.5131 - val_acc: 0.7500
Epoch 1001/1500
576/576 [==============================] - 0s 76us/step - loss: 0.4564 - acc: 0.7847 - val_loss: 0.5131 - val_acc: 0.7500
Epoch 1002/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4563 - acc: 0.7847 - val_loss: 0.5132 - val_acc: 0.7500
Epoch 1003/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4563 - acc: 0.7830 - val_loss: 0.5132 - val_acc: 0.7500
Epoch 1004/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4562 - acc: 0.7847 - val_loss: 0.5132 - val_acc: 0.7500
Epoch 1005/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4562 - acc: 0.7847 - val_loss: 0.5133 - val_acc: 0.7500
Epoch 1006/1500
576/576 [==============================] - 0s 76us/step - loss: 0.4561 - acc: 0.7847 - val_loss: 0.5133 - val_acc: 0.7500
Epoch 1007/1500
576/576 [==============================] - 0s 71us/step - loss: 0.4561 - acc: 0.7847 - val_loss: 0.5133 - val_acc: 0.7500
Epoch 1008/1500
576/576 [==============================] - 0s 73us/step - loss: 0.4560 - acc: 0.7847 - val_loss: 0.5133 - val_acc: 0.7552
Epoch 1009/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4560 - acc: 0.7865 - val_loss: 0.5133 - val_acc: 0.7552
Epoch 1010/1500
576/576 [==============================] - 0s 90us/step - loss: 0.4560 - acc: 0.7865 - val_loss: 0.5134 - val_acc: 0.7552
Epoch 1011/1500
576/576 [==============================] - 0s 87us/step - loss: 0.4559 - acc: 0.7847 - val_loss: 0.5134 - val_acc: 0.7552
Epoch 1012/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4559 - acc: 0.7865 - val_loss: 0.5134 - val_acc: 0.7552
Epoch 1013/1500
576/576 [==============================] - 0s 92us/step - loss: 0.4558 - acc: 0.7865 - val_loss: 0.5134 - val_acc: 0.7552
Epoch 1014/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4558 - acc: 0.7865 - val_loss: 0.5134 - val_acc: 0.7552
Epoch 1015/1500
576/576 [==============================] - 0s 76us/step - loss: 0.4557 - acc: 0.7865 - val_loss: 0.5135 - val_acc: 0.7552
Epoch 1016/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4557 - acc: 0.7847 - val_loss: 0.5135 - val_acc: 0.7552
Epoch 1017/1500
576/576 [==============================] - 0s 69us/step - loss: 0.4557 - acc: 0.7865 - val_loss: 0.5135 - val_acc: 0.7552
Epoch 1018/1500
576/576 [==============================] - 0s 71us/step - loss: 0.4556 - acc: 0.7865 - val_loss: 0.5135 - val_acc: 0.7552
Epoch 1019/1500
576/576 [==============================] - 0s 69us/step - loss: 0.4556 - acc: 0.7847 - val_loss: 0.5135 - val_acc: 0.7552
Epoch 1020/1500
576/576 [==============================] - 0s 73us/step - loss: 0.4555 - acc: 0.7865 - val_loss: 0.5136 - val_acc: 0.7552
Epoch 1021/1500
576/576 [==============================] - 0s 76us/step - loss: 0.4554 - acc: 0.7865 - val_loss: 0.5136 - val_acc: 0.7552
Epoch 1022/1500
576/576 [==============================] - 0s 73us/step - loss: 0.4555 - acc: 0.7865 - val_loss: 0.5136 - val_acc: 0.7552
Epoch 1023/1500
576/576 [==============================] - 0s 97us/step - loss: 0.4554 - acc: 0.7882 - val_loss: 0.5136 - val_acc: 0.7552
Epoch 1024/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4553 - acc: 0.7882 - val_loss: 0.5137 - val_acc: 0.7552
Epoch 1025/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4553 - acc: 0.7865 - val_loss: 0.5137 - val_acc: 0.7552
Epoch 1026/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4553 - acc: 0.7882 - val_loss: 0.5137 - val_acc: 0.7552
Epoch 1027/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4552 - acc: 0.7865 - val_loss: 0.5137 - val_acc: 0.7552
Epoch 1028/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4552 - acc: 0.7882 - val_loss: 0.5138 - val_acc: 0.7552
Epoch 1029/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4551 - acc: 0.7882 - val_loss: 0.5138 - val_acc: 0.7552
Epoch 1030/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4551 - acc: 0.7882 - val_loss: 0.5138 - val_acc: 0.7552
Epoch 1031/1500
576/576 [==============================] - 0s 92us/step - loss: 0.4550 - acc: 0.7882 - val_loss: 0.5138 - val_acc: 0.7552
Epoch 1032/1500
576/576 [==============================] - 0s 75us/step - loss: 0.4550 - acc: 0.7882 - val_loss: 0.5138 - val_acc: 0.7552
Epoch 1033/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4550 - acc: 0.7882 - val_loss: 0.5139 - val_acc: 0.7552
Epoch 1034/1500
576/576 [==============================] - 0s 90us/step - loss: 0.4549 - acc: 0.7865 - val_loss: 0.5139 - val_acc: 0.7552
Epoch 1035/1500
576/576 [==============================] - 0s 92us/step - loss: 0.4549 - acc: 0.7882 - val_loss: 0.5139 - val_acc: 0.7552
Epoch 1036/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4548 - acc: 0.7882 - val_loss: 0.5139 - val_acc: 0.7552
Epoch 1037/1500
576/576 [==============================] - 0s 104us/step - loss: 0.4549 - acc: 0.7882 - val_loss: 0.5139 - val_acc: 0.7552
Epoch 1038/1500
576/576 [==============================] - 0s 73us/step - loss: 0.4548 - acc: 0.7882 - val_loss: 0.5139 - val_acc: 0.7552
Epoch 1039/1500
576/576 [==============================] - 0s 71us/step - loss: 0.4547 - acc: 0.7882 - val_loss: 0.5139 - val_acc: 0.7552
Epoch 1040/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4547 - acc: 0.7882 - val_loss: 0.5140 - val_acc: 0.7552
Epoch 1041/1500
576/576 [==============================] - 0s 76us/step - loss: 0.4546 - acc: 0.7882 - val_loss: 0.5140 - val_acc: 0.7552
Epoch 1042/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4546 - acc: 0.7882 - val_loss: 0.5140 - val_acc: 0.7604
Epoch 1043/1500
576/576 [==============================] - 0s 90us/step - loss: 0.4546 - acc: 0.7882 - val_loss: 0.5140 - val_acc: 0.7604
Epoch 1044/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4545 - acc: 0.7882 - val_loss: 0.5140 - val_acc: 0.7604
Epoch 1045/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4545 - acc: 0.7882 - val_loss: 0.5141 - val_acc: 0.7656
Epoch 1046/1500
576/576 [==============================] - 0s 75us/step - loss: 0.4544 - acc: 0.7882 - val_loss: 0.5141 - val_acc: 0.7656
Epoch 1047/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4544 - acc: 0.7882 - val_loss: 0.5141 - val_acc: 0.7656
Epoch 1048/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4543 - acc: 0.7882 - val_loss: 0.5141 - val_acc: 0.7656
Epoch 1049/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4543 - acc: 0.7882 - val_loss: 0.5142 - val_acc: 0.7656
Epoch 1050/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4543 - acc: 0.7882 - val_loss: 0.5142 - val_acc: 0.7656
Epoch 1051/1500
576/576 [==============================] - 0s 101us/step - loss: 0.4542 - acc: 0.7882 - val_loss: 0.5142 - val_acc: 0.7656
Epoch 1052/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4542 - acc: 0.7882 - val_loss: 0.5142 - val_acc: 0.7656
Epoch 1053/1500
576/576 [==============================] - 0s 123us/step - loss: 0.4541 - acc: 0.7882 - val_loss: 0.5143 - val_acc: 0.7656
Epoch 1054/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4541 - acc: 0.7882 - val_loss: 0.5143 - val_acc: 0.7604
Epoch 1055/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4541 - acc: 0.7882 - val_loss: 0.5143 - val_acc: 0.7604
Epoch 1056/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4540 - acc: 0.7882 - val_loss: 0.5143 - val_acc: 0.7604
Epoch 1057/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4540 - acc: 0.7882 - val_loss: 0.5143 - val_acc: 0.7604
Epoch 1058/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4539 - acc: 0.7882 - val_loss: 0.5144 - val_acc: 0.7604
Epoch 1059/1500
576/576 [==============================] - 0s 87us/step - loss: 0.4539 - acc: 0.7882 - val_loss: 0.5144 - val_acc: 0.7604
Epoch 1060/1500
576/576 [==============================] - 0s 87us/step - loss: 0.4539 - acc: 0.7882 - val_loss: 0.5144 - val_acc: 0.7604
Epoch 1061/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4538 - acc: 0.7882 - val_loss: 0.5144 - val_acc: 0.7552
Epoch 1062/1500
576/576 [==============================] - 0s 87us/step - loss: 0.4537 - acc: 0.7882 - val_loss: 0.5144 - val_acc: 0.7552
Epoch 1063/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4538 - acc: 0.7882 - val_loss: 0.5145 - val_acc: 0.7552
Epoch 1064/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4536 - acc: 0.7882 - val_loss: 0.5145 - val_acc: 0.7552
Epoch 1065/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4536 - acc: 0.7882 - val_loss: 0.5145 - val_acc: 0.7552
Epoch 1066/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4536 - acc: 0.7882 - val_loss: 0.5145 - val_acc: 0.7552
Epoch 1067/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4535 - acc: 0.7882 - val_loss: 0.5145 - val_acc: 0.7552
Epoch 1068/1500
576/576 [==============================] - 0s 66us/step - loss: 0.4535 - acc: 0.7882 - val_loss: 0.5145 - val_acc: 0.7552
Epoch 1069/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4535 - acc: 0.7882 - val_loss: 0.5146 - val_acc: 0.7552
Epoch 1070/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4534 - acc: 0.7882 - val_loss: 0.5146 - val_acc: 0.7552
Epoch 1071/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4533 - acc: 0.7882 - val_loss: 0.5146 - val_acc: 0.7552
Epoch 1072/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4533 - acc: 0.7882 - val_loss: 0.5146 - val_acc: 0.7604
Epoch 1073/1500
576/576 [==============================] - 0s 75us/step - loss: 0.4532 - acc: 0.7882 - val_loss: 0.5146 - val_acc: 0.7604
Epoch 1074/1500
576/576 [==============================] - 0s 66us/step - loss: 0.4532 - acc: 0.7882 - val_loss: 0.5147 - val_acc: 0.7604
Epoch 1075/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4532 - acc: 0.7882 - val_loss: 0.5147 - val_acc: 0.7604
Epoch 1076/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4531 - acc: 0.7882 - val_loss: 0.5147 - val_acc: 0.7604
Epoch 1077/1500
576/576 [==============================] - 0s 75us/step - loss: 0.4530 - acc: 0.7882 - val_loss: 0.5147 - val_acc: 0.7604
Epoch 1078/1500
576/576 [==============================] - 0s 71us/step - loss: 0.4531 - acc: 0.7882 - val_loss: 0.5147 - val_acc: 0.7604
Epoch 1079/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4530 - acc: 0.7882 - val_loss: 0.5147 - val_acc: 0.7604
Epoch 1080/1500
576/576 [==============================] - 0s 106us/step - loss: 0.4530 - acc: 0.7882 - val_loss: 0.5147 - val_acc: 0.7604
Epoch 1081/1500
576/576 [==============================] - 0s 90us/step - loss: 0.4529 - acc: 0.7882 - val_loss: 0.5147 - val_acc: 0.7604
Epoch 1082/1500
576/576 [==============================] - 0s 97us/step - loss: 0.4528 - acc: 0.7882 - val_loss: 0.5148 - val_acc: 0.7604
Epoch 1083/1500
576/576 [==============================] - 0s 108us/step - loss: 0.4528 - acc: 0.7882 - val_loss: 0.5148 - val_acc: 0.7604
Epoch 1084/1500
576/576 [==============================] - 0s 87us/step - loss: 0.4528 - acc: 0.7882 - val_loss: 0.5148 - val_acc: 0.7604
Epoch 1085/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4527 - acc: 0.7882 - val_loss: 0.5148 - val_acc: 0.7604
Epoch 1086/1500
576/576 [==============================] - 0s 87us/step - loss: 0.4527 - acc: 0.7882 - val_loss: 0.5148 - val_acc: 0.7604
Epoch 1087/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4526 - acc: 0.7882 - val_loss: 0.5149 - val_acc: 0.7604
Epoch 1088/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4526 - acc: 0.7882 - val_loss: 0.5149 - val_acc: 0.7604
Epoch 1089/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4526 - acc: 0.7882 - val_loss: 0.5149 - val_acc: 0.7604
Epoch 1090/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4525 - acc: 0.7882 - val_loss: 0.5149 - val_acc: 0.7604
Epoch 1091/1500
576/576 [==============================] - 0s 94us/step - loss: 0.4524 - acc: 0.7882 - val_loss: 0.5149 - val_acc: 0.7604
Epoch 1092/1500
576/576 [==============================] - 0s 76us/step - loss: 0.4524 - acc: 0.7882 - val_loss: 0.5149 - val_acc: 0.7604
Epoch 1093/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4524 - acc: 0.7882 - val_loss: 0.5149 - val_acc: 0.7604
Epoch 1094/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4524 - acc: 0.7882 - val_loss: 0.5150 - val_acc: 0.7604
Epoch 1095/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4523 - acc: 0.7882 - val_loss: 0.5150 - val_acc: 0.7604
Epoch 1096/1500
576/576 [==============================] - 0s 106us/step - loss: 0.4523 - acc: 0.7899 - val_loss: 0.5150 - val_acc: 0.7604
Epoch 1097/1500
576/576 [==============================] - 0s 87us/step - loss: 0.4522 - acc: 0.7882 - val_loss: 0.5150 - val_acc: 0.7604
Epoch 1098/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4522 - acc: 0.7882 - val_loss: 0.5150 - val_acc: 0.7604
Epoch 1099/1500
576/576 [==============================] - 0s 76us/step - loss: 0.4521 - acc: 0.7882 - val_loss: 0.5150 - val_acc: 0.7604
Epoch 1100/1500
576/576 [==============================] - 0s 87us/step - loss: 0.4521 - acc: 0.7882 - val_loss: 0.5150 - val_acc: 0.7604
Epoch 1101/1500
576/576 [==============================] - 0s 87us/step - loss: 0.4521 - acc: 0.7882 - val_loss: 0.5150 - val_acc: 0.7604
Epoch 1102/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4521 - acc: 0.7882 - val_loss: 0.5150 - val_acc: 0.7604
Epoch 1103/1500
576/576 [==============================] - 0s 87us/step - loss: 0.4520 - acc: 0.7882 - val_loss: 0.5150 - val_acc: 0.7604
Epoch 1104/1500
576/576 [==============================] - 0s 87us/step - loss: 0.4519 - acc: 0.7882 - val_loss: 0.5150 - val_acc: 0.7604
Epoch 1105/1500
576/576 [==============================] - 0s 92us/step - loss: 0.4519 - acc: 0.7899 - val_loss: 0.5150 - val_acc: 0.7604
Epoch 1106/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4518 - acc: 0.7882 - val_loss: 0.5150 - val_acc: 0.7656
Epoch 1107/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4518 - acc: 0.7899 - val_loss: 0.5150 - val_acc: 0.7656
Epoch 1108/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4517 - acc: 0.7899 - val_loss: 0.5150 - val_acc: 0.7656
Epoch 1109/1500
576/576 [==============================] - 0s 87us/step - loss: 0.4516 - acc: 0.7882 - val_loss: 0.5150 - val_acc: 0.7656
Epoch 1110/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4516 - acc: 0.7899 - val_loss: 0.5151 - val_acc: 0.7656
Epoch 1111/1500
576/576 [==============================] - 0s 92us/step - loss: 0.4516 - acc: 0.7899 - val_loss: 0.5151 - val_acc: 0.7656
Epoch 1112/1500
576/576 [==============================] - ETA: 0s - loss: 0.4215 - acc: 0.812 - 0s 94us/step - loss: 0.4515 - acc: 0.7917 - val_loss: 0.5151 - val_acc: 0.7656
Epoch 1113/1500
576/576 [==============================] - 0s 94us/step - loss: 0.4515 - acc: 0.7899 - val_loss: 0.5151 - val_acc: 0.7656
Epoch 1114/1500
576/576 [==============================] - 0s 87us/step - loss: 0.4514 - acc: 0.7899 - val_loss: 0.5151 - val_acc: 0.7656
Epoch 1115/1500
576/576 [==============================] - 0s 97us/step - loss: 0.4514 - acc: 0.7899 - val_loss: 0.5151 - val_acc: 0.7656
Epoch 1116/1500
576/576 [==============================] - 0s 90us/step - loss: 0.4513 - acc: 0.7899 - val_loss: 0.5151 - val_acc: 0.7656
Epoch 1117/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4513 - acc: 0.7899 - val_loss: 0.5151 - val_acc: 0.7656
Epoch 1118/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4512 - acc: 0.7917 - val_loss: 0.5151 - val_acc: 0.7656
Epoch 1119/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4512 - acc: 0.7917 - val_loss: 0.5151 - val_acc: 0.7656
Epoch 1120/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4512 - acc: 0.7899 - val_loss: 0.5151 - val_acc: 0.7656
Epoch 1121/1500
576/576 [==============================] - 0s 94us/step - loss: 0.4511 - acc: 0.7899 - val_loss: 0.5151 - val_acc: 0.7656
Epoch 1122/1500
576/576 [==============================] - 0s 76us/step - loss: 0.4511 - acc: 0.7899 - val_loss: 0.5152 - val_acc: 0.7656
Epoch 1123/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4510 - acc: 0.7899 - val_loss: 0.5151 - val_acc: 0.7656
Epoch 1124/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4510 - acc: 0.7917 - val_loss: 0.5151 - val_acc: 0.7656
Epoch 1125/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4510 - acc: 0.7899 - val_loss: 0.5152 - val_acc: 0.7656
Epoch 1126/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4510 - acc: 0.7917 - val_loss: 0.5152 - val_acc: 0.7656
Epoch 1127/1500
576/576 [==============================] - 0s 87us/step - loss: 0.4509 - acc: 0.7899 - val_loss: 0.5152 - val_acc: 0.7656
Epoch 1128/1500
576/576 [==============================] - 0s 95us/step - loss: 0.4509 - acc: 0.7917 - val_loss: 0.5152 - val_acc: 0.7656
Epoch 1129/1500
576/576 [==============================] - 0s 99us/step - loss: 0.4508 - acc: 0.7917 - val_loss: 0.5152 - val_acc: 0.7656
Epoch 1130/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4507 - acc: 0.7917 - val_loss: 0.5152 - val_acc: 0.7656
Epoch 1131/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4507 - acc: 0.7899 - val_loss: 0.5152 - val_acc: 0.7656
Epoch 1132/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4507 - acc: 0.7917 - val_loss: 0.5152 - val_acc: 0.7656
Epoch 1133/1500
576/576 [==============================] - 0s 87us/step - loss: 0.4507 - acc: 0.7917 - val_loss: 0.5152 - val_acc: 0.7656
Epoch 1134/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4506 - acc: 0.7917 - val_loss: 0.5152 - val_acc: 0.7656
Epoch 1135/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4505 - acc: 0.7917 - val_loss: 0.5152 - val_acc: 0.7656
Epoch 1136/1500
576/576 [==============================] - 0s 90us/step - loss: 0.4506 - acc: 0.7917 - val_loss: 0.5152 - val_acc: 0.7656
Epoch 1137/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4505 - acc: 0.7917 - val_loss: 0.5152 - val_acc: 0.7604
Epoch 1138/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4504 - acc: 0.7917 - val_loss: 0.5152 - val_acc: 0.7604
Epoch 1139/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4504 - acc: 0.7917 - val_loss: 0.5152 - val_acc: 0.7604
Epoch 1140/1500
576/576 [==============================] - 0s 90us/step - loss: 0.4504 - acc: 0.7899 - val_loss: 0.5152 - val_acc: 0.7604
Epoch 1141/1500
576/576 [==============================] - 0s 97us/step - loss: 0.4504 - acc: 0.7917 - val_loss: 0.5152 - val_acc: 0.7604
Epoch 1142/1500
576/576 [==============================] - 0s 108us/step - loss: 0.4503 - acc: 0.7917 - val_loss: 0.5152 - val_acc: 0.7604
Epoch 1143/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4503 - acc: 0.7899 - val_loss: 0.5152 - val_acc: 0.7604
Epoch 1144/1500
576/576 [==============================] - 0s 92us/step - loss: 0.4502 - acc: 0.7917 - val_loss: 0.5152 - val_acc: 0.7604
Epoch 1145/1500
576/576 [==============================] - 0s 95us/step - loss: 0.4501 - acc: 0.7917 - val_loss: 0.5152 - val_acc: 0.7604
Epoch 1146/1500
576/576 [==============================] - ETA: 0s - loss: 0.3776 - acc: 0.843 - 0s 92us/step - loss: 0.4502 - acc: 0.7917 - val_loss: 0.5152 - val_acc: 0.7604
Epoch 1147/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4501 - acc: 0.7917 - val_loss: 0.5152 - val_acc: 0.7604
Epoch 1148/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4501 - acc: 0.7899 - val_loss: 0.5152 - val_acc: 0.7604
Epoch 1149/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4501 - acc: 0.7917 - val_loss: 0.5152 - val_acc: 0.7604
Epoch 1150/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4501 - acc: 0.7917 - val_loss: 0.5152 - val_acc: 0.7552
Epoch 1151/1500
576/576 [==============================] - 0s 92us/step - loss: 0.4500 - acc: 0.7899 - val_loss: 0.5152 - val_acc: 0.7552
Epoch 1152/1500
576/576 [==============================] - 0s 92us/step - loss: 0.4500 - acc: 0.7899 - val_loss: 0.5152 - val_acc: 0.7552
Epoch 1153/1500
576/576 [==============================] - 0s 87us/step - loss: 0.4499 - acc: 0.7917 - val_loss: 0.5152 - val_acc: 0.7552
Epoch 1154/1500
576/576 [==============================] - 0s 94us/step - loss: 0.4499 - acc: 0.7899 - val_loss: 0.5152 - val_acc: 0.7552
Epoch 1155/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4498 - acc: 0.7917 - val_loss: 0.5152 - val_acc: 0.7552
Epoch 1156/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4498 - acc: 0.7917 - val_loss: 0.5152 - val_acc: 0.7552
Epoch 1157/1500
576/576 [==============================] - 0s 92us/step - loss: 0.4498 - acc: 0.7899 - val_loss: 0.5152 - val_acc: 0.7552
Epoch 1158/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4498 - acc: 0.7917 - val_loss: 0.5152 - val_acc: 0.7552
Epoch 1159/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4497 - acc: 0.7899 - val_loss: 0.5152 - val_acc: 0.7552
Epoch 1160/1500
576/576 [==============================] - 0s 118us/step - loss: 0.4497 - acc: 0.7917 - val_loss: 0.5152 - val_acc: 0.7552
Epoch 1161/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4496 - acc: 0.7917 - val_loss: 0.5152 - val_acc: 0.7552
Epoch 1162/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4496 - acc: 0.7917 - val_loss: 0.5152 - val_acc: 0.7552
Epoch 1163/1500
576/576 [==============================] - 0s 90us/step - loss: 0.4496 - acc: 0.7917 - val_loss: 0.5152 - val_acc: 0.7552
Epoch 1164/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4495 - acc: 0.7899 - val_loss: 0.5152 - val_acc: 0.7552
Epoch 1165/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4495 - acc: 0.7899 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1166/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4494 - acc: 0.7899 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1167/1500
576/576 [==============================] - 0s 87us/step - loss: 0.4494 - acc: 0.7917 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1168/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4494 - acc: 0.7899 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1169/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4494 - acc: 0.7917 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1170/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4493 - acc: 0.7899 - val_loss: 0.5152 - val_acc: 0.7552
Epoch 1171/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4493 - acc: 0.7899 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1172/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4492 - acc: 0.7917 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1173/1500
576/576 [==============================] - 0s 71us/step - loss: 0.4492 - acc: 0.7917 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1174/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4492 - acc: 0.7899 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1175/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4492 - acc: 0.7917 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1176/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4492 - acc: 0.7899 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1177/1500
576/576 [==============================] - 0s 75us/step - loss: 0.4491 - acc: 0.7917 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1178/1500
576/576 [==============================] - 0s 73us/step - loss: 0.4491 - acc: 0.7899 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1179/1500
576/576 [==============================] - 0s 75us/step - loss: 0.4490 - acc: 0.7899 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1180/1500
576/576 [==============================] - 0s 75us/step - loss: 0.4490 - acc: 0.7917 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1181/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4490 - acc: 0.7899 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1182/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4490 - acc: 0.7899 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1183/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4489 - acc: 0.7899 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1184/1500
576/576 [==============================] - 0s 69us/step - loss: 0.4489 - acc: 0.7899 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1185/1500
576/576 [==============================] - 0s 87us/step - loss: 0.4488 - acc: 0.7899 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1186/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4488 - acc: 0.7899 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1187/1500
576/576 [==============================] - 0s 71us/step - loss: 0.4488 - acc: 0.7899 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1188/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4487 - acc: 0.7899 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1189/1500
576/576 [==============================] - 0s 75us/step - loss: 0.4487 - acc: 0.7899 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1190/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4487 - acc: 0.7917 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1191/1500
576/576 [==============================] - 0s 75us/step - loss: 0.4487 - acc: 0.7899 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1192/1500
576/576 [==============================] - 0s 75us/step - loss: 0.4486 - acc: 0.7917 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1193/1500
576/576 [==============================] - 0s 73us/step - loss: 0.4486 - acc: 0.7917 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1194/1500
576/576 [==============================] - 0s 69us/step - loss: 0.4485 - acc: 0.7899 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1195/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4485 - acc: 0.7899 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1196/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4485 - acc: 0.7899 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1197/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4485 - acc: 0.7899 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1198/1500
576/576 [==============================] - 0s 71us/step - loss: 0.4484 - acc: 0.7917 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1199/1500
576/576 [==============================] - 0s 90us/step - loss: 0.4485 - acc: 0.7899 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1200/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4484 - acc: 0.7899 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1201/1500
576/576 [==============================] - 0s 90us/step - loss: 0.4483 - acc: 0.7899 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1202/1500
576/576 [==============================] - 0s 94us/step - loss: 0.4483 - acc: 0.7917 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1203/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4483 - acc: 0.7899 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1204/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4483 - acc: 0.7917 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1205/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4482 - acc: 0.7899 - val_loss: 0.5149 - val_acc: 0.7552
Epoch 1206/1500
576/576 [==============================] - 0s 94us/step - loss: 0.4482 - acc: 0.7917 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1207/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4482 - acc: 0.7917 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1208/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4481 - acc: 0.7917 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1209/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4482 - acc: 0.7934 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1210/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4481 - acc: 0.7917 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1211/1500
576/576 [==============================] - 0s 87us/step - loss: 0.4481 - acc: 0.7934 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1212/1500
576/576 [==============================] - 0s 97us/step - loss: 0.4481 - acc: 0.7917 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1213/1500
576/576 [==============================] - 0s 99us/step - loss: 0.4480 - acc: 0.7917 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1214/1500
576/576 [==============================] - 0s 76us/step - loss: 0.4479 - acc: 0.7917 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1215/1500
576/576 [==============================] - 0s 76us/step - loss: 0.4479 - acc: 0.7917 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1216/1500
576/576 [==============================] - 0s 75us/step - loss: 0.4479 - acc: 0.7917 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1217/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4478 - acc: 0.7917 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1218/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4478 - acc: 0.7917 - val_loss: 0.5149 - val_acc: 0.7552
Epoch 1219/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4479 - acc: 0.7917 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1220/1500
576/576 [==============================] - 0s 87us/step - loss: 0.4477 - acc: 0.7917 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1221/1500
576/576 [==============================] - 0s 69us/step - loss: 0.4477 - acc: 0.7917 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1222/1500
576/576 [==============================] - 0s 76us/step - loss: 0.4477 - acc: 0.7917 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1223/1500
576/576 [==============================] - 0s 95us/step - loss: 0.4476 - acc: 0.7934 - val_loss: 0.5149 - val_acc: 0.7552
Epoch 1224/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4477 - acc: 0.7917 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1225/1500
576/576 [==============================] - 0s 76us/step - loss: 0.4476 - acc: 0.7934 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1226/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4476 - acc: 0.7934 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1227/1500
576/576 [==============================] - 0s 76us/step - loss: 0.4475 - acc: 0.7934 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1228/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4475 - acc: 0.7917 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1229/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4474 - acc: 0.7917 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1230/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4474 - acc: 0.7917 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1231/1500
576/576 [==============================] - 0s 76us/step - loss: 0.4474 - acc: 0.7917 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1232/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4474 - acc: 0.7917 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1233/1500
576/576 [==============================] - 0s 87us/step - loss: 0.4474 - acc: 0.7917 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1234/1500
576/576 [==============================] - 0s 87us/step - loss: 0.4473 - acc: 0.7917 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1235/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4473 - acc: 0.7934 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1236/1500
576/576 [==============================] - 0s 75us/step - loss: 0.4472 - acc: 0.7934 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1237/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4472 - acc: 0.7934 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1238/1500
576/576 [==============================] - 0s 75us/step - loss: 0.4472 - acc: 0.7934 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1239/1500
576/576 [==============================] - 0s 76us/step - loss: 0.4472 - acc: 0.7917 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1240/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4472 - acc: 0.7934 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1241/1500
576/576 [==============================] - 0s 76us/step - loss: 0.4472 - acc: 0.7917 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1242/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4471 - acc: 0.7934 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1243/1500
576/576 [==============================] - 0s 94us/step - loss: 0.4471 - acc: 0.7934 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1244/1500
576/576 [==============================] - 0s 90us/step - loss: 0.4471 - acc: 0.7934 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1245/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4470 - acc: 0.7934 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1246/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4469 - acc: 0.7934 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1247/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4469 - acc: 0.7917 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1248/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4469 - acc: 0.7917 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1249/1500
576/576 [==============================] - 0s 87us/step - loss: 0.4469 - acc: 0.7934 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1250/1500
576/576 [==============================] - 0s 87us/step - loss: 0.4469 - acc: 0.7934 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1251/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4469 - acc: 0.7934 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1252/1500
576/576 [==============================] - 0s 76us/step - loss: 0.4468 - acc: 0.7934 - val_loss: 0.5152 - val_acc: 0.7552
Epoch 1253/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4468 - acc: 0.7934 - val_loss: 0.5152 - val_acc: 0.7552
Epoch 1254/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4468 - acc: 0.7934 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1255/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4468 - acc: 0.7934 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1256/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4467 - acc: 0.7934 - val_loss: 0.5152 - val_acc: 0.7552
Epoch 1257/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4466 - acc: 0.7934 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1258/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4467 - acc: 0.7934 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1259/1500
576/576 [==============================] - 0s 94us/step - loss: 0.4466 - acc: 0.7951 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1260/1500
576/576 [==============================] - 0s 94us/step - loss: 0.4466 - acc: 0.7951 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1261/1500
576/576 [==============================] - 0s 87us/step - loss: 0.4466 - acc: 0.7951 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1262/1500
576/576 [==============================] - 0s 75us/step - loss: 0.4466 - acc: 0.7934 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1263/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4465 - acc: 0.7951 - val_loss: 0.5152 - val_acc: 0.7552
Epoch 1264/1500
576/576 [==============================] - 0s 95us/step - loss: 0.4465 - acc: 0.7951 - val_loss: 0.5152 - val_acc: 0.7552
Epoch 1265/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4465 - acc: 0.7934 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1266/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4464 - acc: 0.7951 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1267/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4464 - acc: 0.7951 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1268/1500
576/576 [==============================] - 0s 90us/step - loss: 0.4464 - acc: 0.7951 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1269/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4463 - acc: 0.7951 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1270/1500
576/576 [==============================] - 0s 97us/step - loss: 0.4463 - acc: 0.7951 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1271/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4463 - acc: 0.7951 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1272/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4462 - acc: 0.7934 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1273/1500
576/576 [==============================] - 0s 90us/step - loss: 0.4462 - acc: 0.7951 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1274/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4462 - acc: 0.7951 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1275/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4461 - acc: 0.7934 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1276/1500
576/576 [==============================] - 0s 92us/step - loss: 0.4461 - acc: 0.7951 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1277/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4461 - acc: 0.7951 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1278/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4460 - acc: 0.7934 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1279/1500
576/576 [==============================] - 0s 97us/step - loss: 0.4460 - acc: 0.7951 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1280/1500
576/576 [==============================] - 0s 104us/step - loss: 0.4460 - acc: 0.7951 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1281/1500
576/576 [==============================] - 0s 92us/step - loss: 0.4460 - acc: 0.7934 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1282/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4459 - acc: 0.7934 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1283/1500
576/576 [==============================] - 0s 101us/step - loss: 0.4459 - acc: 0.7917 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1284/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4458 - acc: 0.7934 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1285/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4458 - acc: 0.7917 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1286/1500
576/576 [==============================] - 0s 76us/step - loss: 0.4458 - acc: 0.7934 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1287/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4458 - acc: 0.7934 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1288/1500
576/576 [==============================] - 0s 90us/step - loss: 0.4457 - acc: 0.7934 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1289/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4457 - acc: 0.7934 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1290/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4457 - acc: 0.7934 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1291/1500
576/576 [==============================] - 0s 76us/step - loss: 0.4456 - acc: 0.7917 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1292/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4456 - acc: 0.7917 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1293/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4455 - acc: 0.7934 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1294/1500
576/576 [==============================] - 0s 76us/step - loss: 0.4455 - acc: 0.7934 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1295/1500
576/576 [==============================] - 0s 104us/step - loss: 0.4455 - acc: 0.7934 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1296/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4455 - acc: 0.7951 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1297/1500
576/576 [==============================] - 0s 69us/step - loss: 0.4454 - acc: 0.7951 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1298/1500
576/576 [==============================] - 0s 94us/step - loss: 0.4454 - acc: 0.7951 - val_loss: 0.5149 - val_acc: 0.7552
Epoch 1299/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4454 - acc: 0.7917 - val_loss: 0.5149 - val_acc: 0.7552
Epoch 1300/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4453 - acc: 0.7934 - val_loss: 0.5149 - val_acc: 0.7552
Epoch 1301/1500
576/576 [==============================] - 0s 71us/step - loss: 0.4453 - acc: 0.7951 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1302/1500
576/576 [==============================] - 0s 76us/step - loss: 0.4453 - acc: 0.7934 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1303/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4452 - acc: 0.7934 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1304/1500
576/576 [==============================] - 0s 76us/step - loss: 0.4452 - acc: 0.7917 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1305/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4452 - acc: 0.7934 - val_loss: 0.5149 - val_acc: 0.7552
Epoch 1306/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4452 - acc: 0.7951 - val_loss: 0.5149 - val_acc: 0.7552
Epoch 1307/1500
576/576 [==============================] - 0s 90us/step - loss: 0.4451 - acc: 0.7917 - val_loss: 0.5149 - val_acc: 0.7552
Epoch 1308/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4452 - acc: 0.7917 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1309/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4451 - acc: 0.7934 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1310/1500
576/576 [==============================] - 0s 73us/step - loss: 0.4450 - acc: 0.7951 - val_loss: 0.5149 - val_acc: 0.7552
Epoch 1311/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4450 - acc: 0.7951 - val_loss: 0.5149 - val_acc: 0.7552
Epoch 1312/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4450 - acc: 0.7934 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1313/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4449 - acc: 0.7951 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1314/1500
576/576 [==============================] - 0s 73us/step - loss: 0.4449 - acc: 0.7951 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1315/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4449 - acc: 0.7934 - val_loss: 0.5149 - val_acc: 0.7552
Epoch 1316/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4449 - acc: 0.7934 - val_loss: 0.5149 - val_acc: 0.7552
Epoch 1317/1500
576/576 [==============================] - 0s 75us/step - loss: 0.4448 - acc: 0.7934 - val_loss: 0.5149 - val_acc: 0.7552
Epoch 1318/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4448 - acc: 0.7934 - val_loss: 0.5149 - val_acc: 0.7552
Epoch 1319/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4448 - acc: 0.7934 - val_loss: 0.5149 - val_acc: 0.7552
Epoch 1320/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4448 - acc: 0.7951 - val_loss: 0.5149 - val_acc: 0.7552
Epoch 1321/1500
576/576 [==============================] - 0s 90us/step - loss: 0.4447 - acc: 0.7917 - val_loss: 0.5149 - val_acc: 0.7552
Epoch 1322/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4447 - acc: 0.7951 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1323/1500
576/576 [==============================] - 0s 76us/step - loss: 0.4447 - acc: 0.7951 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1324/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4446 - acc: 0.7917 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1325/1500
576/576 [==============================] - 0s 69us/step - loss: 0.4446 - acc: 0.7951 - val_loss: 0.5149 - val_acc: 0.7552
Epoch 1326/1500
576/576 [==============================] - 0s 76us/step - loss: 0.4446 - acc: 0.7951 - val_loss: 0.5149 - val_acc: 0.7552
Epoch 1327/1500
576/576 [==============================] - 0s 73us/step - loss: 0.4446 - acc: 0.7934 - val_loss: 0.5149 - val_acc: 0.7552
Epoch 1328/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4445 - acc: 0.7951 - val_loss: 0.5149 - val_acc: 0.7552
Epoch 1329/1500
576/576 [==============================] - 0s 71us/step - loss: 0.4445 - acc: 0.7951 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1330/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4444 - acc: 0.7951 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1331/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4444 - acc: 0.7951 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1332/1500
576/576 [==============================] - 0s 76us/step - loss: 0.4444 - acc: 0.7934 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1333/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4444 - acc: 0.7951 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1334/1500
576/576 [==============================] - 0s 69us/step - loss: 0.4444 - acc: 0.7951 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1335/1500
576/576 [==============================] - 0s 95us/step - loss: 0.4443 - acc: 0.7951 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1336/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4443 - acc: 0.7951 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1337/1500
576/576 [==============================] - 0s 92us/step - loss: 0.4443 - acc: 0.7951 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1338/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4442 - acc: 0.7951 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1339/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4442 - acc: 0.7951 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1340/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4443 - acc: 0.7951 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1341/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4441 - acc: 0.7951 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1342/1500
576/576 [==============================] - 0s 87us/step - loss: 0.4441 - acc: 0.7951 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1343/1500
576/576 [==============================] - 0s 69us/step - loss: 0.4441 - acc: 0.7951 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1344/1500
576/576 [==============================] - 0s 76us/step - loss: 0.4441 - acc: 0.7951 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1345/1500
576/576 [==============================] - 0s 87us/step - loss: 0.4441 - acc: 0.7951 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1346/1500
576/576 [==============================] - 0s 73us/step - loss: 0.4440 - acc: 0.7951 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1347/1500
576/576 [==============================] - 0s 73us/step - loss: 0.4441 - acc: 0.7951 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1348/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4440 - acc: 0.7951 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1349/1500
576/576 [==============================] - 0s 69us/step - loss: 0.4439 - acc: 0.7951 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1350/1500
576/576 [==============================] - 0s 76us/step - loss: 0.4439 - acc: 0.7951 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1351/1500
576/576 [==============================] - 0s 76us/step - loss: 0.4439 - acc: 0.7951 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1352/1500
576/576 [==============================] - 0s 75us/step - loss: 0.4438 - acc: 0.7951 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1353/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4439 - acc: 0.7951 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1354/1500
576/576 [==============================] - 0s 75us/step - loss: 0.4437 - acc: 0.7951 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1355/1500
576/576 [==============================] - 0s 87us/step - loss: 0.4438 - acc: 0.7951 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1356/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4437 - acc: 0.7951 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1357/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4437 - acc: 0.7951 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1358/1500
576/576 [==============================] - 0s 92us/step - loss: 0.4438 - acc: 0.7951 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1359/1500
576/576 [==============================] - 0s 90us/step - loss: 0.4437 - acc: 0.7951 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1360/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4437 - acc: 0.7951 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1361/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4436 - acc: 0.7951 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1362/1500
576/576 [==============================] - 0s 69us/step - loss: 0.4436 - acc: 0.7951 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1363/1500
576/576 [==============================] - 0s 71us/step - loss: 0.4435 - acc: 0.7951 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1364/1500
576/576 [==============================] - 0s 71us/step - loss: 0.4435 - acc: 0.7951 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1365/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4434 - acc: 0.7951 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1366/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4434 - acc: 0.7934 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1367/1500
576/576 [==============================] - 0s 71us/step - loss: 0.4435 - acc: 0.7951 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1368/1500
576/576 [==============================] - 0s 71us/step - loss: 0.4434 - acc: 0.7951 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1369/1500
576/576 [==============================] - 0s 75us/step - loss: 0.4434 - acc: 0.7951 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1370/1500
576/576 [==============================] - 0s 71us/step - loss: 0.4434 - acc: 0.7951 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1371/1500
576/576 [==============================] - 0s 76us/step - loss: 0.4433 - acc: 0.7934 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1372/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4433 - acc: 0.7951 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1373/1500
576/576 [==============================] - 0s 73us/step - loss: 0.4433 - acc: 0.7934 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1374/1500
576/576 [==============================] - 0s 76us/step - loss: 0.4433 - acc: 0.7934 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1375/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4432 - acc: 0.7934 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1376/1500
576/576 [==============================] - 0s 76us/step - loss: 0.4432 - acc: 0.7934 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1377/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4431 - acc: 0.7934 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1378/1500
576/576 [==============================] - 0s 97us/step - loss: 0.4431 - acc: 0.7934 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1379/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4431 - acc: 0.7934 - val_loss: 0.5152 - val_acc: 0.7552
Epoch 1380/1500
576/576 [==============================] - 0s 87us/step - loss: 0.4431 - acc: 0.7934 - val_loss: 0.5152 - val_acc: 0.7552
Epoch 1381/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4431 - acc: 0.7934 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1382/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4430 - acc: 0.7934 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1383/1500
576/576 [==============================] - 0s 73us/step - loss: 0.4430 - acc: 0.7934 - val_loss: 0.5152 - val_acc: 0.7552
Epoch 1384/1500
576/576 [==============================] - 0s 95us/step - loss: 0.4429 - acc: 0.7934 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1385/1500
576/576 [==============================] - 0s 101us/step - loss: 0.4429 - acc: 0.7934 - val_loss: 0.5152 - val_acc: 0.7552
Epoch 1386/1500
576/576 [==============================] - 0s 95us/step - loss: 0.4429 - acc: 0.7934 - val_loss: 0.5152 - val_acc: 0.7552
Epoch 1387/1500
576/576 [==============================] - 0s 95us/step - loss: 0.4429 - acc: 0.7934 - val_loss: 0.5152 - val_acc: 0.7552
Epoch 1388/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4428 - acc: 0.7934 - val_loss: 0.5152 - val_acc: 0.7552
Epoch 1389/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4428 - acc: 0.7934 - val_loss: 0.5152 - val_acc: 0.7552
Epoch 1390/1500
576/576 [==============================] - 0s 76us/step - loss: 0.4428 - acc: 0.7934 - val_loss: 0.5152 - val_acc: 0.7552
Epoch 1391/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4428 - acc: 0.7934 - val_loss: 0.5152 - val_acc: 0.7552
Epoch 1392/1500
576/576 [==============================] - 0s 95us/step - loss: 0.4427 - acc: 0.7934 - val_loss: 0.5152 - val_acc: 0.7552
Epoch 1393/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4427 - acc: 0.7934 - val_loss: 0.5152 - val_acc: 0.7552
Epoch 1394/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4427 - acc: 0.7934 - val_loss: 0.5152 - val_acc: 0.7500
Epoch 1395/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4426 - acc: 0.7934 - val_loss: 0.5152 - val_acc: 0.7500
Epoch 1396/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4426 - acc: 0.7934 - val_loss: 0.5152 - val_acc: 0.7552
Epoch 1397/1500
576/576 [==============================] - 0s 97us/step - loss: 0.4427 - acc: 0.7934 - val_loss: 0.5153 - val_acc: 0.7552
Epoch 1398/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4425 - acc: 0.7934 - val_loss: 0.5153 - val_acc: 0.7552
Epoch 1399/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4425 - acc: 0.7934 - val_loss: 0.5153 - val_acc: 0.7552
Epoch 1400/1500
576/576 [==============================] - 0s 87us/step - loss: 0.4425 - acc: 0.7934 - val_loss: 0.5153 - val_acc: 0.7552
Epoch 1401/1500
576/576 [==============================] - 0s 102us/step - loss: 0.4424 - acc: 0.7934 - val_loss: 0.5153 - val_acc: 0.7552
Epoch 1402/1500
576/576 [==============================] - 0s 90us/step - loss: 0.4425 - acc: 0.7934 - val_loss: 0.5153 - val_acc: 0.7552
Epoch 1403/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4424 - acc: 0.7934 - val_loss: 0.5153 - val_acc: 0.7552
Epoch 1404/1500
576/576 [==============================] - 0s 94us/step - loss: 0.4423 - acc: 0.7934 - val_loss: 0.5153 - val_acc: 0.7552
Epoch 1405/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4423 - acc: 0.7934 - val_loss: 0.5153 - val_acc: 0.7552
Epoch 1406/1500
576/576 [==============================] - 0s 121us/step - loss: 0.4423 - acc: 0.7934 - val_loss: 0.5153 - val_acc: 0.7552
Epoch 1407/1500
576/576 [==============================] - 0s 104us/step - loss: 0.4423 - acc: 0.7934 - val_loss: 0.5153 - val_acc: 0.7552
Epoch 1408/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4423 - acc: 0.7934 - val_loss: 0.5154 - val_acc: 0.7552
Epoch 1409/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4423 - acc: 0.7934 - val_loss: 0.5154 - val_acc: 0.7500
Epoch 1410/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4422 - acc: 0.7934 - val_loss: 0.5153 - val_acc: 0.7500
Epoch 1411/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4422 - acc: 0.7934 - val_loss: 0.5153 - val_acc: 0.7552
Epoch 1412/1500
576/576 [==============================] - 0s 87us/step - loss: 0.4421 - acc: 0.7934 - val_loss: 0.5153 - val_acc: 0.7500
Epoch 1413/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4422 - acc: 0.7934 - val_loss: 0.5154 - val_acc: 0.7500
Epoch 1414/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4421 - acc: 0.7934 - val_loss: 0.5154 - val_acc: 0.7500
Epoch 1415/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4421 - acc: 0.7934 - val_loss: 0.5153 - val_acc: 0.7500
Epoch 1416/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4421 - acc: 0.7934 - val_loss: 0.5154 - val_acc: 0.7552
Epoch 1417/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4420 - acc: 0.7934 - val_loss: 0.5154 - val_acc: 0.7500
Epoch 1418/1500
576/576 [==============================] - 0s 102us/step - loss: 0.4420 - acc: 0.7934 - val_loss: 0.5154 - val_acc: 0.7552
Epoch 1419/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4420 - acc: 0.7951 - val_loss: 0.5154 - val_acc: 0.7552
Epoch 1420/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4419 - acc: 0.7934 - val_loss: 0.5154 - val_acc: 0.7552
Epoch 1421/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4419 - acc: 0.7934 - val_loss: 0.5154 - val_acc: 0.7552
Epoch 1422/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4419 - acc: 0.7934 - val_loss: 0.5154 - val_acc: 0.7552
Epoch 1423/1500
576/576 [==============================] - 0s 75us/step - loss: 0.4418 - acc: 0.7934 - val_loss: 0.5155 - val_acc: 0.7552
Epoch 1424/1500
576/576 [==============================] - 0s 76us/step - loss: 0.4418 - acc: 0.7934 - val_loss: 0.5155 - val_acc: 0.7500
Epoch 1425/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4417 - acc: 0.7934 - val_loss: 0.5155 - val_acc: 0.7552
Epoch 1426/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4418 - acc: 0.7934 - val_loss: 0.5155 - val_acc: 0.7552
Epoch 1427/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4418 - acc: 0.7934 - val_loss: 0.5155 - val_acc: 0.7552
Epoch 1428/1500
576/576 [==============================] - 0s 76us/step - loss: 0.4417 - acc: 0.7951 - val_loss: 0.5155 - val_acc: 0.7552
Epoch 1429/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4417 - acc: 0.7934 - val_loss: 0.5155 - val_acc: 0.7552
Epoch 1430/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4417 - acc: 0.7934 - val_loss: 0.5155 - val_acc: 0.7552
Epoch 1431/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4416 - acc: 0.7951 - val_loss: 0.5155 - val_acc: 0.7500
Epoch 1432/1500
576/576 [==============================] - 0s 87us/step - loss: 0.4415 - acc: 0.7934 - val_loss: 0.5155 - val_acc: 0.7500
Epoch 1433/1500
576/576 [==============================] - 0s 87us/step - loss: 0.4415 - acc: 0.7951 - val_loss: 0.5155 - val_acc: 0.7500
Epoch 1434/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4415 - acc: 0.7934 - val_loss: 0.5156 - val_acc: 0.7500
Epoch 1435/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4415 - acc: 0.7951 - val_loss: 0.5156 - val_acc: 0.7500
Epoch 1436/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4415 - acc: 0.7969 - val_loss: 0.5155 - val_acc: 0.7500
Epoch 1437/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4414 - acc: 0.7951 - val_loss: 0.5155 - val_acc: 0.7500
Epoch 1438/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4414 - acc: 0.7951 - val_loss: 0.5156 - val_acc: 0.7500
Epoch 1439/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4414 - acc: 0.7951 - val_loss: 0.5155 - val_acc: 0.7500
Epoch 1440/1500
576/576 [==============================] - 0s 94us/step - loss: 0.4414 - acc: 0.7951 - val_loss: 0.5156 - val_acc: 0.7500
Epoch 1441/1500
576/576 [==============================] - 0s 90us/step - loss: 0.4413 - acc: 0.7951 - val_loss: 0.5156 - val_acc: 0.7500
Epoch 1442/1500
576/576 [==============================] - 0s 90us/step - loss: 0.4413 - acc: 0.7951 - val_loss: 0.5156 - val_acc: 0.7500
Epoch 1443/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4413 - acc: 0.7969 - val_loss: 0.5156 - val_acc: 0.7500
Epoch 1444/1500
576/576 [==============================] - 0s 92us/step - loss: 0.4413 - acc: 0.7969 - val_loss: 0.5156 - val_acc: 0.7500
Epoch 1445/1500
576/576 [==============================] - 0s 104us/step - loss: 0.4413 - acc: 0.7969 - val_loss: 0.5156 - val_acc: 0.7500
Epoch 1446/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4412 - acc: 0.7951 - val_loss: 0.5156 - val_acc: 0.7500
Epoch 1447/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4412 - acc: 0.7951 - val_loss: 0.5156 - val_acc: 0.7500
Epoch 1448/1500
576/576 [==============================] - 0s 87us/step - loss: 0.4411 - acc: 0.7934 - val_loss: 0.5156 - val_acc: 0.7500
Epoch 1449/1500
576/576 [==============================] - 0s 87us/step - loss: 0.4411 - acc: 0.7969 - val_loss: 0.5156 - val_acc: 0.7552
Epoch 1450/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4410 - acc: 0.7969 - val_loss: 0.5156 - val_acc: 0.7552
Epoch 1451/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4411 - acc: 0.7969 - val_loss: 0.5157 - val_acc: 0.7552
Epoch 1452/1500
576/576 [==============================] - 0s 94us/step - loss: 0.4410 - acc: 0.7969 - val_loss: 0.5156 - val_acc: 0.7552
Epoch 1453/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4410 - acc: 0.7969 - val_loss: 0.5157 - val_acc: 0.7552
Epoch 1454/1500
576/576 [==============================] - 0s 95us/step - loss: 0.4409 - acc: 0.7969 - val_loss: 0.5157 - val_acc: 0.7552
Epoch 1455/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4410 - acc: 0.7969 - val_loss: 0.5157 - val_acc: 0.7552
Epoch 1456/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4409 - acc: 0.7969 - val_loss: 0.5158 - val_acc: 0.7552
Epoch 1457/1500
576/576 [==============================] - 0s 90us/step - loss: 0.4408 - acc: 0.7969 - val_loss: 0.5157 - val_acc: 0.7552
Epoch 1458/1500
576/576 [==============================] - 0s 92us/step - loss: 0.4409 - acc: 0.7969 - val_loss: 0.5157 - val_acc: 0.7552
Epoch 1459/1500
576/576 [==============================] - 0s 120us/step - loss: 0.4408 - acc: 0.7969 - val_loss: 0.5157 - val_acc: 0.7552
Epoch 1460/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4408 - acc: 0.7969 - val_loss: 0.5158 - val_acc: 0.7552
Epoch 1461/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4408 - acc: 0.7969 - val_loss: 0.5158 - val_acc: 0.7552
Epoch 1462/1500
576/576 [==============================] - 0s 92us/step - loss: 0.4408 - acc: 0.7969 - val_loss: 0.5158 - val_acc: 0.7552
Epoch 1463/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4407 - acc: 0.7969 - val_loss: 0.5158 - val_acc: 0.7552
Epoch 1464/1500
576/576 [==============================] - 0s 104us/step - loss: 0.4406 - acc: 0.7969 - val_loss: 0.5158 - val_acc: 0.7552
Epoch 1465/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4406 - acc: 0.7969 - val_loss: 0.5158 - val_acc: 0.7552
Epoch 1466/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4406 - acc: 0.7969 - val_loss: 0.5159 - val_acc: 0.7552
Epoch 1467/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4406 - acc: 0.7969 - val_loss: 0.5159 - val_acc: 0.7500
Epoch 1468/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4405 - acc: 0.7969 - val_loss: 0.5159 - val_acc: 0.7500
Epoch 1469/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4405 - acc: 0.7969 - val_loss: 0.5159 - val_acc: 0.7500
Epoch 1470/1500
576/576 [==============================] - 0s 71us/step - loss: 0.4405 - acc: 0.7969 - val_loss: 0.5159 - val_acc: 0.7500
Epoch 1471/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4404 - acc: 0.7969 - val_loss: 0.5159 - val_acc: 0.7500
Epoch 1472/1500
576/576 [==============================] - 0s 73us/step - loss: 0.4404 - acc: 0.7969 - val_loss: 0.5160 - val_acc: 0.7552
Epoch 1473/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4404 - acc: 0.7969 - val_loss: 0.5160 - val_acc: 0.7552
Epoch 1474/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4404 - acc: 0.7969 - val_loss: 0.5160 - val_acc: 0.7552
Epoch 1475/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4404 - acc: 0.7969 - val_loss: 0.5160 - val_acc: 0.7500
Epoch 1476/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4403 - acc: 0.7969 - val_loss: 0.5160 - val_acc: 0.7500
Epoch 1477/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4403 - acc: 0.7969 - val_loss: 0.5160 - val_acc: 0.7500
Epoch 1478/1500
576/576 [==============================] - 0s 87us/step - loss: 0.4403 - acc: 0.7969 - val_loss: 0.5160 - val_acc: 0.7500
Epoch 1479/1500
576/576 [==============================] - 0s 71us/step - loss: 0.4403 - acc: 0.7969 - val_loss: 0.5160 - val_acc: 0.7500
Epoch 1480/1500
576/576 [==============================] - 0s 73us/step - loss: 0.4403 - acc: 0.7969 - val_loss: 0.5161 - val_acc: 0.7500
Epoch 1481/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4402 - acc: 0.7969 - val_loss: 0.5161 - val_acc: 0.7500
Epoch 1482/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4402 - acc: 0.7969 - val_loss: 0.5161 - val_acc: 0.7500
Epoch 1483/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4401 - acc: 0.7969 - val_loss: 0.5161 - val_acc: 0.7500
Epoch 1484/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4401 - acc: 0.7969 - val_loss: 0.5161 - val_acc: 0.7500
Epoch 1485/1500
576/576 [==============================] - 0s 80us/step - loss: 0.4401 - acc: 0.7969 - val_loss: 0.5161 - val_acc: 0.7500
Epoch 1486/1500
576/576 [==============================] - 0s 73us/step - loss: 0.4401 - acc: 0.7969 - val_loss: 0.5161 - val_acc: 0.7500
Epoch 1487/1500
576/576 [==============================] - 0s 82us/step - loss: 0.4401 - acc: 0.7969 - val_loss: 0.5162 - val_acc: 0.7500
Epoch 1488/1500
576/576 [==============================] - 0s 69us/step - loss: 0.4400 - acc: 0.7969 - val_loss: 0.5162 - val_acc: 0.7500
Epoch 1489/1500
576/576 [==============================] - 0s 69us/step - loss: 0.4399 - acc: 0.7969 - val_loss: 0.5161 - val_acc: 0.7500
Epoch 1490/1500
576/576 [==============================] - 0s 75us/step - loss: 0.4399 - acc: 0.7969 - val_loss: 0.5161 - val_acc: 0.7500
Epoch 1491/1500
576/576 [==============================] - 0s 75us/step - loss: 0.4399 - acc: 0.7969 - val_loss: 0.5162 - val_acc: 0.7500
Epoch 1492/1500
576/576 [==============================] - 0s 85us/step - loss: 0.4399 - acc: 0.7969 - val_loss: 0.5162 - val_acc: 0.7500
Epoch 1493/1500
576/576 [==============================] - 0s 76us/step - loss: 0.4399 - acc: 0.7969 - val_loss: 0.5162 - val_acc: 0.7500
Epoch 1494/1500
576/576 [==============================] - 0s 90us/step - loss: 0.4398 - acc: 0.7969 - val_loss: 0.5162 - val_acc: 0.7500
Epoch 1495/1500
576/576 [==============================] - 0s 83us/step - loss: 0.4398 - acc: 0.7969 - val_loss: 0.5162 - val_acc: 0.7500
Epoch 1496/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4398 - acc: 0.7986 - val_loss: 0.5163 - val_acc: 0.7500
Epoch 1497/1500
576/576 [==============================] - 0s 95us/step - loss: 0.4398 - acc: 0.7969 - val_loss: 0.5162 - val_acc: 0.7500
Epoch 1498/1500
576/576 [==============================] - 0s 95us/step - loss: 0.4397 - acc: 0.7969 - val_loss: 0.5163 - val_acc: 0.7500
Epoch 1499/1500
576/576 [==============================] - 0s 75us/step - loss: 0.4397 - acc: 0.7969 - val_loss: 0.5163 - val_acc: 0.7500
Epoch 1500/1500
576/576 [==============================] - 0s 78us/step - loss: 0.4397 - acc: 0.7969 - val_loss: 0.5163 - val_acc: 0.7500
Out[24]:
4
In [25]:
# predict the classes and the  probabilitisty scores.

y_pred_class_nn_ex = model_ex.predict_classes(X_test_norm)
y_pred_prob_nn_ex = model_ex.predict(X_test_norm)
In [26]:
#Graph the trajectory of the loss functions, accuracy on both train and test set




fig, ax = plt.subplots() #set the axes and difference the canvas
ax.plot(run_hist_ex.history["loss"],'r', label="Train Loss")           #plot the loss from the history object since it comes in a form of a dict we can access  the values via their keys
ax.plot(run_hist_ex.history["val_loss"],'b', label="Validation Loss")
ax.legend()
plt.title('Loss Train and Test')


plt.figure(2)#set the second canvas

#plot the accuracy from the history object since it comes in a form of a dict we can access  the values via their keys

plt.plot(run_hist_ex.history['acc'], 'g',  label='train accuracy')     
plt.plot(run_hist_ex.history['val_acc'],'y', label='validation accuracy')
plt.title('Accuracy Train and Test')
plt.legend()
Out[26]:
<matplotlib.legend.Legend at 0x212a02b0f98>

if we have to pick a good epoch value from these two plot above we can easily point at 200, because after that the model makes no more positive changes

In [27]:
print('accuracy is {:.3f}'.format(accuracy_score(y_test,y_pred_class_nn_ex)))
print('roc-auc is {:.3f}'.format(roc_auc_score(y_test,y_pred_prob_nn_ex)))

plot_roc(y_test, y_pred_prob_nn_ex, 'NN')
accuracy is 0.750
roc-auc is 0.800

and the our classifier doesn't look bad! and the fact its not close to the dianol line it indicates that our model knows what it doing.

In [28]:
 
  File "<ipython-input-28-c88214b542f3>", line 1
    df k
       ^
SyntaxError: invalid syntax

EXPERIMENT

WE'RE GOING TO CREATE FUNCTIONS THAT WE CAN PLAY WITH :)

In [52]:
def experiment(n_nodes, epoch, learning_rate, final_layer_activation):
    '''this function initialize a ANN and calculates the scores, then returns a list of model performance(history, y_predic_class, and probabilities)'''
    
    #Initialize the model
    model = Sequential([
    Dense(n_nodes, input_shape=(8,), activation="relu"),
    Dense(n_nodes, activation="relu"),
    Dense(1, activation=final_layer_activation)
    ])
        
    #compile the model
    model.compile(SGD(lr = learning_rate), "binary_crossentropy", metrics=["accuracy"])
    
    #train the model
    hist = model.fit(X_train_norm, y_train, validation_data=(X_test_norm, y_test), epochs=epoch)
    
    #predictions
    y_pred_class = model.predict_classes(X_test_norm)
    y_pred_prob = model.predict(X_test_norm)
    
    return [hist, y_pred_class, y_pred_prob]
In [53]:
X_train.shape
Out[53]:
(576, 8)
In [63]:
model = experiment(12, 10, .003, 'relu')
Train on 576 samples, validate on 192 samples
Epoch 1/10
576/576 [==============================] - 1s 2ms/step - loss: 3.3748 - acc: 0.6319 - val_loss: 2.4445 - val_acc: 0.6354
Epoch 2/10
576/576 [==============================] - 0s 95us/step - loss: 2.5209 - acc: 0.6285 - val_loss: 1.5796 - val_acc: 0.6510
Epoch 3/10
576/576 [==============================] - 0s 95us/step - loss: 1.3467 - acc: 0.6406 - val_loss: 0.9023 - val_acc: 0.6927
Epoch 4/10
576/576 [==============================] - 0s 99us/step - loss: 1.0170 - acc: 0.6632 - val_loss: 0.8878 - val_acc: 0.7031
Epoch 5/10
576/576 [==============================] - 0s 92us/step - loss: 0.9036 - acc: 0.6562 - val_loss: 0.8723 - val_acc: 0.7188
Epoch 6/10
576/576 [==============================] - 0s 94us/step - loss: 0.8856 - acc: 0.6615 - val_loss: 0.8686 - val_acc: 0.7135
Epoch 7/10
576/576 [==============================] - 0s 88us/step - loss: 0.8756 - acc: 0.6771 - val_loss: 0.7983 - val_acc: 0.7240
Epoch 8/10
576/576 [==============================] - 0s 99us/step - loss: 0.8673 - acc: 0.6753 - val_loss: 0.7905 - val_acc: 0.7240
Epoch 9/10
576/576 [==============================] - 0s 106us/step - loss: 0.8308 - acc: 0.6823 - val_loss: 0.6445 - val_acc: 0.7292
Epoch 10/10
576/576 [==============================] - 0s 128us/step - loss: 0.6995 - acc: 0.6910 - val_loss: 0.6387 - val_acc: 0.7240
In [31]:
def plot_experiment(model):
    '''this function plots the trajectory of accuracy and loss'''
    
    
    
    plt.figure()
    #plot the accuracy from the history object since it comes in a form of a dict we can access  the values via their keys

    plt.plot(model[0].history['acc'], 'g',  label='train accuracy')
    plt.plot(model[0].history['val_acc'],'y', label='validation accuracy')
    plt.title('Accuracy Train and Test')
    plt.legend()


    
    
    fig,ax = plt.subplots()
    #plot the Loss from the history object since it comes in a form of a dict we can access  the values via their keys

    ax.plot(model[0].history["loss"],'r', label="Train Loss")
    ax.plot(model[0].history["val_loss"],'b', label="Validation Loss")
    ax.legend()
    plt.title('Loss Train and Test')
    
   
In [64]:
plot_experiment(model)
In [65]:
print('accuracy is {:.3f}'.format(accuracy_score(y_test,model[1])))
print('roc-auc is {:.3f}'.format(roc_auc_score(y_test,model[2])))

plot_roc(y_test, model[2], 'NN')
accuracy is 0.724
roc-auc is 0.735
In [66]:
recify linear unit for the hidden layer and 
  File "<ipython-input-66-f70849914d2e>", line 1
    recify linear unit for the hidden layer and
                ^
SyntaxError: invalid syntax
In [67]:
model = experiment(32, 10, .003, 'relu')
plot_experiment(model)
print('accuracy is {:.3f}'.format(accuracy_score(y_test,model[1])))
print('roc-auc is {:.3f}'.format(roc_auc_score(y_test,model[2])))

plot_roc(y_test, model[2], 'NN')
Train on 576 samples, validate on 192 samples
Epoch 1/10
576/576 [==============================] - 1s 2ms/step - loss: 1.8006 - acc: 0.6562 - val_loss: 1.3142 - val_acc: 0.5833
Epoch 2/10
576/576 [==============================] - 0s 95us/step - loss: 1.1452 - acc: 0.6632 - val_loss: 1.0992 - val_acc: 0.6042
Epoch 3/10
576/576 [==============================] - 0s 97us/step - loss: 0.9875 - acc: 0.6615 - val_loss: 0.7602 - val_acc: 0.6615
Epoch 4/10
576/576 [==============================] - 0s 113us/step - loss: 0.6845 - acc: 0.6944 - val_loss: 0.7017 - val_acc: 0.6510
Epoch 5/10
576/576 [==============================] - 0s 104us/step - loss: 0.6360 - acc: 0.7049 - val_loss: 0.6821 - val_acc: 0.6562
Epoch 6/10
576/576 [==============================] - 0s 94us/step - loss: 0.5966 - acc: 0.7049 - val_loss: 0.6637 - val_acc: 0.6562
Epoch 7/10
576/576 [==============================] - 0s 108us/step - loss: 0.5819 - acc: 0.7083 - val_loss: 0.6505 - val_acc: 0.6562
Epoch 8/10
576/576 [==============================] - 0s 108us/step - loss: 0.5705 - acc: 0.7135 - val_loss: 0.6397 - val_acc: 0.6562
Epoch 9/10
576/576 [==============================] - 0s 125us/step - loss: 0.5614 - acc: 0.7118 - val_loss: 0.6300 - val_acc: 0.6615
Epoch 10/10
576/576 [==============================] - 0s 128us/step - loss: 0.5497 - acc: 0.7135 - val_loss: 0.6534 - val_acc: 0.6927
accuracy is 0.693
roc-auc is 0.735
In [68]:
model = experiment(32, 10, .003, 'sigmoid')
plot_experiment(model)
print('accuracy is {:.3f}'.format(accuracy_score(y_test,model[1])))
print('roc-auc is {:.3f}'.format(roc_auc_score(y_test,model[2])))

plot_roc(y_test, model[2], 'NN')
Train on 576 samples, validate on 192 samples
Epoch 1/10
576/576 [==============================] - 1s 2ms/step - loss: 0.6594 - acc: 0.6059 - val_loss: 0.6586 - val_acc: 0.6042
Epoch 2/10
576/576 [==============================] - 0s 116us/step - loss: 0.6500 - acc: 0.6198 - val_loss: 0.6512 - val_acc: 0.6198
Epoch 3/10
576/576 [==============================] - 0s 139us/step - loss: 0.6416 - acc: 0.6250 - val_loss: 0.6447 - val_acc: 0.6250
Epoch 4/10
576/576 [==============================] - 0s 109us/step - loss: 0.6339 - acc: 0.6424 - val_loss: 0.6387 - val_acc: 0.6250
Epoch 5/10
576/576 [==============================] - 0s 127us/step - loss: 0.6270 - acc: 0.6597 - val_loss: 0.6332 - val_acc: 0.6667
Epoch 6/10
576/576 [==============================] - 0s 113us/step - loss: 0.6207 - acc: 0.6597 - val_loss: 0.6282 - val_acc: 0.6667
Epoch 7/10
576/576 [==============================] - 0s 135us/step - loss: 0.6148 - acc: 0.6667 - val_loss: 0.6236 - val_acc: 0.6719
Epoch 8/10
576/576 [==============================] - 0s 134us/step - loss: 0.6094 - acc: 0.6771 - val_loss: 0.6193 - val_acc: 0.6771
Epoch 9/10
576/576 [==============================] - 0s 142us/step - loss: 0.6043 - acc: 0.6771 - val_loss: 0.6153 - val_acc: 0.6771
Epoch 10/10
576/576 [==============================] - 0s 108us/step - loss: 0.5996 - acc: 0.6875 - val_loss: 0.6115 - val_acc: 0.6771
accuracy is 0.677
roc-auc is 0.710

this is not too bad

In [70]:
model = experiment(32, 10, .003, 'sigmoid')
plot_experiment(model)
print('accuracy is {:.3f}'.format(accuracy_score(y_test,model[1])))
print('roc-auc is {:.3f}'.format(roc_auc_score(y_test,model[2])))

plot_roc(y_test, model[2], 'NN')
Train on 576 samples, validate on 192 samples
Epoch 1/10
576/576 [==============================] - 2s 3ms/step - loss: 0.6984 - acc: 0.5000 - val_loss: 0.6835 - val_acc: 0.5156
Epoch 2/10
576/576 [==============================] - 0s 97us/step - loss: 0.6831 - acc: 0.5503 - val_loss: 0.6702 - val_acc: 0.5521
Epoch 3/10
576/576 [==============================] - 0s 104us/step - loss: 0.6698 - acc: 0.5903 - val_loss: 0.6585 - val_acc: 0.5990
Epoch 4/10
576/576 [==============================] - 0s 109us/step - loss: 0.6579 - acc: 0.6250 - val_loss: 0.6481 - val_acc: 0.6042
Epoch 5/10
576/576 [==============================] - 0s 134us/step - loss: 0.6473 - acc: 0.6441 - val_loss: 0.6387 - val_acc: 0.6250
Epoch 6/10
576/576 [==============================] - 0s 128us/step - loss: 0.6379 - acc: 0.6771 - val_loss: 0.6304 - val_acc: 0.6771
Epoch 7/10
576/576 [==============================] - 0s 108us/step - loss: 0.6294 - acc: 0.6927 - val_loss: 0.6229 - val_acc: 0.7083
Epoch 8/10
576/576 [==============================] - 0s 115us/step - loss: 0.6217 - acc: 0.7031 - val_loss: 0.6162 - val_acc: 0.7083
Epoch 9/10
576/576 [==============================] - 0s 111us/step - loss: 0.6148 - acc: 0.7049 - val_loss: 0.6101 - val_acc: 0.7031
Epoch 10/10
576/576 [==============================] - 0s 102us/step - loss: 0.6086 - acc: 0.7118 - val_loss: 0.6046 - val_acc: 0.7240
accuracy is 0.724
roc-auc is 0.776

getting better

In [71]:
model = experiment(32, 150, .003, 'sigmoid')
plot_experiment(model)
print('accuracy is {:.3f}'.format(accuracy_score(y_test,model[1])))
print('roc-auc is {:.3f}'.format(roc_auc_score(y_test,model[2])))

plot_roc(y_test, model[2], 'NN')
Train on 576 samples, validate on 192 samples
Epoch 1/150
576/576 [==============================] - 1s 3ms/step - loss: 0.6562 - acc: 0.6545 - val_loss: 0.6755 - val_acc: 0.6406
Epoch 2/150
576/576 [==============================] - 0s 121us/step - loss: 0.6497 - acc: 0.6545 - val_loss: 0.6688 - val_acc: 0.6406
Epoch 3/150
576/576 [==============================] - 0s 99us/step - loss: 0.6437 - acc: 0.6545 - val_loss: 0.6625 - val_acc: 0.6406
Epoch 4/150
576/576 [==============================] - 0s 106us/step - loss: 0.6380 - acc: 0.6545 - val_loss: 0.6565 - val_acc: 0.6406
Epoch 5/150
576/576 [==============================] - 0s 111us/step - loss: 0.6326 - acc: 0.6545 - val_loss: 0.6510 - val_acc: 0.6406
Epoch 6/150
576/576 [==============================] - 0s 127us/step - loss: 0.6275 - acc: 0.6545 - val_loss: 0.6457 - val_acc: 0.6406
Epoch 7/150
576/576 [==============================] - 0s 106us/step - loss: 0.6226 - acc: 0.6545 - val_loss: 0.6406 - val_acc: 0.6406
Epoch 8/150
576/576 [==============================] - 0s 118us/step - loss: 0.6178 - acc: 0.6545 - val_loss: 0.6358 - val_acc: 0.6406
Epoch 9/150
576/576 [==============================] - 0s 108us/step - loss: 0.6133 - acc: 0.6545 - val_loss: 0.6312 - val_acc: 0.6406
Epoch 10/150
576/576 [==============================] - 0s 101us/step - loss: 0.6090 - acc: 0.6545 - val_loss: 0.6268 - val_acc: 0.6406
Epoch 11/150
576/576 [==============================] - 0s 99us/step - loss: 0.6048 - acc: 0.6545 - val_loss: 0.6225 - val_acc: 0.6406
Epoch 12/150
576/576 [==============================] - 0s 121us/step - loss: 0.6008 - acc: 0.6545 - val_loss: 0.6185 - val_acc: 0.6458
Epoch 13/150
576/576 [==============================] - 0s 108us/step - loss: 0.5971 - acc: 0.6562 - val_loss: 0.6147 - val_acc: 0.6458
Epoch 14/150
576/576 [==============================] - 0s 97us/step - loss: 0.5933 - acc: 0.6580 - val_loss: 0.6110 - val_acc: 0.6458
Epoch 15/150
576/576 [==============================] - 0s 97us/step - loss: 0.5898 - acc: 0.6597 - val_loss: 0.6075 - val_acc: 0.6458
Epoch 16/150
576/576 [==============================] - 0s 163us/step - loss: 0.5863 - acc: 0.6597 - val_loss: 0.6041 - val_acc: 0.6510
Epoch 17/150
576/576 [==============================] - 0s 95us/step - loss: 0.5830 - acc: 0.6632 - val_loss: 0.6009 - val_acc: 0.6510
Epoch 18/150
576/576 [==============================] - 0s 141us/step - loss: 0.5796 - acc: 0.6667 - val_loss: 0.5977 - val_acc: 0.6667
Epoch 19/150
576/576 [==============================] - 0s 132us/step - loss: 0.5764 - acc: 0.6615 - val_loss: 0.5946 - val_acc: 0.6667
Epoch 20/150
576/576 [==============================] - 0s 99us/step - loss: 0.5733 - acc: 0.6615 - val_loss: 0.5917 - val_acc: 0.6667
Epoch 21/150
576/576 [==============================] - 0s 102us/step - loss: 0.5703 - acc: 0.6649 - val_loss: 0.5888 - val_acc: 0.6667
Epoch 22/150
576/576 [==============================] - 0s 115us/step - loss: 0.5673 - acc: 0.6684 - val_loss: 0.5859 - val_acc: 0.6719
Epoch 23/150
576/576 [==============================] - 0s 104us/step - loss: 0.5644 - acc: 0.6736 - val_loss: 0.5832 - val_acc: 0.6823
Epoch 24/150
576/576 [==============================] - 0s 104us/step - loss: 0.5616 - acc: 0.6788 - val_loss: 0.5805 - val_acc: 0.6875
Epoch 25/150
576/576 [==============================] - 0s 111us/step - loss: 0.5588 - acc: 0.6806 - val_loss: 0.5779 - val_acc: 0.6875
Epoch 26/150
576/576 [==============================] - 0s 95us/step - loss: 0.5561 - acc: 0.6858 - val_loss: 0.5753 - val_acc: 0.6979
Epoch 27/150
576/576 [==============================] - 0s 106us/step - loss: 0.5536 - acc: 0.6910 - val_loss: 0.5729 - val_acc: 0.7135
Epoch 28/150
576/576 [==============================] - 0s 90us/step - loss: 0.5510 - acc: 0.6997 - val_loss: 0.5705 - val_acc: 0.7135
Epoch 29/150
576/576 [==============================] - 0s 118us/step - loss: 0.5485 - acc: 0.7031 - val_loss: 0.5682 - val_acc: 0.7188
Epoch 30/150
576/576 [==============================] - 0s 94us/step - loss: 0.5460 - acc: 0.7066 - val_loss: 0.5659 - val_acc: 0.7292
Epoch 31/150
576/576 [==============================] - 0s 104us/step - loss: 0.5437 - acc: 0.7031 - val_loss: 0.5637 - val_acc: 0.7240
Epoch 32/150
576/576 [==============================] - 0s 108us/step - loss: 0.5414 - acc: 0.7066 - val_loss: 0.5616 - val_acc: 0.7240
Epoch 33/150
576/576 [==============================] - 0s 102us/step - loss: 0.5391 - acc: 0.7066 - val_loss: 0.5596 - val_acc: 0.7188
Epoch 34/150
576/576 [==============================] - 0s 95us/step - loss: 0.5369 - acc: 0.7118 - val_loss: 0.5576 - val_acc: 0.7188
Epoch 35/150
576/576 [==============================] - 0s 128us/step - loss: 0.5348 - acc: 0.7101 - val_loss: 0.5557 - val_acc: 0.7188
Epoch 36/150
576/576 [==============================] - 0s 94us/step - loss: 0.5326 - acc: 0.7205 - val_loss: 0.5538 - val_acc: 0.7344
Epoch 37/150
576/576 [==============================] - 0s 99us/step - loss: 0.5306 - acc: 0.7309 - val_loss: 0.5519 - val_acc: 0.7240
Epoch 38/150
576/576 [==============================] - 0s 94us/step - loss: 0.5286 - acc: 0.7292 - val_loss: 0.5502 - val_acc: 0.7240
Epoch 39/150
576/576 [==============================] - 0s 139us/step - loss: 0.5266 - acc: 0.7292 - val_loss: 0.5484 - val_acc: 0.7240
Epoch 40/150
576/576 [==============================] - 0s 111us/step - loss: 0.5247 - acc: 0.7344 - val_loss: 0.5467 - val_acc: 0.7292
Epoch 41/150
576/576 [==============================] - 0s 104us/step - loss: 0.5228 - acc: 0.7326 - val_loss: 0.5451 - val_acc: 0.7292
Epoch 42/150
576/576 [==============================] - 0s 116us/step - loss: 0.5209 - acc: 0.7344 - val_loss: 0.5435 - val_acc: 0.7344
Epoch 43/150
576/576 [==============================] - 0s 142us/step - loss: 0.5192 - acc: 0.7344 - val_loss: 0.5419 - val_acc: 0.7344
Epoch 44/150
576/576 [==============================] - 0s 139us/step - loss: 0.5174 - acc: 0.7326 - val_loss: 0.5404 - val_acc: 0.7292
Epoch 45/150
576/576 [==============================] - 0s 135us/step - loss: 0.5157 - acc: 0.7378 - val_loss: 0.5389 - val_acc: 0.7292
Epoch 46/150
576/576 [==============================] - 0s 116us/step - loss: 0.5140 - acc: 0.7413 - val_loss: 0.5375 - val_acc: 0.7240
Epoch 47/150
576/576 [==============================] - 0s 109us/step - loss: 0.5123 - acc: 0.7378 - val_loss: 0.5361 - val_acc: 0.7292
Epoch 48/150
576/576 [==============================] - 0s 153us/step - loss: 0.5107 - acc: 0.7413 - val_loss: 0.5347 - val_acc: 0.7292
Epoch 49/150
576/576 [==============================] - 0s 130us/step - loss: 0.5091 - acc: 0.7448 - val_loss: 0.5334 - val_acc: 0.7292
Epoch 50/150
576/576 [==============================] - 0s 128us/step - loss: 0.5076 - acc: 0.7431 - val_loss: 0.5321 - val_acc: 0.7344
Epoch 51/150
576/576 [==============================] - 0s 151us/step - loss: 0.5061 - acc: 0.7431 - val_loss: 0.5309 - val_acc: 0.7396
Epoch 52/150
576/576 [==============================] - 0s 141us/step - loss: 0.5046 - acc: 0.7448 - val_loss: 0.5297 - val_acc: 0.7396
Epoch 53/150
576/576 [==============================] - 0s 198us/step - loss: 0.5031 - acc: 0.7500 - val_loss: 0.5286 - val_acc: 0.7344
Epoch 54/150
576/576 [==============================] - 0s 135us/step - loss: 0.5018 - acc: 0.7500 - val_loss: 0.5274 - val_acc: 0.7344
Epoch 55/150
576/576 [==============================] - 0s 109us/step - loss: 0.5004 - acc: 0.7500 - val_loss: 0.5264 - val_acc: 0.7344
Epoch 56/150
576/576 [==============================] - 0s 104us/step - loss: 0.4990 - acc: 0.7500 - val_loss: 0.5253 - val_acc: 0.7344
Epoch 57/150
576/576 [==============================] - 0s 95us/step - loss: 0.4977 - acc: 0.7517 - val_loss: 0.5243 - val_acc: 0.7396
Epoch 58/150
576/576 [==============================] - 0s 113us/step - loss: 0.4965 - acc: 0.7552 - val_loss: 0.5233 - val_acc: 0.7396
Epoch 59/150
576/576 [==============================] - 0s 135us/step - loss: 0.4952 - acc: 0.7552 - val_loss: 0.5224 - val_acc: 0.7396
Epoch 60/150
576/576 [==============================] - 0s 109us/step - loss: 0.4940 - acc: 0.7552 - val_loss: 0.5215 - val_acc: 0.7396
Epoch 61/150
576/576 [==============================] - 0s 134us/step - loss: 0.4929 - acc: 0.7552 - val_loss: 0.5206 - val_acc: 0.7396
Epoch 62/150
576/576 [==============================] - 0s 111us/step - loss: 0.4917 - acc: 0.7569 - val_loss: 0.5197 - val_acc: 0.7448
Epoch 63/150
576/576 [==============================] - 0s 130us/step - loss: 0.4906 - acc: 0.7587 - val_loss: 0.5188 - val_acc: 0.7448
Epoch 64/150
576/576 [==============================] - 0s 180us/step - loss: 0.4895 - acc: 0.7552 - val_loss: 0.5180 - val_acc: 0.7448
Epoch 65/150
576/576 [==============================] - 0s 168us/step - loss: 0.4884 - acc: 0.7552 - val_loss: 0.5173 - val_acc: 0.7448
Epoch 66/150
576/576 [==============================] - 0s 156us/step - loss: 0.4873 - acc: 0.7569 - val_loss: 0.5165 - val_acc: 0.7500
Epoch 67/150
576/576 [==============================] - 0s 147us/step - loss: 0.4863 - acc: 0.7604 - val_loss: 0.5158 - val_acc: 0.7552
Epoch 68/150
576/576 [==============================] - 0s 127us/step - loss: 0.4853 - acc: 0.7604 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 69/150
576/576 [==============================] - 0s 135us/step - loss: 0.4843 - acc: 0.7639 - val_loss: 0.5144 - val_acc: 0.7552
Epoch 70/150
576/576 [==============================] - 0s 101us/step - loss: 0.4834 - acc: 0.7622 - val_loss: 0.5137 - val_acc: 0.7500
Epoch 71/150
576/576 [==============================] - 0s 99us/step - loss: 0.4825 - acc: 0.7656 - val_loss: 0.5131 - val_acc: 0.7448
Epoch 72/150
576/576 [==============================] - 0s 108us/step - loss: 0.4816 - acc: 0.7639 - val_loss: 0.5125 - val_acc: 0.7448
Epoch 73/150
576/576 [==============================] - 0s 151us/step - loss: 0.4806 - acc: 0.7674 - val_loss: 0.5119 - val_acc: 0.7448
Epoch 74/150
576/576 [==============================] - 0s 127us/step - loss: 0.4798 - acc: 0.7656 - val_loss: 0.5113 - val_acc: 0.7448
Epoch 75/150
576/576 [==============================] - 0s 108us/step - loss: 0.4789 - acc: 0.7656 - val_loss: 0.5108 - val_acc: 0.7448
Epoch 76/150
576/576 [==============================] - 0s 141us/step - loss: 0.4780 - acc: 0.7674 - val_loss: 0.5102 - val_acc: 0.7448
Epoch 77/150
576/576 [==============================] - 0s 128us/step - loss: 0.4772 - acc: 0.7691 - val_loss: 0.5097 - val_acc: 0.7448
Epoch 78/150
576/576 [==============================] - 0s 160us/step - loss: 0.4764 - acc: 0.7708 - val_loss: 0.5092 - val_acc: 0.7500
Epoch 79/150
576/576 [==============================] - 0s 142us/step - loss: 0.4756 - acc: 0.7726 - val_loss: 0.5087 - val_acc: 0.7552
Epoch 80/150
576/576 [==============================] - 0s 108us/step - loss: 0.4749 - acc: 0.7726 - val_loss: 0.5083 - val_acc: 0.7552
Epoch 81/150
576/576 [==============================] - 0s 127us/step - loss: 0.4741 - acc: 0.7726 - val_loss: 0.5078 - val_acc: 0.7604
Epoch 82/150
576/576 [==============================] - 0s 120us/step - loss: 0.4733 - acc: 0.7760 - val_loss: 0.5074 - val_acc: 0.7604
Epoch 83/150
576/576 [==============================] - 0s 111us/step - loss: 0.4726 - acc: 0.7812 - val_loss: 0.5069 - val_acc: 0.7604
Epoch 84/150
576/576 [==============================] - 0s 142us/step - loss: 0.4719 - acc: 0.7795 - val_loss: 0.5065 - val_acc: 0.7604
Epoch 85/150
576/576 [==============================] - 0s 142us/step - loss: 0.4712 - acc: 0.7795 - val_loss: 0.5061 - val_acc: 0.7604
Epoch 86/150
576/576 [==============================] - 0s 135us/step - loss: 0.4705 - acc: 0.7812 - val_loss: 0.5058 - val_acc: 0.7604
Epoch 87/150
576/576 [==============================] - 0s 144us/step - loss: 0.4698 - acc: 0.7847 - val_loss: 0.5054 - val_acc: 0.7604
Epoch 88/150
576/576 [==============================] - 0s 109us/step - loss: 0.4692 - acc: 0.7865 - val_loss: 0.5050 - val_acc: 0.7604
Epoch 89/150
576/576 [==============================] - 0s 125us/step - loss: 0.4685 - acc: 0.7865 - val_loss: 0.5047 - val_acc: 0.7604
Epoch 90/150
576/576 [==============================] - 0s 149us/step - loss: 0.4679 - acc: 0.7865 - val_loss: 0.5044 - val_acc: 0.7604
Epoch 91/150
576/576 [==============================] - 0s 132us/step - loss: 0.4673 - acc: 0.7865 - val_loss: 0.5040 - val_acc: 0.7604
Epoch 92/150
576/576 [==============================] - 0s 146us/step - loss: 0.4666 - acc: 0.7865 - val_loss: 0.5037 - val_acc: 0.7604
Epoch 93/150
576/576 [==============================] - 0s 115us/step - loss: 0.4661 - acc: 0.7865 - val_loss: 0.5034 - val_acc: 0.7604
Epoch 94/150
576/576 [==============================] - 0s 116us/step - loss: 0.4655 - acc: 0.7865 - val_loss: 0.5032 - val_acc: 0.7604
Epoch 95/150
576/576 [==============================] - 0s 111us/step - loss: 0.4649 - acc: 0.7865 - val_loss: 0.5029 - val_acc: 0.7604
Epoch 96/150
576/576 [==============================] - 0s 116us/step - loss: 0.4643 - acc: 0.7847 - val_loss: 0.5026 - val_acc: 0.7604
Epoch 97/150
576/576 [==============================] - 0s 127us/step - loss: 0.4637 - acc: 0.7830 - val_loss: 0.5024 - val_acc: 0.7604
Epoch 98/150
576/576 [==============================] - 0s 165us/step - loss: 0.4632 - acc: 0.7830 - val_loss: 0.5021 - val_acc: 0.7604
Epoch 99/150
576/576 [==============================] - 0s 149us/step - loss: 0.4627 - acc: 0.7847 - val_loss: 0.5019 - val_acc: 0.7604
Epoch 100/150
576/576 [==============================] - 0s 108us/step - loss: 0.4621 - acc: 0.7830 - val_loss: 0.5017 - val_acc: 0.7604
Epoch 101/150
576/576 [==============================] - 0s 132us/step - loss: 0.4616 - acc: 0.7830 - val_loss: 0.5014 - val_acc: 0.7604
Epoch 102/150
576/576 [==============================] - 0s 102us/step - loss: 0.4611 - acc: 0.7812 - val_loss: 0.5012 - val_acc: 0.7604
Epoch 103/150
576/576 [==============================] - 0s 118us/step - loss: 0.4607 - acc: 0.7830 - val_loss: 0.5010 - val_acc: 0.7604
Epoch 104/150
576/576 [==============================] - 0s 106us/step - loss: 0.4602 - acc: 0.7830 - val_loss: 0.5009 - val_acc: 0.7604
Epoch 105/150
576/576 [==============================] - 0s 101us/step - loss: 0.4597 - acc: 0.7830 - val_loss: 0.5007 - val_acc: 0.7604
Epoch 106/150
576/576 [==============================] - 0s 135us/step - loss: 0.4593 - acc: 0.7812 - val_loss: 0.5005 - val_acc: 0.7604
Epoch 107/150
576/576 [==============================] - 0s 118us/step - loss: 0.4588 - acc: 0.7778 - val_loss: 0.5003 - val_acc: 0.7604
Epoch 108/150
576/576 [==============================] - 0s 115us/step - loss: 0.4583 - acc: 0.7795 - val_loss: 0.5002 - val_acc: 0.7604
Epoch 109/150
576/576 [==============================] - 0s 125us/step - loss: 0.4579 - acc: 0.7778 - val_loss: 0.5000 - val_acc: 0.7552
Epoch 110/150
576/576 [==============================] - 0s 132us/step - loss: 0.4575 - acc: 0.7778 - val_loss: 0.4999 - val_acc: 0.7552
Epoch 111/150
576/576 [==============================] - 0s 118us/step - loss: 0.4571 - acc: 0.7760 - val_loss: 0.4997 - val_acc: 0.7552
Epoch 112/150
576/576 [==============================] - 0s 132us/step - loss: 0.4566 - acc: 0.7760 - val_loss: 0.4996 - val_acc: 0.7552
Epoch 113/150
576/576 [==============================] - 0s 118us/step - loss: 0.4562 - acc: 0.7760 - val_loss: 0.4995 - val_acc: 0.7552
Epoch 114/150
576/576 [==============================] - 0s 123us/step - loss: 0.4559 - acc: 0.7743 - val_loss: 0.4993 - val_acc: 0.7552
Epoch 115/150
576/576 [==============================] - 0s 170us/step - loss: 0.4555 - acc: 0.7760 - val_loss: 0.4992 - val_acc: 0.7552
Epoch 116/150
576/576 [==============================] - 0s 104us/step - loss: 0.4551 - acc: 0.7760 - val_loss: 0.4991 - val_acc: 0.7552
Epoch 117/150
576/576 [==============================] - 0s 102us/step - loss: 0.4547 - acc: 0.7743 - val_loss: 0.4990 - val_acc: 0.7552
Epoch 118/150
576/576 [==============================] - 0s 132us/step - loss: 0.4543 - acc: 0.7743 - val_loss: 0.4989 - val_acc: 0.7552
Epoch 119/150
576/576 [==============================] - 0s 111us/step - loss: 0.4540 - acc: 0.7743 - val_loss: 0.4988 - val_acc: 0.7552
Epoch 120/150
576/576 [==============================] - 0s 111us/step - loss: 0.4536 - acc: 0.7743 - val_loss: 0.4987 - val_acc: 0.7500
Epoch 121/150
576/576 [==============================] - 0s 106us/step - loss: 0.4533 - acc: 0.7743 - val_loss: 0.4986 - val_acc: 0.7500
Epoch 122/150
576/576 [==============================] - 0s 149us/step - loss: 0.4529 - acc: 0.7743 - val_loss: 0.4985 - val_acc: 0.7500
Epoch 123/150
576/576 [==============================] - 0s 118us/step - loss: 0.4526 - acc: 0.7743 - val_loss: 0.4985 - val_acc: 0.7500
Epoch 124/150
576/576 [==============================] - 0s 108us/step - loss: 0.4522 - acc: 0.7743 - val_loss: 0.4984 - val_acc: 0.7500
Epoch 125/150
576/576 [==============================] - 0s 158us/step - loss: 0.4518 - acc: 0.7743 - val_loss: 0.4984 - val_acc: 0.7552
Epoch 126/150
576/576 [==============================] - 0s 108us/step - loss: 0.4515 - acc: 0.7743 - val_loss: 0.4983 - val_acc: 0.7552
Epoch 127/150
576/576 [==============================] - 0s 127us/step - loss: 0.4512 - acc: 0.7743 - val_loss: 0.4983 - val_acc: 0.7552
Epoch 128/150
576/576 [==============================] - 0s 141us/step - loss: 0.4509 - acc: 0.7760 - val_loss: 0.4982 - val_acc: 0.7552
Epoch 129/150
576/576 [==============================] - 0s 128us/step - loss: 0.4506 - acc: 0.7743 - val_loss: 0.4982 - val_acc: 0.7552
Epoch 130/150
576/576 [==============================] - 0s 149us/step - loss: 0.4503 - acc: 0.7760 - val_loss: 0.4981 - val_acc: 0.7552
Epoch 131/150
576/576 [==============================] - 0s 135us/step - loss: 0.4500 - acc: 0.7760 - val_loss: 0.4981 - val_acc: 0.7500
Epoch 132/150
576/576 [==============================] - 0s 120us/step - loss: 0.4497 - acc: 0.7760 - val_loss: 0.4980 - val_acc: 0.7500
Epoch 133/150
576/576 [==============================] - 0s 130us/step - loss: 0.4494 - acc: 0.7760 - val_loss: 0.4980 - val_acc: 0.7500
Epoch 134/150
576/576 [==============================] - 0s 141us/step - loss: 0.4491 - acc: 0.7778 - val_loss: 0.4980 - val_acc: 0.7500
Epoch 135/150
576/576 [==============================] - ETA: 0s - loss: 0.4344 - acc: 0.787 - 0s 137us/step - loss: 0.4489 - acc: 0.7778 - val_loss: 0.4980 - val_acc: 0.7552
Epoch 136/150
576/576 [==============================] - 0s 149us/step - loss: 0.4486 - acc: 0.7778 - val_loss: 0.4980 - val_acc: 0.7552
Epoch 137/150
576/576 [==============================] - 0s 151us/step - loss: 0.4483 - acc: 0.7778 - val_loss: 0.4980 - val_acc: 0.7552
Epoch 138/150
576/576 [==============================] - 0s 142us/step - loss: 0.4480 - acc: 0.7760 - val_loss: 0.4980 - val_acc: 0.7552
Epoch 139/150
576/576 [==============================] - 0s 141us/step - loss: 0.4477 - acc: 0.7778 - val_loss: 0.4980 - val_acc: 0.7604
Epoch 140/150
576/576 [==============================] - 0s 135us/step - loss: 0.4475 - acc: 0.7760 - val_loss: 0.4980 - val_acc: 0.7604
Epoch 141/150
576/576 [==============================] - 0s 116us/step - loss: 0.4472 - acc: 0.7760 - val_loss: 0.4980 - val_acc: 0.7604
Epoch 142/150
576/576 [==============================] - 0s 115us/step - loss: 0.4469 - acc: 0.7743 - val_loss: 0.4980 - val_acc: 0.7604
Epoch 143/150
576/576 [==============================] - 0s 113us/step - loss: 0.4467 - acc: 0.7760 - val_loss: 0.4980 - val_acc: 0.7604
Epoch 144/150
576/576 [==============================] - 0s 137us/step - loss: 0.4464 - acc: 0.7778 - val_loss: 0.4980 - val_acc: 0.7552
Epoch 145/150
576/576 [==============================] - 0s 127us/step - loss: 0.4462 - acc: 0.7760 - val_loss: 0.4980 - val_acc: 0.7552
Epoch 146/150
576/576 [==============================] - 0s 153us/step - loss: 0.4459 - acc: 0.7778 - val_loss: 0.4980 - val_acc: 0.7552
Epoch 147/150
576/576 [==============================] - 0s 144us/step - loss: 0.4457 - acc: 0.7812 - val_loss: 0.4980 - val_acc: 0.7552
Epoch 148/150
576/576 [==============================] - 0s 116us/step - loss: 0.4454 - acc: 0.7812 - val_loss: 0.4980 - val_acc: 0.7552
Epoch 149/150
576/576 [==============================] - 0s 149us/step - loss: 0.4452 - acc: 0.7812 - val_loss: 0.4980 - val_acc: 0.7552
Epoch 150/150
576/576 [==============================] - 0s 130us/step - loss: 0.4450 - acc: 0.7812 - val_loss: 0.4980 - val_acc: 0.7552
accuracy is 0.755
roc-auc is 0.825
In [72]:
model = experiment(32, 1500, .003, 'sigmoid')
plot_experiment(model)
print('accuracy is {:.3f}'.format(accuracy_score(y_test,model[1])))
print('roc-auc is {:.3f}'.format(roc_auc_score(y_test,model[2])))

plot_roc(y_test, model[2], 'NN')
Train on 576 samples, validate on 192 samples
Epoch 1/1500
576/576 [==============================] - 2s 3ms/step - loss: 0.7236 - acc: 0.3958 - val_loss: 0.7126 - val_acc: 0.4271
Epoch 2/1500
576/576 [==============================] - 0s 104us/step - loss: 0.7172 - acc: 0.4253 - val_loss: 0.7073 - val_acc: 0.4427
Epoch 3/1500
576/576 [==============================] - 0s 109us/step - loss: 0.7113 - acc: 0.4497 - val_loss: 0.7025 - val_acc: 0.4740
Epoch 4/1500
576/576 [==============================] - 0s 130us/step - loss: 0.7059 - acc: 0.4688 - val_loss: 0.6980 - val_acc: 0.4844
Epoch 5/1500
576/576 [==============================] - 0s 120us/step - loss: 0.7009 - acc: 0.5017 - val_loss: 0.6939 - val_acc: 0.5208
Epoch 6/1500
576/576 [==============================] - 0s 134us/step - loss: 0.6962 - acc: 0.5382 - val_loss: 0.6900 - val_acc: 0.5469
Epoch 7/1500
576/576 [==============================] - 0s 121us/step - loss: 0.6919 - acc: 0.5590 - val_loss: 0.6864 - val_acc: 0.5521
Epoch 8/1500
576/576 [==============================] - 0s 127us/step - loss: 0.6878 - acc: 0.5833 - val_loss: 0.6831 - val_acc: 0.5885
Epoch 9/1500
576/576 [==============================] - 0s 115us/step - loss: 0.6840 - acc: 0.6059 - val_loss: 0.6799 - val_acc: 0.5885
Epoch 10/1500
576/576 [==============================] - 0s 106us/step - loss: 0.6804 - acc: 0.6163 - val_loss: 0.6769 - val_acc: 0.5781
Epoch 11/1500
576/576 [==============================] - 0s 123us/step - loss: 0.6770 - acc: 0.6233 - val_loss: 0.6741 - val_acc: 0.6042
Epoch 12/1500
576/576 [==============================] - 0s 109us/step - loss: 0.6738 - acc: 0.6302 - val_loss: 0.6714 - val_acc: 0.6302
Epoch 13/1500
576/576 [==============================] - 0s 132us/step - loss: 0.6707 - acc: 0.6424 - val_loss: 0.6688 - val_acc: 0.6562
Epoch 14/1500
576/576 [==============================] - 0s 104us/step - loss: 0.6678 - acc: 0.6493 - val_loss: 0.6664 - val_acc: 0.6562
Epoch 15/1500
576/576 [==============================] - 0s 146us/step - loss: 0.6650 - acc: 0.6597 - val_loss: 0.6640 - val_acc: 0.6562
Epoch 16/1500
576/576 [==============================] - 0s 109us/step - loss: 0.6624 - acc: 0.6649 - val_loss: 0.6618 - val_acc: 0.6562
Epoch 17/1500
576/576 [==============================] - 0s 127us/step - loss: 0.6598 - acc: 0.6632 - val_loss: 0.6596 - val_acc: 0.6510
Epoch 18/1500
576/576 [==============================] - 0s 115us/step - loss: 0.6573 - acc: 0.6580 - val_loss: 0.6575 - val_acc: 0.6510
Epoch 19/1500
576/576 [==============================] - 0s 108us/step - loss: 0.6549 - acc: 0.6597 - val_loss: 0.6555 - val_acc: 0.6562
Epoch 20/1500
576/576 [==============================] - 0s 134us/step - loss: 0.6526 - acc: 0.6580 - val_loss: 0.6535 - val_acc: 0.6510
Epoch 21/1500
576/576 [==============================] - 0s 121us/step - loss: 0.6503 - acc: 0.6580 - val_loss: 0.6516 - val_acc: 0.6562
Epoch 22/1500
576/576 [==============================] - 0s 118us/step - loss: 0.6482 - acc: 0.6562 - val_loss: 0.6497 - val_acc: 0.6510
Epoch 23/1500
576/576 [==============================] - 0s 106us/step - loss: 0.6461 - acc: 0.6580 - val_loss: 0.6479 - val_acc: 0.6510
Epoch 24/1500
576/576 [==============================] - 0s 95us/step - loss: 0.6441 - acc: 0.6545 - val_loss: 0.6462 - val_acc: 0.6510
Epoch 25/1500
576/576 [==============================] - 0s 106us/step - loss: 0.6421 - acc: 0.6545 - val_loss: 0.6445 - val_acc: 0.6458
Epoch 26/1500
576/576 [==============================] - 0s 125us/step - loss: 0.6402 - acc: 0.6545 - val_loss: 0.6428 - val_acc: 0.6458
Epoch 27/1500
576/576 [==============================] - 0s 125us/step - loss: 0.6383 - acc: 0.6545 - val_loss: 0.6412 - val_acc: 0.6406
Epoch 28/1500
576/576 [==============================] - 0s 137us/step - loss: 0.6365 - acc: 0.6528 - val_loss: 0.6396 - val_acc: 0.6406
Epoch 29/1500
576/576 [==============================] - 0s 109us/step - loss: 0.6347 - acc: 0.6545 - val_loss: 0.6380 - val_acc: 0.6406
Epoch 30/1500
576/576 [==============================] - ETA: 0s - loss: 0.6362 - acc: 0.645 - 0s 144us/step - loss: 0.6329 - acc: 0.6545 - val_loss: 0.6365 - val_acc: 0.6406
Epoch 31/1500
576/576 [==============================] - 0s 113us/step - loss: 0.6311 - acc: 0.6562 - val_loss: 0.6350 - val_acc: 0.6406
Epoch 32/1500
576/576 [==============================] - 0s 125us/step - loss: 0.6294 - acc: 0.6562 - val_loss: 0.6334 - val_acc: 0.6406
Epoch 33/1500
576/576 [==============================] - 0s 154us/step - loss: 0.6277 - acc: 0.6545 - val_loss: 0.6320 - val_acc: 0.6406
Epoch 34/1500
576/576 [==============================] - 0s 106us/step - loss: 0.6260 - acc: 0.6545 - val_loss: 0.6305 - val_acc: 0.6406
Epoch 35/1500
576/576 [==============================] - 0s 109us/step - loss: 0.6243 - acc: 0.6545 - val_loss: 0.6291 - val_acc: 0.6406
Epoch 36/1500
576/576 [==============================] - 0s 102us/step - loss: 0.6227 - acc: 0.6545 - val_loss: 0.6276 - val_acc: 0.6406
Epoch 37/1500
576/576 [==============================] - 0s 111us/step - loss: 0.6211 - acc: 0.6545 - val_loss: 0.6262 - val_acc: 0.6406
Epoch 38/1500
576/576 [==============================] - 0s 111us/step - loss: 0.6194 - acc: 0.6545 - val_loss: 0.6248 - val_acc: 0.6406
Epoch 39/1500
576/576 [==============================] - 0s 106us/step - loss: 0.6179 - acc: 0.6528 - val_loss: 0.6235 - val_acc: 0.6406
Epoch 40/1500
576/576 [==============================] - 0s 97us/step - loss: 0.6163 - acc: 0.6528 - val_loss: 0.6221 - val_acc: 0.6406
Epoch 41/1500
576/576 [==============================] - 0s 111us/step - loss: 0.6147 - acc: 0.6528 - val_loss: 0.6207 - val_acc: 0.6406
Epoch 42/1500
576/576 [==============================] - 0s 127us/step - loss: 0.6132 - acc: 0.6528 - val_loss: 0.6194 - val_acc: 0.6458
Epoch 43/1500
576/576 [==============================] - 0s 123us/step - loss: 0.6116 - acc: 0.6528 - val_loss: 0.6181 - val_acc: 0.6458
Epoch 44/1500
576/576 [==============================] - 0s 128us/step - loss: 0.6101 - acc: 0.6528 - val_loss: 0.6168 - val_acc: 0.6458
Epoch 45/1500
576/576 [==============================] - 0s 111us/step - loss: 0.6086 - acc: 0.6528 - val_loss: 0.6154 - val_acc: 0.6458
Epoch 46/1500
576/576 [==============================] - 0s 102us/step - loss: 0.6071 - acc: 0.6528 - val_loss: 0.6141 - val_acc: 0.6458
Epoch 47/1500
576/576 [==============================] - 0s 121us/step - loss: 0.6056 - acc: 0.6528 - val_loss: 0.6128 - val_acc: 0.6458
Epoch 48/1500
576/576 [==============================] - 0s 125us/step - loss: 0.6041 - acc: 0.6528 - val_loss: 0.6116 - val_acc: 0.6458
Epoch 49/1500
576/576 [==============================] - 0s 116us/step - loss: 0.6026 - acc: 0.6528 - val_loss: 0.6103 - val_acc: 0.6458
Epoch 50/1500
576/576 [==============================] - 0s 139us/step - loss: 0.6011 - acc: 0.6528 - val_loss: 0.6090 - val_acc: 0.6458
Epoch 51/1500
576/576 [==============================] - 0s 132us/step - loss: 0.5996 - acc: 0.6545 - val_loss: 0.6077 - val_acc: 0.6458
Epoch 52/1500
576/576 [==============================] - 0s 101us/step - loss: 0.5981 - acc: 0.6545 - val_loss: 0.6064 - val_acc: 0.6458
Epoch 53/1500
576/576 [==============================] - 0s 99us/step - loss: 0.5966 - acc: 0.6562 - val_loss: 0.6052 - val_acc: 0.6458
Epoch 54/1500
576/576 [==============================] - 0s 113us/step - loss: 0.5951 - acc: 0.6562 - val_loss: 0.6039 - val_acc: 0.6458
Epoch 55/1500
576/576 [==============================] - 0s 108us/step - loss: 0.5936 - acc: 0.6562 - val_loss: 0.6026 - val_acc: 0.6458
Epoch 56/1500
576/576 [==============================] - 0s 104us/step - loss: 0.5921 - acc: 0.6562 - val_loss: 0.6013 - val_acc: 0.6458
Epoch 57/1500
576/576 [==============================] - 0s 104us/step - loss: 0.5906 - acc: 0.6562 - val_loss: 0.6001 - val_acc: 0.6458
Epoch 58/1500
576/576 [==============================] - 0s 130us/step - loss: 0.5891 - acc: 0.6580 - val_loss: 0.5988 - val_acc: 0.6458
Epoch 59/1500
576/576 [==============================] - 0s 106us/step - loss: 0.5876 - acc: 0.6580 - val_loss: 0.5976 - val_acc: 0.6458
Epoch 60/1500
576/576 [==============================] - 0s 113us/step - loss: 0.5861 - acc: 0.6580 - val_loss: 0.5963 - val_acc: 0.6458
Epoch 61/1500
576/576 [==============================] - 0s 108us/step - loss: 0.5846 - acc: 0.6580 - val_loss: 0.5951 - val_acc: 0.6458
Epoch 62/1500
576/576 [==============================] - 0s 132us/step - loss: 0.5831 - acc: 0.6580 - val_loss: 0.5939 - val_acc: 0.6458
Epoch 63/1500
576/576 [==============================] - 0s 121us/step - loss: 0.5816 - acc: 0.6580 - val_loss: 0.5926 - val_acc: 0.6458
Epoch 64/1500
576/576 [==============================] - 0s 115us/step - loss: 0.5801 - acc: 0.6580 - val_loss: 0.5914 - val_acc: 0.6458
Epoch 65/1500
576/576 [==============================] - 0s 109us/step - loss: 0.5786 - acc: 0.6597 - val_loss: 0.5902 - val_acc: 0.6458
Epoch 66/1500
576/576 [==============================] - 0s 108us/step - loss: 0.5771 - acc: 0.6597 - val_loss: 0.5889 - val_acc: 0.6458
Epoch 67/1500
576/576 [==============================] - 0s 141us/step - loss: 0.5756 - acc: 0.6615 - val_loss: 0.5877 - val_acc: 0.6458
Epoch 68/1500
576/576 [==============================] - 0s 130us/step - loss: 0.5741 - acc: 0.6632 - val_loss: 0.5865 - val_acc: 0.6458
Epoch 69/1500
576/576 [==============================] - 0s 118us/step - loss: 0.5727 - acc: 0.6649 - val_loss: 0.5852 - val_acc: 0.6458
Epoch 70/1500
576/576 [==============================] - 0s 115us/step - loss: 0.5712 - acc: 0.6649 - val_loss: 0.5840 - val_acc: 0.6458
Epoch 71/1500
576/576 [==============================] - 0s 149us/step - loss: 0.5697 - acc: 0.6667 - val_loss: 0.5828 - val_acc: 0.6458
Epoch 72/1500
576/576 [==============================] - 0s 139us/step - loss: 0.5682 - acc: 0.6667 - val_loss: 0.5816 - val_acc: 0.6510
Epoch 73/1500
576/576 [==============================] - 0s 134us/step - loss: 0.5668 - acc: 0.6701 - val_loss: 0.5804 - val_acc: 0.6510
Epoch 74/1500
576/576 [==============================] - 0s 141us/step - loss: 0.5653 - acc: 0.6736 - val_loss: 0.5792 - val_acc: 0.6510
Epoch 75/1500
576/576 [==============================] - 0s 130us/step - loss: 0.5638 - acc: 0.6736 - val_loss: 0.5780 - val_acc: 0.6510
Epoch 76/1500
576/576 [==============================] - 0s 118us/step - loss: 0.5624 - acc: 0.6736 - val_loss: 0.5768 - val_acc: 0.6562
Epoch 77/1500
576/576 [==============================] - 0s 128us/step - loss: 0.5610 - acc: 0.6736 - val_loss: 0.5756 - val_acc: 0.6562
Epoch 78/1500
576/576 [==============================] - 0s 144us/step - loss: 0.5595 - acc: 0.6719 - val_loss: 0.5744 - val_acc: 0.6562
Epoch 79/1500
576/576 [==============================] - 0s 106us/step - loss: 0.5581 - acc: 0.6753 - val_loss: 0.5733 - val_acc: 0.6562
Epoch 80/1500
576/576 [==============================] - 0s 123us/step - loss: 0.5566 - acc: 0.6788 - val_loss: 0.5721 - val_acc: 0.6615
Epoch 81/1500
576/576 [==============================] - 0s 127us/step - loss: 0.5552 - acc: 0.6806 - val_loss: 0.5709 - val_acc: 0.6615
Epoch 82/1500
576/576 [==============================] - 0s 132us/step - loss: 0.5537 - acc: 0.6823 - val_loss: 0.5697 - val_acc: 0.6615
Epoch 83/1500
576/576 [==============================] - 0s 125us/step - loss: 0.5523 - acc: 0.6823 - val_loss: 0.5686 - val_acc: 0.6615
Epoch 84/1500
576/576 [==============================] - 0s 132us/step - loss: 0.5508 - acc: 0.6823 - val_loss: 0.5674 - val_acc: 0.6615
Epoch 85/1500
576/576 [==============================] - 0s 128us/step - loss: 0.5494 - acc: 0.6771 - val_loss: 0.5663 - val_acc: 0.6719
Epoch 86/1500
576/576 [==============================] - 0s 128us/step - loss: 0.5480 - acc: 0.6771 - val_loss: 0.5651 - val_acc: 0.6719
Epoch 87/1500
576/576 [==============================] - 0s 132us/step - loss: 0.5466 - acc: 0.6806 - val_loss: 0.5640 - val_acc: 0.6771
Epoch 88/1500
576/576 [==============================] - 0s 115us/step - loss: 0.5451 - acc: 0.6823 - val_loss: 0.5628 - val_acc: 0.6823
Epoch 89/1500
576/576 [==============================] - 0s 118us/step - loss: 0.5437 - acc: 0.6840 - val_loss: 0.5617 - val_acc: 0.6875
Epoch 90/1500
576/576 [==============================] - 0s 146us/step - loss: 0.5423 - acc: 0.6840 - val_loss: 0.5606 - val_acc: 0.6875
Epoch 91/1500
576/576 [==============================] - 0s 115us/step - loss: 0.5408 - acc: 0.6840 - val_loss: 0.5595 - val_acc: 0.6979
Epoch 92/1500
576/576 [==============================] - 0s 113us/step - loss: 0.5394 - acc: 0.6858 - val_loss: 0.5583 - val_acc: 0.6927
Epoch 93/1500
576/576 [==============================] - 0s 128us/step - loss: 0.5380 - acc: 0.6875 - val_loss: 0.5572 - val_acc: 0.6927
Epoch 94/1500
576/576 [==============================] - 0s 137us/step - loss: 0.5366 - acc: 0.6910 - val_loss: 0.5561 - val_acc: 0.7031
Epoch 95/1500
576/576 [==============================] - 0s 118us/step - loss: 0.5352 - acc: 0.6910 - val_loss: 0.5550 - val_acc: 0.6979
Epoch 96/1500
576/576 [==============================] - 0s 121us/step - loss: 0.5338 - acc: 0.6944 - val_loss: 0.5540 - val_acc: 0.6979
Epoch 97/1500
576/576 [==============================] - 0s 139us/step - loss: 0.5324 - acc: 0.6962 - val_loss: 0.5529 - val_acc: 0.7031
Epoch 98/1500
576/576 [==============================] - 0s 135us/step - loss: 0.5311 - acc: 0.7014 - val_loss: 0.5518 - val_acc: 0.7083
Epoch 99/1500
576/576 [==============================] - 0s 116us/step - loss: 0.5297 - acc: 0.7014 - val_loss: 0.5507 - val_acc: 0.7188
Epoch 100/1500
576/576 [==============================] - 0s 144us/step - loss: 0.5283 - acc: 0.7049 - val_loss: 0.5497 - val_acc: 0.7344
Epoch 101/1500
576/576 [==============================] - 0s 132us/step - loss: 0.5270 - acc: 0.7101 - val_loss: 0.5486 - val_acc: 0.7396
Epoch 102/1500
576/576 [==============================] - 0s 106us/step - loss: 0.5256 - acc: 0.7118 - val_loss: 0.5476 - val_acc: 0.7448
Epoch 103/1500
576/576 [==============================] - 0s 111us/step - loss: 0.5243 - acc: 0.7170 - val_loss: 0.5465 - val_acc: 0.7500
Epoch 104/1500
576/576 [==============================] - 0s 146us/step - loss: 0.5229 - acc: 0.7188 - val_loss: 0.5455 - val_acc: 0.7500
Epoch 105/1500
576/576 [==============================] - 0s 104us/step - loss: 0.5216 - acc: 0.7188 - val_loss: 0.5445 - val_acc: 0.7500
Epoch 106/1500
576/576 [==============================] - 0s 116us/step - loss: 0.5203 - acc: 0.7222 - val_loss: 0.5435 - val_acc: 0.7500
Epoch 107/1500
576/576 [==============================] - 0s 121us/step - loss: 0.5191 - acc: 0.7274 - val_loss: 0.5425 - val_acc: 0.7500
Epoch 108/1500
576/576 [==============================] - 0s 108us/step - loss: 0.5178 - acc: 0.7292 - val_loss: 0.5415 - val_acc: 0.7552
Epoch 109/1500
576/576 [==============================] - 0s 106us/step - loss: 0.5165 - acc: 0.7274 - val_loss: 0.5405 - val_acc: 0.7552
Epoch 110/1500
576/576 [==============================] - 0s 101us/step - loss: 0.5152 - acc: 0.7309 - val_loss: 0.5396 - val_acc: 0.7552
Epoch 111/1500
576/576 [==============================] - 0s 137us/step - loss: 0.5140 - acc: 0.7344 - val_loss: 0.5386 - val_acc: 0.7552
Epoch 112/1500
576/576 [==============================] - 0s 130us/step - loss: 0.5127 - acc: 0.7361 - val_loss: 0.5377 - val_acc: 0.7552
Epoch 113/1500
576/576 [==============================] - 0s 128us/step - loss: 0.5115 - acc: 0.7344 - val_loss: 0.5368 - val_acc: 0.7552
Epoch 114/1500
576/576 [==============================] - 0s 109us/step - loss: 0.5104 - acc: 0.7361 - val_loss: 0.5359 - val_acc: 0.7604
Epoch 115/1500
576/576 [==============================] - 0s 109us/step - loss: 0.5092 - acc: 0.7378 - val_loss: 0.5350 - val_acc: 0.7552
Epoch 116/1500
576/576 [==============================] - 0s 113us/step - loss: 0.5080 - acc: 0.7396 - val_loss: 0.5341 - val_acc: 0.7552
Epoch 117/1500
576/576 [==============================] - 0s 120us/step - loss: 0.5068 - acc: 0.7413 - val_loss: 0.5333 - val_acc: 0.7604
Epoch 118/1500
576/576 [==============================] - 0s 108us/step - loss: 0.5056 - acc: 0.7431 - val_loss: 0.5324 - val_acc: 0.7656
Epoch 119/1500
576/576 [==============================] - 0s 116us/step - loss: 0.5045 - acc: 0.7448 - val_loss: 0.5316 - val_acc: 0.7604
Epoch 120/1500
576/576 [==============================] - 0s 95us/step - loss: 0.5034 - acc: 0.7448 - val_loss: 0.5307 - val_acc: 0.7604
Epoch 121/1500
576/576 [==============================] - 0s 99us/step - loss: 0.5023 - acc: 0.7483 - val_loss: 0.5299 - val_acc: 0.7604
Epoch 122/1500
576/576 [==============================] - 0s 125us/step - loss: 0.5011 - acc: 0.7465 - val_loss: 0.5292 - val_acc: 0.7604
Epoch 123/1500
576/576 [==============================] - 0s 130us/step - loss: 0.5000 - acc: 0.7500 - val_loss: 0.5284 - val_acc: 0.7656
Epoch 124/1500
576/576 [==============================] - 0s 104us/step - loss: 0.4990 - acc: 0.7517 - val_loss: 0.5276 - val_acc: 0.7656
Epoch 125/1500
576/576 [==============================] - 0s 139us/step - loss: 0.4979 - acc: 0.7535 - val_loss: 0.5268 - val_acc: 0.7656
Epoch 126/1500
576/576 [==============================] - 0s 109us/step - loss: 0.4968 - acc: 0.7535 - val_loss: 0.5261 - val_acc: 0.7656
Epoch 127/1500
576/576 [==============================] - 0s 118us/step - loss: 0.4958 - acc: 0.7552 - val_loss: 0.5254 - val_acc: 0.7656
Epoch 128/1500
576/576 [==============================] - 0s 134us/step - loss: 0.4948 - acc: 0.7517 - val_loss: 0.5246 - val_acc: 0.7656
Epoch 129/1500
576/576 [==============================] - 0s 102us/step - loss: 0.4938 - acc: 0.7517 - val_loss: 0.5239 - val_acc: 0.7656
Epoch 130/1500
576/576 [==============================] - 0s 111us/step - loss: 0.4928 - acc: 0.7535 - val_loss: 0.5232 - val_acc: 0.7656
Epoch 131/1500
576/576 [==============================] - 0s 144us/step - loss: 0.4918 - acc: 0.7552 - val_loss: 0.5225 - val_acc: 0.7604
Epoch 132/1500
576/576 [==============================] - 0s 142us/step - loss: 0.4908 - acc: 0.7587 - val_loss: 0.5219 - val_acc: 0.7604
Epoch 133/1500
576/576 [==============================] - 0s 132us/step - loss: 0.4898 - acc: 0.7569 - val_loss: 0.5212 - val_acc: 0.7656
Epoch 134/1500
576/576 [==============================] - 0s 125us/step - loss: 0.4889 - acc: 0.7604 - val_loss: 0.5205 - val_acc: 0.7656
Epoch 135/1500
576/576 [==============================] - 0s 137us/step - loss: 0.4879 - acc: 0.7604 - val_loss: 0.5199 - val_acc: 0.7656
Epoch 136/1500
576/576 [==============================] - 0s 118us/step - loss: 0.4870 - acc: 0.7604 - val_loss: 0.5193 - val_acc: 0.7604
Epoch 137/1500
576/576 [==============================] - 0s 132us/step - loss: 0.4861 - acc: 0.7604 - val_loss: 0.5187 - val_acc: 0.7604
Epoch 138/1500
576/576 [==============================] - 0s 128us/step - loss: 0.4852 - acc: 0.7639 - val_loss: 0.5181 - val_acc: 0.7604
Epoch 139/1500
576/576 [==============================] - 0s 139us/step - loss: 0.4843 - acc: 0.7691 - val_loss: 0.5175 - val_acc: 0.7604
Epoch 140/1500
576/576 [==============================] - 0s 151us/step - loss: 0.4834 - acc: 0.7743 - val_loss: 0.5169 - val_acc: 0.7604
Epoch 141/1500
576/576 [==============================] - 0s 156us/step - loss: 0.4825 - acc: 0.7743 - val_loss: 0.5163 - val_acc: 0.7604
Epoch 142/1500
576/576 [==============================] - 0s 135us/step - loss: 0.4817 - acc: 0.7743 - val_loss: 0.5158 - val_acc: 0.7604
Epoch 143/1500
576/576 [==============================] - 0s 113us/step - loss: 0.4808 - acc: 0.7760 - val_loss: 0.5152 - val_acc: 0.7604
Epoch 144/1500
576/576 [==============================] - 0s 115us/step - loss: 0.4801 - acc: 0.7743 - val_loss: 0.5147 - val_acc: 0.7604
Epoch 145/1500
576/576 [==============================] - 0s 118us/step - loss: 0.4793 - acc: 0.7743 - val_loss: 0.5142 - val_acc: 0.7604
Epoch 146/1500
576/576 [==============================] - 0s 125us/step - loss: 0.4784 - acc: 0.7743 - val_loss: 0.5136 - val_acc: 0.7604
Epoch 147/1500
576/576 [==============================] - 0s 147us/step - loss: 0.4777 - acc: 0.7760 - val_loss: 0.5131 - val_acc: 0.7604
Epoch 148/1500
576/576 [==============================] - 0s 134us/step - loss: 0.4769 - acc: 0.7830 - val_loss: 0.5127 - val_acc: 0.7552
Epoch 149/1500
576/576 [==============================] - 0s 134us/step - loss: 0.4762 - acc: 0.7812 - val_loss: 0.5122 - val_acc: 0.7552
Epoch 150/1500
576/576 [==============================] - 0s 108us/step - loss: 0.4754 - acc: 0.7830 - val_loss: 0.5117 - val_acc: 0.7552
Epoch 151/1500
576/576 [==============================] - 0s 115us/step - loss: 0.4747 - acc: 0.7847 - val_loss: 0.5112 - val_acc: 0.7448
Epoch 152/1500
576/576 [==============================] - 0s 121us/step - loss: 0.4740 - acc: 0.7882 - val_loss: 0.5108 - val_acc: 0.7500
Epoch 153/1500
576/576 [==============================] - 0s 102us/step - loss: 0.4733 - acc: 0.7882 - val_loss: 0.5103 - val_acc: 0.7552
Epoch 154/1500
576/576 [==============================] - 0s 134us/step - loss: 0.4727 - acc: 0.7865 - val_loss: 0.5099 - val_acc: 0.7552
Epoch 155/1500
576/576 [==============================] - 0s 123us/step - loss: 0.4719 - acc: 0.7882 - val_loss: 0.5095 - val_acc: 0.7552
Epoch 156/1500
576/576 [==============================] - 0s 135us/step - loss: 0.4713 - acc: 0.7865 - val_loss: 0.5091 - val_acc: 0.7500
Epoch 157/1500
576/576 [==============================] - 0s 125us/step - loss: 0.4707 - acc: 0.7865 - val_loss: 0.5087 - val_acc: 0.7448
Epoch 158/1500
576/576 [==============================] - 0s 121us/step - loss: 0.4700 - acc: 0.7865 - val_loss: 0.5083 - val_acc: 0.7448
Epoch 159/1500
576/576 [==============================] - 0s 160us/step - loss: 0.4694 - acc: 0.7847 - val_loss: 0.5080 - val_acc: 0.7448
Epoch 160/1500
576/576 [==============================] - 0s 151us/step - loss: 0.4687 - acc: 0.7847 - val_loss: 0.5076 - val_acc: 0.7500
Epoch 161/1500
576/576 [==============================] - 0s 106us/step - loss: 0.4681 - acc: 0.7847 - val_loss: 0.5073 - val_acc: 0.7500
Epoch 162/1500
576/576 [==============================] - 0s 111us/step - loss: 0.4675 - acc: 0.7882 - val_loss: 0.5069 - val_acc: 0.7500
Epoch 163/1500
576/576 [==============================] - 0s 153us/step - loss: 0.4669 - acc: 0.7882 - val_loss: 0.5066 - val_acc: 0.7500
Epoch 164/1500
576/576 [==============================] - 0s 104us/step - loss: 0.4664 - acc: 0.7882 - val_loss: 0.5063 - val_acc: 0.7500
Epoch 165/1500
576/576 [==============================] - 0s 109us/step - loss: 0.4658 - acc: 0.7899 - val_loss: 0.5059 - val_acc: 0.7500
Epoch 166/1500
576/576 [==============================] - 0s 94us/step - loss: 0.4652 - acc: 0.7882 - val_loss: 0.5056 - val_acc: 0.7500
Epoch 167/1500
576/576 [==============================] - 0s 139us/step - loss: 0.4647 - acc: 0.7882 - val_loss: 0.5053 - val_acc: 0.7552
Epoch 168/1500
576/576 [==============================] - 0s 108us/step - loss: 0.4641 - acc: 0.7847 - val_loss: 0.5050 - val_acc: 0.7552
Epoch 169/1500
576/576 [==============================] - 0s 99us/step - loss: 0.4636 - acc: 0.7847 - val_loss: 0.5047 - val_acc: 0.7552
Epoch 170/1500
576/576 [==============================] - 0s 99us/step - loss: 0.4631 - acc: 0.7865 - val_loss: 0.5045 - val_acc: 0.7552
Epoch 171/1500
576/576 [==============================] - 0s 139us/step - loss: 0.4626 - acc: 0.7865 - val_loss: 0.5042 - val_acc: 0.7552
Epoch 172/1500
576/576 [==============================] - 0s 102us/step - loss: 0.4621 - acc: 0.7865 - val_loss: 0.5039 - val_acc: 0.7552
Epoch 173/1500
576/576 [==============================] - 0s 108us/step - loss: 0.4616 - acc: 0.7865 - val_loss: 0.5037 - val_acc: 0.7552
Epoch 174/1500
576/576 [==============================] - 0s 109us/step - loss: 0.4611 - acc: 0.7865 - val_loss: 0.5034 - val_acc: 0.7500
Epoch 175/1500
576/576 [==============================] - 0s 113us/step - loss: 0.4606 - acc: 0.7865 - val_loss: 0.5031 - val_acc: 0.7552
Epoch 176/1500
576/576 [==============================] - 0s 115us/step - loss: 0.4601 - acc: 0.7899 - val_loss: 0.5029 - val_acc: 0.7552
Epoch 177/1500
576/576 [==============================] - 0s 113us/step - loss: 0.4597 - acc: 0.7899 - val_loss: 0.5027 - val_acc: 0.7604
Epoch 178/1500
576/576 [==============================] - 0s 132us/step - loss: 0.4592 - acc: 0.7899 - val_loss: 0.5024 - val_acc: 0.7604
Epoch 179/1500
576/576 [==============================] - 0s 97us/step - loss: 0.4588 - acc: 0.7899 - val_loss: 0.5022 - val_acc: 0.7604
Epoch 180/1500
576/576 [==============================] - 0s 102us/step - loss: 0.4583 - acc: 0.7882 - val_loss: 0.5020 - val_acc: 0.7604
Epoch 181/1500
576/576 [==============================] - 0s 104us/step - loss: 0.4579 - acc: 0.7882 - val_loss: 0.5018 - val_acc: 0.7552
Epoch 182/1500
576/576 [==============================] - 0s 139us/step - loss: 0.4575 - acc: 0.7882 - val_loss: 0.5016 - val_acc: 0.7552
Epoch 183/1500
576/576 [==============================] - 0s 123us/step - loss: 0.4571 - acc: 0.7882 - val_loss: 0.5014 - val_acc: 0.7500
Epoch 184/1500
576/576 [==============================] - 0s 97us/step - loss: 0.4567 - acc: 0.7882 - val_loss: 0.5011 - val_acc: 0.7500
Epoch 185/1500
576/576 [==============================] - 0s 127us/step - loss: 0.4563 - acc: 0.7882 - val_loss: 0.5009 - val_acc: 0.7500
Epoch 186/1500
576/576 [==============================] - 0s 102us/step - loss: 0.4559 - acc: 0.7882 - val_loss: 0.5008 - val_acc: 0.7500
Epoch 187/1500
576/576 [==============================] - 0s 118us/step - loss: 0.4555 - acc: 0.7899 - val_loss: 0.5006 - val_acc: 0.7500
Epoch 188/1500
576/576 [==============================] - 0s 121us/step - loss: 0.4551 - acc: 0.7899 - val_loss: 0.5004 - val_acc: 0.7500
Epoch 189/1500
576/576 [==============================] - 0s 108us/step - loss: 0.4548 - acc: 0.7899 - val_loss: 0.5002 - val_acc: 0.7500
Epoch 190/1500
576/576 [==============================] - 0s 109us/step - loss: 0.4544 - acc: 0.7899 - val_loss: 0.5000 - val_acc: 0.7500
Epoch 191/1500
576/576 [==============================] - 0s 130us/step - loss: 0.4541 - acc: 0.7917 - val_loss: 0.4999 - val_acc: 0.7500
Epoch 192/1500
576/576 [==============================] - 0s 123us/step - loss: 0.4538 - acc: 0.7882 - val_loss: 0.4997 - val_acc: 0.7500
Epoch 193/1500
576/576 [==============================] - 0s 101us/step - loss: 0.4533 - acc: 0.7899 - val_loss: 0.4996 - val_acc: 0.7500
Epoch 194/1500
576/576 [==============================] - 0s 106us/step - loss: 0.4530 - acc: 0.7917 - val_loss: 0.4994 - val_acc: 0.7500
Epoch 195/1500
576/576 [==============================] - 0s 147us/step - loss: 0.4527 - acc: 0.7899 - val_loss: 0.4993 - val_acc: 0.7500
Epoch 196/1500
576/576 [==============================] - 0s 128us/step - loss: 0.4523 - acc: 0.7917 - val_loss: 0.4991 - val_acc: 0.7500
Epoch 197/1500
576/576 [==============================] - 0s 125us/step - loss: 0.4520 - acc: 0.7899 - val_loss: 0.4990 - val_acc: 0.7500
Epoch 198/1500
576/576 [==============================] - 0s 141us/step - loss: 0.4517 - acc: 0.7899 - val_loss: 0.4989 - val_acc: 0.7500
Epoch 199/1500
576/576 [==============================] - 0s 147us/step - loss: 0.4514 - acc: 0.7899 - val_loss: 0.4987 - val_acc: 0.7448
Epoch 200/1500
576/576 [==============================] - 0s 156us/step - loss: 0.4511 - acc: 0.7917 - val_loss: 0.4986 - val_acc: 0.7448
Epoch 201/1500
576/576 [==============================] - 0s 144us/step - loss: 0.4508 - acc: 0.7934 - val_loss: 0.4985 - val_acc: 0.7448
Epoch 202/1500
576/576 [==============================] - 0s 139us/step - loss: 0.4505 - acc: 0.7934 - val_loss: 0.4984 - val_acc: 0.7448
Epoch 203/1500
576/576 [==============================] - 0s 151us/step - loss: 0.4501 - acc: 0.7934 - val_loss: 0.4983 - val_acc: 0.7448
Epoch 204/1500
576/576 [==============================] - 0s 132us/step - loss: 0.4499 - acc: 0.7934 - val_loss: 0.4982 - val_acc: 0.7448
Epoch 205/1500
576/576 [==============================] - 0s 149us/step - loss: 0.4496 - acc: 0.7934 - val_loss: 0.4980 - val_acc: 0.7448
Epoch 206/1500
576/576 [==============================] - 0s 154us/step - loss: 0.4493 - acc: 0.7934 - val_loss: 0.4979 - val_acc: 0.7448
Epoch 207/1500
576/576 [==============================] - 0s 125us/step - loss: 0.4490 - acc: 0.7934 - val_loss: 0.4978 - val_acc: 0.7448
Epoch 208/1500
576/576 [==============================] - 0s 142us/step - loss: 0.4488 - acc: 0.7917 - val_loss: 0.4977 - val_acc: 0.7448
Epoch 209/1500
576/576 [==============================] - 0s 120us/step - loss: 0.4485 - acc: 0.7934 - val_loss: 0.4976 - val_acc: 0.7448
Epoch 210/1500
576/576 [==============================] - 0s 149us/step - loss: 0.4483 - acc: 0.7951 - val_loss: 0.4976 - val_acc: 0.7448
Epoch 211/1500
576/576 [==============================] - 0s 137us/step - loss: 0.4480 - acc: 0.7917 - val_loss: 0.4975 - val_acc: 0.7448
Epoch 212/1500
576/576 [==============================] - 0s 141us/step - loss: 0.4477 - acc: 0.7917 - val_loss: 0.4974 - val_acc: 0.7448
Epoch 213/1500
576/576 [==============================] - 0s 116us/step - loss: 0.4475 - acc: 0.7951 - val_loss: 0.4973 - val_acc: 0.7448
Epoch 214/1500
576/576 [==============================] - 0s 144us/step - loss: 0.4472 - acc: 0.7934 - val_loss: 0.4972 - val_acc: 0.7448
Epoch 215/1500
576/576 [==============================] - 0s 127us/step - loss: 0.4470 - acc: 0.7934 - val_loss: 0.4971 - val_acc: 0.7448
Epoch 216/1500
576/576 [==============================] - 0s 128us/step - loss: 0.4467 - acc: 0.7917 - val_loss: 0.4970 - val_acc: 0.7448
Epoch 217/1500
576/576 [==============================] - 0s 141us/step - loss: 0.4465 - acc: 0.7951 - val_loss: 0.4970 - val_acc: 0.7448
Epoch 218/1500
576/576 [==============================] - 0s 137us/step - loss: 0.4463 - acc: 0.7934 - val_loss: 0.4969 - val_acc: 0.7448
Epoch 219/1500
576/576 [==============================] - 0s 118us/step - loss: 0.4461 - acc: 0.7951 - val_loss: 0.4968 - val_acc: 0.7448
Epoch 220/1500
576/576 [==============================] - 0s 149us/step - loss: 0.4458 - acc: 0.7951 - val_loss: 0.4968 - val_acc: 0.7448
Epoch 221/1500
576/576 [==============================] - 0s 108us/step - loss: 0.4455 - acc: 0.7934 - val_loss: 0.4967 - val_acc: 0.7448
Epoch 222/1500
576/576 [==============================] - 0s 142us/step - loss: 0.4453 - acc: 0.7934 - val_loss: 0.4966 - val_acc: 0.7448
Epoch 223/1500
576/576 [==============================] - 0s 135us/step - loss: 0.4451 - acc: 0.7969 - val_loss: 0.4966 - val_acc: 0.7448
Epoch 224/1500
576/576 [==============================] - 0s 127us/step - loss: 0.4449 - acc: 0.7951 - val_loss: 0.4965 - val_acc: 0.7448
Epoch 225/1500
576/576 [==============================] - 0s 118us/step - loss: 0.4447 - acc: 0.7951 - val_loss: 0.4964 - val_acc: 0.7500
Epoch 226/1500
576/576 [==============================] - 0s 130us/step - loss: 0.4445 - acc: 0.7934 - val_loss: 0.4964 - val_acc: 0.7500
Epoch 227/1500
576/576 [==============================] - 0s 156us/step - loss: 0.4443 - acc: 0.7951 - val_loss: 0.4963 - val_acc: 0.7500
Epoch 228/1500
576/576 [==============================] - 0s 113us/step - loss: 0.4440 - acc: 0.7951 - val_loss: 0.4963 - val_acc: 0.7500
Epoch 229/1500
576/576 [==============================] - 0s 142us/step - loss: 0.4439 - acc: 0.7969 - val_loss: 0.4962 - val_acc: 0.7500
Epoch 230/1500
576/576 [==============================] - 0s 141us/step - loss: 0.4437 - acc: 0.7986 - val_loss: 0.4961 - val_acc: 0.7500
Epoch 231/1500
576/576 [==============================] - 0s 142us/step - loss: 0.4434 - acc: 0.7951 - val_loss: 0.4961 - val_acc: 0.7500
Epoch 232/1500
576/576 [==============================] - 0s 127us/step - loss: 0.4433 - acc: 0.7986 - val_loss: 0.4960 - val_acc: 0.7500
Epoch 233/1500
576/576 [==============================] - 0s 149us/step - loss: 0.4431 - acc: 0.7986 - val_loss: 0.4960 - val_acc: 0.7500
Epoch 234/1500
576/576 [==============================] - 0s 123us/step - loss: 0.4428 - acc: 0.8003 - val_loss: 0.4960 - val_acc: 0.7500
Epoch 235/1500
576/576 [==============================] - 0s 160us/step - loss: 0.4427 - acc: 0.7986 - val_loss: 0.4959 - val_acc: 0.7448
Epoch 236/1500
576/576 [==============================] - 0s 113us/step - loss: 0.4425 - acc: 0.7986 - val_loss: 0.4959 - val_acc: 0.7448
Epoch 237/1500
576/576 [==============================] - 0s 130us/step - loss: 0.4423 - acc: 0.7986 - val_loss: 0.4958 - val_acc: 0.7448
Epoch 238/1500
576/576 [==============================] - 0s 135us/step - loss: 0.4421 - acc: 0.7986 - val_loss: 0.4958 - val_acc: 0.7448
Epoch 239/1500
576/576 [==============================] - 0s 132us/step - loss: 0.4419 - acc: 0.7986 - val_loss: 0.4958 - val_acc: 0.7448
Epoch 240/1500
576/576 [==============================] - 0s 123us/step - loss: 0.4418 - acc: 0.7986 - val_loss: 0.4957 - val_acc: 0.7448
Epoch 241/1500
576/576 [==============================] - 0s 146us/step - loss: 0.4416 - acc: 0.7986 - val_loss: 0.4957 - val_acc: 0.7448
Epoch 242/1500
576/576 [==============================] - 0s 127us/step - loss: 0.4415 - acc: 0.7986 - val_loss: 0.4956 - val_acc: 0.7448
Epoch 243/1500
576/576 [==============================] - 0s 113us/step - loss: 0.4412 - acc: 0.7986 - val_loss: 0.4956 - val_acc: 0.7448
Epoch 244/1500
576/576 [==============================] - 0s 121us/step - loss: 0.4410 - acc: 0.7986 - val_loss: 0.4956 - val_acc: 0.7448
Epoch 245/1500
576/576 [==============================] - 0s 127us/step - loss: 0.4409 - acc: 0.7986 - val_loss: 0.4955 - val_acc: 0.7500
Epoch 246/1500
576/576 [==============================] - 0s 130us/step - loss: 0.4407 - acc: 0.7986 - val_loss: 0.4955 - val_acc: 0.7500
Epoch 247/1500
576/576 [==============================] - 0s 146us/step - loss: 0.4406 - acc: 0.7986 - val_loss: 0.4955 - val_acc: 0.7448
Epoch 248/1500
576/576 [==============================] - 0s 118us/step - loss: 0.4404 - acc: 0.7986 - val_loss: 0.4954 - val_acc: 0.7448
Epoch 249/1500
576/576 [==============================] - 0s 158us/step - loss: 0.4402 - acc: 0.7986 - val_loss: 0.4954 - val_acc: 0.7448
Epoch 250/1500
576/576 [==============================] - 0s 106us/step - loss: 0.4401 - acc: 0.7986 - val_loss: 0.4954 - val_acc: 0.7448
Epoch 251/1500
576/576 [==============================] - 0s 125us/step - loss: 0.4399 - acc: 0.7986 - val_loss: 0.4953 - val_acc: 0.7448
Epoch 252/1500
576/576 [==============================] - 0s 127us/step - loss: 0.4397 - acc: 0.7986 - val_loss: 0.4953 - val_acc: 0.7396
Epoch 253/1500
576/576 [==============================] - 0s 125us/step - loss: 0.4396 - acc: 0.7969 - val_loss: 0.4953 - val_acc: 0.7396
Epoch 254/1500
576/576 [==============================] - 0s 127us/step - loss: 0.4394 - acc: 0.7986 - val_loss: 0.4953 - val_acc: 0.7396
Epoch 255/1500
576/576 [==============================] - 0s 123us/step - loss: 0.4393 - acc: 0.7969 - val_loss: 0.4952 - val_acc: 0.7396
Epoch 256/1500
576/576 [==============================] - 0s 147us/step - loss: 0.4391 - acc: 0.7969 - val_loss: 0.4952 - val_acc: 0.7396
Epoch 257/1500
576/576 [==============================] - 0s 130us/step - loss: 0.4390 - acc: 0.7969 - val_loss: 0.4952 - val_acc: 0.7396
Epoch 258/1500
576/576 [==============================] - 0s 109us/step - loss: 0.4388 - acc: 0.7969 - val_loss: 0.4952 - val_acc: 0.7396
Epoch 259/1500
576/576 [==============================] - 0s 132us/step - loss: 0.4386 - acc: 0.7951 - val_loss: 0.4952 - val_acc: 0.7396
Epoch 260/1500
576/576 [==============================] - 0s 120us/step - loss: 0.4385 - acc: 0.7969 - val_loss: 0.4951 - val_acc: 0.7396
Epoch 261/1500
576/576 [==============================] - 0s 125us/step - loss: 0.4383 - acc: 0.7951 - val_loss: 0.4951 - val_acc: 0.7396
Epoch 262/1500
576/576 [==============================] - 0s 134us/step - loss: 0.4382 - acc: 0.7969 - val_loss: 0.4951 - val_acc: 0.7396
Epoch 263/1500
576/576 [==============================] - 0s 104us/step - loss: 0.4381 - acc: 0.7969 - val_loss: 0.4951 - val_acc: 0.7396
Epoch 264/1500
576/576 [==============================] - 0s 121us/step - loss: 0.4379 - acc: 0.7951 - val_loss: 0.4951 - val_acc: 0.7396
Epoch 265/1500
576/576 [==============================] - 0s 146us/step - loss: 0.4378 - acc: 0.7951 - val_loss: 0.4951 - val_acc: 0.7396
Epoch 266/1500
576/576 [==============================] - 0s 123us/step - loss: 0.4377 - acc: 0.7986 - val_loss: 0.4951 - val_acc: 0.7396
Epoch 267/1500
576/576 [==============================] - 0s 115us/step - loss: 0.4375 - acc: 0.7951 - val_loss: 0.4951 - val_acc: 0.7396
Epoch 268/1500
576/576 [==============================] - 0s 139us/step - loss: 0.4374 - acc: 0.7951 - val_loss: 0.4951 - val_acc: 0.7448
Epoch 269/1500
576/576 [==============================] - 0s 115us/step - loss: 0.4372 - acc: 0.7951 - val_loss: 0.4951 - val_acc: 0.7448
Epoch 270/1500
576/576 [==============================] - 0s 141us/step - loss: 0.4371 - acc: 0.7951 - val_loss: 0.4950 - val_acc: 0.7448
Epoch 271/1500
576/576 [==============================] - 0s 121us/step - loss: 0.4370 - acc: 0.7951 - val_loss: 0.4950 - val_acc: 0.7448
Epoch 272/1500
576/576 [==============================] - 0s 134us/step - loss: 0.4368 - acc: 0.7951 - val_loss: 0.4950 - val_acc: 0.7396
Epoch 273/1500
576/576 [==============================] - 0s 115us/step - loss: 0.4367 - acc: 0.7969 - val_loss: 0.4950 - val_acc: 0.7396
Epoch 274/1500
576/576 [==============================] - 0s 127us/step - loss: 0.4365 - acc: 0.7969 - val_loss: 0.4950 - val_acc: 0.7396
Epoch 275/1500
576/576 [==============================] - 0s 132us/step - loss: 0.4364 - acc: 0.7969 - val_loss: 0.4950 - val_acc: 0.7396
Epoch 276/1500
576/576 [==============================] - 0s 141us/step - loss: 0.4363 - acc: 0.7951 - val_loss: 0.4950 - val_acc: 0.7396
Epoch 277/1500
576/576 [==============================] - 0s 146us/step - loss: 0.4362 - acc: 0.7951 - val_loss: 0.4949 - val_acc: 0.7396
Epoch 278/1500
576/576 [==============================] - 0s 125us/step - loss: 0.4360 - acc: 0.7934 - val_loss: 0.4949 - val_acc: 0.7396
Epoch 279/1500
576/576 [==============================] - 0s 127us/step - loss: 0.4359 - acc: 0.7969 - val_loss: 0.4949 - val_acc: 0.7396
Epoch 280/1500
576/576 [==============================] - 0s 125us/step - loss: 0.4357 - acc: 0.7969 - val_loss: 0.4949 - val_acc: 0.7396
Epoch 281/1500
576/576 [==============================] - 0s 137us/step - loss: 0.4356 - acc: 0.7969 - val_loss: 0.4949 - val_acc: 0.7396
Epoch 282/1500
576/576 [==============================] - 0s 120us/step - loss: 0.4355 - acc: 0.7969 - val_loss: 0.4949 - val_acc: 0.7396
Epoch 283/1500
576/576 [==============================] - 0s 127us/step - loss: 0.4353 - acc: 0.7969 - val_loss: 0.4948 - val_acc: 0.7396
Epoch 284/1500
576/576 [==============================] - 0s 128us/step - loss: 0.4353 - acc: 0.7969 - val_loss: 0.4948 - val_acc: 0.7396
Epoch 285/1500
576/576 [==============================] - 0s 115us/step - loss: 0.4351 - acc: 0.7951 - val_loss: 0.4948 - val_acc: 0.7396
Epoch 286/1500
576/576 [==============================] - 0s 142us/step - loss: 0.4350 - acc: 0.7951 - val_loss: 0.4948 - val_acc: 0.7396
Epoch 287/1500
576/576 [==============================] - 0s 128us/step - loss: 0.4348 - acc: 0.7969 - val_loss: 0.4948 - val_acc: 0.7396
Epoch 288/1500
576/576 [==============================] - 0s 121us/step - loss: 0.4347 - acc: 0.7951 - val_loss: 0.4948 - val_acc: 0.7396
Epoch 289/1500
576/576 [==============================] - 0s 134us/step - loss: 0.4346 - acc: 0.7951 - val_loss: 0.4948 - val_acc: 0.7396
Epoch 290/1500
576/576 [==============================] - 0s 142us/step - loss: 0.4344 - acc: 0.7969 - val_loss: 0.4948 - val_acc: 0.7396
Epoch 291/1500
576/576 [==============================] - 0s 146us/step - loss: 0.4343 - acc: 0.7951 - val_loss: 0.4948 - val_acc: 0.7396
Epoch 292/1500
576/576 [==============================] - 0s 139us/step - loss: 0.4342 - acc: 0.7951 - val_loss: 0.4948 - val_acc: 0.7396
Epoch 293/1500
576/576 [==============================] - 0s 142us/step - loss: 0.4341 - acc: 0.7969 - val_loss: 0.4948 - val_acc: 0.7396
Epoch 294/1500
576/576 [==============================] - 0s 149us/step - loss: 0.4340 - acc: 0.7951 - val_loss: 0.4948 - val_acc: 0.7396
Epoch 295/1500
576/576 [==============================] - 0s 137us/step - loss: 0.4339 - acc: 0.7951 - val_loss: 0.4948 - val_acc: 0.7396
Epoch 296/1500
576/576 [==============================] - 0s 142us/step - loss: 0.4338 - acc: 0.7951 - val_loss: 0.4948 - val_acc: 0.7396
Epoch 297/1500
576/576 [==============================] - 0s 113us/step - loss: 0.4336 - acc: 0.7951 - val_loss: 0.4948 - val_acc: 0.7396
Epoch 298/1500
576/576 [==============================] - 0s 132us/step - loss: 0.4335 - acc: 0.7969 - val_loss: 0.4948 - val_acc: 0.7396
Epoch 299/1500
576/576 [==============================] - 0s 137us/step - loss: 0.4334 - acc: 0.7969 - val_loss: 0.4948 - val_acc: 0.7396
Epoch 300/1500
576/576 [==============================] - 0s 127us/step - loss: 0.4332 - acc: 0.7969 - val_loss: 0.4948 - val_acc: 0.7396
Epoch 301/1500
576/576 [==============================] - 0s 121us/step - loss: 0.4332 - acc: 0.7986 - val_loss: 0.4947 - val_acc: 0.7396
Epoch 302/1500
576/576 [==============================] - 0s 141us/step - loss: 0.4330 - acc: 0.7969 - val_loss: 0.4947 - val_acc: 0.7448
Epoch 303/1500
576/576 [==============================] - 0s 106us/step - loss: 0.4329 - acc: 0.7951 - val_loss: 0.4947 - val_acc: 0.7448
Epoch 304/1500
576/576 [==============================] - 0s 137us/step - loss: 0.4328 - acc: 0.7986 - val_loss: 0.4947 - val_acc: 0.7396
Epoch 305/1500
576/576 [==============================] - 0s 125us/step - loss: 0.4326 - acc: 0.7986 - val_loss: 0.4947 - val_acc: 0.7448
Epoch 306/1500
576/576 [==============================] - 0s 137us/step - loss: 0.4325 - acc: 0.7986 - val_loss: 0.4947 - val_acc: 0.7448
Epoch 307/1500
576/576 [==============================] - 0s 128us/step - loss: 0.4325 - acc: 0.7969 - val_loss: 0.4947 - val_acc: 0.7448
Epoch 308/1500
576/576 [==============================] - 0s 116us/step - loss: 0.4323 - acc: 0.7986 - val_loss: 0.4947 - val_acc: 0.7448
Epoch 309/1500
576/576 [==============================] - 0s 127us/step - loss: 0.4322 - acc: 0.7986 - val_loss: 0.4947 - val_acc: 0.7448
Epoch 310/1500
576/576 [==============================] - 0s 113us/step - loss: 0.4321 - acc: 0.7986 - val_loss: 0.4946 - val_acc: 0.7448
Epoch 311/1500
576/576 [==============================] - 0s 121us/step - loss: 0.4320 - acc: 0.7986 - val_loss: 0.4946 - val_acc: 0.7448
Epoch 312/1500
576/576 [==============================] - 0s 111us/step - loss: 0.4319 - acc: 0.7986 - val_loss: 0.4946 - val_acc: 0.7448
Epoch 313/1500
576/576 [==============================] - 0s 109us/step - loss: 0.4317 - acc: 0.7986 - val_loss: 0.4946 - val_acc: 0.7448
Epoch 314/1500
576/576 [==============================] - 0s 121us/step - loss: 0.4316 - acc: 0.7986 - val_loss: 0.4946 - val_acc: 0.7448
Epoch 315/1500
576/576 [==============================] - 0s 128us/step - loss: 0.4315 - acc: 0.7986 - val_loss: 0.4946 - val_acc: 0.7448
Epoch 316/1500
576/576 [==============================] - 0s 134us/step - loss: 0.4314 - acc: 0.7986 - val_loss: 0.4946 - val_acc: 0.7448
Epoch 317/1500
576/576 [==============================] - 0s 102us/step - loss: 0.4313 - acc: 0.7986 - val_loss: 0.4946 - val_acc: 0.7448
Epoch 318/1500
576/576 [==============================] - 0s 123us/step - loss: 0.4312 - acc: 0.7986 - val_loss: 0.4946 - val_acc: 0.7448
Epoch 319/1500
576/576 [==============================] - 0s 116us/step - loss: 0.4311 - acc: 0.7986 - val_loss: 0.4946 - val_acc: 0.7448
Epoch 320/1500
576/576 [==============================] - 0s 95us/step - loss: 0.4310 - acc: 0.7986 - val_loss: 0.4946 - val_acc: 0.7448
Epoch 321/1500
576/576 [==============================] - 0s 121us/step - loss: 0.4309 - acc: 0.7986 - val_loss: 0.4946 - val_acc: 0.7448
Epoch 322/1500
576/576 [==============================] - 0s 101us/step - loss: 0.4307 - acc: 0.7986 - val_loss: 0.4946 - val_acc: 0.7448
Epoch 323/1500
576/576 [==============================] - 0s 108us/step - loss: 0.4307 - acc: 0.7986 - val_loss: 0.4946 - val_acc: 0.7448
Epoch 324/1500
576/576 [==============================] - 0s 115us/step - loss: 0.4305 - acc: 0.7986 - val_loss: 0.4946 - val_acc: 0.7448
Epoch 325/1500
576/576 [==============================] - 0s 113us/step - loss: 0.4304 - acc: 0.7986 - val_loss: 0.4946 - val_acc: 0.7500
Epoch 326/1500
576/576 [==============================] - 0s 147us/step - loss: 0.4303 - acc: 0.7986 - val_loss: 0.4946 - val_acc: 0.7500
Epoch 327/1500
576/576 [==============================] - 0s 141us/step - loss: 0.4302 - acc: 0.7986 - val_loss: 0.4946 - val_acc: 0.7500
Epoch 328/1500
576/576 [==============================] - 0s 113us/step - loss: 0.4301 - acc: 0.7986 - val_loss: 0.4946 - val_acc: 0.7500
Epoch 329/1500
576/576 [==============================] - 0s 149us/step - loss: 0.4300 - acc: 0.7986 - val_loss: 0.4946 - val_acc: 0.7552
Epoch 330/1500
576/576 [==============================] - 0s 128us/step - loss: 0.4298 - acc: 0.7986 - val_loss: 0.4946 - val_acc: 0.7552
Epoch 331/1500
576/576 [==============================] - 0s 132us/step - loss: 0.4297 - acc: 0.7986 - val_loss: 0.4946 - val_acc: 0.7552
Epoch 332/1500
576/576 [==============================] - 0s 142us/step - loss: 0.4296 - acc: 0.7986 - val_loss: 0.4946 - val_acc: 0.7552
Epoch 333/1500
576/576 [==============================] - 0s 142us/step - loss: 0.4295 - acc: 0.7986 - val_loss: 0.4946 - val_acc: 0.7552
Epoch 334/1500
576/576 [==============================] - 0s 125us/step - loss: 0.4294 - acc: 0.7986 - val_loss: 0.4946 - val_acc: 0.7552
Epoch 335/1500
576/576 [==============================] - 0s 151us/step - loss: 0.4293 - acc: 0.7986 - val_loss: 0.4946 - val_acc: 0.7552
Epoch 336/1500
576/576 [==============================] - 0s 135us/step - loss: 0.4292 - acc: 0.7986 - val_loss: 0.4946 - val_acc: 0.7552
Epoch 337/1500
576/576 [==============================] - 0s 127us/step - loss: 0.4292 - acc: 0.8003 - val_loss: 0.4945 - val_acc: 0.7552
Epoch 338/1500
576/576 [==============================] - 0s 134us/step - loss: 0.4291 - acc: 0.7986 - val_loss: 0.4945 - val_acc: 0.7552
Epoch 339/1500
576/576 [==============================] - 0s 128us/step - loss: 0.4290 - acc: 0.7986 - val_loss: 0.4945 - val_acc: 0.7552
Epoch 340/1500
576/576 [==============================] - 0s 132us/step - loss: 0.4288 - acc: 0.8003 - val_loss: 0.4945 - val_acc: 0.7552
Epoch 341/1500
576/576 [==============================] - 0s 141us/step - loss: 0.4287 - acc: 0.8003 - val_loss: 0.4945 - val_acc: 0.7552
Epoch 342/1500
576/576 [==============================] - 0s 104us/step - loss: 0.4286 - acc: 0.7986 - val_loss: 0.4946 - val_acc: 0.7552
Epoch 343/1500
576/576 [==============================] - 0s 144us/step - loss: 0.4285 - acc: 0.8003 - val_loss: 0.4946 - val_acc: 0.7552
Epoch 344/1500
576/576 [==============================] - 0s 127us/step - loss: 0.4284 - acc: 0.8003 - val_loss: 0.4945 - val_acc: 0.7552
Epoch 345/1500
576/576 [==============================] - 0s 102us/step - loss: 0.4283 - acc: 0.8003 - val_loss: 0.4945 - val_acc: 0.7552
Epoch 346/1500
576/576 [==============================] - 0s 106us/step - loss: 0.4282 - acc: 0.8003 - val_loss: 0.4945 - val_acc: 0.7552
Epoch 347/1500
576/576 [==============================] - 0s 118us/step - loss: 0.4282 - acc: 0.8003 - val_loss: 0.4945 - val_acc: 0.7552
Epoch 348/1500
576/576 [==============================] - 0s 123us/step - loss: 0.4280 - acc: 0.8003 - val_loss: 0.4945 - val_acc: 0.7552
Epoch 349/1500
576/576 [==============================] - 0s 141us/step - loss: 0.4279 - acc: 0.8003 - val_loss: 0.4945 - val_acc: 0.7552
Epoch 350/1500
576/576 [==============================] - 0s 102us/step - loss: 0.4279 - acc: 0.8003 - val_loss: 0.4945 - val_acc: 0.7552
Epoch 351/1500
576/576 [==============================] - 0s 125us/step - loss: 0.4277 - acc: 0.8021 - val_loss: 0.4945 - val_acc: 0.7552
Epoch 352/1500
576/576 [==============================] - 0s 120us/step - loss: 0.4276 - acc: 0.8003 - val_loss: 0.4945 - val_acc: 0.7552
Epoch 353/1500
576/576 [==============================] - 0s 101us/step - loss: 0.4276 - acc: 0.8021 - val_loss: 0.4945 - val_acc: 0.7552
Epoch 354/1500
576/576 [==============================] - 0s 151us/step - loss: 0.4275 - acc: 0.8003 - val_loss: 0.4945 - val_acc: 0.7552
Epoch 355/1500
576/576 [==============================] - 0s 132us/step - loss: 0.4274 - acc: 0.8003 - val_loss: 0.4945 - val_acc: 0.7552
Epoch 356/1500
576/576 [==============================] - 0s 120us/step - loss: 0.4273 - acc: 0.8003 - val_loss: 0.4945 - val_acc: 0.7552
Epoch 357/1500
576/576 [==============================] - 0s 137us/step - loss: 0.4272 - acc: 0.8038 - val_loss: 0.4945 - val_acc: 0.7552
Epoch 358/1500
576/576 [==============================] - 0s 121us/step - loss: 0.4271 - acc: 0.8003 - val_loss: 0.4945 - val_acc: 0.7552
Epoch 359/1500
576/576 [==============================] - 0s 135us/step - loss: 0.4270 - acc: 0.8003 - val_loss: 0.4945 - val_acc: 0.7552
Epoch 360/1500
576/576 [==============================] - 0s 109us/step - loss: 0.4269 - acc: 0.8003 - val_loss: 0.4945 - val_acc: 0.7552
Epoch 361/1500
576/576 [==============================] - 0s 134us/step - loss: 0.4268 - acc: 0.7986 - val_loss: 0.4945 - val_acc: 0.7552
Epoch 362/1500
576/576 [==============================] - 0s 109us/step - loss: 0.4267 - acc: 0.7986 - val_loss: 0.4945 - val_acc: 0.7552
Epoch 363/1500
576/576 [==============================] - 0s 109us/step - loss: 0.4266 - acc: 0.8003 - val_loss: 0.4945 - val_acc: 0.7552
Epoch 364/1500
576/576 [==============================] - 0s 135us/step - loss: 0.4265 - acc: 0.8038 - val_loss: 0.4945 - val_acc: 0.7552
Epoch 365/1500
576/576 [==============================] - 0s 139us/step - loss: 0.4264 - acc: 0.8021 - val_loss: 0.4945 - val_acc: 0.7552
Epoch 366/1500
576/576 [==============================] - 0s 109us/step - loss: 0.4264 - acc: 0.8038 - val_loss: 0.4945 - val_acc: 0.7552
Epoch 367/1500
576/576 [==============================] - 0s 142us/step - loss: 0.4262 - acc: 0.8038 - val_loss: 0.4945 - val_acc: 0.7604
Epoch 368/1500
576/576 [==============================] - 0s 118us/step - loss: 0.4262 - acc: 0.8021 - val_loss: 0.4945 - val_acc: 0.7604
Epoch 369/1500
576/576 [==============================] - 0s 130us/step - loss: 0.4261 - acc: 0.8021 - val_loss: 0.4945 - val_acc: 0.7604
Epoch 370/1500
576/576 [==============================] - 0s 109us/step - loss: 0.4260 - acc: 0.8021 - val_loss: 0.4945 - val_acc: 0.7604
Epoch 371/1500
576/576 [==============================] - 0s 113us/step - loss: 0.4259 - acc: 0.8003 - val_loss: 0.4945 - val_acc: 0.7604
Epoch 372/1500
576/576 [==============================] - 0s 127us/step - loss: 0.4258 - acc: 0.8003 - val_loss: 0.4945 - val_acc: 0.7604
Epoch 373/1500
576/576 [==============================] - 0s 116us/step - loss: 0.4257 - acc: 0.8021 - val_loss: 0.4945 - val_acc: 0.7604
Epoch 374/1500
576/576 [==============================] - 0s 120us/step - loss: 0.4257 - acc: 0.8021 - val_loss: 0.4945 - val_acc: 0.7604
Epoch 375/1500
576/576 [==============================] - 0s 120us/step - loss: 0.4256 - acc: 0.8038 - val_loss: 0.4945 - val_acc: 0.7604
Epoch 376/1500
576/576 [==============================] - 0s 134us/step - loss: 0.4255 - acc: 0.8021 - val_loss: 0.4945 - val_acc: 0.7604
Epoch 377/1500
576/576 [==============================] - 0s 128us/step - loss: 0.4254 - acc: 0.8021 - val_loss: 0.4945 - val_acc: 0.7604
Epoch 378/1500
576/576 [==============================] - 0s 115us/step - loss: 0.4253 - acc: 0.7986 - val_loss: 0.4946 - val_acc: 0.7604
Epoch 379/1500
576/576 [==============================] - 0s 111us/step - loss: 0.4252 - acc: 0.8021 - val_loss: 0.4946 - val_acc: 0.7604
Epoch 380/1500
576/576 [==============================] - 0s 109us/step - loss: 0.4251 - acc: 0.8021 - val_loss: 0.4946 - val_acc: 0.7604
Epoch 381/1500
576/576 [==============================] - 0s 113us/step - loss: 0.4251 - acc: 0.8021 - val_loss: 0.4946 - val_acc: 0.7604
Epoch 382/1500
576/576 [==============================] - 0s 135us/step - loss: 0.4250 - acc: 0.8021 - val_loss: 0.4946 - val_acc: 0.7604
Epoch 383/1500
576/576 [==============================] - 0s 161us/step - loss: 0.4249 - acc: 0.8021 - val_loss: 0.4946 - val_acc: 0.7604
Epoch 384/1500
576/576 [==============================] - 0s 135us/step - loss: 0.4248 - acc: 0.8021 - val_loss: 0.4946 - val_acc: 0.7604
Epoch 385/1500
576/576 [==============================] - 0s 128us/step - loss: 0.4247 - acc: 0.8021 - val_loss: 0.4946 - val_acc: 0.7604
Epoch 386/1500
576/576 [==============================] - 0s 128us/step - loss: 0.4246 - acc: 0.8021 - val_loss: 0.4946 - val_acc: 0.7604
Epoch 387/1500
576/576 [==============================] - 0s 137us/step - loss: 0.4245 - acc: 0.8003 - val_loss: 0.4946 - val_acc: 0.7604
Epoch 388/1500
576/576 [==============================] - 0s 135us/step - loss: 0.4244 - acc: 0.8003 - val_loss: 0.4946 - val_acc: 0.7604
Epoch 389/1500
576/576 [==============================] - 0s 116us/step - loss: 0.4243 - acc: 0.8038 - val_loss: 0.4946 - val_acc: 0.7604
Epoch 390/1500
576/576 [==============================] - 0s 142us/step - loss: 0.4243 - acc: 0.8021 - val_loss: 0.4946 - val_acc: 0.7604
Epoch 391/1500
576/576 [==============================] - ETA: 0s - loss: 0.4264 - acc: 0.797 - 0s 137us/step - loss: 0.4242 - acc: 0.8021 - val_loss: 0.4946 - val_acc: 0.7604
Epoch 392/1500
576/576 [==============================] - 0s 127us/step - loss: 0.4241 - acc: 0.8021 - val_loss: 0.4947 - val_acc: 0.7604
Epoch 393/1500
576/576 [==============================] - 0s 134us/step - loss: 0.4240 - acc: 0.8003 - val_loss: 0.4947 - val_acc: 0.7604
Epoch 394/1500
576/576 [==============================] - 0s 154us/step - loss: 0.4239 - acc: 0.8021 - val_loss: 0.4947 - val_acc: 0.7604
Epoch 395/1500
576/576 [==============================] - 0s 134us/step - loss: 0.4239 - acc: 0.8003 - val_loss: 0.4947 - val_acc: 0.7604
Epoch 396/1500
576/576 [==============================] - 0s 144us/step - loss: 0.4238 - acc: 0.8021 - val_loss: 0.4947 - val_acc: 0.7604
Epoch 397/1500
576/576 [==============================] - 0s 111us/step - loss: 0.4237 - acc: 0.8056 - val_loss: 0.4947 - val_acc: 0.7604
Epoch 398/1500
576/576 [==============================] - 0s 147us/step - loss: 0.4236 - acc: 0.8056 - val_loss: 0.4947 - val_acc: 0.7604
Epoch 399/1500
576/576 [==============================] - 0s 128us/step - loss: 0.4236 - acc: 0.8003 - val_loss: 0.4947 - val_acc: 0.7604
Epoch 400/1500
576/576 [==============================] - 0s 123us/step - loss: 0.4235 - acc: 0.8021 - val_loss: 0.4947 - val_acc: 0.7604
Epoch 401/1500
576/576 [==============================] - 0s 139us/step - loss: 0.4234 - acc: 0.8038 - val_loss: 0.4947 - val_acc: 0.7604
Epoch 402/1500
576/576 [==============================] - 0s 134us/step - loss: 0.4233 - acc: 0.8038 - val_loss: 0.4947 - val_acc: 0.7604
Epoch 403/1500
576/576 [==============================] - 0s 125us/step - loss: 0.4233 - acc: 0.8038 - val_loss: 0.4947 - val_acc: 0.7604
Epoch 404/1500
576/576 [==============================] - 0s 116us/step - loss: 0.4232 - acc: 0.8038 - val_loss: 0.4948 - val_acc: 0.7604
Epoch 405/1500
576/576 [==============================] - 0s 141us/step - loss: 0.4231 - acc: 0.8056 - val_loss: 0.4948 - val_acc: 0.7604
Epoch 406/1500
576/576 [==============================] - 0s 146us/step - loss: 0.4230 - acc: 0.8056 - val_loss: 0.4948 - val_acc: 0.7604
Epoch 407/1500
576/576 [==============================] - 0s 127us/step - loss: 0.4229 - acc: 0.8056 - val_loss: 0.4948 - val_acc: 0.7604
Epoch 408/1500
576/576 [==============================] - 0s 135us/step - loss: 0.4229 - acc: 0.8056 - val_loss: 0.4948 - val_acc: 0.7604
Epoch 409/1500
576/576 [==============================] - 0s 116us/step - loss: 0.4228 - acc: 0.8056 - val_loss: 0.4948 - val_acc: 0.7604
Epoch 410/1500
576/576 [==============================] - 0s 125us/step - loss: 0.4227 - acc: 0.8056 - val_loss: 0.4948 - val_acc: 0.7604
Epoch 411/1500
576/576 [==============================] - 0s 141us/step - loss: 0.4226 - acc: 0.8056 - val_loss: 0.4948 - val_acc: 0.7604
Epoch 412/1500
576/576 [==============================] - 0s 109us/step - loss: 0.4226 - acc: 0.8056 - val_loss: 0.4948 - val_acc: 0.7604
Epoch 413/1500
576/576 [==============================] - 0s 135us/step - loss: 0.4225 - acc: 0.8056 - val_loss: 0.4948 - val_acc: 0.7604
Epoch 414/1500
576/576 [==============================] - 0s 137us/step - loss: 0.4224 - acc: 0.8056 - val_loss: 0.4948 - val_acc: 0.7604
Epoch 415/1500
576/576 [==============================] - 0s 127us/step - loss: 0.4223 - acc: 0.8056 - val_loss: 0.4948 - val_acc: 0.7604
Epoch 416/1500
576/576 [==============================] - 0s 118us/step - loss: 0.4223 - acc: 0.8056 - val_loss: 0.4949 - val_acc: 0.7604
Epoch 417/1500
576/576 [==============================] - 0s 135us/step - loss: 0.4222 - acc: 0.8056 - val_loss: 0.4948 - val_acc: 0.7604
Epoch 418/1500
576/576 [==============================] - 0s 113us/step - loss: 0.4221 - acc: 0.8056 - val_loss: 0.4948 - val_acc: 0.7604
Epoch 419/1500
576/576 [==============================] - 0s 135us/step - loss: 0.4220 - acc: 0.8056 - val_loss: 0.4948 - val_acc: 0.7604
Epoch 420/1500
576/576 [==============================] - 0s 134us/step - loss: 0.4219 - acc: 0.8056 - val_loss: 0.4949 - val_acc: 0.7604
Epoch 421/1500
576/576 [==============================] - 0s 135us/step - loss: 0.4218 - acc: 0.8056 - val_loss: 0.4949 - val_acc: 0.7604
Epoch 422/1500
576/576 [==============================] - 0s 116us/step - loss: 0.4218 - acc: 0.8056 - val_loss: 0.4949 - val_acc: 0.7604
Epoch 423/1500
576/576 [==============================] - 0s 139us/step - loss: 0.4217 - acc: 0.8056 - val_loss: 0.4949 - val_acc: 0.7604
Epoch 424/1500
576/576 [==============================] - 0s 137us/step - loss: 0.4216 - acc: 0.8056 - val_loss: 0.4949 - val_acc: 0.7604
Epoch 425/1500
576/576 [==============================] - 0s 128us/step - loss: 0.4215 - acc: 0.8056 - val_loss: 0.4949 - val_acc: 0.7604
Epoch 426/1500
576/576 [==============================] - 0s 118us/step - loss: 0.4215 - acc: 0.8056 - val_loss: 0.4949 - val_acc: 0.7604
Epoch 427/1500
576/576 [==============================] - 0s 132us/step - loss: 0.4214 - acc: 0.8056 - val_loss: 0.4949 - val_acc: 0.7604
Epoch 428/1500
576/576 [==============================] - 0s 121us/step - loss: 0.4214 - acc: 0.8056 - val_loss: 0.4949 - val_acc: 0.7604
Epoch 429/1500
576/576 [==============================] - 0s 101us/step - loss: 0.4213 - acc: 0.8056 - val_loss: 0.4949 - val_acc: 0.7604
Epoch 430/1500
576/576 [==============================] - 0s 113us/step - loss: 0.4211 - acc: 0.8056 - val_loss: 0.4949 - val_acc: 0.7604
Epoch 431/1500
576/576 [==============================] - 0s 113us/step - loss: 0.4210 - acc: 0.8056 - val_loss: 0.4949 - val_acc: 0.7604
Epoch 432/1500
576/576 [==============================] - 0s 106us/step - loss: 0.4210 - acc: 0.8056 - val_loss: 0.4949 - val_acc: 0.7604
Epoch 433/1500
576/576 [==============================] - 0s 130us/step - loss: 0.4210 - acc: 0.8056 - val_loss: 0.4949 - val_acc: 0.7604
Epoch 434/1500
576/576 [==============================] - 0s 113us/step - loss: 0.4209 - acc: 0.8056 - val_loss: 0.4949 - val_acc: 0.7604
Epoch 435/1500
576/576 [==============================] - 0s 115us/step - loss: 0.4208 - acc: 0.8056 - val_loss: 0.4950 - val_acc: 0.7604
Epoch 436/1500
576/576 [==============================] - 0s 106us/step - loss: 0.4207 - acc: 0.8073 - val_loss: 0.4950 - val_acc: 0.7604
Epoch 437/1500
576/576 [==============================] - 0s 123us/step - loss: 0.4206 - acc: 0.8073 - val_loss: 0.4950 - val_acc: 0.7604
Epoch 438/1500
576/576 [==============================] - 0s 108us/step - loss: 0.4205 - acc: 0.8073 - val_loss: 0.4950 - val_acc: 0.7604
Epoch 439/1500
576/576 [==============================] - 0s 111us/step - loss: 0.4204 - acc: 0.8073 - val_loss: 0.4950 - val_acc: 0.7604
Epoch 440/1500
576/576 [==============================] - 0s 137us/step - loss: 0.4204 - acc: 0.8073 - val_loss: 0.4950 - val_acc: 0.7604
Epoch 441/1500
576/576 [==============================] - 0s 127us/step - loss: 0.4203 - acc: 0.8073 - val_loss: 0.4950 - val_acc: 0.7604
Epoch 442/1500
576/576 [==============================] - 0s 102us/step - loss: 0.4202 - acc: 0.8073 - val_loss: 0.4950 - val_acc: 0.7604
Epoch 443/1500
576/576 [==============================] - 0s 104us/step - loss: 0.4201 - acc: 0.8073 - val_loss: 0.4951 - val_acc: 0.7604
Epoch 444/1500
576/576 [==============================] - 0s 115us/step - loss: 0.4201 - acc: 0.8073 - val_loss: 0.4951 - val_acc: 0.7604
Epoch 445/1500
576/576 [==============================] - 0s 132us/step - loss: 0.4200 - acc: 0.8073 - val_loss: 0.4951 - val_acc: 0.7604
Epoch 446/1500
576/576 [==============================] - 0s 111us/step - loss: 0.4199 - acc: 0.8073 - val_loss: 0.4951 - val_acc: 0.7604
Epoch 447/1500
576/576 [==============================] - 0s 104us/step - loss: 0.4198 - acc: 0.8073 - val_loss: 0.4951 - val_acc: 0.7604
Epoch 448/1500
576/576 [==============================] - 0s 106us/step - loss: 0.4198 - acc: 0.8073 - val_loss: 0.4951 - val_acc: 0.7604
Epoch 449/1500
576/576 [==============================] - 0s 104us/step - loss: 0.4197 - acc: 0.8073 - val_loss: 0.4951 - val_acc: 0.7604
Epoch 450/1500
576/576 [==============================] - 0s 106us/step - loss: 0.4196 - acc: 0.8073 - val_loss: 0.4951 - val_acc: 0.7604
Epoch 451/1500
576/576 [==============================] - 0s 111us/step - loss: 0.4195 - acc: 0.8073 - val_loss: 0.4951 - val_acc: 0.7604
Epoch 452/1500
576/576 [==============================] - 0s 128us/step - loss: 0.4194 - acc: 0.8073 - val_loss: 0.4952 - val_acc: 0.7604
Epoch 453/1500
576/576 [==============================] - 0s 102us/step - loss: 0.4194 - acc: 0.8073 - val_loss: 0.4952 - val_acc: 0.7604
Epoch 454/1500
576/576 [==============================] - 0s 125us/step - loss: 0.4193 - acc: 0.8073 - val_loss: 0.4952 - val_acc: 0.7604
Epoch 455/1500
576/576 [==============================] - 0s 99us/step - loss: 0.4192 - acc: 0.8073 - val_loss: 0.4952 - val_acc: 0.7604
Epoch 456/1500
576/576 [==============================] - 0s 111us/step - loss: 0.4191 - acc: 0.8073 - val_loss: 0.4952 - val_acc: 0.7604
Epoch 457/1500
576/576 [==============================] - 0s 104us/step - loss: 0.4191 - acc: 0.8073 - val_loss: 0.4952 - val_acc: 0.7604
Epoch 458/1500
576/576 [==============================] - 0s 116us/step - loss: 0.4190 - acc: 0.8073 - val_loss: 0.4952 - val_acc: 0.7604
Epoch 459/1500
576/576 [==============================] - 0s 108us/step - loss: 0.4188 - acc: 0.8073 - val_loss: 0.4952 - val_acc: 0.7604
Epoch 460/1500
576/576 [==============================] - 0s 127us/step - loss: 0.4188 - acc: 0.8073 - val_loss: 0.4952 - val_acc: 0.7604
Epoch 461/1500
576/576 [==============================] - 0s 101us/step - loss: 0.4188 - acc: 0.8073 - val_loss: 0.4952 - val_acc: 0.7604
Epoch 462/1500
576/576 [==============================] - 0s 108us/step - loss: 0.4186 - acc: 0.8073 - val_loss: 0.4952 - val_acc: 0.7604
Epoch 463/1500
576/576 [==============================] - 0s 109us/step - loss: 0.4185 - acc: 0.8073 - val_loss: 0.4953 - val_acc: 0.7604
Epoch 464/1500
576/576 [==============================] - 0s 113us/step - loss: 0.4185 - acc: 0.8073 - val_loss: 0.4953 - val_acc: 0.7604
Epoch 465/1500
576/576 [==============================] - 0s 101us/step - loss: 0.4184 - acc: 0.8073 - val_loss: 0.4953 - val_acc: 0.7604
Epoch 466/1500
576/576 [==============================] - 0s 113us/step - loss: 0.4184 - acc: 0.8073 - val_loss: 0.4953 - val_acc: 0.7604
Epoch 467/1500
576/576 [==============================] - 0s 106us/step - loss: 0.4183 - acc: 0.8073 - val_loss: 0.4953 - val_acc: 0.7552
Epoch 468/1500
576/576 [==============================] - 0s 102us/step - loss: 0.4182 - acc: 0.8073 - val_loss: 0.4953 - val_acc: 0.7552
Epoch 469/1500
576/576 [==============================] - 0s 123us/step - loss: 0.4181 - acc: 0.8073 - val_loss: 0.4954 - val_acc: 0.7552
Epoch 470/1500
576/576 [==============================] - 0s 141us/step - loss: 0.4180 - acc: 0.8073 - val_loss: 0.4954 - val_acc: 0.7552
Epoch 471/1500
576/576 [==============================] - 0s 111us/step - loss: 0.4179 - acc: 0.8073 - val_loss: 0.4954 - val_acc: 0.7552
Epoch 472/1500
576/576 [==============================] - 0s 109us/step - loss: 0.4178 - acc: 0.8073 - val_loss: 0.4954 - val_acc: 0.7552
Epoch 473/1500
576/576 [==============================] - 0s 120us/step - loss: 0.4178 - acc: 0.8073 - val_loss: 0.4954 - val_acc: 0.7552
Epoch 474/1500
576/576 [==============================] - 0s 109us/step - loss: 0.4177 - acc: 0.8073 - val_loss: 0.4954 - val_acc: 0.7552
Epoch 475/1500
576/576 [==============================] - 0s 109us/step - loss: 0.4176 - acc: 0.8073 - val_loss: 0.4954 - val_acc: 0.7552
Epoch 476/1500
576/576 [==============================] - 0s 116us/step - loss: 0.4176 - acc: 0.8073 - val_loss: 0.4954 - val_acc: 0.7552
Epoch 477/1500
576/576 [==============================] - 0s 123us/step - loss: 0.4175 - acc: 0.8073 - val_loss: 0.4954 - val_acc: 0.7552
Epoch 478/1500
576/576 [==============================] - 0s 108us/step - loss: 0.4174 - acc: 0.8073 - val_loss: 0.4954 - val_acc: 0.7552
Epoch 479/1500
576/576 [==============================] - 0s 104us/step - loss: 0.4173 - acc: 0.8073 - val_loss: 0.4954 - val_acc: 0.7604
Epoch 480/1500
576/576 [==============================] - 0s 111us/step - loss: 0.4173 - acc: 0.8073 - val_loss: 0.4954 - val_acc: 0.7604
Epoch 481/1500
576/576 [==============================] - 0s 144us/step - loss: 0.4171 - acc: 0.8073 - val_loss: 0.4954 - val_acc: 0.7604
Epoch 482/1500
576/576 [==============================] - 0s 102us/step - loss: 0.4171 - acc: 0.8073 - val_loss: 0.4955 - val_acc: 0.7604
Epoch 483/1500
576/576 [==============================] - 0s 123us/step - loss: 0.4171 - acc: 0.8073 - val_loss: 0.4955 - val_acc: 0.7604
Epoch 484/1500
576/576 [==============================] - 0s 118us/step - loss: 0.4169 - acc: 0.8073 - val_loss: 0.4955 - val_acc: 0.7604
Epoch 485/1500
576/576 [==============================] - 0s 134us/step - loss: 0.4169 - acc: 0.8073 - val_loss: 0.4955 - val_acc: 0.7604
Epoch 486/1500
576/576 [==============================] - 0s 118us/step - loss: 0.4168 - acc: 0.8073 - val_loss: 0.4955 - val_acc: 0.7604
Epoch 487/1500
576/576 [==============================] - 0s 102us/step - loss: 0.4167 - acc: 0.8073 - val_loss: 0.4955 - val_acc: 0.7604
Epoch 488/1500
576/576 [==============================] - 0s 113us/step - loss: 0.4167 - acc: 0.8073 - val_loss: 0.4955 - val_acc: 0.7604
Epoch 489/1500
576/576 [==============================] - 0s 134us/step - loss: 0.4166 - acc: 0.8073 - val_loss: 0.4955 - val_acc: 0.7604
Epoch 490/1500
576/576 [==============================] - 0s 101us/step - loss: 0.4165 - acc: 0.8073 - val_loss: 0.4955 - val_acc: 0.7604
Epoch 491/1500
576/576 [==============================] - 0s 101us/step - loss: 0.4164 - acc: 0.8073 - val_loss: 0.4955 - val_acc: 0.7604
Epoch 492/1500
576/576 [==============================] - 0s 127us/step - loss: 0.4164 - acc: 0.8073 - val_loss: 0.4955 - val_acc: 0.7604
Epoch 493/1500
576/576 [==============================] - 0s 109us/step - loss: 0.4162 - acc: 0.8073 - val_loss: 0.4955 - val_acc: 0.7604
Epoch 494/1500
576/576 [==============================] - 0s 125us/step - loss: 0.4162 - acc: 0.8073 - val_loss: 0.4956 - val_acc: 0.7604
Epoch 495/1500
576/576 [==============================] - 0s 108us/step - loss: 0.4162 - acc: 0.8073 - val_loss: 0.4956 - val_acc: 0.7604
Epoch 496/1500
576/576 [==============================] - 0s 111us/step - loss: 0.4160 - acc: 0.8073 - val_loss: 0.4956 - val_acc: 0.7604
Epoch 497/1500
576/576 [==============================] - 0s 102us/step - loss: 0.4160 - acc: 0.8073 - val_loss: 0.4956 - val_acc: 0.7604
Epoch 498/1500
576/576 [==============================] - 0s 102us/step - loss: 0.4159 - acc: 0.8073 - val_loss: 0.4956 - val_acc: 0.7604
Epoch 499/1500
576/576 [==============================] - 0s 116us/step - loss: 0.4158 - acc: 0.8073 - val_loss: 0.4956 - val_acc: 0.7604
Epoch 500/1500
576/576 [==============================] - 0s 116us/step - loss: 0.4158 - acc: 0.8073 - val_loss: 0.4956 - val_acc: 0.7604
Epoch 501/1500
576/576 [==============================] - 0s 113us/step - loss: 0.4156 - acc: 0.8073 - val_loss: 0.4956 - val_acc: 0.7604
Epoch 502/1500
576/576 [==============================] - 0s 127us/step - loss: 0.4156 - acc: 0.8073 - val_loss: 0.4956 - val_acc: 0.7604
Epoch 503/1500
576/576 [==============================] - 0s 132us/step - loss: 0.4156 - acc: 0.8073 - val_loss: 0.4956 - val_acc: 0.7604
Epoch 504/1500
576/576 [==============================] - 0s 102us/step - loss: 0.4155 - acc: 0.8073 - val_loss: 0.4956 - val_acc: 0.7604
Epoch 505/1500
576/576 [==============================] - 0s 99us/step - loss: 0.4154 - acc: 0.8073 - val_loss: 0.4956 - val_acc: 0.7604
Epoch 506/1500
576/576 [==============================] - 0s 109us/step - loss: 0.4153 - acc: 0.8073 - val_loss: 0.4957 - val_acc: 0.7604
Epoch 507/1500
576/576 [==============================] - 0s 108us/step - loss: 0.4152 - acc: 0.8073 - val_loss: 0.4956 - val_acc: 0.7604
Epoch 508/1500
576/576 [==============================] - 0s 102us/step - loss: 0.4152 - acc: 0.8073 - val_loss: 0.4956 - val_acc: 0.7604
Epoch 509/1500
576/576 [==============================] - 0s 106us/step - loss: 0.4151 - acc: 0.8073 - val_loss: 0.4957 - val_acc: 0.7604
Epoch 510/1500
576/576 [==============================] - 0s 102us/step - loss: 0.4150 - acc: 0.8073 - val_loss: 0.4957 - val_acc: 0.7604
Epoch 511/1500
576/576 [==============================] - 0s 108us/step - loss: 0.4150 - acc: 0.8073 - val_loss: 0.4956 - val_acc: 0.7604
Epoch 512/1500
576/576 [==============================] - 0s 104us/step - loss: 0.4149 - acc: 0.8073 - val_loss: 0.4957 - val_acc: 0.7604
Epoch 513/1500
576/576 [==============================] - 0s 111us/step - loss: 0.4148 - acc: 0.8073 - val_loss: 0.4957 - val_acc: 0.7604
Epoch 514/1500
576/576 [==============================] - 0s 113us/step - loss: 0.4147 - acc: 0.8073 - val_loss: 0.4956 - val_acc: 0.7604
Epoch 515/1500
576/576 [==============================] - 0s 111us/step - loss: 0.4147 - acc: 0.8073 - val_loss: 0.4957 - val_acc: 0.7604
Epoch 516/1500
576/576 [==============================] - 0s 158us/step - loss: 0.4146 - acc: 0.8073 - val_loss: 0.4957 - val_acc: 0.7604
Epoch 517/1500
576/576 [==============================] - 0s 104us/step - loss: 0.4146 - acc: 0.8073 - val_loss: 0.4957 - val_acc: 0.7604
Epoch 518/1500
576/576 [==============================] - 0s 95us/step - loss: 0.4144 - acc: 0.8073 - val_loss: 0.4957 - val_acc: 0.7604
Epoch 519/1500
576/576 [==============================] - 0s 102us/step - loss: 0.4144 - acc: 0.8073 - val_loss: 0.4957 - val_acc: 0.7604
Epoch 520/1500
576/576 [==============================] - 0s 95us/step - loss: 0.4143 - acc: 0.8073 - val_loss: 0.4957 - val_acc: 0.7604
Epoch 521/1500
576/576 [==============================] - 0s 102us/step - loss: 0.4142 - acc: 0.8073 - val_loss: 0.4957 - val_acc: 0.7604
Epoch 522/1500
576/576 [==============================] - 0s 101us/step - loss: 0.4142 - acc: 0.8073 - val_loss: 0.4957 - val_acc: 0.7604
Epoch 523/1500
576/576 [==============================] - 0s 106us/step - loss: 0.4141 - acc: 0.8073 - val_loss: 0.4957 - val_acc: 0.7604
Epoch 524/1500
576/576 [==============================] - 0s 101us/step - loss: 0.4141 - acc: 0.8073 - val_loss: 0.4957 - val_acc: 0.7604
Epoch 525/1500
576/576 [==============================] - 0s 99us/step - loss: 0.4140 - acc: 0.8073 - val_loss: 0.4957 - val_acc: 0.7604
Epoch 526/1500
576/576 [==============================] - 0s 111us/step - loss: 0.4139 - acc: 0.8073 - val_loss: 0.4957 - val_acc: 0.7604
Epoch 527/1500
576/576 [==============================] - 0s 108us/step - loss: 0.4138 - acc: 0.8073 - val_loss: 0.4957 - val_acc: 0.7604
Epoch 528/1500
576/576 [==============================] - 0s 125us/step - loss: 0.4137 - acc: 0.8073 - val_loss: 0.4957 - val_acc: 0.7604
Epoch 529/1500
576/576 [==============================] - 0s 99us/step - loss: 0.4137 - acc: 0.8073 - val_loss: 0.4958 - val_acc: 0.7604
Epoch 530/1500
576/576 [==============================] - 0s 99us/step - loss: 0.4136 - acc: 0.8073 - val_loss: 0.4958 - val_acc: 0.7604
Epoch 531/1500
576/576 [==============================] - 0s 111us/step - loss: 0.4135 - acc: 0.8073 - val_loss: 0.4958 - val_acc: 0.7604
Epoch 532/1500
576/576 [==============================] - 0s 113us/step - loss: 0.4135 - acc: 0.8073 - val_loss: 0.4958 - val_acc: 0.7604
Epoch 533/1500
576/576 [==============================] - 0s 102us/step - loss: 0.4134 - acc: 0.8073 - val_loss: 0.4958 - val_acc: 0.7604
Epoch 534/1500
576/576 [==============================] - 0s 111us/step - loss: 0.4133 - acc: 0.8056 - val_loss: 0.4958 - val_acc: 0.7604
Epoch 535/1500
576/576 [==============================] - 0s 108us/step - loss: 0.4132 - acc: 0.8073 - val_loss: 0.4958 - val_acc: 0.7552
Epoch 536/1500
576/576 [==============================] - 0s 113us/step - loss: 0.4132 - acc: 0.8090 - val_loss: 0.4958 - val_acc: 0.7552
Epoch 537/1500
576/576 [==============================] - 0s 106us/step - loss: 0.4131 - acc: 0.8073 - val_loss: 0.4958 - val_acc: 0.7552
Epoch 538/1500
576/576 [==============================] - 0s 111us/step - loss: 0.4130 - acc: 0.8073 - val_loss: 0.4958 - val_acc: 0.7552
Epoch 539/1500
576/576 [==============================] - 0s 116us/step - loss: 0.4130 - acc: 0.8073 - val_loss: 0.4958 - val_acc: 0.7552
Epoch 540/1500
576/576 [==============================] - 0s 132us/step - loss: 0.4128 - acc: 0.8073 - val_loss: 0.4958 - val_acc: 0.7552
Epoch 541/1500
576/576 [==============================] - 0s 125us/step - loss: 0.4128 - acc: 0.8073 - val_loss: 0.4958 - val_acc: 0.7552
Epoch 542/1500
576/576 [==============================] - 0s 127us/step - loss: 0.4128 - acc: 0.8056 - val_loss: 0.4959 - val_acc: 0.7552
Epoch 543/1500
576/576 [==============================] - 0s 127us/step - loss: 0.4126 - acc: 0.8073 - val_loss: 0.4959 - val_acc: 0.7552
Epoch 544/1500
576/576 [==============================] - 0s 106us/step - loss: 0.4125 - acc: 0.8056 - val_loss: 0.4959 - val_acc: 0.7552
Epoch 545/1500
576/576 [==============================] - 0s 160us/step - loss: 0.4125 - acc: 0.8056 - val_loss: 0.4959 - val_acc: 0.7552
Epoch 546/1500
576/576 [==============================] - 0s 113us/step - loss: 0.4125 - acc: 0.8073 - val_loss: 0.4959 - val_acc: 0.7552
Epoch 547/1500
576/576 [==============================] - 0s 134us/step - loss: 0.4123 - acc: 0.8090 - val_loss: 0.4959 - val_acc: 0.7552
Epoch 548/1500
576/576 [==============================] - 0s 118us/step - loss: 0.4123 - acc: 0.8056 - val_loss: 0.4959 - val_acc: 0.7552
Epoch 549/1500
576/576 [==============================] - 0s 118us/step - loss: 0.4122 - acc: 0.8090 - val_loss: 0.4959 - val_acc: 0.7552
Epoch 550/1500
576/576 [==============================] - 0s 106us/step - loss: 0.4121 - acc: 0.8073 - val_loss: 0.4959 - val_acc: 0.7552
Epoch 551/1500
576/576 [==============================] - 0s 109us/step - loss: 0.4121 - acc: 0.8090 - val_loss: 0.4959 - val_acc: 0.7552
Epoch 552/1500
576/576 [==============================] - 0s 104us/step - loss: 0.4119 - acc: 0.8090 - val_loss: 0.4959 - val_acc: 0.7552
Epoch 553/1500
576/576 [==============================] - 0s 101us/step - loss: 0.4119 - acc: 0.8090 - val_loss: 0.4959 - val_acc: 0.7552
Epoch 554/1500
576/576 [==============================] - 0s 99us/step - loss: 0.4118 - acc: 0.8073 - val_loss: 0.4959 - val_acc: 0.7552
Epoch 555/1500
576/576 [==============================] - 0s 108us/step - loss: 0.4118 - acc: 0.8090 - val_loss: 0.4959 - val_acc: 0.7552
Epoch 556/1500
576/576 [==============================] - 0s 102us/step - loss: 0.4117 - acc: 0.8090 - val_loss: 0.4959 - val_acc: 0.7552
Epoch 557/1500
576/576 [==============================] - 0s 115us/step - loss: 0.4116 - acc: 0.8108 - val_loss: 0.4960 - val_acc: 0.7552
Epoch 558/1500
576/576 [==============================] - 0s 108us/step - loss: 0.4115 - acc: 0.8090 - val_loss: 0.4960 - val_acc: 0.7552
Epoch 559/1500
576/576 [==============================] - 0s 102us/step - loss: 0.4115 - acc: 0.8090 - val_loss: 0.4960 - val_acc: 0.7552
Epoch 560/1500
576/576 [==============================] - 0s 120us/step - loss: 0.4114 - acc: 0.8090 - val_loss: 0.4960 - val_acc: 0.7552
Epoch 561/1500
576/576 [==============================] - 0s 104us/step - loss: 0.4113 - acc: 0.8108 - val_loss: 0.4960 - val_acc: 0.7552
Epoch 562/1500
576/576 [==============================] - 0s 106us/step - loss: 0.4112 - acc: 0.8090 - val_loss: 0.4960 - val_acc: 0.7552
Epoch 563/1500
576/576 [==============================] - 0s 130us/step - loss: 0.4112 - acc: 0.8108 - val_loss: 0.4960 - val_acc: 0.7552
Epoch 564/1500
576/576 [==============================] - 0s 113us/step - loss: 0.4111 - acc: 0.8090 - val_loss: 0.4960 - val_acc: 0.7552
Epoch 565/1500
576/576 [==============================] - 0s 99us/step - loss: 0.4110 - acc: 0.8108 - val_loss: 0.4960 - val_acc: 0.7552
Epoch 566/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4109 - acc: 0.8108 - val_loss: 0.4960 - val_acc: 0.7552
Epoch 567/1500
576/576 [==============================] - 0s 97us/step - loss: 0.4109 - acc: 0.8090 - val_loss: 0.4960 - val_acc: 0.7552
Epoch 568/1500
576/576 [==============================] - 0s 95us/step - loss: 0.4108 - acc: 0.8125 - val_loss: 0.4960 - val_acc: 0.7552
Epoch 569/1500
576/576 [==============================] - 0s 101us/step - loss: 0.4107 - acc: 0.8125 - val_loss: 0.4960 - val_acc: 0.7552
Epoch 570/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4106 - acc: 0.8108 - val_loss: 0.4960 - val_acc: 0.7552
Epoch 571/1500
576/576 [==============================] - 0s 104us/step - loss: 0.4106 - acc: 0.8108 - val_loss: 0.4960 - val_acc: 0.7552
Epoch 572/1500
576/576 [==============================] - 0s 92us/step - loss: 0.4105 - acc: 0.8125 - val_loss: 0.4960 - val_acc: 0.7552
Epoch 573/1500
576/576 [==============================] - 0s 111us/step - loss: 0.4104 - acc: 0.8125 - val_loss: 0.4960 - val_acc: 0.7552
Epoch 574/1500
576/576 [==============================] - 0s 116us/step - loss: 0.4104 - acc: 0.8108 - val_loss: 0.4960 - val_acc: 0.7552
Epoch 575/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4103 - acc: 0.8108 - val_loss: 0.4960 - val_acc: 0.7552
Epoch 576/1500
576/576 [==============================] - 0s 95us/step - loss: 0.4102 - acc: 0.8125 - val_loss: 0.4960 - val_acc: 0.7552
Epoch 577/1500
576/576 [==============================] - 0s 108us/step - loss: 0.4102 - acc: 0.8125 - val_loss: 0.4960 - val_acc: 0.7552
Epoch 578/1500
576/576 [==============================] - 0s 95us/step - loss: 0.4101 - acc: 0.8142 - val_loss: 0.4960 - val_acc: 0.7552
Epoch 579/1500
576/576 [==============================] - 0s 101us/step - loss: 0.4100 - acc: 0.8142 - val_loss: 0.4960 - val_acc: 0.7552
Epoch 580/1500
576/576 [==============================] - 0s 94us/step - loss: 0.4099 - acc: 0.8142 - val_loss: 0.4960 - val_acc: 0.7552
Epoch 581/1500
576/576 [==============================] - 0s 92us/step - loss: 0.4099 - acc: 0.8108 - val_loss: 0.4960 - val_acc: 0.7552
Epoch 582/1500
576/576 [==============================] - 0s 94us/step - loss: 0.4098 - acc: 0.8142 - val_loss: 0.4960 - val_acc: 0.7552
Epoch 583/1500
576/576 [==============================] - 0s 94us/step - loss: 0.4098 - acc: 0.8125 - val_loss: 0.4960 - val_acc: 0.7552
Epoch 584/1500
576/576 [==============================] - 0s 90us/step - loss: 0.4096 - acc: 0.8125 - val_loss: 0.4960 - val_acc: 0.7552
Epoch 585/1500
576/576 [==============================] - 0s 95us/step - loss: 0.4096 - acc: 0.8142 - val_loss: 0.4960 - val_acc: 0.7552
Epoch 586/1500
576/576 [==============================] - 0s 102us/step - loss: 0.4095 - acc: 0.8142 - val_loss: 0.4959 - val_acc: 0.7552
Epoch 587/1500
576/576 [==============================] - 0s 92us/step - loss: 0.4095 - acc: 0.8142 - val_loss: 0.4959 - val_acc: 0.7552
Epoch 588/1500
576/576 [==============================] - 0s 97us/step - loss: 0.4094 - acc: 0.8142 - val_loss: 0.4960 - val_acc: 0.7552
Epoch 589/1500
576/576 [==============================] - 0s 94us/step - loss: 0.4093 - acc: 0.8142 - val_loss: 0.4960 - val_acc: 0.7552
Epoch 590/1500
576/576 [==============================] - 0s 102us/step - loss: 0.4092 - acc: 0.8142 - val_loss: 0.4960 - val_acc: 0.7552
Epoch 591/1500
576/576 [==============================] - 0s 90us/step - loss: 0.4092 - acc: 0.8142 - val_loss: 0.4960 - val_acc: 0.7552
Epoch 592/1500
576/576 [==============================] - 0s 106us/step - loss: 0.4091 - acc: 0.8142 - val_loss: 0.4959 - val_acc: 0.7552
Epoch 593/1500
576/576 [==============================] - 0s 95us/step - loss: 0.4090 - acc: 0.8142 - val_loss: 0.4960 - val_acc: 0.7552
Epoch 594/1500
576/576 [==============================] - 0s 101us/step - loss: 0.4089 - acc: 0.8142 - val_loss: 0.4960 - val_acc: 0.7552
Epoch 595/1500
576/576 [==============================] - 0s 113us/step - loss: 0.4089 - acc: 0.8142 - val_loss: 0.4959 - val_acc: 0.7552
Epoch 596/1500
576/576 [==============================] - 0s 108us/step - loss: 0.4088 - acc: 0.8142 - val_loss: 0.4960 - val_acc: 0.7552
Epoch 597/1500
576/576 [==============================] - 0s 106us/step - loss: 0.4087 - acc: 0.8142 - val_loss: 0.4959 - val_acc: 0.7552
Epoch 598/1500
576/576 [==============================] - 0s 106us/step - loss: 0.4087 - acc: 0.8142 - val_loss: 0.4960 - val_acc: 0.7552
Epoch 599/1500
576/576 [==============================] - 0s 102us/step - loss: 0.4086 - acc: 0.8142 - val_loss: 0.4960 - val_acc: 0.7552
Epoch 600/1500
576/576 [==============================] - 0s 102us/step - loss: 0.4086 - acc: 0.8142 - val_loss: 0.4960 - val_acc: 0.7552
Epoch 601/1500
576/576 [==============================] - 0s 95us/step - loss: 0.4085 - acc: 0.8142 - val_loss: 0.4960 - val_acc: 0.7552
Epoch 602/1500
576/576 [==============================] - 0s 101us/step - loss: 0.4085 - acc: 0.8142 - val_loss: 0.4960 - val_acc: 0.7552
Epoch 603/1500
576/576 [==============================] - 0s 101us/step - loss: 0.4083 - acc: 0.8142 - val_loss: 0.4960 - val_acc: 0.7552
Epoch 604/1500
576/576 [==============================] - 0s 101us/step - loss: 0.4082 - acc: 0.8142 - val_loss: 0.4960 - val_acc: 0.7552
Epoch 605/1500
576/576 [==============================] - 0s 94us/step - loss: 0.4082 - acc: 0.8142 - val_loss: 0.4960 - val_acc: 0.7552
Epoch 606/1500
576/576 [==============================] - 0s 101us/step - loss: 0.4081 - acc: 0.8142 - val_loss: 0.4960 - val_acc: 0.7552
Epoch 607/1500
576/576 [==============================] - 0s 102us/step - loss: 0.4081 - acc: 0.8142 - val_loss: 0.4960 - val_acc: 0.7604
Epoch 608/1500
576/576 [==============================] - 0s 101us/step - loss: 0.4080 - acc: 0.8142 - val_loss: 0.4960 - val_acc: 0.7604
Epoch 609/1500
576/576 [==============================] - 0s 113us/step - loss: 0.4079 - acc: 0.8142 - val_loss: 0.4960 - val_acc: 0.7604
Epoch 610/1500
576/576 [==============================] - 0s 106us/step - loss: 0.4079 - acc: 0.8142 - val_loss: 0.4960 - val_acc: 0.7604
Epoch 611/1500
576/576 [==============================] - 0s 109us/step - loss: 0.4078 - acc: 0.8142 - val_loss: 0.4960 - val_acc: 0.7604
Epoch 612/1500
576/576 [==============================] - 0s 135us/step - loss: 0.4077 - acc: 0.8142 - val_loss: 0.4960 - val_acc: 0.7604
Epoch 613/1500
576/576 [==============================] - 0s 111us/step - loss: 0.4077 - acc: 0.8142 - val_loss: 0.4960 - val_acc: 0.7604
Epoch 614/1500
576/576 [==============================] - 0s 111us/step - loss: 0.4077 - acc: 0.8142 - val_loss: 0.4960 - val_acc: 0.7604
Epoch 615/1500
576/576 [==============================] - 0s 101us/step - loss: 0.4075 - acc: 0.8142 - val_loss: 0.4960 - val_acc: 0.7604
Epoch 616/1500
576/576 [==============================] - ETA: 0s - loss: 0.2280 - acc: 0.937 - 0s 104us/step - loss: 0.4075 - acc: 0.8142 - val_loss: 0.4960 - val_acc: 0.7604
Epoch 617/1500
576/576 [==============================] - 0s 90us/step - loss: 0.4074 - acc: 0.8142 - val_loss: 0.4960 - val_acc: 0.7604
Epoch 618/1500
576/576 [==============================] - 0s 102us/step - loss: 0.4073 - acc: 0.8142 - val_loss: 0.4960 - val_acc: 0.7604
Epoch 619/1500
576/576 [==============================] - 0s 101us/step - loss: 0.4072 - acc: 0.8142 - val_loss: 0.4959 - val_acc: 0.7604
Epoch 620/1500
576/576 [==============================] - 0s 106us/step - loss: 0.4072 - acc: 0.8142 - val_loss: 0.4959 - val_acc: 0.7604
Epoch 621/1500
576/576 [==============================] - 0s 102us/step - loss: 0.4071 - acc: 0.8142 - val_loss: 0.4959 - val_acc: 0.7604
Epoch 622/1500
576/576 [==============================] - 0s 130us/step - loss: 0.4070 - acc: 0.8142 - val_loss: 0.4959 - val_acc: 0.7604
Epoch 623/1500
576/576 [==============================] - 0s 109us/step - loss: 0.4069 - acc: 0.8160 - val_loss: 0.4959 - val_acc: 0.7604
Epoch 624/1500
576/576 [==============================] - 0s 95us/step - loss: 0.4069 - acc: 0.8142 - val_loss: 0.4959 - val_acc: 0.7604
Epoch 625/1500
576/576 [==============================] - 0s 108us/step - loss: 0.4067 - acc: 0.8142 - val_loss: 0.4959 - val_acc: 0.7604
Epoch 626/1500
576/576 [==============================] - 0s 90us/step - loss: 0.4067 - acc: 0.8160 - val_loss: 0.4958 - val_acc: 0.7604
Epoch 627/1500
576/576 [==============================] - 0s 90us/step - loss: 0.4066 - acc: 0.8160 - val_loss: 0.4958 - val_acc: 0.7604
Epoch 628/1500
576/576 [==============================] - 0s 104us/step - loss: 0.4066 - acc: 0.8160 - val_loss: 0.4958 - val_acc: 0.7604
Epoch 629/1500
576/576 [==============================] - 0s 97us/step - loss: 0.4064 - acc: 0.8160 - val_loss: 0.4958 - val_acc: 0.7604
Epoch 630/1500
576/576 [==============================] - 0s 101us/step - loss: 0.4064 - acc: 0.8160 - val_loss: 0.4959 - val_acc: 0.7604
Epoch 631/1500
576/576 [==============================] - 0s 111us/step - loss: 0.4063 - acc: 0.8160 - val_loss: 0.4959 - val_acc: 0.7604
Epoch 632/1500
576/576 [==============================] - 0s 95us/step - loss: 0.4063 - acc: 0.8160 - val_loss: 0.4958 - val_acc: 0.7604
Epoch 633/1500
576/576 [==============================] - 0s 97us/step - loss: 0.4062 - acc: 0.8160 - val_loss: 0.4958 - val_acc: 0.7604
Epoch 634/1500
576/576 [==============================] - 0s 97us/step - loss: 0.4061 - acc: 0.8160 - val_loss: 0.4958 - val_acc: 0.7604
Epoch 635/1500
576/576 [==============================] - 0s 104us/step - loss: 0.4060 - acc: 0.8160 - val_loss: 0.4958 - val_acc: 0.7604
Epoch 636/1500
576/576 [==============================] - 0s 109us/step - loss: 0.4059 - acc: 0.8160 - val_loss: 0.4958 - val_acc: 0.7604
Epoch 637/1500
576/576 [==============================] - 0s 92us/step - loss: 0.4059 - acc: 0.8177 - val_loss: 0.4958 - val_acc: 0.7604
Epoch 638/1500
576/576 [==============================] - 0s 97us/step - loss: 0.4058 - acc: 0.8142 - val_loss: 0.4958 - val_acc: 0.7604
Epoch 639/1500
576/576 [==============================] - 0s 92us/step - loss: 0.4056 - acc: 0.8160 - val_loss: 0.4958 - val_acc: 0.7604
Epoch 640/1500
576/576 [==============================] - 0s 115us/step - loss: 0.4056 - acc: 0.8177 - val_loss: 0.4958 - val_acc: 0.7604
Epoch 641/1500
576/576 [==============================] - 0s 94us/step - loss: 0.4056 - acc: 0.8160 - val_loss: 0.4959 - val_acc: 0.7604
Epoch 642/1500
576/576 [==============================] - 0s 94us/step - loss: 0.4055 - acc: 0.8160 - val_loss: 0.4958 - val_acc: 0.7604
Epoch 643/1500
576/576 [==============================] - 0s 92us/step - loss: 0.4054 - acc: 0.8177 - val_loss: 0.4958 - val_acc: 0.7604
Epoch 644/1500
576/576 [==============================] - 0s 92us/step - loss: 0.4053 - acc: 0.8194 - val_loss: 0.4958 - val_acc: 0.7604
Epoch 645/1500
576/576 [==============================] - 0s 104us/step - loss: 0.4053 - acc: 0.8142 - val_loss: 0.4958 - val_acc: 0.7604
Epoch 646/1500
576/576 [==============================] - 0s 95us/step - loss: 0.4051 - acc: 0.8177 - val_loss: 0.4958 - val_acc: 0.7604
Epoch 647/1500
576/576 [==============================] - 0s 95us/step - loss: 0.4051 - acc: 0.8160 - val_loss: 0.4958 - val_acc: 0.7604
Epoch 648/1500
576/576 [==============================] - 0s 95us/step - loss: 0.4050 - acc: 0.8160 - val_loss: 0.4958 - val_acc: 0.7604
Epoch 649/1500
576/576 [==============================] - 0s 88us/step - loss: 0.4050 - acc: 0.8194 - val_loss: 0.4958 - val_acc: 0.7604
Epoch 650/1500
576/576 [==============================] - 0s 99us/step - loss: 0.4049 - acc: 0.8177 - val_loss: 0.4958 - val_acc: 0.7604
Epoch 651/1500
576/576 [==============================] - 0s 92us/step - loss: 0.4048 - acc: 0.8160 - val_loss: 0.4958 - val_acc: 0.7604
Epoch 652/1500
576/576 [==============================] - 0s 92us/step - loss: 0.4047 - acc: 0.8177 - val_loss: 0.4958 - val_acc: 0.7604
Epoch 653/1500
576/576 [==============================] - 0s 94us/step - loss: 0.4046 - acc: 0.8177 - val_loss: 0.4958 - val_acc: 0.7604
Epoch 654/1500
576/576 [==============================] - 0s 106us/step - loss: 0.4046 - acc: 0.8177 - val_loss: 0.4958 - val_acc: 0.7604
Epoch 655/1500
576/576 [==============================] - 0s 102us/step - loss: 0.4045 - acc: 0.8177 - val_loss: 0.4958 - val_acc: 0.7604
Epoch 656/1500
576/576 [==============================] - 0s 109us/step - loss: 0.4044 - acc: 0.8177 - val_loss: 0.4958 - val_acc: 0.7604
Epoch 657/1500
576/576 [==============================] - 0s 115us/step - loss: 0.4043 - acc: 0.8194 - val_loss: 0.4958 - val_acc: 0.7604
Epoch 658/1500
576/576 [==============================] - 0s 127us/step - loss: 0.4042 - acc: 0.8177 - val_loss: 0.4958 - val_acc: 0.7604
Epoch 659/1500
576/576 [==============================] - 0s 109us/step - loss: 0.4042 - acc: 0.8194 - val_loss: 0.4958 - val_acc: 0.7604
Epoch 660/1500
576/576 [==============================] - 0s 111us/step - loss: 0.4041 - acc: 0.8194 - val_loss: 0.4958 - val_acc: 0.7604
Epoch 661/1500
576/576 [==============================] - 0s 156us/step - loss: 0.4040 - acc: 0.8194 - val_loss: 0.4958 - val_acc: 0.7604
Epoch 662/1500
576/576 [==============================] - 0s 106us/step - loss: 0.4039 - acc: 0.8194 - val_loss: 0.4958 - val_acc: 0.7604
Epoch 663/1500
576/576 [==============================] - 0s 101us/step - loss: 0.4039 - acc: 0.8177 - val_loss: 0.4958 - val_acc: 0.7604
Epoch 664/1500
576/576 [==============================] - 0s 109us/step - loss: 0.4038 - acc: 0.8177 - val_loss: 0.4958 - val_acc: 0.7604
Epoch 665/1500
576/576 [==============================] - 0s 115us/step - loss: 0.4037 - acc: 0.8194 - val_loss: 0.4958 - val_acc: 0.7604
Epoch 666/1500
576/576 [==============================] - 0s 111us/step - loss: 0.4037 - acc: 0.8177 - val_loss: 0.4958 - val_acc: 0.7604
Epoch 667/1500
576/576 [==============================] - 0s 120us/step - loss: 0.4036 - acc: 0.8212 - val_loss: 0.4958 - val_acc: 0.7604
Epoch 668/1500
576/576 [==============================] - 0s 147us/step - loss: 0.4036 - acc: 0.8177 - val_loss: 0.4958 - val_acc: 0.7604
Epoch 669/1500
576/576 [==============================] - 0s 109us/step - loss: 0.4034 - acc: 0.8194 - val_loss: 0.4958 - val_acc: 0.7604
Epoch 670/1500
576/576 [==============================] - 0s 111us/step - loss: 0.4034 - acc: 0.8194 - val_loss: 0.4958 - val_acc: 0.7604
Epoch 671/1500
576/576 [==============================] - 0s 111us/step - loss: 0.4033 - acc: 0.8194 - val_loss: 0.4958 - val_acc: 0.7604
Epoch 672/1500
576/576 [==============================] - 0s 135us/step - loss: 0.4033 - acc: 0.8194 - val_loss: 0.4958 - val_acc: 0.7604
Epoch 673/1500
576/576 [==============================] - 0s 116us/step - loss: 0.4032 - acc: 0.8194 - val_loss: 0.4958 - val_acc: 0.7604
Epoch 674/1500
576/576 [==============================] - 0s 123us/step - loss: 0.4031 - acc: 0.8177 - val_loss: 0.4959 - val_acc: 0.7604
Epoch 675/1500
576/576 [==============================] - 0s 146us/step - loss: 0.4031 - acc: 0.8194 - val_loss: 0.4958 - val_acc: 0.7604
Epoch 676/1500
576/576 [==============================] - 0s 108us/step - loss: 0.4029 - acc: 0.8194 - val_loss: 0.4958 - val_acc: 0.7604
Epoch 677/1500
576/576 [==============================] - 0s 109us/step - loss: 0.4029 - acc: 0.8212 - val_loss: 0.4958 - val_acc: 0.7604
Epoch 678/1500
576/576 [==============================] - 0s 102us/step - loss: 0.4028 - acc: 0.8177 - val_loss: 0.4958 - val_acc: 0.7604
Epoch 679/1500
576/576 [==============================] - 0s 102us/step - loss: 0.4027 - acc: 0.8177 - val_loss: 0.4958 - val_acc: 0.7604
Epoch 680/1500
576/576 [==============================] - 0s 108us/step - loss: 0.4026 - acc: 0.8177 - val_loss: 0.4959 - val_acc: 0.7604
Epoch 681/1500
576/576 [==============================] - 0s 115us/step - loss: 0.4026 - acc: 0.8194 - val_loss: 0.4959 - val_acc: 0.7604
Epoch 682/1500
576/576 [==============================] - 0s 115us/step - loss: 0.4024 - acc: 0.8212 - val_loss: 0.4959 - val_acc: 0.7604
Epoch 683/1500
576/576 [==============================] - 0s 108us/step - loss: 0.4024 - acc: 0.8247 - val_loss: 0.4958 - val_acc: 0.7604
Epoch 684/1500
576/576 [==============================] - 0s 102us/step - loss: 0.4023 - acc: 0.8194 - val_loss: 0.4959 - val_acc: 0.7604
Epoch 685/1500
576/576 [==============================] - 0s 141us/step - loss: 0.4022 - acc: 0.8212 - val_loss: 0.4959 - val_acc: 0.7604
Epoch 686/1500
576/576 [==============================] - 0s 106us/step - loss: 0.4022 - acc: 0.8194 - val_loss: 0.4959 - val_acc: 0.7604
Epoch 687/1500
576/576 [==============================] - 0s 113us/step - loss: 0.4021 - acc: 0.8212 - val_loss: 0.4959 - val_acc: 0.7604
Epoch 688/1500
576/576 [==============================] - 0s 97us/step - loss: 0.4021 - acc: 0.8229 - val_loss: 0.4959 - val_acc: 0.7604
Epoch 689/1500
576/576 [==============================] - 0s 113us/step - loss: 0.4020 - acc: 0.8194 - val_loss: 0.4959 - val_acc: 0.7604
Epoch 690/1500
576/576 [==============================] - 0s 97us/step - loss: 0.4019 - acc: 0.8194 - val_loss: 0.4959 - val_acc: 0.7604
Epoch 691/1500
576/576 [==============================] - 0s 111us/step - loss: 0.4018 - acc: 0.8212 - val_loss: 0.4959 - val_acc: 0.7604
Epoch 692/1500
576/576 [==============================] - 0s 121us/step - loss: 0.4017 - acc: 0.8212 - val_loss: 0.4959 - val_acc: 0.7604
Epoch 693/1500
576/576 [==============================] - 0s 101us/step - loss: 0.4016 - acc: 0.8212 - val_loss: 0.4959 - val_acc: 0.7604
Epoch 694/1500
576/576 [==============================] - 0s 109us/step - loss: 0.4016 - acc: 0.8212 - val_loss: 0.4960 - val_acc: 0.7604
Epoch 695/1500
576/576 [==============================] - 0s 108us/step - loss: 0.4015 - acc: 0.8194 - val_loss: 0.4960 - val_acc: 0.7604
Epoch 696/1500
576/576 [==============================] - 0s 118us/step - loss: 0.4015 - acc: 0.8229 - val_loss: 0.4960 - val_acc: 0.7604
Epoch 697/1500
576/576 [==============================] - 0s 109us/step - loss: 0.4014 - acc: 0.8212 - val_loss: 0.4960 - val_acc: 0.7604
Epoch 698/1500
576/576 [==============================] - 0s 113us/step - loss: 0.4014 - acc: 0.8212 - val_loss: 0.4960 - val_acc: 0.7604
Epoch 699/1500
576/576 [==============================] - 0s 116us/step - loss: 0.4013 - acc: 0.8212 - val_loss: 0.4960 - val_acc: 0.7604
Epoch 700/1500
576/576 [==============================] - 0s 123us/step - loss: 0.4012 - acc: 0.8229 - val_loss: 0.4960 - val_acc: 0.7552
Epoch 701/1500
576/576 [==============================] - 0s 104us/step - loss: 0.4011 - acc: 0.8212 - val_loss: 0.4960 - val_acc: 0.7552
Epoch 702/1500
576/576 [==============================] - 0s 104us/step - loss: 0.4011 - acc: 0.8229 - val_loss: 0.4960 - val_acc: 0.7552
Epoch 703/1500
576/576 [==============================] - 0s 111us/step - loss: 0.4010 - acc: 0.8247 - val_loss: 0.4960 - val_acc: 0.7552
Epoch 704/1500
576/576 [==============================] - 0s 104us/step - loss: 0.4009 - acc: 0.8212 - val_loss: 0.4960 - val_acc: 0.7552
Epoch 705/1500
576/576 [==============================] - 0s 109us/step - loss: 0.4008 - acc: 0.8247 - val_loss: 0.4960 - val_acc: 0.7552
Epoch 706/1500
576/576 [==============================] - 0s 108us/step - loss: 0.4007 - acc: 0.8229 - val_loss: 0.4960 - val_acc: 0.7552
Epoch 707/1500
576/576 [==============================] - 0s 113us/step - loss: 0.4007 - acc: 0.8229 - val_loss: 0.4960 - val_acc: 0.7552
Epoch 708/1500
576/576 [==============================] - 0s 104us/step - loss: 0.4006 - acc: 0.8229 - val_loss: 0.4960 - val_acc: 0.7552
Epoch 709/1500
576/576 [==============================] - 0s 116us/step - loss: 0.4006 - acc: 0.8229 - val_loss: 0.4960 - val_acc: 0.7552
Epoch 710/1500
576/576 [==============================] - 0s 116us/step - loss: 0.4005 - acc: 0.8264 - val_loss: 0.4961 - val_acc: 0.7552
Epoch 711/1500
576/576 [==============================] - 0s 101us/step - loss: 0.4004 - acc: 0.8229 - val_loss: 0.4961 - val_acc: 0.7552
Epoch 712/1500
576/576 [==============================] - 0s 108us/step - loss: 0.4003 - acc: 0.8229 - val_loss: 0.4961 - val_acc: 0.7552
Epoch 713/1500
576/576 [==============================] - 0s 121us/step - loss: 0.4002 - acc: 0.8229 - val_loss: 0.4961 - val_acc: 0.7552
Epoch 714/1500
576/576 [==============================] - 0s 120us/step - loss: 0.4001 - acc: 0.8229 - val_loss: 0.4961 - val_acc: 0.7604
Epoch 715/1500
576/576 [==============================] - 0s 127us/step - loss: 0.4001 - acc: 0.8229 - val_loss: 0.4961 - val_acc: 0.7604
Epoch 716/1500
576/576 [==============================] - 0s 132us/step - loss: 0.4000 - acc: 0.8247 - val_loss: 0.4961 - val_acc: 0.7604
Epoch 717/1500
576/576 [==============================] - 0s 106us/step - loss: 0.3999 - acc: 0.8247 - val_loss: 0.4961 - val_acc: 0.7604
Epoch 718/1500
576/576 [==============================] - 0s 127us/step - loss: 0.3999 - acc: 0.8229 - val_loss: 0.4961 - val_acc: 0.7604
Epoch 719/1500
576/576 [==============================] - 0s 115us/step - loss: 0.3999 - acc: 0.8229 - val_loss: 0.4961 - val_acc: 0.7604
Epoch 720/1500
576/576 [==============================] - 0s 108us/step - loss: 0.3997 - acc: 0.8229 - val_loss: 0.4961 - val_acc: 0.7604
Epoch 721/1500
576/576 [==============================] - 0s 109us/step - loss: 0.3997 - acc: 0.8264 - val_loss: 0.4961 - val_acc: 0.7604
Epoch 722/1500
576/576 [==============================] - 0s 132us/step - loss: 0.3996 - acc: 0.8212 - val_loss: 0.4961 - val_acc: 0.7604
Epoch 723/1500
576/576 [==============================] - 0s 120us/step - loss: 0.3996 - acc: 0.8247 - val_loss: 0.4962 - val_acc: 0.7604
Epoch 724/1500
576/576 [==============================] - 0s 127us/step - loss: 0.3995 - acc: 0.8247 - val_loss: 0.4962 - val_acc: 0.7604
Epoch 725/1500
576/576 [==============================] - 0s 141us/step - loss: 0.3994 - acc: 0.8247 - val_loss: 0.4962 - val_acc: 0.7604
Epoch 726/1500
576/576 [==============================] - 0s 109us/step - loss: 0.3993 - acc: 0.8247 - val_loss: 0.4962 - val_acc: 0.7604
Epoch 727/1500
576/576 [==============================] - 0s 118us/step - loss: 0.3993 - acc: 0.8264 - val_loss: 0.4962 - val_acc: 0.7604
Epoch 728/1500
576/576 [==============================] - 0s 106us/step - loss: 0.3992 - acc: 0.8247 - val_loss: 0.4962 - val_acc: 0.7604
Epoch 729/1500
576/576 [==============================] - 0s 115us/step - loss: 0.3992 - acc: 0.8229 - val_loss: 0.4962 - val_acc: 0.7604
Epoch 730/1500
576/576 [==============================] - 0s 125us/step - loss: 0.3991 - acc: 0.8229 - val_loss: 0.4962 - val_acc: 0.7604
Epoch 731/1500
576/576 [==============================] - 0s 109us/step - loss: 0.3990 - acc: 0.8229 - val_loss: 0.4962 - val_acc: 0.7604
Epoch 732/1500
576/576 [==============================] - 0s 115us/step - loss: 0.3989 - acc: 0.8247 - val_loss: 0.4962 - val_acc: 0.7604
Epoch 733/1500
576/576 [==============================] - 0s 128us/step - loss: 0.3989 - acc: 0.8264 - val_loss: 0.4962 - val_acc: 0.7604
Epoch 734/1500
576/576 [==============================] - 0s 111us/step - loss: 0.3988 - acc: 0.8229 - val_loss: 0.4962 - val_acc: 0.7604
Epoch 735/1500
576/576 [==============================] - 0s 108us/step - loss: 0.3987 - acc: 0.8247 - val_loss: 0.4962 - val_acc: 0.7604
Epoch 736/1500
576/576 [==============================] - 0s 123us/step - loss: 0.3987 - acc: 0.8247 - val_loss: 0.4962 - val_acc: 0.7604
Epoch 737/1500
576/576 [==============================] - 0s 108us/step - loss: 0.3986 - acc: 0.8247 - val_loss: 0.4962 - val_acc: 0.7604
Epoch 738/1500
576/576 [==============================] - 0s 113us/step - loss: 0.3985 - acc: 0.8212 - val_loss: 0.4963 - val_acc: 0.7604
Epoch 739/1500
576/576 [==============================] - 0s 135us/step - loss: 0.3985 - acc: 0.8247 - val_loss: 0.4963 - val_acc: 0.7604
Epoch 740/1500
576/576 [==============================] - 0s 104us/step - loss: 0.3984 - acc: 0.8229 - val_loss: 0.4963 - val_acc: 0.7604
Epoch 741/1500
576/576 [==============================] - 0s 113us/step - loss: 0.3984 - acc: 0.8229 - val_loss: 0.4963 - val_acc: 0.7604
Epoch 742/1500
576/576 [==============================] - 0s 113us/step - loss: 0.3983 - acc: 0.8229 - val_loss: 0.4963 - val_acc: 0.7604
Epoch 743/1500
576/576 [==============================] - 0s 108us/step - loss: 0.3982 - acc: 0.8247 - val_loss: 0.4963 - val_acc: 0.7604
Epoch 744/1500
576/576 [==============================] - 0s 102us/step - loss: 0.3982 - acc: 0.8229 - val_loss: 0.4963 - val_acc: 0.7604
Epoch 745/1500
576/576 [==============================] - 0s 95us/step - loss: 0.3981 - acc: 0.8247 - val_loss: 0.4963 - val_acc: 0.7604
Epoch 746/1500
576/576 [==============================] - 0s 101us/step - loss: 0.3980 - acc: 0.8229 - val_loss: 0.4963 - val_acc: 0.7604
Epoch 747/1500
576/576 [==============================] - 0s 106us/step - loss: 0.3980 - acc: 0.8264 - val_loss: 0.4964 - val_acc: 0.7604
Epoch 748/1500
576/576 [==============================] - 0s 108us/step - loss: 0.3979 - acc: 0.8247 - val_loss: 0.4964 - val_acc: 0.7656
Epoch 749/1500
576/576 [==============================] - 0s 99us/step - loss: 0.3978 - acc: 0.8247 - val_loss: 0.4964 - val_acc: 0.7656
Epoch 750/1500
576/576 [==============================] - 0s 92us/step - loss: 0.3977 - acc: 0.8229 - val_loss: 0.4964 - val_acc: 0.7656
Epoch 751/1500
576/576 [==============================] - 0s 109us/step - loss: 0.3977 - acc: 0.8247 - val_loss: 0.4964 - val_acc: 0.7604
Epoch 752/1500
576/576 [==============================] - 0s 108us/step - loss: 0.3977 - acc: 0.8212 - val_loss: 0.4964 - val_acc: 0.7604
Epoch 753/1500
576/576 [==============================] - 0s 109us/step - loss: 0.3976 - acc: 0.8229 - val_loss: 0.4964 - val_acc: 0.7604
Epoch 754/1500
576/576 [==============================] - 0s 104us/step - loss: 0.3975 - acc: 0.8247 - val_loss: 0.4964 - val_acc: 0.7604
Epoch 755/1500
576/576 [==============================] - 0s 95us/step - loss: 0.3975 - acc: 0.8229 - val_loss: 0.4964 - val_acc: 0.7656
Epoch 756/1500
576/576 [==============================] - ETA: 0s - loss: 0.3334 - acc: 0.843 - 0s 97us/step - loss: 0.3974 - acc: 0.8229 - val_loss: 0.4965 - val_acc: 0.7656
Epoch 757/1500
576/576 [==============================] - 0s 104us/step - loss: 0.3973 - acc: 0.8247 - val_loss: 0.4965 - val_acc: 0.7656
Epoch 758/1500
576/576 [==============================] - 0s 94us/step - loss: 0.3972 - acc: 0.8229 - val_loss: 0.4965 - val_acc: 0.7656
Epoch 759/1500
576/576 [==============================] - 0s 95us/step - loss: 0.3972 - acc: 0.8229 - val_loss: 0.4965 - val_acc: 0.7656
Epoch 760/1500
576/576 [==============================] - 0s 102us/step - loss: 0.3971 - acc: 0.8247 - val_loss: 0.4965 - val_acc: 0.7656
Epoch 761/1500
576/576 [==============================] - 0s 116us/step - loss: 0.3970 - acc: 0.8247 - val_loss: 0.4965 - val_acc: 0.7656
Epoch 762/1500
576/576 [==============================] - 0s 137us/step - loss: 0.3969 - acc: 0.8229 - val_loss: 0.4965 - val_acc: 0.7604
Epoch 763/1500
576/576 [==============================] - 0s 99us/step - loss: 0.3969 - acc: 0.8229 - val_loss: 0.4965 - val_acc: 0.7604
Epoch 764/1500
576/576 [==============================] - 0s 95us/step - loss: 0.3969 - acc: 0.8229 - val_loss: 0.4965 - val_acc: 0.7604
Epoch 765/1500
576/576 [==============================] - 0s 94us/step - loss: 0.3967 - acc: 0.8229 - val_loss: 0.4965 - val_acc: 0.7604
Epoch 766/1500
576/576 [==============================] - 0s 101us/step - loss: 0.3967 - acc: 0.8229 - val_loss: 0.4965 - val_acc: 0.7604
Epoch 767/1500
576/576 [==============================] - 0s 118us/step - loss: 0.3966 - acc: 0.8229 - val_loss: 0.4965 - val_acc: 0.7604
Epoch 768/1500
576/576 [==============================] - 0s 115us/step - loss: 0.3965 - acc: 0.8229 - val_loss: 0.4966 - val_acc: 0.7604
Epoch 769/1500
576/576 [==============================] - 0s 99us/step - loss: 0.3965 - acc: 0.8229 - val_loss: 0.4965 - val_acc: 0.7604
Epoch 770/1500
576/576 [==============================] - 0s 144us/step - loss: 0.3964 - acc: 0.8229 - val_loss: 0.4966 - val_acc: 0.7604
Epoch 771/1500
576/576 [==============================] - 0s 104us/step - loss: 0.3964 - acc: 0.8247 - val_loss: 0.4965 - val_acc: 0.7604
Epoch 772/1500
576/576 [==============================] - 0s 135us/step - loss: 0.3963 - acc: 0.8229 - val_loss: 0.4966 - val_acc: 0.7604
Epoch 773/1500
576/576 [==============================] - 0s 135us/step - loss: 0.3962 - acc: 0.8229 - val_loss: 0.4966 - val_acc: 0.7604
Epoch 774/1500
576/576 [==============================] - 0s 120us/step - loss: 0.3962 - acc: 0.8229 - val_loss: 0.4966 - val_acc: 0.7604
Epoch 775/1500
576/576 [==============================] - 0s 118us/step - loss: 0.3961 - acc: 0.8229 - val_loss: 0.4966 - val_acc: 0.7604
Epoch 776/1500
576/576 [==============================] - 0s 160us/step - loss: 0.3961 - acc: 0.8229 - val_loss: 0.4966 - val_acc: 0.7604
Epoch 777/1500
576/576 [==============================] - 0s 135us/step - loss: 0.3959 - acc: 0.8247 - val_loss: 0.4966 - val_acc: 0.7604
Epoch 778/1500
576/576 [==============================] - 0s 101us/step - loss: 0.3959 - acc: 0.8229 - val_loss: 0.4966 - val_acc: 0.7604
Epoch 779/1500
576/576 [==============================] - 0s 125us/step - loss: 0.3958 - acc: 0.8229 - val_loss: 0.4966 - val_acc: 0.7604
Epoch 780/1500
576/576 [==============================] - 0s 109us/step - loss: 0.3958 - acc: 0.8229 - val_loss: 0.4966 - val_acc: 0.7604
Epoch 781/1500
576/576 [==============================] - 0s 111us/step - loss: 0.3957 - acc: 0.8212 - val_loss: 0.4967 - val_acc: 0.7604
Epoch 782/1500
576/576 [==============================] - 0s 132us/step - loss: 0.3957 - acc: 0.8229 - val_loss: 0.4967 - val_acc: 0.7552
Epoch 783/1500
576/576 [==============================] - 0s 111us/step - loss: 0.3956 - acc: 0.8229 - val_loss: 0.4967 - val_acc: 0.7552
Epoch 784/1500
576/576 [==============================] - 0s 101us/step - loss: 0.3955 - acc: 0.8264 - val_loss: 0.4967 - val_acc: 0.7552
Epoch 785/1500
576/576 [==============================] - 0s 97us/step - loss: 0.3954 - acc: 0.8229 - val_loss: 0.4967 - val_acc: 0.7552
Epoch 786/1500
576/576 [==============================] - 0s 135us/step - loss: 0.3954 - acc: 0.8247 - val_loss: 0.4967 - val_acc: 0.7552
Epoch 787/1500
576/576 [==============================] - 0s 101us/step - loss: 0.3954 - acc: 0.8247 - val_loss: 0.4967 - val_acc: 0.7552
Epoch 788/1500
576/576 [==============================] - 0s 102us/step - loss: 0.3953 - acc: 0.8247 - val_loss: 0.4967 - val_acc: 0.7552
Epoch 789/1500
576/576 [==============================] - 0s 94us/step - loss: 0.3953 - acc: 0.8247 - val_loss: 0.4967 - val_acc: 0.7552
Epoch 790/1500
576/576 [==============================] - 0s 102us/step - loss: 0.3952 - acc: 0.8247 - val_loss: 0.4968 - val_acc: 0.7552
Epoch 791/1500
576/576 [==============================] - 0s 106us/step - loss: 0.3951 - acc: 0.8264 - val_loss: 0.4967 - val_acc: 0.7552
Epoch 792/1500
576/576 [==============================] - 0s 99us/step - loss: 0.3951 - acc: 0.8229 - val_loss: 0.4968 - val_acc: 0.7552
Epoch 793/1500
576/576 [==============================] - 0s 97us/step - loss: 0.3950 - acc: 0.8247 - val_loss: 0.4968 - val_acc: 0.7552
Epoch 794/1500
576/576 [==============================] - 0s 99us/step - loss: 0.3949 - acc: 0.8247 - val_loss: 0.4968 - val_acc: 0.7552
Epoch 795/1500
576/576 [==============================] - 0s 102us/step - loss: 0.3948 - acc: 0.8247 - val_loss: 0.4968 - val_acc: 0.7552
Epoch 796/1500
576/576 [==============================] - 0s 95us/step - loss: 0.3948 - acc: 0.8247 - val_loss: 0.4968 - val_acc: 0.7552
Epoch 797/1500
576/576 [==============================] - 0s 101us/step - loss: 0.3947 - acc: 0.8229 - val_loss: 0.4968 - val_acc: 0.7552
Epoch 798/1500
576/576 [==============================] - 0s 127us/step - loss: 0.3947 - acc: 0.8281 - val_loss: 0.4968 - val_acc: 0.7552
Epoch 799/1500
576/576 [==============================] - 0s 125us/step - loss: 0.3946 - acc: 0.8247 - val_loss: 0.4969 - val_acc: 0.7552
Epoch 800/1500
576/576 [==============================] - 0s 128us/step - loss: 0.3945 - acc: 0.8229 - val_loss: 0.4969 - val_acc: 0.7552
Epoch 801/1500
576/576 [==============================] - 0s 125us/step - loss: 0.3944 - acc: 0.8229 - val_loss: 0.4969 - val_acc: 0.7552
Epoch 802/1500
576/576 [==============================] - 0s 130us/step - loss: 0.3944 - acc: 0.8229 - val_loss: 0.4969 - val_acc: 0.7552
Epoch 803/1500
576/576 [==============================] - 0s 101us/step - loss: 0.3943 - acc: 0.8229 - val_loss: 0.4969 - val_acc: 0.7552
Epoch 804/1500
576/576 [==============================] - 0s 135us/step - loss: 0.3942 - acc: 0.8229 - val_loss: 0.4970 - val_acc: 0.7552
Epoch 805/1500
576/576 [==============================] - 0s 101us/step - loss: 0.3942 - acc: 0.8247 - val_loss: 0.4970 - val_acc: 0.7552
Epoch 806/1500
576/576 [==============================] - 0s 104us/step - loss: 0.3941 - acc: 0.8229 - val_loss: 0.4970 - val_acc: 0.7552
Epoch 807/1500
576/576 [==============================] - 0s 111us/step - loss: 0.3941 - acc: 0.8229 - val_loss: 0.4971 - val_acc: 0.7552
Epoch 808/1500
576/576 [==============================] - 0s 121us/step - loss: 0.3940 - acc: 0.8247 - val_loss: 0.4970 - val_acc: 0.7552
Epoch 809/1500
576/576 [==============================] - 0s 121us/step - loss: 0.3939 - acc: 0.8229 - val_loss: 0.4971 - val_acc: 0.7552
Epoch 810/1500
576/576 [==============================] - 0s 99us/step - loss: 0.3939 - acc: 0.8229 - val_loss: 0.4971 - val_acc: 0.7552
Epoch 811/1500
576/576 [==============================] - 0s 106us/step - loss: 0.3938 - acc: 0.8247 - val_loss: 0.4971 - val_acc: 0.7552
Epoch 812/1500
576/576 [==============================] - 0s 115us/step - loss: 0.3937 - acc: 0.8229 - val_loss: 0.4971 - val_acc: 0.7552
Epoch 813/1500
576/576 [==============================] - 0s 111us/step - loss: 0.3937 - acc: 0.8229 - val_loss: 0.4971 - val_acc: 0.7552
Epoch 814/1500
576/576 [==============================] - 0s 137us/step - loss: 0.3936 - acc: 0.8229 - val_loss: 0.4971 - val_acc: 0.7552
Epoch 815/1500
576/576 [==============================] - 0s 128us/step - loss: 0.3936 - acc: 0.8247 - val_loss: 0.4972 - val_acc: 0.7552
Epoch 816/1500
576/576 [==============================] - 0s 127us/step - loss: 0.3935 - acc: 0.8229 - val_loss: 0.4972 - val_acc: 0.7552
Epoch 817/1500
576/576 [==============================] - 0s 97us/step - loss: 0.3934 - acc: 0.8229 - val_loss: 0.4972 - val_acc: 0.7552
Epoch 818/1500
576/576 [==============================] - 0s 90us/step - loss: 0.3933 - acc: 0.8229 - val_loss: 0.4972 - val_acc: 0.7552
Epoch 819/1500
576/576 [==============================] - 0s 101us/step - loss: 0.3933 - acc: 0.8247 - val_loss: 0.4973 - val_acc: 0.7552
Epoch 820/1500
576/576 [==============================] - 0s 102us/step - loss: 0.3933 - acc: 0.8247 - val_loss: 0.4973 - val_acc: 0.7552
Epoch 821/1500
576/576 [==============================] - 0s 90us/step - loss: 0.3932 - acc: 0.8247 - val_loss: 0.4973 - val_acc: 0.7552
Epoch 822/1500
576/576 [==============================] - 0s 92us/step - loss: 0.3931 - acc: 0.8229 - val_loss: 0.4973 - val_acc: 0.7552
Epoch 823/1500
576/576 [==============================] - 0s 95us/step - loss: 0.3930 - acc: 0.8247 - val_loss: 0.4974 - val_acc: 0.7552
Epoch 824/1500
576/576 [==============================] - 0s 87us/step - loss: 0.3930 - acc: 0.8229 - val_loss: 0.4974 - val_acc: 0.7552
Epoch 825/1500
576/576 [==============================] - 0s 109us/step - loss: 0.3929 - acc: 0.8229 - val_loss: 0.4974 - val_acc: 0.7552
Epoch 826/1500
576/576 [==============================] - 0s 108us/step - loss: 0.3929 - acc: 0.8247 - val_loss: 0.4974 - val_acc: 0.7552
Epoch 827/1500
576/576 [==============================] - 0s 95us/step - loss: 0.3928 - acc: 0.8247 - val_loss: 0.4975 - val_acc: 0.7552
Epoch 828/1500
576/576 [==============================] - 0s 90us/step - loss: 0.3927 - acc: 0.8247 - val_loss: 0.4975 - val_acc: 0.7552
Epoch 829/1500
576/576 [==============================] - 0s 88us/step - loss: 0.3927 - acc: 0.8247 - val_loss: 0.4975 - val_acc: 0.7552
Epoch 830/1500
576/576 [==============================] - 0s 88us/step - loss: 0.3926 - acc: 0.8247 - val_loss: 0.4975 - val_acc: 0.7552
Epoch 831/1500
576/576 [==============================] - 0s 106us/step - loss: 0.3925 - acc: 0.8247 - val_loss: 0.4975 - val_acc: 0.7552
Epoch 832/1500
576/576 [==============================] - 0s 130us/step - loss: 0.3925 - acc: 0.8229 - val_loss: 0.4976 - val_acc: 0.7552
Epoch 833/1500
576/576 [==============================] - 0s 120us/step - loss: 0.3924 - acc: 0.8247 - val_loss: 0.4976 - val_acc: 0.7552
Epoch 834/1500
576/576 [==============================] - 0s 95us/step - loss: 0.3923 - acc: 0.8247 - val_loss: 0.4976 - val_acc: 0.7552
Epoch 835/1500
576/576 [==============================] - 0s 104us/step - loss: 0.3922 - acc: 0.8247 - val_loss: 0.4976 - val_acc: 0.7552
Epoch 836/1500
576/576 [==============================] - 0s 115us/step - loss: 0.3922 - acc: 0.8264 - val_loss: 0.4976 - val_acc: 0.7552
Epoch 837/1500
576/576 [==============================] - 0s 109us/step - loss: 0.3921 - acc: 0.8247 - val_loss: 0.4977 - val_acc: 0.7552
Epoch 838/1500
576/576 [==============================] - 0s 99us/step - loss: 0.3921 - acc: 0.8247 - val_loss: 0.4977 - val_acc: 0.7552
Epoch 839/1500
576/576 [==============================] - 0s 97us/step - loss: 0.3921 - acc: 0.8247 - val_loss: 0.4977 - val_acc: 0.7552
Epoch 840/1500
576/576 [==============================] - 0s 106us/step - loss: 0.3920 - acc: 0.8247 - val_loss: 0.4977 - val_acc: 0.7552
Epoch 841/1500
576/576 [==============================] - 0s 102us/step - loss: 0.3919 - acc: 0.8247 - val_loss: 0.4978 - val_acc: 0.7552
Epoch 842/1500
576/576 [==============================] - 0s 108us/step - loss: 0.3918 - acc: 0.8264 - val_loss: 0.4978 - val_acc: 0.7552
Epoch 843/1500
576/576 [==============================] - 0s 118us/step - loss: 0.3917 - acc: 0.8247 - val_loss: 0.4978 - val_acc: 0.7552
Epoch 844/1500
576/576 [==============================] - 0s 102us/step - loss: 0.3917 - acc: 0.8247 - val_loss: 0.4978 - val_acc: 0.7552
Epoch 845/1500
576/576 [==============================] - 0s 99us/step - loss: 0.3916 - acc: 0.8247 - val_loss: 0.4978 - val_acc: 0.7552
Epoch 846/1500
576/576 [==============================] - 0s 101us/step - loss: 0.3915 - acc: 0.8247 - val_loss: 0.4979 - val_acc: 0.7552
Epoch 847/1500
576/576 [==============================] - 0s 101us/step - loss: 0.3915 - acc: 0.8247 - val_loss: 0.4979 - val_acc: 0.7552
Epoch 848/1500
576/576 [==============================] - 0s 116us/step - loss: 0.3914 - acc: 0.8247 - val_loss: 0.4979 - val_acc: 0.7552
Epoch 849/1500
576/576 [==============================] - 0s 101us/step - loss: 0.3913 - acc: 0.8247 - val_loss: 0.4979 - val_acc: 0.7552
Epoch 850/1500
576/576 [==============================] - 0s 109us/step - loss: 0.3913 - acc: 0.8264 - val_loss: 0.4980 - val_acc: 0.7552
Epoch 851/1500
576/576 [==============================] - 0s 132us/step - loss: 0.3913 - acc: 0.8247 - val_loss: 0.4980 - val_acc: 0.7552
Epoch 852/1500
576/576 [==============================] - 0s 115us/step - loss: 0.3912 - acc: 0.8264 - val_loss: 0.4980 - val_acc: 0.7552
Epoch 853/1500
576/576 [==============================] - 0s 108us/step - loss: 0.3911 - acc: 0.8247 - val_loss: 0.4981 - val_acc: 0.7552
Epoch 854/1500
576/576 [==============================] - 0s 102us/step - loss: 0.3910 - acc: 0.8247 - val_loss: 0.4981 - val_acc: 0.7552
Epoch 855/1500
576/576 [==============================] - 0s 90us/step - loss: 0.3910 - acc: 0.8247 - val_loss: 0.4981 - val_acc: 0.7552
Epoch 856/1500
576/576 [==============================] - 0s 90us/step - loss: 0.3909 - acc: 0.8229 - val_loss: 0.4981 - val_acc: 0.7552
Epoch 857/1500
576/576 [==============================] - 0s 97us/step - loss: 0.3908 - acc: 0.8247 - val_loss: 0.4981 - val_acc: 0.7552
Epoch 858/1500
576/576 [==============================] - 0s 127us/step - loss: 0.3908 - acc: 0.8229 - val_loss: 0.4981 - val_acc: 0.7552
Epoch 859/1500
576/576 [==============================] - 0s 97us/step - loss: 0.3907 - acc: 0.8247 - val_loss: 0.4981 - val_acc: 0.7552
Epoch 860/1500
576/576 [==============================] - 0s 90us/step - loss: 0.3907 - acc: 0.8247 - val_loss: 0.4981 - val_acc: 0.7552
Epoch 861/1500
576/576 [==============================] - 0s 111us/step - loss: 0.3906 - acc: 0.8247 - val_loss: 0.4982 - val_acc: 0.7552
Epoch 862/1500
576/576 [==============================] - 0s 111us/step - loss: 0.3905 - acc: 0.8247 - val_loss: 0.4982 - val_acc: 0.7552
Epoch 863/1500
576/576 [==============================] - 0s 104us/step - loss: 0.3904 - acc: 0.8247 - val_loss: 0.4982 - val_acc: 0.7552
Epoch 864/1500
576/576 [==============================] - 0s 97us/step - loss: 0.3904 - acc: 0.8247 - val_loss: 0.4982 - val_acc: 0.7552
Epoch 865/1500
576/576 [==============================] - 0s 97us/step - loss: 0.3903 - acc: 0.8247 - val_loss: 0.4982 - val_acc: 0.7552
Epoch 866/1500
576/576 [==============================] - 0s 94us/step - loss: 0.3903 - acc: 0.8247 - val_loss: 0.4982 - val_acc: 0.7552
Epoch 867/1500
576/576 [==============================] - 0s 90us/step - loss: 0.3902 - acc: 0.8247 - val_loss: 0.4983 - val_acc: 0.7552
Epoch 868/1500
576/576 [==============================] - 0s 109us/step - loss: 0.3901 - acc: 0.8247 - val_loss: 0.4983 - val_acc: 0.7552
Epoch 869/1500
576/576 [==============================] - 0s 90us/step - loss: 0.3901 - acc: 0.8247 - val_loss: 0.4983 - val_acc: 0.7552
Epoch 870/1500
576/576 [==============================] - 0s 88us/step - loss: 0.3900 - acc: 0.8229 - val_loss: 0.4983 - val_acc: 0.7552
Epoch 871/1500
576/576 [==============================] - 0s 102us/step - loss: 0.3899 - acc: 0.8247 - val_loss: 0.4984 - val_acc: 0.7552
Epoch 872/1500
576/576 [==============================] - 0s 95us/step - loss: 0.3898 - acc: 0.8229 - val_loss: 0.4984 - val_acc: 0.7552
Epoch 873/1500
576/576 [==============================] - 0s 90us/step - loss: 0.3898 - acc: 0.8229 - val_loss: 0.4984 - val_acc: 0.7552
Epoch 874/1500
576/576 [==============================] - 0s 101us/step - loss: 0.3897 - acc: 0.8229 - val_loss: 0.4985 - val_acc: 0.7552
Epoch 875/1500
576/576 [==============================] - 0s 102us/step - loss: 0.3897 - acc: 0.8247 - val_loss: 0.4985 - val_acc: 0.7552
Epoch 876/1500
576/576 [==============================] - 0s 92us/step - loss: 0.3896 - acc: 0.8247 - val_loss: 0.4985 - val_acc: 0.7552
Epoch 877/1500
576/576 [==============================] - 0s 94us/step - loss: 0.3895 - acc: 0.8247 - val_loss: 0.4985 - val_acc: 0.7552
Epoch 878/1500
576/576 [==============================] - 0s 106us/step - loss: 0.3895 - acc: 0.8229 - val_loss: 0.4985 - val_acc: 0.7552
Epoch 879/1500
576/576 [==============================] - 0s 99us/step - loss: 0.3894 - acc: 0.8247 - val_loss: 0.4985 - val_acc: 0.7552
Epoch 880/1500
576/576 [==============================] - 0s 99us/step - loss: 0.3894 - acc: 0.8229 - val_loss: 0.4985 - val_acc: 0.7552
Epoch 881/1500
576/576 [==============================] - 0s 92us/step - loss: 0.3892 - acc: 0.8229 - val_loss: 0.4986 - val_acc: 0.7552
Epoch 882/1500
576/576 [==============================] - 0s 108us/step - loss: 0.3892 - acc: 0.8229 - val_loss: 0.4986 - val_acc: 0.7552
Epoch 883/1500
576/576 [==============================] - 0s 97us/step - loss: 0.3891 - acc: 0.8229 - val_loss: 0.4986 - val_acc: 0.7552
Epoch 884/1500
576/576 [==============================] - 0s 99us/step - loss: 0.3891 - acc: 0.8247 - val_loss: 0.4986 - val_acc: 0.7552
Epoch 885/1500
576/576 [==============================] - 0s 97us/step - loss: 0.3890 - acc: 0.8229 - val_loss: 0.4986 - val_acc: 0.7552
Epoch 886/1500
576/576 [==============================] - 0s 92us/step - loss: 0.3890 - acc: 0.8247 - val_loss: 0.4986 - val_acc: 0.7552
Epoch 887/1500
576/576 [==============================] - 0s 90us/step - loss: 0.3889 - acc: 0.8247 - val_loss: 0.4986 - val_acc: 0.7552
Epoch 888/1500
576/576 [==============================] - 0s 78us/step - loss: 0.3889 - acc: 0.8229 - val_loss: 0.4986 - val_acc: 0.7552
Epoch 889/1500
576/576 [==============================] - 0s 90us/step - loss: 0.3887 - acc: 0.8229 - val_loss: 0.4986 - val_acc: 0.7552
Epoch 890/1500
576/576 [==============================] - 0s 94us/step - loss: 0.3886 - acc: 0.8229 - val_loss: 0.4987 - val_acc: 0.7552
Epoch 891/1500
576/576 [==============================] - 0s 104us/step - loss: 0.3886 - acc: 0.8229 - val_loss: 0.4987 - val_acc: 0.7552
Epoch 892/1500
576/576 [==============================] - 0s 85us/step - loss: 0.3885 - acc: 0.8229 - val_loss: 0.4987 - val_acc: 0.7552
Epoch 893/1500
576/576 [==============================] - 0s 125us/step - loss: 0.3885 - acc: 0.8247 - val_loss: 0.4988 - val_acc: 0.7552
Epoch 894/1500
576/576 [==============================] - 0s 95us/step - loss: 0.3884 - acc: 0.8229 - val_loss: 0.4988 - val_acc: 0.7552
Epoch 895/1500
576/576 [==============================] - 0s 113us/step - loss: 0.3883 - acc: 0.8229 - val_loss: 0.4988 - val_acc: 0.7552
Epoch 896/1500
576/576 [==============================] - 0s 102us/step - loss: 0.3883 - acc: 0.8229 - val_loss: 0.4988 - val_acc: 0.7552
Epoch 897/1500
576/576 [==============================] - 0s 101us/step - loss: 0.3882 - acc: 0.8229 - val_loss: 0.4988 - val_acc: 0.7552
Epoch 898/1500
576/576 [==============================] - 0s 116us/step - loss: 0.3881 - acc: 0.8247 - val_loss: 0.4988 - val_acc: 0.7552
Epoch 899/1500
576/576 [==============================] - 0s 135us/step - loss: 0.3881 - acc: 0.8229 - val_loss: 0.4988 - val_acc: 0.7552
Epoch 900/1500
576/576 [==============================] - 0s 111us/step - loss: 0.3881 - acc: 0.8229 - val_loss: 0.4988 - val_acc: 0.7552
Epoch 901/1500
576/576 [==============================] - 0s 106us/step - loss: 0.3880 - acc: 0.8247 - val_loss: 0.4988 - val_acc: 0.7552
Epoch 902/1500
576/576 [==============================] - 0s 125us/step - loss: 0.3880 - acc: 0.8247 - val_loss: 0.4989 - val_acc: 0.7552
Epoch 903/1500
576/576 [==============================] - 0s 109us/step - loss: 0.3879 - acc: 0.8229 - val_loss: 0.4989 - val_acc: 0.7552
Epoch 904/1500
576/576 [==============================] - 0s 128us/step - loss: 0.3877 - acc: 0.8247 - val_loss: 0.4989 - val_acc: 0.7552
Epoch 905/1500
576/576 [==============================] - 0s 108us/step - loss: 0.3877 - acc: 0.8229 - val_loss: 0.4989 - val_acc: 0.7552
Epoch 906/1500
576/576 [==============================] - 0s 106us/step - loss: 0.3876 - acc: 0.8247 - val_loss: 0.4990 - val_acc: 0.7552
Epoch 907/1500
576/576 [==============================] - 0s 104us/step - loss: 0.3876 - acc: 0.8247 - val_loss: 0.4990 - val_acc: 0.7552
Epoch 908/1500
576/576 [==============================] - 0s 123us/step - loss: 0.3875 - acc: 0.8247 - val_loss: 0.4990 - val_acc: 0.7552
Epoch 909/1500
576/576 [==============================] - 0s 146us/step - loss: 0.3874 - acc: 0.8247 - val_loss: 0.4990 - val_acc: 0.7552
Epoch 910/1500
576/576 [==============================] - 0s 109us/step - loss: 0.3874 - acc: 0.8229 - val_loss: 0.4990 - val_acc: 0.7552
Epoch 911/1500
576/576 [==============================] - 0s 106us/step - loss: 0.3873 - acc: 0.8247 - val_loss: 0.4990 - val_acc: 0.7552
Epoch 912/1500
576/576 [==============================] - 0s 109us/step - loss: 0.3872 - acc: 0.8247 - val_loss: 0.4991 - val_acc: 0.7552
Epoch 913/1500
576/576 [==============================] - 0s 109us/step - loss: 0.3872 - acc: 0.8247 - val_loss: 0.4991 - val_acc: 0.7552
Epoch 914/1500
576/576 [==============================] - 0s 137us/step - loss: 0.3871 - acc: 0.8229 - val_loss: 0.4991 - val_acc: 0.7552
Epoch 915/1500
576/576 [==============================] - 0s 111us/step - loss: 0.3870 - acc: 0.8247 - val_loss: 0.4991 - val_acc: 0.7552
Epoch 916/1500
576/576 [==============================] - 0s 109us/step - loss: 0.3870 - acc: 0.8247 - val_loss: 0.4991 - val_acc: 0.7552
Epoch 917/1500
576/576 [==============================] - 0s 128us/step - loss: 0.3869 - acc: 0.8247 - val_loss: 0.4992 - val_acc: 0.7552
Epoch 918/1500
576/576 [==============================] - 0s 116us/step - loss: 0.3868 - acc: 0.8247 - val_loss: 0.4991 - val_acc: 0.7552
Epoch 919/1500
576/576 [==============================] - 0s 108us/step - loss: 0.3867 - acc: 0.8247 - val_loss: 0.4992 - val_acc: 0.7552
Epoch 920/1500
576/576 [==============================] - 0s 125us/step - loss: 0.3867 - acc: 0.8247 - val_loss: 0.4992 - val_acc: 0.7552
Epoch 921/1500
576/576 [==============================] - 0s 109us/step - loss: 0.3867 - acc: 0.8247 - val_loss: 0.4992 - val_acc: 0.7604
Epoch 922/1500
576/576 [==============================] - 0s 127us/step - loss: 0.3866 - acc: 0.8247 - val_loss: 0.4992 - val_acc: 0.7604
Epoch 923/1500
576/576 [==============================] - 0s 108us/step - loss: 0.3866 - acc: 0.8247 - val_loss: 0.4992 - val_acc: 0.7604
Epoch 924/1500
576/576 [==============================] - 0s 106us/step - loss: 0.3865 - acc: 0.8247 - val_loss: 0.4992 - val_acc: 0.7604
Epoch 925/1500
576/576 [==============================] - 0s 123us/step - loss: 0.3864 - acc: 0.8247 - val_loss: 0.4993 - val_acc: 0.7604
Epoch 926/1500
576/576 [==============================] - 0s 123us/step - loss: 0.3863 - acc: 0.8247 - val_loss: 0.4993 - val_acc: 0.7604
Epoch 927/1500
576/576 [==============================] - 0s 108us/step - loss: 0.3863 - acc: 0.8247 - val_loss: 0.4993 - val_acc: 0.7604
Epoch 928/1500
576/576 [==============================] - 0s 108us/step - loss: 0.3862 - acc: 0.8247 - val_loss: 0.4993 - val_acc: 0.7604
Epoch 929/1500
576/576 [==============================] - 0s 108us/step - loss: 0.3862 - acc: 0.8247 - val_loss: 0.4993 - val_acc: 0.7604
Epoch 930/1500
576/576 [==============================] - 0s 101us/step - loss: 0.3861 - acc: 0.8247 - val_loss: 0.4994 - val_acc: 0.7604
Epoch 931/1500
576/576 [==============================] - 0s 102us/step - loss: 0.3860 - acc: 0.8247 - val_loss: 0.4994 - val_acc: 0.7604
Epoch 932/1500
576/576 [==============================] - 0s 111us/step - loss: 0.3860 - acc: 0.8247 - val_loss: 0.4994 - val_acc: 0.7604
Epoch 933/1500
576/576 [==============================] - 0s 109us/step - loss: 0.3860 - acc: 0.8247 - val_loss: 0.4995 - val_acc: 0.7604
Epoch 934/1500
576/576 [==============================] - 0s 106us/step - loss: 0.3859 - acc: 0.8247 - val_loss: 0.4994 - val_acc: 0.7604
Epoch 935/1500
576/576 [==============================] - 0s 104us/step - loss: 0.3858 - acc: 0.8247 - val_loss: 0.4995 - val_acc: 0.7604
Epoch 936/1500
576/576 [==============================] - 0s 101us/step - loss: 0.3857 - acc: 0.8247 - val_loss: 0.4995 - val_acc: 0.7552
Epoch 937/1500
576/576 [==============================] - 0s 109us/step - loss: 0.3857 - acc: 0.8247 - val_loss: 0.4995 - val_acc: 0.7552
Epoch 938/1500
576/576 [==============================] - 0s 106us/step - loss: 0.3857 - acc: 0.8247 - val_loss: 0.4995 - val_acc: 0.7552
Epoch 939/1500
576/576 [==============================] - 0s 106us/step - loss: 0.3855 - acc: 0.8247 - val_loss: 0.4996 - val_acc: 0.7552
Epoch 940/1500
576/576 [==============================] - 0s 106us/step - loss: 0.3855 - acc: 0.8247 - val_loss: 0.4996 - val_acc: 0.7552
Epoch 941/1500
576/576 [==============================] - 0s 101us/step - loss: 0.3854 - acc: 0.8247 - val_loss: 0.4996 - val_acc: 0.7552
Epoch 942/1500
576/576 [==============================] - 0s 109us/step - loss: 0.3854 - acc: 0.8247 - val_loss: 0.4996 - val_acc: 0.7552
Epoch 943/1500
576/576 [==============================] - 0s 109us/step - loss: 0.3853 - acc: 0.8247 - val_loss: 0.4996 - val_acc: 0.7552
Epoch 944/1500
576/576 [==============================] - 0s 102us/step - loss: 0.3852 - acc: 0.8247 - val_loss: 0.4997 - val_acc: 0.7552
Epoch 945/1500
576/576 [==============================] - 0s 102us/step - loss: 0.3852 - acc: 0.8247 - val_loss: 0.4997 - val_acc: 0.7552
Epoch 946/1500
576/576 [==============================] - 0s 109us/step - loss: 0.3851 - acc: 0.8247 - val_loss: 0.4997 - val_acc: 0.7552
Epoch 947/1500
576/576 [==============================] - 0s 95us/step - loss: 0.3851 - acc: 0.8247 - val_loss: 0.4997 - val_acc: 0.7552
Epoch 948/1500
576/576 [==============================] - 0s 106us/step - loss: 0.3850 - acc: 0.8247 - val_loss: 0.4997 - val_acc: 0.7552
Epoch 949/1500
576/576 [==============================] - 0s 94us/step - loss: 0.3849 - acc: 0.8247 - val_loss: 0.4997 - val_acc: 0.7552
Epoch 950/1500
576/576 [==============================] - 0s 139us/step - loss: 0.3849 - acc: 0.8247 - val_loss: 0.4997 - val_acc: 0.7552
Epoch 951/1500
576/576 [==============================] - 0s 125us/step - loss: 0.3848 - acc: 0.8247 - val_loss: 0.4998 - val_acc: 0.7552
Epoch 952/1500
576/576 [==============================] - 0s 108us/step - loss: 0.3848 - acc: 0.8247 - val_loss: 0.4998 - val_acc: 0.7552
Epoch 953/1500
576/576 [==============================] - 0s 123us/step - loss: 0.3847 - acc: 0.8247 - val_loss: 0.4998 - val_acc: 0.7552
Epoch 954/1500
576/576 [==============================] - 0s 127us/step - loss: 0.3846 - acc: 0.8247 - val_loss: 0.4998 - val_acc: 0.7552
Epoch 955/1500
576/576 [==============================] - 0s 123us/step - loss: 0.3846 - acc: 0.8247 - val_loss: 0.4998 - val_acc: 0.7552
Epoch 956/1500
576/576 [==============================] - 0s 111us/step - loss: 0.3845 - acc: 0.8247 - val_loss: 0.4999 - val_acc: 0.7552
Epoch 957/1500
576/576 [==============================] - 0s 111us/step - loss: 0.3844 - acc: 0.8247 - val_loss: 0.4999 - val_acc: 0.7552
Epoch 958/1500
576/576 [==============================] - 0s 146us/step - loss: 0.3844 - acc: 0.8247 - val_loss: 0.4998 - val_acc: 0.7552
Epoch 959/1500
576/576 [==============================] - 0s 106us/step - loss: 0.3843 - acc: 0.8229 - val_loss: 0.4999 - val_acc: 0.7552
Epoch 960/1500
576/576 [==============================] - 0s 132us/step - loss: 0.3843 - acc: 0.8229 - val_loss: 0.4999 - val_acc: 0.7552
Epoch 961/1500
576/576 [==============================] - 0s 116us/step - loss: 0.3842 - acc: 0.8247 - val_loss: 0.4999 - val_acc: 0.7552
Epoch 962/1500
576/576 [==============================] - 0s 111us/step - loss: 0.3841 - acc: 0.8247 - val_loss: 0.5000 - val_acc: 0.7552
Epoch 963/1500
576/576 [==============================] - 0s 109us/step - loss: 0.3841 - acc: 0.8247 - val_loss: 0.5000 - val_acc: 0.7552
Epoch 964/1500
576/576 [==============================] - 0s 111us/step - loss: 0.3840 - acc: 0.8229 - val_loss: 0.5000 - val_acc: 0.7552
Epoch 965/1500
576/576 [==============================] - 0s 115us/step - loss: 0.3840 - acc: 0.8229 - val_loss: 0.5000 - val_acc: 0.7552
Epoch 966/1500
576/576 [==============================] - 0s 115us/step - loss: 0.3838 - acc: 0.8247 - val_loss: 0.5000 - val_acc: 0.7552
Epoch 967/1500
576/576 [==============================] - 0s 109us/step - loss: 0.3839 - acc: 0.8247 - val_loss: 0.5000 - val_acc: 0.7552
Epoch 968/1500
576/576 [==============================] - 0s 116us/step - loss: 0.3838 - acc: 0.8247 - val_loss: 0.5000 - val_acc: 0.7552
Epoch 969/1500
576/576 [==============================] - 0s 123us/step - loss: 0.3837 - acc: 0.8247 - val_loss: 0.5001 - val_acc: 0.7552
Epoch 970/1500
576/576 [==============================] - 0s 115us/step - loss: 0.3836 - acc: 0.8229 - val_loss: 0.5001 - val_acc: 0.7552
Epoch 971/1500
576/576 [==============================] - 0s 104us/step - loss: 0.3836 - acc: 0.8247 - val_loss: 0.5001 - val_acc: 0.7552
Epoch 972/1500
576/576 [==============================] - 0s 116us/step - loss: 0.3835 - acc: 0.8229 - val_loss: 0.5001 - val_acc: 0.7500
Epoch 973/1500
576/576 [==============================] - 0s 118us/step - loss: 0.3835 - acc: 0.8247 - val_loss: 0.5001 - val_acc: 0.7500
Epoch 974/1500
576/576 [==============================] - 0s 99us/step - loss: 0.3834 - acc: 0.8247 - val_loss: 0.5001 - val_acc: 0.7500
Epoch 975/1500
576/576 [==============================] - 0s 106us/step - loss: 0.3833 - acc: 0.8229 - val_loss: 0.5002 - val_acc: 0.7500
Epoch 976/1500
576/576 [==============================] - 0s 101us/step - loss: 0.3833 - acc: 0.8229 - val_loss: 0.5002 - val_acc: 0.7500
Epoch 977/1500
576/576 [==============================] - 0s 104us/step - loss: 0.3832 - acc: 0.8229 - val_loss: 0.5002 - val_acc: 0.7500
Epoch 978/1500
576/576 [==============================] - 0s 102us/step - loss: 0.3830 - acc: 0.8229 - val_loss: 0.5002 - val_acc: 0.7500
Epoch 979/1500
576/576 [==============================] - 0s 99us/step - loss: 0.3831 - acc: 0.8229 - val_loss: 0.5002 - val_acc: 0.7500
Epoch 980/1500
576/576 [==============================] - 0s 106us/step - loss: 0.3830 - acc: 0.8229 - val_loss: 0.5002 - val_acc: 0.7500
Epoch 981/1500
576/576 [==============================] - 0s 104us/step - loss: 0.3829 - acc: 0.8229 - val_loss: 0.5003 - val_acc: 0.7500
Epoch 982/1500
576/576 [==============================] - ETA: 0s - loss: 0.4469 - acc: 0.718 - 0s 108us/step - loss: 0.3829 - acc: 0.8229 - val_loss: 0.5003 - val_acc: 0.7500
Epoch 983/1500
576/576 [==============================] - 0s 90us/step - loss: 0.3828 - acc: 0.8229 - val_loss: 0.5003 - val_acc: 0.7500
Epoch 984/1500
576/576 [==============================] - 0s 108us/step - loss: 0.3827 - acc: 0.8229 - val_loss: 0.5004 - val_acc: 0.7500
Epoch 985/1500
576/576 [==============================] - 0s 102us/step - loss: 0.3826 - acc: 0.8229 - val_loss: 0.5004 - val_acc: 0.7500
Epoch 986/1500
576/576 [==============================] - 0s 97us/step - loss: 0.3826 - acc: 0.8229 - val_loss: 0.5004 - val_acc: 0.7500
Epoch 987/1500
576/576 [==============================] - 0s 99us/step - loss: 0.3825 - acc: 0.8229 - val_loss: 0.5004 - val_acc: 0.7500
Epoch 988/1500
576/576 [==============================] - 0s 92us/step - loss: 0.3825 - acc: 0.8247 - val_loss: 0.5004 - val_acc: 0.7500
Epoch 989/1500
576/576 [==============================] - 0s 95us/step - loss: 0.3824 - acc: 0.8229 - val_loss: 0.5005 - val_acc: 0.7500
Epoch 990/1500
576/576 [==============================] - 0s 90us/step - loss: 0.3823 - acc: 0.8229 - val_loss: 0.5005 - val_acc: 0.7500
Epoch 991/1500
576/576 [==============================] - 0s 97us/step - loss: 0.3823 - acc: 0.8229 - val_loss: 0.5005 - val_acc: 0.7500
Epoch 992/1500
576/576 [==============================] - 0s 108us/step - loss: 0.3822 - acc: 0.8229 - val_loss: 0.5006 - val_acc: 0.7500
Epoch 993/1500
576/576 [==============================] - 0s 102us/step - loss: 0.3822 - acc: 0.8229 - val_loss: 0.5006 - val_acc: 0.7500
Epoch 994/1500
576/576 [==============================] - 0s 115us/step - loss: 0.3821 - acc: 0.8229 - val_loss: 0.5006 - val_acc: 0.7500
Epoch 995/1500
576/576 [==============================] - 0s 108us/step - loss: 0.3820 - acc: 0.8229 - val_loss: 0.5007 - val_acc: 0.7500
Epoch 996/1500
576/576 [==============================] - 0s 99us/step - loss: 0.3820 - acc: 0.8229 - val_loss: 0.5007 - val_acc: 0.7500
Epoch 997/1500
576/576 [==============================] - 0s 104us/step - loss: 0.3818 - acc: 0.8229 - val_loss: 0.5007 - val_acc: 0.7500
Epoch 998/1500
576/576 [==============================] - 0s 128us/step - loss: 0.3818 - acc: 0.8229 - val_loss: 0.5007 - val_acc: 0.7500
Epoch 999/1500
576/576 [==============================] - 0s 104us/step - loss: 0.3818 - acc: 0.8229 - val_loss: 0.5008 - val_acc: 0.7500
Epoch 1000/1500
576/576 [==============================] - 0s 94us/step - loss: 0.3817 - acc: 0.8229 - val_loss: 0.5008 - val_acc: 0.7500
Epoch 1001/1500
576/576 [==============================] - 0s 111us/step - loss: 0.3816 - acc: 0.8229 - val_loss: 0.5008 - val_acc: 0.7500
Epoch 1002/1500
576/576 [==============================] - 0s 99us/step - loss: 0.3816 - acc: 0.8229 - val_loss: 0.5008 - val_acc: 0.7500
Epoch 1003/1500
576/576 [==============================] - 0s 90us/step - loss: 0.3815 - acc: 0.8229 - val_loss: 0.5009 - val_acc: 0.7500
Epoch 1004/1500
576/576 [==============================] - 0s 90us/step - loss: 0.3814 - acc: 0.8229 - val_loss: 0.5008 - val_acc: 0.7500
Epoch 1005/1500
576/576 [==============================] - 0s 106us/step - loss: 0.3813 - acc: 0.8229 - val_loss: 0.5009 - val_acc: 0.7500
Epoch 1006/1500
576/576 [==============================] - 0s 113us/step - loss: 0.3813 - acc: 0.8229 - val_loss: 0.5009 - val_acc: 0.7500
Epoch 1007/1500
576/576 [==============================] - 0s 99us/step - loss: 0.3812 - acc: 0.8229 - val_loss: 0.5009 - val_acc: 0.7500
Epoch 1008/1500
576/576 [==============================] - 0s 123us/step - loss: 0.3812 - acc: 0.8229 - val_loss: 0.5009 - val_acc: 0.7500
Epoch 1009/1500
576/576 [==============================] - 0s 158us/step - loss: 0.3811 - acc: 0.8229 - val_loss: 0.5010 - val_acc: 0.7500
Epoch 1010/1500
576/576 [==============================] - 0s 168us/step - loss: 0.3810 - acc: 0.8229 - val_loss: 0.5011 - val_acc: 0.7500
Epoch 1011/1500
576/576 [==============================] - 0s 142us/step - loss: 0.3810 - acc: 0.8229 - val_loss: 0.5011 - val_acc: 0.7500
Epoch 1012/1500
576/576 [==============================] - 0s 128us/step - loss: 0.3809 - acc: 0.8229 - val_loss: 0.5011 - val_acc: 0.7500
Epoch 1013/1500
576/576 [==============================] - 0s 132us/step - loss: 0.3809 - acc: 0.8229 - val_loss: 0.5011 - val_acc: 0.7500
Epoch 1014/1500
576/576 [==============================] - 0s 137us/step - loss: 0.3807 - acc: 0.8229 - val_loss: 0.5011 - val_acc: 0.7500
Epoch 1015/1500
576/576 [==============================] - 0s 151us/step - loss: 0.3807 - acc: 0.8229 - val_loss: 0.5012 - val_acc: 0.7500
Epoch 1016/1500
576/576 [==============================] - 0s 142us/step - loss: 0.3806 - acc: 0.8229 - val_loss: 0.5011 - val_acc: 0.7500
Epoch 1017/1500
576/576 [==============================] - 0s 147us/step - loss: 0.3805 - acc: 0.8229 - val_loss: 0.5012 - val_acc: 0.7500
Epoch 1018/1500
576/576 [==============================] - 0s 121us/step - loss: 0.3805 - acc: 0.8229 - val_loss: 0.5012 - val_acc: 0.7500
Epoch 1019/1500
576/576 [==============================] - 0s 139us/step - loss: 0.3804 - acc: 0.8229 - val_loss: 0.5012 - val_acc: 0.7500
Epoch 1020/1500
576/576 [==============================] - 0s 128us/step - loss: 0.3804 - acc: 0.8229 - val_loss: 0.5012 - val_acc: 0.7500
Epoch 1021/1500
576/576 [==============================] - ETA: 0s - loss: 0.3918 - acc: 0.818 - 0s 141us/step - loss: 0.3803 - acc: 0.8229 - val_loss: 0.5013 - val_acc: 0.7500
Epoch 1022/1500
576/576 [==============================] - 0s 130us/step - loss: 0.3802 - acc: 0.8229 - val_loss: 0.5013 - val_acc: 0.7500
Epoch 1023/1500
576/576 [==============================] - 0s 120us/step - loss: 0.3801 - acc: 0.8229 - val_loss: 0.5013 - val_acc: 0.7500
Epoch 1024/1500
576/576 [==============================] - 0s 154us/step - loss: 0.3801 - acc: 0.8229 - val_loss: 0.5013 - val_acc: 0.7500
Epoch 1025/1500
576/576 [==============================] - 0s 142us/step - loss: 0.3800 - acc: 0.8229 - val_loss: 0.5013 - val_acc: 0.7500
Epoch 1026/1500
576/576 [==============================] - 0s 115us/step - loss: 0.3800 - acc: 0.8229 - val_loss: 0.5014 - val_acc: 0.7500
Epoch 1027/1500
576/576 [==============================] - 0s 128us/step - loss: 0.3799 - acc: 0.8229 - val_loss: 0.5014 - val_acc: 0.7500
Epoch 1028/1500
576/576 [==============================] - 0s 144us/step - loss: 0.3798 - acc: 0.8229 - val_loss: 0.5014 - val_acc: 0.7500
Epoch 1029/1500
576/576 [==============================] - 0s 116us/step - loss: 0.3797 - acc: 0.8229 - val_loss: 0.5014 - val_acc: 0.7500
Epoch 1030/1500
576/576 [==============================] - 0s 116us/step - loss: 0.3797 - acc: 0.8229 - val_loss: 0.5014 - val_acc: 0.7500
Epoch 1031/1500
576/576 [==============================] - 0s 146us/step - loss: 0.3796 - acc: 0.8229 - val_loss: 0.5015 - val_acc: 0.7500
Epoch 1032/1500
576/576 [==============================] - 0s 134us/step - loss: 0.3796 - acc: 0.8229 - val_loss: 0.5015 - val_acc: 0.7500
Epoch 1033/1500
576/576 [==============================] - 0s 116us/step - loss: 0.3795 - acc: 0.8229 - val_loss: 0.5015 - val_acc: 0.7500
Epoch 1034/1500
576/576 [==============================] - 0s 128us/step - loss: 0.3794 - acc: 0.8229 - val_loss: 0.5015 - val_acc: 0.7500
Epoch 1035/1500
576/576 [==============================] - 0s 146us/step - loss: 0.3794 - acc: 0.8229 - val_loss: 0.5016 - val_acc: 0.7500
Epoch 1036/1500
576/576 [==============================] - 0s 116us/step - loss: 0.3793 - acc: 0.8229 - val_loss: 0.5016 - val_acc: 0.7500
Epoch 1037/1500
576/576 [==============================] - 0s 130us/step - loss: 0.3792 - acc: 0.8229 - val_loss: 0.5016 - val_acc: 0.7500
Epoch 1038/1500
576/576 [==============================] - 0s 113us/step - loss: 0.3792 - acc: 0.8229 - val_loss: 0.5017 - val_acc: 0.7500
Epoch 1039/1500
576/576 [==============================] - 0s 142us/step - loss: 0.3791 - acc: 0.8229 - val_loss: 0.5017 - val_acc: 0.7500
Epoch 1040/1500
576/576 [==============================] - 0s 108us/step - loss: 0.3791 - acc: 0.8247 - val_loss: 0.5017 - val_acc: 0.7500
Epoch 1041/1500
576/576 [==============================] - 0s 147us/step - loss: 0.3790 - acc: 0.8247 - val_loss: 0.5018 - val_acc: 0.7500
Epoch 1042/1500
576/576 [==============================] - 0s 144us/step - loss: 0.3789 - acc: 0.8229 - val_loss: 0.5017 - val_acc: 0.7500
Epoch 1043/1500
576/576 [==============================] - 0s 113us/step - loss: 0.3788 - acc: 0.8229 - val_loss: 0.5018 - val_acc: 0.7500
Epoch 1044/1500
576/576 [==============================] - 0s 118us/step - loss: 0.3787 - acc: 0.8229 - val_loss: 0.5018 - val_acc: 0.7500
Epoch 1045/1500
576/576 [==============================] - 0s 125us/step - loss: 0.3787 - acc: 0.8229 - val_loss: 0.5018 - val_acc: 0.7500
Epoch 1046/1500
576/576 [==============================] - 0s 111us/step - loss: 0.3787 - acc: 0.8229 - val_loss: 0.5019 - val_acc: 0.7500
Epoch 1047/1500
576/576 [==============================] - 0s 139us/step - loss: 0.3786 - acc: 0.8229 - val_loss: 0.5019 - val_acc: 0.7500
Epoch 1048/1500
576/576 [==============================] - 0s 128us/step - loss: 0.3785 - acc: 0.8247 - val_loss: 0.5019 - val_acc: 0.7500
Epoch 1049/1500
576/576 [==============================] - 0s 127us/step - loss: 0.3784 - acc: 0.8247 - val_loss: 0.5019 - val_acc: 0.7500
Epoch 1050/1500
576/576 [==============================] - 0s 151us/step - loss: 0.3783 - acc: 0.8229 - val_loss: 0.5020 - val_acc: 0.7500
Epoch 1051/1500
576/576 [==============================] - 0s 113us/step - loss: 0.3783 - acc: 0.8247 - val_loss: 0.5021 - val_acc: 0.7500
Epoch 1052/1500
576/576 [==============================] - 0s 118us/step - loss: 0.3783 - acc: 0.8229 - val_loss: 0.5021 - val_acc: 0.7500
Epoch 1053/1500
576/576 [==============================] - 0s 102us/step - loss: 0.3782 - acc: 0.8229 - val_loss: 0.5021 - val_acc: 0.7500
Epoch 1054/1500
576/576 [==============================] - 0s 109us/step - loss: 0.3782 - acc: 0.8247 - val_loss: 0.5021 - val_acc: 0.7500
Epoch 1055/1500
576/576 [==============================] - 0s 135us/step - loss: 0.3781 - acc: 0.8247 - val_loss: 0.5021 - val_acc: 0.7500
Epoch 1056/1500
576/576 [==============================] - 0s 111us/step - loss: 0.3780 - acc: 0.8229 - val_loss: 0.5021 - val_acc: 0.7500
Epoch 1057/1500
576/576 [==============================] - 0s 92us/step - loss: 0.3779 - acc: 0.8229 - val_loss: 0.5022 - val_acc: 0.7500
Epoch 1058/1500
576/576 [==============================] - 0s 94us/step - loss: 0.3778 - acc: 0.8229 - val_loss: 0.5022 - val_acc: 0.7500
Epoch 1059/1500
576/576 [==============================] - 0s 90us/step - loss: 0.3778 - acc: 0.8229 - val_loss: 0.5023 - val_acc: 0.7500
Epoch 1060/1500
576/576 [==============================] - 0s 95us/step - loss: 0.3777 - acc: 0.8247 - val_loss: 0.5023 - val_acc: 0.7500
Epoch 1061/1500
576/576 [==============================] - 0s 115us/step - loss: 0.3776 - acc: 0.8247 - val_loss: 0.5023 - val_acc: 0.7500
Epoch 1062/1500
576/576 [==============================] - 0s 87us/step - loss: 0.3776 - acc: 0.8229 - val_loss: 0.5024 - val_acc: 0.7500
Epoch 1063/1500
576/576 [==============================] - 0s 99us/step - loss: 0.3775 - acc: 0.8247 - val_loss: 0.5024 - val_acc: 0.7500
Epoch 1064/1500
576/576 [==============================] - 0s 104us/step - loss: 0.3774 - acc: 0.8229 - val_loss: 0.5025 - val_acc: 0.7500
Epoch 1065/1500
576/576 [==============================] - 0s 109us/step - loss: 0.3774 - acc: 0.8247 - val_loss: 0.5025 - val_acc: 0.7500
Epoch 1066/1500
576/576 [==============================] - 0s 102us/step - loss: 0.3773 - acc: 0.8247 - val_loss: 0.5025 - val_acc: 0.7500
Epoch 1067/1500
576/576 [==============================] - 0s 92us/step - loss: 0.3773 - acc: 0.8247 - val_loss: 0.5025 - val_acc: 0.7500
Epoch 1068/1500
576/576 [==============================] - 0s 115us/step - loss: 0.3772 - acc: 0.8247 - val_loss: 0.5026 - val_acc: 0.7500
Epoch 1069/1500
576/576 [==============================] - 0s 102us/step - loss: 0.3771 - acc: 0.8247 - val_loss: 0.5026 - val_acc: 0.7500
Epoch 1070/1500
576/576 [==============================] - 0s 97us/step - loss: 0.3771 - acc: 0.8247 - val_loss: 0.5026 - val_acc: 0.7500
Epoch 1071/1500
576/576 [==============================] - 0s 102us/step - loss: 0.3770 - acc: 0.8247 - val_loss: 0.5027 - val_acc: 0.7500
Epoch 1072/1500
576/576 [==============================] - 0s 130us/step - loss: 0.3769 - acc: 0.8247 - val_loss: 0.5026 - val_acc: 0.7500
Epoch 1073/1500
576/576 [==============================] - 0s 101us/step - loss: 0.3768 - acc: 0.8247 - val_loss: 0.5027 - val_acc: 0.7500
Epoch 1074/1500
576/576 [==============================] - 0s 139us/step - loss: 0.3768 - acc: 0.8247 - val_loss: 0.5027 - val_acc: 0.7500
Epoch 1075/1500
576/576 [==============================] - 0s 154us/step - loss: 0.3767 - acc: 0.8247 - val_loss: 0.5028 - val_acc: 0.7500
Epoch 1076/1500
576/576 [==============================] - 0s 144us/step - loss: 0.3767 - acc: 0.8247 - val_loss: 0.5028 - val_acc: 0.7500
Epoch 1077/1500
576/576 [==============================] - 0s 113us/step - loss: 0.3767 - acc: 0.8247 - val_loss: 0.5028 - val_acc: 0.7500
Epoch 1078/1500
576/576 [==============================] - 0s 156us/step - loss: 0.3765 - acc: 0.8247 - val_loss: 0.5028 - val_acc: 0.7500
Epoch 1079/1500
576/576 [==============================] - 0s 149us/step - loss: 0.3764 - acc: 0.8247 - val_loss: 0.5028 - val_acc: 0.7500
Epoch 1080/1500
576/576 [==============================] - 0s 144us/step - loss: 0.3764 - acc: 0.8247 - val_loss: 0.5028 - val_acc: 0.7500
Epoch 1081/1500
576/576 [==============================] - 0s 132us/step - loss: 0.3763 - acc: 0.8247 - val_loss: 0.5029 - val_acc: 0.7500
Epoch 1082/1500
576/576 [==============================] - 0s 141us/step - loss: 0.3763 - acc: 0.8247 - val_loss: 0.5029 - val_acc: 0.7500
Epoch 1083/1500
576/576 [==============================] - 0s 135us/step - loss: 0.3762 - acc: 0.8247 - val_loss: 0.5029 - val_acc: 0.7500
Epoch 1084/1500
576/576 [==============================] - 0s 106us/step - loss: 0.3761 - acc: 0.8247 - val_loss: 0.5029 - val_acc: 0.7500
Epoch 1085/1500
576/576 [==============================] - 0s 118us/step - loss: 0.3761 - acc: 0.8247 - val_loss: 0.5030 - val_acc: 0.7500
Epoch 1086/1500
576/576 [==============================] - 0s 108us/step - loss: 0.3760 - acc: 0.8247 - val_loss: 0.5030 - val_acc: 0.7500
Epoch 1087/1500
576/576 [==============================] - 0s 134us/step - loss: 0.3760 - acc: 0.8247 - val_loss: 0.5030 - val_acc: 0.7500
Epoch 1088/1500
576/576 [==============================] - 0s 132us/step - loss: 0.3759 - acc: 0.8247 - val_loss: 0.5030 - val_acc: 0.7500
Epoch 1089/1500
576/576 [==============================] - 0s 115us/step - loss: 0.3759 - acc: 0.8247 - val_loss: 0.5030 - val_acc: 0.7500
Epoch 1090/1500
576/576 [==============================] - 0s 111us/step - loss: 0.3757 - acc: 0.8247 - val_loss: 0.5031 - val_acc: 0.7500
Epoch 1091/1500
576/576 [==============================] - 0s 130us/step - loss: 0.3757 - acc: 0.8247 - val_loss: 0.5030 - val_acc: 0.7500
Epoch 1092/1500
576/576 [==============================] - 0s 144us/step - loss: 0.3756 - acc: 0.8264 - val_loss: 0.5031 - val_acc: 0.7500
Epoch 1093/1500
576/576 [==============================] - 0s 128us/step - loss: 0.3755 - acc: 0.8247 - val_loss: 0.5031 - val_acc: 0.7500
Epoch 1094/1500
576/576 [==============================] - 0s 127us/step - loss: 0.3755 - acc: 0.8247 - val_loss: 0.5031 - val_acc: 0.7500
Epoch 1095/1500
576/576 [==============================] - 0s 106us/step - loss: 0.3754 - acc: 0.8247 - val_loss: 0.5031 - val_acc: 0.7500
Epoch 1096/1500
576/576 [==============================] - 0s 108us/step - loss: 0.3753 - acc: 0.8247 - val_loss: 0.5031 - val_acc: 0.7500
Epoch 1097/1500
576/576 [==============================] - 0s 97us/step - loss: 0.3752 - acc: 0.8247 - val_loss: 0.5031 - val_acc: 0.7500
Epoch 1098/1500
576/576 [==============================] - 0s 104us/step - loss: 0.3752 - acc: 0.8247 - val_loss: 0.5032 - val_acc: 0.7500
Epoch 1099/1500
576/576 [==============================] - 0s 108us/step - loss: 0.3752 - acc: 0.8247 - val_loss: 0.5032 - val_acc: 0.7500
Epoch 1100/1500
576/576 [==============================] - 0s 92us/step - loss: 0.3751 - acc: 0.8247 - val_loss: 0.5033 - val_acc: 0.7500
Epoch 1101/1500
576/576 [==============================] - 0s 108us/step - loss: 0.3751 - acc: 0.8247 - val_loss: 0.5032 - val_acc: 0.7448
Epoch 1102/1500
576/576 [==============================] - 0s 106us/step - loss: 0.3749 - acc: 0.8247 - val_loss: 0.5033 - val_acc: 0.7500
Epoch 1103/1500
576/576 [==============================] - 0s 102us/step - loss: 0.3748 - acc: 0.8247 - val_loss: 0.5033 - val_acc: 0.7500
Epoch 1104/1500
576/576 [==============================] - 0s 94us/step - loss: 0.3748 - acc: 0.8247 - val_loss: 0.5034 - val_acc: 0.7500
Epoch 1105/1500
576/576 [==============================] - 0s 102us/step - loss: 0.3748 - acc: 0.8247 - val_loss: 0.5034 - val_acc: 0.7500
Epoch 1106/1500
576/576 [==============================] - 0s 130us/step - loss: 0.3746 - acc: 0.8247 - val_loss: 0.5034 - val_acc: 0.7500
Epoch 1107/1500
576/576 [==============================] - 0s 149us/step - loss: 0.3747 - acc: 0.8264 - val_loss: 0.5035 - val_acc: 0.7500
Epoch 1108/1500
576/576 [==============================] - 0s 90us/step - loss: 0.3746 - acc: 0.8264 - val_loss: 0.5034 - val_acc: 0.7500
Epoch 1109/1500
576/576 [==============================] - 0s 111us/step - loss: 0.3745 - acc: 0.8264 - val_loss: 0.5034 - val_acc: 0.7500
Epoch 1110/1500
576/576 [==============================] - 0s 94us/step - loss: 0.3744 - acc: 0.8264 - val_loss: 0.5035 - val_acc: 0.7500
Epoch 1111/1500
576/576 [==============================] - 0s 102us/step - loss: 0.3743 - acc: 0.8247 - val_loss: 0.5035 - val_acc: 0.7448
Epoch 1112/1500
576/576 [==============================] - 0s 121us/step - loss: 0.3743 - acc: 0.8264 - val_loss: 0.5036 - val_acc: 0.7500
Epoch 1113/1500
576/576 [==============================] - 0s 125us/step - loss: 0.3742 - acc: 0.8264 - val_loss: 0.5036 - val_acc: 0.7500
Epoch 1114/1500
576/576 [==============================] - 0s 99us/step - loss: 0.3741 - acc: 0.8264 - val_loss: 0.5036 - val_acc: 0.7500
Epoch 1115/1500
576/576 [==============================] - 0s 108us/step - loss: 0.3741 - acc: 0.8264 - val_loss: 0.5037 - val_acc: 0.7448
Epoch 1116/1500
576/576 [==============================] - 0s 90us/step - loss: 0.3740 - acc: 0.8247 - val_loss: 0.5037 - val_acc: 0.7500
Epoch 1117/1500
576/576 [==============================] - 0s 137us/step - loss: 0.3740 - acc: 0.8264 - val_loss: 0.5038 - val_acc: 0.7500
Epoch 1118/1500
576/576 [==============================] - 0s 108us/step - loss: 0.3740 - acc: 0.8264 - val_loss: 0.5038 - val_acc: 0.7500
Epoch 1119/1500
576/576 [==============================] - 0s 115us/step - loss: 0.3738 - acc: 0.8264 - val_loss: 0.5038 - val_acc: 0.7500
Epoch 1120/1500
576/576 [==============================] - 0s 118us/step - loss: 0.3738 - acc: 0.8264 - val_loss: 0.5039 - val_acc: 0.7500
Epoch 1121/1500
576/576 [==============================] - 0s 135us/step - loss: 0.3737 - acc: 0.8264 - val_loss: 0.5038 - val_acc: 0.7500
Epoch 1122/1500
576/576 [==============================] - 0s 125us/step - loss: 0.3737 - acc: 0.8247 - val_loss: 0.5038 - val_acc: 0.7448
Epoch 1123/1500
576/576 [==============================] - 0s 121us/step - loss: 0.3735 - acc: 0.8264 - val_loss: 0.5039 - val_acc: 0.7448
Epoch 1124/1500
576/576 [==============================] - 0s 172us/step - loss: 0.3736 - acc: 0.8264 - val_loss: 0.5039 - val_acc: 0.7448
Epoch 1125/1500
576/576 [==============================] - 0s 130us/step - loss: 0.3734 - acc: 0.8247 - val_loss: 0.5039 - val_acc: 0.7448
Epoch 1126/1500
576/576 [==============================] - 0s 147us/step - loss: 0.3734 - acc: 0.8264 - val_loss: 0.5039 - val_acc: 0.7448
Epoch 1127/1500
576/576 [==============================] - 0s 120us/step - loss: 0.3733 - acc: 0.8264 - val_loss: 0.5039 - val_acc: 0.7448
Epoch 1128/1500
576/576 [==============================] - 0s 108us/step - loss: 0.3733 - acc: 0.8281 - val_loss: 0.5039 - val_acc: 0.7448
Epoch 1129/1500
576/576 [==============================] - 0s 109us/step - loss: 0.3732 - acc: 0.8264 - val_loss: 0.5039 - val_acc: 0.7448
Epoch 1130/1500
576/576 [==============================] - 0s 128us/step - loss: 0.3732 - acc: 0.8264 - val_loss: 0.5039 - val_acc: 0.7448
Epoch 1131/1500
576/576 [==============================] - 0s 109us/step - loss: 0.3731 - acc: 0.8281 - val_loss: 0.5040 - val_acc: 0.7448
Epoch 1132/1500
576/576 [==============================] - 0s 134us/step - loss: 0.3730 - acc: 0.8281 - val_loss: 0.5041 - val_acc: 0.7500
Epoch 1133/1500
576/576 [==============================] - 0s 113us/step - loss: 0.3729 - acc: 0.8281 - val_loss: 0.5041 - val_acc: 0.7448
Epoch 1134/1500
576/576 [==============================] - 0s 101us/step - loss: 0.3729 - acc: 0.8281 - val_loss: 0.5041 - val_acc: 0.7448
Epoch 1135/1500
576/576 [==============================] - 0s 102us/step - loss: 0.3728 - acc: 0.8264 - val_loss: 0.5041 - val_acc: 0.7448
Epoch 1136/1500
576/576 [==============================] - 0s 118us/step - loss: 0.3727 - acc: 0.8264 - val_loss: 0.5041 - val_acc: 0.7448
Epoch 1137/1500
576/576 [==============================] - 0s 102us/step - loss: 0.3727 - acc: 0.8281 - val_loss: 0.5041 - val_acc: 0.7448
Epoch 1138/1500
576/576 [==============================] - 0s 111us/step - loss: 0.3726 - acc: 0.8281 - val_loss: 0.5041 - val_acc: 0.7448
Epoch 1139/1500
576/576 [==============================] - 0s 111us/step - loss: 0.3725 - acc: 0.8281 - val_loss: 0.5042 - val_acc: 0.7448
Epoch 1140/1500
576/576 [==============================] - 0s 115us/step - loss: 0.3725 - acc: 0.8264 - val_loss: 0.5042 - val_acc: 0.7448
Epoch 1141/1500
576/576 [==============================] - 0s 130us/step - loss: 0.3725 - acc: 0.8281 - val_loss: 0.5043 - val_acc: 0.7448
Epoch 1142/1500
576/576 [==============================] - 0s 141us/step - loss: 0.3723 - acc: 0.8281 - val_loss: 0.5043 - val_acc: 0.7448
Epoch 1143/1500
576/576 [==============================] - 0s 125us/step - loss: 0.3723 - acc: 0.8281 - val_loss: 0.5044 - val_acc: 0.7500
Epoch 1144/1500
576/576 [==============================] - 0s 134us/step - loss: 0.3722 - acc: 0.8281 - val_loss: 0.5044 - val_acc: 0.7500
Epoch 1145/1500
576/576 [==============================] - 0s 139us/step - loss: 0.3722 - acc: 0.8281 - val_loss: 0.5044 - val_acc: 0.7448
Epoch 1146/1500
576/576 [==============================] - 0s 141us/step - loss: 0.3721 - acc: 0.8281 - val_loss: 0.5044 - val_acc: 0.7448
Epoch 1147/1500
576/576 [==============================] - 0s 146us/step - loss: 0.3720 - acc: 0.8281 - val_loss: 0.5045 - val_acc: 0.7448
Epoch 1148/1500
576/576 [==============================] - 0s 135us/step - loss: 0.3719 - acc: 0.8281 - val_loss: 0.5045 - val_acc: 0.7448
Epoch 1149/1500
576/576 [==============================] - 0s 120us/step - loss: 0.3719 - acc: 0.8281 - val_loss: 0.5045 - val_acc: 0.7448
Epoch 1150/1500
576/576 [==============================] - 0s 113us/step - loss: 0.3718 - acc: 0.8281 - val_loss: 0.5046 - val_acc: 0.7448
Epoch 1151/1500
576/576 [==============================] - 0s 132us/step - loss: 0.3717 - acc: 0.8281 - val_loss: 0.5046 - val_acc: 0.7448
Epoch 1152/1500
576/576 [==============================] - 0s 132us/step - loss: 0.3718 - acc: 0.8281 - val_loss: 0.5046 - val_acc: 0.7448
Epoch 1153/1500
576/576 [==============================] - 0s 137us/step - loss: 0.3717 - acc: 0.8281 - val_loss: 0.5046 - val_acc: 0.7448
Epoch 1154/1500
576/576 [==============================] - 0s 99us/step - loss: 0.3716 - acc: 0.8281 - val_loss: 0.5046 - val_acc: 0.7448
Epoch 1155/1500
576/576 [==============================] - 0s 102us/step - loss: 0.3715 - acc: 0.8299 - val_loss: 0.5047 - val_acc: 0.7448
Epoch 1156/1500
576/576 [==============================] - 0s 101us/step - loss: 0.3715 - acc: 0.8316 - val_loss: 0.5047 - val_acc: 0.7448
Epoch 1157/1500
576/576 [==============================] - 0s 109us/step - loss: 0.3714 - acc: 0.8281 - val_loss: 0.5047 - val_acc: 0.7448
Epoch 1158/1500
576/576 [==============================] - 0s 111us/step - loss: 0.3713 - acc: 0.8316 - val_loss: 0.5048 - val_acc: 0.7448
Epoch 1159/1500
576/576 [==============================] - 0s 104us/step - loss: 0.3713 - acc: 0.8316 - val_loss: 0.5048 - val_acc: 0.7448
Epoch 1160/1500
576/576 [==============================] - 0s 102us/step - loss: 0.3712 - acc: 0.8316 - val_loss: 0.5049 - val_acc: 0.7448
Epoch 1161/1500
576/576 [==============================] - 0s 132us/step - loss: 0.3711 - acc: 0.8316 - val_loss: 0.5049 - val_acc: 0.7448
Epoch 1162/1500
576/576 [==============================] - 0s 128us/step - loss: 0.3711 - acc: 0.8316 - val_loss: 0.5049 - val_acc: 0.7448
Epoch 1163/1500
576/576 [==============================] - 0s 118us/step - loss: 0.3710 - acc: 0.8316 - val_loss: 0.5050 - val_acc: 0.7448
Epoch 1164/1500
576/576 [==============================] - 0s 104us/step - loss: 0.3710 - acc: 0.8316 - val_loss: 0.5050 - val_acc: 0.7448
Epoch 1165/1500
576/576 [==============================] - 0s 104us/step - loss: 0.3709 - acc: 0.8316 - val_loss: 0.5050 - val_acc: 0.7448
Epoch 1166/1500
576/576 [==============================] - 0s 123us/step - loss: 0.3708 - acc: 0.8316 - val_loss: 0.5050 - val_acc: 0.7448
Epoch 1167/1500
576/576 [==============================] - 0s 108us/step - loss: 0.3708 - acc: 0.8316 - val_loss: 0.5050 - val_acc: 0.7448
Epoch 1168/1500
576/576 [==============================] - 0s 106us/step - loss: 0.3708 - acc: 0.8316 - val_loss: 0.5051 - val_acc: 0.7448
Epoch 1169/1500
576/576 [==============================] - 0s 115us/step - loss: 0.3707 - acc: 0.8316 - val_loss: 0.5051 - val_acc: 0.7448
Epoch 1170/1500
576/576 [==============================] - 0s 102us/step - loss: 0.3705 - acc: 0.8316 - val_loss: 0.5052 - val_acc: 0.7448
Epoch 1171/1500
576/576 [==============================] - 0s 109us/step - loss: 0.3705 - acc: 0.8316 - val_loss: 0.5052 - val_acc: 0.7448
Epoch 1172/1500
576/576 [==============================] - 0s 102us/step - loss: 0.3705 - acc: 0.8316 - val_loss: 0.5052 - val_acc: 0.7448
Epoch 1173/1500
576/576 [==============================] - 0s 104us/step - loss: 0.3704 - acc: 0.8316 - val_loss: 0.5052 - val_acc: 0.7448
Epoch 1174/1500
576/576 [==============================] - 0s 109us/step - loss: 0.3703 - acc: 0.8316 - val_loss: 0.5053 - val_acc: 0.7448
Epoch 1175/1500
576/576 [==============================] - 0s 101us/step - loss: 0.3702 - acc: 0.8316 - val_loss: 0.5053 - val_acc: 0.7448
Epoch 1176/1500
576/576 [==============================] - 0s 102us/step - loss: 0.3702 - acc: 0.8316 - val_loss: 0.5053 - val_acc: 0.7448
Epoch 1177/1500
576/576 [==============================] - 0s 111us/step - loss: 0.3702 - acc: 0.8316 - val_loss: 0.5053 - val_acc: 0.7448
Epoch 1178/1500
576/576 [==============================] - 0s 109us/step - loss: 0.3701 - acc: 0.8316 - val_loss: 0.5054 - val_acc: 0.7448
Epoch 1179/1500
576/576 [==============================] - 0s 109us/step - loss: 0.3700 - acc: 0.8316 - val_loss: 0.5054 - val_acc: 0.7448
Epoch 1180/1500
576/576 [==============================] - 0s 109us/step - loss: 0.3699 - acc: 0.8316 - val_loss: 0.5054 - val_acc: 0.7448
Epoch 1181/1500
576/576 [==============================] - 0s 108us/step - loss: 0.3699 - acc: 0.8316 - val_loss: 0.5055 - val_acc: 0.7448
Epoch 1182/1500
576/576 [==============================] - 0s 116us/step - loss: 0.3698 - acc: 0.8316 - val_loss: 0.5054 - val_acc: 0.7448
Epoch 1183/1500
576/576 [==============================] - 0s 106us/step - loss: 0.3697 - acc: 0.8333 - val_loss: 0.5055 - val_acc: 0.7448
Epoch 1184/1500
576/576 [==============================] - 0s 104us/step - loss: 0.3697 - acc: 0.8316 - val_loss: 0.5055 - val_acc: 0.7448
Epoch 1185/1500
576/576 [==============================] - 0s 92us/step - loss: 0.3696 - acc: 0.8316 - val_loss: 0.5056 - val_acc: 0.7448
Epoch 1186/1500
576/576 [==============================] - 0s 116us/step - loss: 0.3695 - acc: 0.8316 - val_loss: 0.5056 - val_acc: 0.7448
Epoch 1187/1500
576/576 [==============================] - 0s 120us/step - loss: 0.3696 - acc: 0.8316 - val_loss: 0.5056 - val_acc: 0.7448
Epoch 1188/1500
576/576 [==============================] - 0s 104us/step - loss: 0.3695 - acc: 0.8316 - val_loss: 0.5057 - val_acc: 0.7448
Epoch 1189/1500
576/576 [==============================] - 0s 123us/step - loss: 0.3693 - acc: 0.8333 - val_loss: 0.5057 - val_acc: 0.7448
Epoch 1190/1500
576/576 [==============================] - 0s 127us/step - loss: 0.3693 - acc: 0.8333 - val_loss: 0.5057 - val_acc: 0.7448
Epoch 1191/1500
576/576 [==============================] - 0s 113us/step - loss: 0.3692 - acc: 0.8333 - val_loss: 0.5057 - val_acc: 0.7448
Epoch 1192/1500
576/576 [==============================] - 0s 127us/step - loss: 0.3691 - acc: 0.8316 - val_loss: 0.5057 - val_acc: 0.7448
Epoch 1193/1500
576/576 [==============================] - 0s 113us/step - loss: 0.3690 - acc: 0.8333 - val_loss: 0.5058 - val_acc: 0.7448
Epoch 1194/1500
576/576 [==============================] - 0s 101us/step - loss: 0.3690 - acc: 0.8333 - val_loss: 0.5058 - val_acc: 0.7448
Epoch 1195/1500
576/576 [==============================] - 0s 102us/step - loss: 0.3690 - acc: 0.8333 - val_loss: 0.5058 - val_acc: 0.7448
Epoch 1196/1500
576/576 [==============================] - 0s 109us/step - loss: 0.3690 - acc: 0.8333 - val_loss: 0.5059 - val_acc: 0.7448
Epoch 1197/1500
576/576 [==============================] - 0s 108us/step - loss: 0.3688 - acc: 0.8333 - val_loss: 0.5058 - val_acc: 0.7448
Epoch 1198/1500
576/576 [==============================] - 0s 109us/step - loss: 0.3688 - acc: 0.8333 - val_loss: 0.5059 - val_acc: 0.7448
Epoch 1199/1500
576/576 [==============================] - 0s 106us/step - loss: 0.3688 - acc: 0.8333 - val_loss: 0.5060 - val_acc: 0.7448
Epoch 1200/1500
576/576 [==============================] - 0s 104us/step - loss: 0.3686 - acc: 0.8333 - val_loss: 0.5060 - val_acc: 0.7448
Epoch 1201/1500
576/576 [==============================] - 0s 116us/step - loss: 0.3686 - acc: 0.8333 - val_loss: 0.5060 - val_acc: 0.7448
Epoch 1202/1500
576/576 [==============================] - 0s 108us/step - loss: 0.3686 - acc: 0.8333 - val_loss: 0.5061 - val_acc: 0.7448
Epoch 1203/1500
576/576 [==============================] - 0s 111us/step - loss: 0.3684 - acc: 0.8333 - val_loss: 0.5061 - val_acc: 0.7448
Epoch 1204/1500
576/576 [==============================] - 0s 118us/step - loss: 0.3685 - acc: 0.8333 - val_loss: 0.5062 - val_acc: 0.7448
Epoch 1205/1500
576/576 [==============================] - 0s 104us/step - loss: 0.3683 - acc: 0.8333 - val_loss: 0.5061 - val_acc: 0.7448
Epoch 1206/1500
576/576 [==============================] - 0s 95us/step - loss: 0.3683 - acc: 0.8333 - val_loss: 0.5062 - val_acc: 0.7448
Epoch 1207/1500
576/576 [==============================] - 0s 109us/step - loss: 0.3682 - acc: 0.8333 - val_loss: 0.5062 - val_acc: 0.7448
Epoch 1208/1500
576/576 [==============================] - 0s 108us/step - loss: 0.3681 - acc: 0.8333 - val_loss: 0.5062 - val_acc: 0.7448
Epoch 1209/1500
576/576 [==============================] - 0s 106us/step - loss: 0.3681 - acc: 0.8333 - val_loss: 0.5062 - val_acc: 0.7448
Epoch 1210/1500
576/576 [==============================] - 0s 106us/step - loss: 0.3680 - acc: 0.8333 - val_loss: 0.5062 - val_acc: 0.7448
Epoch 1211/1500
576/576 [==============================] - 0s 101us/step - loss: 0.3680 - acc: 0.8333 - val_loss: 0.5063 - val_acc: 0.7448
Epoch 1212/1500
576/576 [==============================] - 0s 125us/step - loss: 0.3679 - acc: 0.8333 - val_loss: 0.5063 - val_acc: 0.7448
Epoch 1213/1500
576/576 [==============================] - 0s 94us/step - loss: 0.3678 - acc: 0.8333 - val_loss: 0.5064 - val_acc: 0.7448
Epoch 1214/1500
576/576 [==============================] - 0s 102us/step - loss: 0.3679 - acc: 0.8333 - val_loss: 0.5064 - val_acc: 0.7448
Epoch 1215/1500
576/576 [==============================] - 0s 113us/step - loss: 0.3678 - acc: 0.8333 - val_loss: 0.5064 - val_acc: 0.7448
Epoch 1216/1500
576/576 [==============================] - 0s 120us/step - loss: 0.3677 - acc: 0.8333 - val_loss: 0.5064 - val_acc: 0.7448
Epoch 1217/1500
576/576 [==============================] - 0s 99us/step - loss: 0.3676 - acc: 0.8333 - val_loss: 0.5065 - val_acc: 0.7448
Epoch 1218/1500
576/576 [==============================] - 0s 90us/step - loss: 0.3675 - acc: 0.8333 - val_loss: 0.5065 - val_acc: 0.7448
Epoch 1219/1500
576/576 [==============================] - 0s 90us/step - loss: 0.3675 - acc: 0.8333 - val_loss: 0.5066 - val_acc: 0.7448
Epoch 1220/1500
576/576 [==============================] - 0s 104us/step - loss: 0.3675 - acc: 0.8333 - val_loss: 0.5065 - val_acc: 0.7448
Epoch 1221/1500
576/576 [==============================] - 0s 101us/step - loss: 0.3674 - acc: 0.8333 - val_loss: 0.5066 - val_acc: 0.7448
Epoch 1222/1500
576/576 [==============================] - 0s 109us/step - loss: 0.3673 - acc: 0.8333 - val_loss: 0.5067 - val_acc: 0.7448
Epoch 1223/1500
576/576 [==============================] - 0s 109us/step - loss: 0.3673 - acc: 0.8316 - val_loss: 0.5067 - val_acc: 0.7448
Epoch 1224/1500
576/576 [==============================] - 0s 120us/step - loss: 0.3672 - acc: 0.8333 - val_loss: 0.5067 - val_acc: 0.7448
Epoch 1225/1500
576/576 [==============================] - 0s 95us/step - loss: 0.3671 - acc: 0.8316 - val_loss: 0.5067 - val_acc: 0.7448
Epoch 1226/1500
576/576 [==============================] - 0s 109us/step - loss: 0.3671 - acc: 0.8333 - val_loss: 0.5067 - val_acc: 0.7448
Epoch 1227/1500
576/576 [==============================] - 0s 88us/step - loss: 0.3670 - acc: 0.8333 - val_loss: 0.5067 - val_acc: 0.7448
Epoch 1228/1500
576/576 [==============================] - 0s 94us/step - loss: 0.3670 - acc: 0.8333 - val_loss: 0.5068 - val_acc: 0.7448
Epoch 1229/1500
576/576 [==============================] - 0s 109us/step - loss: 0.3668 - acc: 0.8333 - val_loss: 0.5068 - val_acc: 0.7448
Epoch 1230/1500
576/576 [==============================] - 0s 106us/step - loss: 0.3668 - acc: 0.8333 - val_loss: 0.5069 - val_acc: 0.7448
Epoch 1231/1500
576/576 [==============================] - 0s 92us/step - loss: 0.3668 - acc: 0.8316 - val_loss: 0.5069 - val_acc: 0.7448
Epoch 1232/1500
576/576 [==============================] - 0s 125us/step - loss: 0.3666 - acc: 0.8333 - val_loss: 0.5070 - val_acc: 0.7448
Epoch 1233/1500
576/576 [==============================] - 0s 125us/step - loss: 0.3666 - acc: 0.8316 - val_loss: 0.5070 - val_acc: 0.7448
Epoch 1234/1500
576/576 [==============================] - 0s 101us/step - loss: 0.3665 - acc: 0.8316 - val_loss: 0.5069 - val_acc: 0.7448
Epoch 1235/1500
576/576 [==============================] - 0s 90us/step - loss: 0.3665 - acc: 0.8333 - val_loss: 0.5070 - val_acc: 0.7500
Epoch 1236/1500
576/576 [==============================] - 0s 123us/step - loss: 0.3664 - acc: 0.8316 - val_loss: 0.5071 - val_acc: 0.7500
Epoch 1237/1500
576/576 [==============================] - 0s 94us/step - loss: 0.3664 - acc: 0.8333 - val_loss: 0.5071 - val_acc: 0.7500
Epoch 1238/1500
576/576 [==============================] - 0s 90us/step - loss: 0.3663 - acc: 0.8316 - val_loss: 0.5071 - val_acc: 0.7500
Epoch 1239/1500
576/576 [==============================] - 0s 94us/step - loss: 0.3663 - acc: 0.8316 - val_loss: 0.5071 - val_acc: 0.7500
Epoch 1240/1500
576/576 [==============================] - 0s 94us/step - loss: 0.3662 - acc: 0.8316 - val_loss: 0.5071 - val_acc: 0.7500
Epoch 1241/1500
576/576 [==============================] - 0s 87us/step - loss: 0.3661 - acc: 0.8351 - val_loss: 0.5072 - val_acc: 0.7500
Epoch 1242/1500
576/576 [==============================] - 0s 94us/step - loss: 0.3661 - acc: 0.8333 - val_loss: 0.5072 - val_acc: 0.7500
Epoch 1243/1500
576/576 [==============================] - 0s 102us/step - loss: 0.3660 - acc: 0.8333 - val_loss: 0.5072 - val_acc: 0.7500
Epoch 1244/1500
576/576 [==============================] - 0s 106us/step - loss: 0.3660 - acc: 0.8333 - val_loss: 0.5072 - val_acc: 0.7500
Epoch 1245/1500
576/576 [==============================] - 0s 130us/step - loss: 0.3659 - acc: 0.8351 - val_loss: 0.5073 - val_acc: 0.7500
Epoch 1246/1500
576/576 [==============================] - 0s 101us/step - loss: 0.3659 - acc: 0.8333 - val_loss: 0.5073 - val_acc: 0.7500
Epoch 1247/1500
576/576 [==============================] - 0s 104us/step - loss: 0.3658 - acc: 0.8351 - val_loss: 0.5073 - val_acc: 0.7500
Epoch 1248/1500
576/576 [==============================] - 0s 132us/step - loss: 0.3657 - acc: 0.8333 - val_loss: 0.5073 - val_acc: 0.7500
Epoch 1249/1500
576/576 [==============================] - 0s 102us/step - loss: 0.3657 - acc: 0.8333 - val_loss: 0.5073 - val_acc: 0.7500
Epoch 1250/1500
576/576 [==============================] - 0s 101us/step - loss: 0.3656 - acc: 0.8351 - val_loss: 0.5074 - val_acc: 0.7500
Epoch 1251/1500
576/576 [==============================] - 0s 102us/step - loss: 0.3656 - acc: 0.8333 - val_loss: 0.5074 - val_acc: 0.7500
Epoch 1252/1500
576/576 [==============================] - 0s 151us/step - loss: 0.3654 - acc: 0.8333 - val_loss: 0.5075 - val_acc: 0.7500
Epoch 1253/1500
576/576 [==============================] - 0s 101us/step - loss: 0.3654 - acc: 0.8351 - val_loss: 0.5075 - val_acc: 0.7500
Epoch 1254/1500
576/576 [==============================] - 0s 101us/step - loss: 0.3654 - acc: 0.8333 - val_loss: 0.5076 - val_acc: 0.7500
Epoch 1255/1500
576/576 [==============================] - 0s 102us/step - loss: 0.3653 - acc: 0.8333 - val_loss: 0.5076 - val_acc: 0.7500
Epoch 1256/1500
576/576 [==============================] - 0s 94us/step - loss: 0.3652 - acc: 0.8333 - val_loss: 0.5076 - val_acc: 0.7500
Epoch 1257/1500
576/576 [==============================] - 0s 102us/step - loss: 0.3652 - acc: 0.8333 - val_loss: 0.5077 - val_acc: 0.7500
Epoch 1258/1500
576/576 [==============================] - 0s 115us/step - loss: 0.3652 - acc: 0.8333 - val_loss: 0.5077 - val_acc: 0.7500
Epoch 1259/1500
576/576 [==============================] - 0s 111us/step - loss: 0.3651 - acc: 0.8333 - val_loss: 0.5077 - val_acc: 0.7500
Epoch 1260/1500
576/576 [==============================] - 0s 115us/step - loss: 0.3650 - acc: 0.8333 - val_loss: 0.5078 - val_acc: 0.7500
Epoch 1261/1500
576/576 [==============================] - 0s 111us/step - loss: 0.3650 - acc: 0.8333 - val_loss: 0.5078 - val_acc: 0.7500
Epoch 1262/1500
576/576 [==============================] - 0s 99us/step - loss: 0.3649 - acc: 0.8368 - val_loss: 0.5079 - val_acc: 0.7500
Epoch 1263/1500
576/576 [==============================] - 0s 128us/step - loss: 0.3649 - acc: 0.8333 - val_loss: 0.5078 - val_acc: 0.7500
Epoch 1264/1500
576/576 [==============================] - 0s 97us/step - loss: 0.3648 - acc: 0.8333 - val_loss: 0.5078 - val_acc: 0.7500
Epoch 1265/1500
576/576 [==============================] - 0s 106us/step - loss: 0.3647 - acc: 0.8333 - val_loss: 0.5079 - val_acc: 0.7500
Epoch 1266/1500
576/576 [==============================] - 0s 134us/step - loss: 0.3647 - acc: 0.8333 - val_loss: 0.5079 - val_acc: 0.7500
Epoch 1267/1500
576/576 [==============================] - 0s 109us/step - loss: 0.3646 - acc: 0.8333 - val_loss: 0.5079 - val_acc: 0.7500
Epoch 1268/1500
576/576 [==============================] - 0s 111us/step - loss: 0.3645 - acc: 0.8333 - val_loss: 0.5079 - val_acc: 0.7500
Epoch 1269/1500
576/576 [==============================] - 0s 95us/step - loss: 0.3644 - acc: 0.8333 - val_loss: 0.5080 - val_acc: 0.7500
Epoch 1270/1500
576/576 [==============================] - 0s 106us/step - loss: 0.3644 - acc: 0.8333 - val_loss: 0.5081 - val_acc: 0.7500
Epoch 1271/1500
576/576 [==============================] - 0s 108us/step - loss: 0.3644 - acc: 0.8333 - val_loss: 0.5081 - val_acc: 0.7500
Epoch 1272/1500
576/576 [==============================] - 0s 97us/step - loss: 0.3643 - acc: 0.8333 - val_loss: 0.5082 - val_acc: 0.7500
Epoch 1273/1500
576/576 [==============================] - 0s 95us/step - loss: 0.3642 - acc: 0.8333 - val_loss: 0.5082 - val_acc: 0.7500
Epoch 1274/1500
576/576 [==============================] - 0s 109us/step - loss: 0.3642 - acc: 0.8333 - val_loss: 0.5082 - val_acc: 0.7500
Epoch 1275/1500
576/576 [==============================] - 0s 104us/step - loss: 0.3641 - acc: 0.8333 - val_loss: 0.5083 - val_acc: 0.7500
Epoch 1276/1500
576/576 [==============================] - 0s 102us/step - loss: 0.3641 - acc: 0.8333 - val_loss: 0.5083 - val_acc: 0.7500
Epoch 1277/1500
576/576 [==============================] - 0s 102us/step - loss: 0.3640 - acc: 0.8333 - val_loss: 0.5084 - val_acc: 0.7500
Epoch 1278/1500
576/576 [==============================] - 0s 99us/step - loss: 0.3639 - acc: 0.8333 - val_loss: 0.5084 - val_acc: 0.7500
Epoch 1279/1500
576/576 [==============================] - 0s 87us/step - loss: 0.3639 - acc: 0.8333 - val_loss: 0.5085 - val_acc: 0.7500
Epoch 1280/1500
576/576 [==============================] - 0s 94us/step - loss: 0.3638 - acc: 0.8333 - val_loss: 0.5085 - val_acc: 0.7500
Epoch 1281/1500
576/576 [==============================] - 0s 95us/step - loss: 0.3637 - acc: 0.8333 - val_loss: 0.5086 - val_acc: 0.7500
Epoch 1282/1500
576/576 [==============================] - 0s 106us/step - loss: 0.3638 - acc: 0.8333 - val_loss: 0.5086 - val_acc: 0.7500
Epoch 1283/1500
576/576 [==============================] - 0s 123us/step - loss: 0.3636 - acc: 0.8333 - val_loss: 0.5087 - val_acc: 0.7500
Epoch 1284/1500
576/576 [==============================] - 0s 134us/step - loss: 0.3636 - acc: 0.8333 - val_loss: 0.5087 - val_acc: 0.7448
Epoch 1285/1500
576/576 [==============================] - 0s 111us/step - loss: 0.3635 - acc: 0.8333 - val_loss: 0.5087 - val_acc: 0.7448
Epoch 1286/1500
576/576 [==============================] - 0s 99us/step - loss: 0.3635 - acc: 0.8333 - val_loss: 0.5087 - val_acc: 0.7448
Epoch 1287/1500
576/576 [==============================] - 0s 142us/step - loss: 0.3634 - acc: 0.8333 - val_loss: 0.5087 - val_acc: 0.7448
Epoch 1288/1500
576/576 [==============================] - 0s 139us/step - loss: 0.3634 - acc: 0.8333 - val_loss: 0.5088 - val_acc: 0.7448
Epoch 1289/1500
576/576 [==============================] - ETA: 0s - loss: 0.3834 - acc: 0.819 - 0s 137us/step - loss: 0.3633 - acc: 0.8333 - val_loss: 0.5088 - val_acc: 0.7448
Epoch 1290/1500
576/576 [==============================] - 0s 113us/step - loss: 0.3633 - acc: 0.8333 - val_loss: 0.5088 - val_acc: 0.7448
Epoch 1291/1500
576/576 [==============================] - 0s 121us/step - loss: 0.3632 - acc: 0.8333 - val_loss: 0.5088 - val_acc: 0.7448
Epoch 1292/1500
576/576 [==============================] - 0s 121us/step - loss: 0.3631 - acc: 0.8333 - val_loss: 0.5089 - val_acc: 0.7448
Epoch 1293/1500
576/576 [==============================] - 0s 128us/step - loss: 0.3631 - acc: 0.8333 - val_loss: 0.5089 - val_acc: 0.7448
Epoch 1294/1500
576/576 [==============================] - 0s 144us/step - loss: 0.3629 - acc: 0.8333 - val_loss: 0.5088 - val_acc: 0.7448
Epoch 1295/1500
576/576 [==============================] - 0s 121us/step - loss: 0.3629 - acc: 0.8333 - val_loss: 0.5089 - val_acc: 0.7448
Epoch 1296/1500
576/576 [==============================] - 0s 97us/step - loss: 0.3629 - acc: 0.8333 - val_loss: 0.5090 - val_acc: 0.7448
Epoch 1297/1500
576/576 [==============================] - 0s 106us/step - loss: 0.3628 - acc: 0.8333 - val_loss: 0.5090 - val_acc: 0.7448
Epoch 1298/1500
576/576 [==============================] - 0s 87us/step - loss: 0.3628 - acc: 0.8333 - val_loss: 0.5091 - val_acc: 0.7448
Epoch 1299/1500
576/576 [==============================] - 0s 102us/step - loss: 0.3626 - acc: 0.8333 - val_loss: 0.5092 - val_acc: 0.7448
Epoch 1300/1500
576/576 [==============================] - 0s 95us/step - loss: 0.3627 - acc: 0.8333 - val_loss: 0.5091 - val_acc: 0.7448
Epoch 1301/1500
576/576 [==============================] - 0s 97us/step - loss: 0.3626 - acc: 0.8333 - val_loss: 0.5092 - val_acc: 0.7448
Epoch 1302/1500
576/576 [==============================] - 0s 95us/step - loss: 0.3626 - acc: 0.8333 - val_loss: 0.5093 - val_acc: 0.7448
Epoch 1303/1500
576/576 [==============================] - 0s 130us/step - loss: 0.3624 - acc: 0.8333 - val_loss: 0.5092 - val_acc: 0.7500
Epoch 1304/1500
576/576 [==============================] - 0s 102us/step - loss: 0.3623 - acc: 0.8333 - val_loss: 0.5093 - val_acc: 0.7500
Epoch 1305/1500
576/576 [==============================] - 0s 104us/step - loss: 0.3623 - acc: 0.8333 - val_loss: 0.5094 - val_acc: 0.7500
Epoch 1306/1500
576/576 [==============================] - 0s 102us/step - loss: 0.3622 - acc: 0.8333 - val_loss: 0.5094 - val_acc: 0.7500
Epoch 1307/1500
576/576 [==============================] - 0s 113us/step - loss: 0.3621 - acc: 0.8333 - val_loss: 0.5094 - val_acc: 0.7500
Epoch 1308/1500
576/576 [==============================] - 0s 137us/step - loss: 0.3621 - acc: 0.8333 - val_loss: 0.5095 - val_acc: 0.7500
Epoch 1309/1500
576/576 [==============================] - 0s 128us/step - loss: 0.3621 - acc: 0.8333 - val_loss: 0.5095 - val_acc: 0.7500
Epoch 1310/1500
576/576 [==============================] - 0s 101us/step - loss: 0.3620 - acc: 0.8333 - val_loss: 0.5096 - val_acc: 0.7500
Epoch 1311/1500
576/576 [==============================] - 0s 132us/step - loss: 0.3619 - acc: 0.8333 - val_loss: 0.5096 - val_acc: 0.7500
Epoch 1312/1500
576/576 [==============================] - 0s 106us/step - loss: 0.3619 - acc: 0.8333 - val_loss: 0.5096 - val_acc: 0.7500
Epoch 1313/1500
576/576 [==============================] - 0s 97us/step - loss: 0.3618 - acc: 0.8333 - val_loss: 0.5096 - val_acc: 0.7500
Epoch 1314/1500
576/576 [==============================] - 0s 97us/step - loss: 0.3618 - acc: 0.8333 - val_loss: 0.5097 - val_acc: 0.7500
Epoch 1315/1500
576/576 [==============================] - 0s 109us/step - loss: 0.3617 - acc: 0.8333 - val_loss: 0.5097 - val_acc: 0.7500
Epoch 1316/1500
576/576 [==============================] - 0s 102us/step - loss: 0.3616 - acc: 0.8333 - val_loss: 0.5097 - val_acc: 0.7500
Epoch 1317/1500
576/576 [==============================] - 0s 106us/step - loss: 0.3616 - acc: 0.8351 - val_loss: 0.5098 - val_acc: 0.7500
Epoch 1318/1500
576/576 [==============================] - 0s 101us/step - loss: 0.3615 - acc: 0.8333 - val_loss: 0.5099 - val_acc: 0.7500
Epoch 1319/1500
576/576 [==============================] - 0s 160us/step - loss: 0.3615 - acc: 0.8333 - val_loss: 0.5098 - val_acc: 0.7500
Epoch 1320/1500
576/576 [==============================] - 0s 106us/step - loss: 0.3613 - acc: 0.8333 - val_loss: 0.5099 - val_acc: 0.7500
Epoch 1321/1500
576/576 [==============================] - 0s 113us/step - loss: 0.3613 - acc: 0.8333 - val_loss: 0.5099 - val_acc: 0.7500
Epoch 1322/1500
576/576 [==============================] - 0s 137us/step - loss: 0.3613 - acc: 0.8333 - val_loss: 0.5098 - val_acc: 0.7500
Epoch 1323/1500
576/576 [==============================] - 0s 108us/step - loss: 0.3612 - acc: 0.8333 - val_loss: 0.5099 - val_acc: 0.7500
Epoch 1324/1500
576/576 [==============================] - 0s 106us/step - loss: 0.3612 - acc: 0.8351 - val_loss: 0.5100 - val_acc: 0.7500
Epoch 1325/1500
576/576 [==============================] - 0s 109us/step - loss: 0.3611 - acc: 0.8333 - val_loss: 0.5099 - val_acc: 0.7500
Epoch 1326/1500
576/576 [==============================] - 0s 108us/step - loss: 0.3611 - acc: 0.8351 - val_loss: 0.5100 - val_acc: 0.7500
Epoch 1327/1500
576/576 [==============================] - 0s 109us/step - loss: 0.3609 - acc: 0.8333 - val_loss: 0.5100 - val_acc: 0.7500
Epoch 1328/1500
576/576 [==============================] - 0s 102us/step - loss: 0.3609 - acc: 0.8333 - val_loss: 0.5100 - val_acc: 0.7500
Epoch 1329/1500
576/576 [==============================] - 0s 97us/step - loss: 0.3609 - acc: 0.8333 - val_loss: 0.5101 - val_acc: 0.7500
Epoch 1330/1500
576/576 [==============================] - 0s 111us/step - loss: 0.3607 - acc: 0.8333 - val_loss: 0.5102 - val_acc: 0.7500
Epoch 1331/1500
576/576 [==============================] - 0s 108us/step - loss: 0.3607 - acc: 0.8351 - val_loss: 0.5103 - val_acc: 0.7500
Epoch 1332/1500
576/576 [==============================] - 0s 102us/step - loss: 0.3608 - acc: 0.8333 - val_loss: 0.5103 - val_acc: 0.7500
Epoch 1333/1500
576/576 [==============================] - 0s 90us/step - loss: 0.3607 - acc: 0.8333 - val_loss: 0.5102 - val_acc: 0.7500
Epoch 1334/1500
576/576 [==============================] - 0s 88us/step - loss: 0.3606 - acc: 0.8333 - val_loss: 0.5102 - val_acc: 0.7500
Epoch 1335/1500
576/576 [==============================] - 0s 102us/step - loss: 0.3605 - acc: 0.8333 - val_loss: 0.5102 - val_acc: 0.7500
Epoch 1336/1500
576/576 [==============================] - 0s 253us/step - loss: 0.3604 - acc: 0.8351 - val_loss: 0.5103 - val_acc: 0.7500
Epoch 1337/1500
576/576 [==============================] - 0s 168us/step - loss: 0.3604 - acc: 0.8351 - val_loss: 0.5103 - val_acc: 0.7500
Epoch 1338/1500
576/576 [==============================] - 0s 137us/step - loss: 0.3603 - acc: 0.8368 - val_loss: 0.5104 - val_acc: 0.7500
Epoch 1339/1500
576/576 [==============================] - 0s 102us/step - loss: 0.3602 - acc: 0.8333 - val_loss: 0.5104 - val_acc: 0.7500
Epoch 1340/1500
576/576 [==============================] - 0s 101us/step - loss: 0.3601 - acc: 0.8333 - val_loss: 0.5105 - val_acc: 0.7500
Epoch 1341/1500
576/576 [==============================] - 0s 101us/step - loss: 0.3601 - acc: 0.8351 - val_loss: 0.5105 - val_acc: 0.7500
Epoch 1342/1500
576/576 [==============================] - 0s 101us/step - loss: 0.3601 - acc: 0.8351 - val_loss: 0.5105 - val_acc: 0.7500
Epoch 1343/1500
576/576 [==============================] - 0s 111us/step - loss: 0.3600 - acc: 0.8333 - val_loss: 0.5106 - val_acc: 0.7500
Epoch 1344/1500
576/576 [==============================] - 0s 95us/step - loss: 0.3599 - acc: 0.8351 - val_loss: 0.5107 - val_acc: 0.7500
Epoch 1345/1500
576/576 [==============================] - 0s 127us/step - loss: 0.3599 - acc: 0.8333 - val_loss: 0.5106 - val_acc: 0.7500
Epoch 1346/1500
576/576 [==============================] - 0s 95us/step - loss: 0.3598 - acc: 0.8351 - val_loss: 0.5107 - val_acc: 0.7500
Epoch 1347/1500
576/576 [==============================] - 0s 99us/step - loss: 0.3598 - acc: 0.8351 - val_loss: 0.5107 - val_acc: 0.7500
Epoch 1348/1500
576/576 [==============================] - 0s 111us/step - loss: 0.3596 - acc: 0.8333 - val_loss: 0.5107 - val_acc: 0.7500
Epoch 1349/1500
576/576 [==============================] - 0s 99us/step - loss: 0.3595 - acc: 0.8351 - val_loss: 0.5107 - val_acc: 0.7500
Epoch 1350/1500
576/576 [==============================] - 0s 111us/step - loss: 0.3595 - acc: 0.8351 - val_loss: 0.5108 - val_acc: 0.7500
Epoch 1351/1500
576/576 [==============================] - 0s 99us/step - loss: 0.3595 - acc: 0.8351 - val_loss: 0.5108 - val_acc: 0.7500
Epoch 1352/1500
576/576 [==============================] - 0s 88us/step - loss: 0.3594 - acc: 0.8333 - val_loss: 0.5109 - val_acc: 0.7500
Epoch 1353/1500
576/576 [==============================] - 0s 102us/step - loss: 0.3593 - acc: 0.8351 - val_loss: 0.5109 - val_acc: 0.7500
Epoch 1354/1500
576/576 [==============================] - 0s 92us/step - loss: 0.3593 - acc: 0.8333 - val_loss: 0.5109 - val_acc: 0.7500
Epoch 1355/1500
576/576 [==============================] - 0s 97us/step - loss: 0.3592 - acc: 0.8333 - val_loss: 0.5110 - val_acc: 0.7552
Epoch 1356/1500
576/576 [==============================] - 0s 95us/step - loss: 0.3591 - acc: 0.8351 - val_loss: 0.5110 - val_acc: 0.7552
Epoch 1357/1500
576/576 [==============================] - 0s 104us/step - loss: 0.3592 - acc: 0.8368 - val_loss: 0.5111 - val_acc: 0.7552
Epoch 1358/1500
576/576 [==============================] - 0s 97us/step - loss: 0.3591 - acc: 0.8351 - val_loss: 0.5111 - val_acc: 0.7552
Epoch 1359/1500
576/576 [==============================] - 0s 97us/step - loss: 0.3590 - acc: 0.8333 - val_loss: 0.5110 - val_acc: 0.7552
Epoch 1360/1500
576/576 [==============================] - 0s 113us/step - loss: 0.3590 - acc: 0.8351 - val_loss: 0.5111 - val_acc: 0.7552
Epoch 1361/1500
576/576 [==============================] - 0s 125us/step - loss: 0.3588 - acc: 0.8333 - val_loss: 0.5111 - val_acc: 0.7552
Epoch 1362/1500
576/576 [==============================] - 0s 104us/step - loss: 0.3588 - acc: 0.8351 - val_loss: 0.5112 - val_acc: 0.7552
Epoch 1363/1500
576/576 [==============================] - 0s 123us/step - loss: 0.3587 - acc: 0.8351 - val_loss: 0.5112 - val_acc: 0.7552
Epoch 1364/1500
576/576 [==============================] - 0s 101us/step - loss: 0.3586 - acc: 0.8351 - val_loss: 0.5112 - val_acc: 0.7552
Epoch 1365/1500
576/576 [==============================] - 0s 128us/step - loss: 0.3586 - acc: 0.8351 - val_loss: 0.5112 - val_acc: 0.7552
Epoch 1366/1500
576/576 [==============================] - 0s 128us/step - loss: 0.3585 - acc: 0.8351 - val_loss: 0.5113 - val_acc: 0.7552
Epoch 1367/1500
576/576 [==============================] - 0s 134us/step - loss: 0.3585 - acc: 0.8351 - val_loss: 0.5114 - val_acc: 0.7552
Epoch 1368/1500
576/576 [==============================] - 0s 116us/step - loss: 0.3584 - acc: 0.8333 - val_loss: 0.5114 - val_acc: 0.7552
Epoch 1369/1500
576/576 [==============================] - 0s 109us/step - loss: 0.3584 - acc: 0.8351 - val_loss: 0.5114 - val_acc: 0.7552
Epoch 1370/1500
576/576 [==============================] - 0s 108us/step - loss: 0.3582 - acc: 0.8351 - val_loss: 0.5114 - val_acc: 0.7552
Epoch 1371/1500
576/576 [==============================] - 0s 109us/step - loss: 0.3582 - acc: 0.8351 - val_loss: 0.5115 - val_acc: 0.7552
Epoch 1372/1500
576/576 [==============================] - 0s 109us/step - loss: 0.3581 - acc: 0.8351 - val_loss: 0.5114 - val_acc: 0.7552
Epoch 1373/1500
576/576 [==============================] - 0s 104us/step - loss: 0.3580 - acc: 0.8368 - val_loss: 0.5115 - val_acc: 0.7552
Epoch 1374/1500
576/576 [==============================] - 0s 135us/step - loss: 0.3580 - acc: 0.8333 - val_loss: 0.5115 - val_acc: 0.7552
Epoch 1375/1500
576/576 [==============================] - 0s 115us/step - loss: 0.3580 - acc: 0.8333 - val_loss: 0.5115 - val_acc: 0.7552
Epoch 1376/1500
576/576 [==============================] - 0s 108us/step - loss: 0.3579 - acc: 0.8333 - val_loss: 0.5116 - val_acc: 0.7552
Epoch 1377/1500
576/576 [==============================] - 0s 104us/step - loss: 0.3577 - acc: 0.8351 - val_loss: 0.5116 - val_acc: 0.7552
Epoch 1378/1500
576/576 [==============================] - 0s 111us/step - loss: 0.3577 - acc: 0.8351 - val_loss: 0.5116 - val_acc: 0.7552
Epoch 1379/1500
576/576 [==============================] - 0s 109us/step - loss: 0.3577 - acc: 0.8368 - val_loss: 0.5118 - val_acc: 0.7552
Epoch 1380/1500
576/576 [==============================] - 0s 125us/step - loss: 0.3576 - acc: 0.8351 - val_loss: 0.5118 - val_acc: 0.7552
Epoch 1381/1500
576/576 [==============================] - 0s 121us/step - loss: 0.3575 - acc: 0.8351 - val_loss: 0.5119 - val_acc: 0.7552
Epoch 1382/1500
576/576 [==============================] - 0s 106us/step - loss: 0.3574 - acc: 0.8351 - val_loss: 0.5119 - val_acc: 0.7552
Epoch 1383/1500
576/576 [==============================] - 0s 115us/step - loss: 0.3575 - acc: 0.8333 - val_loss: 0.5119 - val_acc: 0.7552
Epoch 1384/1500
576/576 [==============================] - 0s 121us/step - loss: 0.3573 - acc: 0.8351 - val_loss: 0.5119 - val_acc: 0.7552
Epoch 1385/1500
576/576 [==============================] - 0s 104us/step - loss: 0.3573 - acc: 0.8368 - val_loss: 0.5120 - val_acc: 0.7552
Epoch 1386/1500
576/576 [==============================] - 0s 104us/step - loss: 0.3571 - acc: 0.8385 - val_loss: 0.5121 - val_acc: 0.7552
Epoch 1387/1500
576/576 [==============================] - 0s 134us/step - loss: 0.3571 - acc: 0.8351 - val_loss: 0.5121 - val_acc: 0.7552
Epoch 1388/1500
576/576 [==============================] - 0s 109us/step - loss: 0.3571 - acc: 0.8368 - val_loss: 0.5121 - val_acc: 0.7552
Epoch 1389/1500
576/576 [==============================] - 0s 106us/step - loss: 0.3570 - acc: 0.8385 - val_loss: 0.5123 - val_acc: 0.7552
Epoch 1390/1500
576/576 [==============================] - 0s 109us/step - loss: 0.3569 - acc: 0.8351 - val_loss: 0.5123 - val_acc: 0.7552
Epoch 1391/1500
576/576 [==============================] - 0s 118us/step - loss: 0.3569 - acc: 0.8368 - val_loss: 0.5123 - val_acc: 0.7552
Epoch 1392/1500
576/576 [==============================] - 0s 102us/step - loss: 0.3568 - acc: 0.8368 - val_loss: 0.5123 - val_acc: 0.7552
Epoch 1393/1500
576/576 [==============================] - 0s 104us/step - loss: 0.3568 - acc: 0.8368 - val_loss: 0.5123 - val_acc: 0.7552
Epoch 1394/1500
576/576 [==============================] - 0s 99us/step - loss: 0.3567 - acc: 0.8385 - val_loss: 0.5125 - val_acc: 0.7552
Epoch 1395/1500
576/576 [==============================] - 0s 104us/step - loss: 0.3566 - acc: 0.8385 - val_loss: 0.5125 - val_acc: 0.7552
Epoch 1396/1500
576/576 [==============================] - 0s 108us/step - loss: 0.3566 - acc: 0.8351 - val_loss: 0.5125 - val_acc: 0.7552
Epoch 1397/1500
576/576 [==============================] - 0s 106us/step - loss: 0.3565 - acc: 0.8351 - val_loss: 0.5125 - val_acc: 0.7552
Epoch 1398/1500
576/576 [==============================] - 0s 104us/step - loss: 0.3565 - acc: 0.8368 - val_loss: 0.5125 - val_acc: 0.7552
Epoch 1399/1500
576/576 [==============================] - 0s 123us/step - loss: 0.3563 - acc: 0.8368 - val_loss: 0.5126 - val_acc: 0.7552
Epoch 1400/1500
576/576 [==============================] - 0s 120us/step - loss: 0.3563 - acc: 0.8368 - val_loss: 0.5126 - val_acc: 0.7552
Epoch 1401/1500
576/576 [==============================] - 0s 125us/step - loss: 0.3562 - acc: 0.8368 - val_loss: 0.5127 - val_acc: 0.7552
Epoch 1402/1500
576/576 [==============================] - 0s 109us/step - loss: 0.3562 - acc: 0.8368 - val_loss: 0.5127 - val_acc: 0.7552
Epoch 1403/1500
576/576 [==============================] - 0s 115us/step - loss: 0.3561 - acc: 0.8368 - val_loss: 0.5128 - val_acc: 0.7552
Epoch 1404/1500
576/576 [==============================] - 0s 106us/step - loss: 0.3561 - acc: 0.8368 - val_loss: 0.5128 - val_acc: 0.7552
Epoch 1405/1500
576/576 [==============================] - 0s 99us/step - loss: 0.3560 - acc: 0.8368 - val_loss: 0.5128 - val_acc: 0.7552
Epoch 1406/1500
576/576 [==============================] - 0s 102us/step - loss: 0.3559 - acc: 0.8385 - val_loss: 0.5129 - val_acc: 0.7552
Epoch 1407/1500
576/576 [==============================] - 0s 104us/step - loss: 0.3558 - acc: 0.8368 - val_loss: 0.5130 - val_acc: 0.7552
Epoch 1408/1500
576/576 [==============================] - 0s 108us/step - loss: 0.3559 - acc: 0.8368 - val_loss: 0.5131 - val_acc: 0.7552
Epoch 1409/1500
576/576 [==============================] - 0s 104us/step - loss: 0.3557 - acc: 0.8368 - val_loss: 0.5132 - val_acc: 0.7552
Epoch 1410/1500
576/576 [==============================] - 0s 121us/step - loss: 0.3557 - acc: 0.8368 - val_loss: 0.5133 - val_acc: 0.7552
Epoch 1411/1500
576/576 [==============================] - 0s 108us/step - loss: 0.3556 - acc: 0.8368 - val_loss: 0.5133 - val_acc: 0.7552
Epoch 1412/1500
576/576 [==============================] - 0s 108us/step - loss: 0.3555 - acc: 0.8368 - val_loss: 0.5133 - val_acc: 0.7552
Epoch 1413/1500
576/576 [==============================] - 0s 111us/step - loss: 0.3555 - acc: 0.8368 - val_loss: 0.5133 - val_acc: 0.7552
Epoch 1414/1500
576/576 [==============================] - 0s 106us/step - loss: 0.3554 - acc: 0.8368 - val_loss: 0.5133 - val_acc: 0.7552
Epoch 1415/1500
576/576 [==============================] - 0s 141us/step - loss: 0.3554 - acc: 0.8368 - val_loss: 0.5133 - val_acc: 0.7552
Epoch 1416/1500
576/576 [==============================] - 0s 118us/step - loss: 0.3552 - acc: 0.8368 - val_loss: 0.5133 - val_acc: 0.7552
Epoch 1417/1500
576/576 [==============================] - 0s 101us/step - loss: 0.3552 - acc: 0.8368 - val_loss: 0.5135 - val_acc: 0.7552
Epoch 1418/1500
576/576 [==============================] - 0s 101us/step - loss: 0.3551 - acc: 0.8368 - val_loss: 0.5135 - val_acc: 0.7552
Epoch 1419/1500
576/576 [==============================] - 0s 108us/step - loss: 0.3551 - acc: 0.8368 - val_loss: 0.5135 - val_acc: 0.7552
Epoch 1420/1500
576/576 [==============================] - 0s 102us/step - loss: 0.3550 - acc: 0.8368 - val_loss: 0.5135 - val_acc: 0.7552
Epoch 1421/1500
576/576 [==============================] - 0s 94us/step - loss: 0.3550 - acc: 0.8368 - val_loss: 0.5136 - val_acc: 0.7552
Epoch 1422/1500
576/576 [==============================] - 0s 156us/step - loss: 0.3549 - acc: 0.8368 - val_loss: 0.5136 - val_acc: 0.7552
Epoch 1423/1500
576/576 [==============================] - 0s 115us/step - loss: 0.3548 - acc: 0.8368 - val_loss: 0.5137 - val_acc: 0.7552
Epoch 1424/1500
576/576 [==============================] - 0s 130us/step - loss: 0.3547 - acc: 0.8385 - val_loss: 0.5137 - val_acc: 0.7552
Epoch 1425/1500
576/576 [==============================] - 0s 104us/step - loss: 0.3547 - acc: 0.8368 - val_loss: 0.5138 - val_acc: 0.7552
Epoch 1426/1500
576/576 [==============================] - 0s 92us/step - loss: 0.3546 - acc: 0.8368 - val_loss: 0.5138 - val_acc: 0.7552
Epoch 1427/1500
576/576 [==============================] - 0s 102us/step - loss: 0.3546 - acc: 0.8368 - val_loss: 0.5139 - val_acc: 0.7552
Epoch 1428/1500
576/576 [==============================] - 0s 125us/step - loss: 0.3545 - acc: 0.8385 - val_loss: 0.5139 - val_acc: 0.7552
Epoch 1429/1500
576/576 [==============================] - 0s 97us/step - loss: 0.3544 - acc: 0.8385 - val_loss: 0.5139 - val_acc: 0.7552
Epoch 1430/1500
576/576 [==============================] - 0s 135us/step - loss: 0.3544 - acc: 0.8368 - val_loss: 0.5140 - val_acc: 0.7552
Epoch 1431/1500
576/576 [==============================] - 0s 99us/step - loss: 0.3544 - acc: 0.8368 - val_loss: 0.5141 - val_acc: 0.7552
Epoch 1432/1500
576/576 [==============================] - 0s 106us/step - loss: 0.3542 - acc: 0.8403 - val_loss: 0.5142 - val_acc: 0.7552
Epoch 1433/1500
576/576 [==============================] - 0s 102us/step - loss: 0.3542 - acc: 0.8385 - val_loss: 0.5141 - val_acc: 0.7552
Epoch 1434/1500
576/576 [==============================] - 0s 95us/step - loss: 0.3542 - acc: 0.8385 - val_loss: 0.5141 - val_acc: 0.7552
Epoch 1435/1500
576/576 [==============================] - 0s 109us/step - loss: 0.3540 - acc: 0.8368 - val_loss: 0.5141 - val_acc: 0.7552
Epoch 1436/1500
576/576 [==============================] - 0s 106us/step - loss: 0.3540 - acc: 0.8368 - val_loss: 0.5142 - val_acc: 0.7552
Epoch 1437/1500
576/576 [==============================] - 0s 104us/step - loss: 0.3539 - acc: 0.8385 - val_loss: 0.5143 - val_acc: 0.7552
Epoch 1438/1500
576/576 [==============================] - 0s 111us/step - loss: 0.3539 - acc: 0.8385 - val_loss: 0.5144 - val_acc: 0.7552
Epoch 1439/1500
576/576 [==============================] - 0s 109us/step - loss: 0.3538 - acc: 0.8368 - val_loss: 0.5144 - val_acc: 0.7552
Epoch 1440/1500
576/576 [==============================] - 0s 125us/step - loss: 0.3538 - acc: 0.8385 - val_loss: 0.5145 - val_acc: 0.7552
Epoch 1441/1500
576/576 [==============================] - 0s 116us/step - loss: 0.3538 - acc: 0.8385 - val_loss: 0.5146 - val_acc: 0.7552
Epoch 1442/1500
576/576 [==============================] - 0s 104us/step - loss: 0.3535 - acc: 0.8403 - val_loss: 0.5146 - val_acc: 0.7552
Epoch 1443/1500
576/576 [==============================] - 0s 118us/step - loss: 0.3536 - acc: 0.8385 - val_loss: 0.5147 - val_acc: 0.7552
Epoch 1444/1500
576/576 [==============================] - 0s 116us/step - loss: 0.3534 - acc: 0.8385 - val_loss: 0.5147 - val_acc: 0.7552
Epoch 1445/1500
576/576 [==============================] - 0s 127us/step - loss: 0.3534 - acc: 0.8385 - val_loss: 0.5148 - val_acc: 0.7552
Epoch 1446/1500
576/576 [==============================] - 0s 102us/step - loss: 0.3534 - acc: 0.8385 - val_loss: 0.5148 - val_acc: 0.7552
Epoch 1447/1500
576/576 [==============================] - 0s 115us/step - loss: 0.3533 - acc: 0.8403 - val_loss: 0.5149 - val_acc: 0.7552
Epoch 1448/1500
576/576 [==============================] - 0s 106us/step - loss: 0.3533 - acc: 0.8403 - val_loss: 0.5149 - val_acc: 0.7552
Epoch 1449/1500
576/576 [==============================] - 0s 97us/step - loss: 0.3532 - acc: 0.8385 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1450/1500
576/576 [==============================] - 0s 95us/step - loss: 0.3532 - acc: 0.8385 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1451/1500
576/576 [==============================] - 0s 87us/step - loss: 0.3530 - acc: 0.8385 - val_loss: 0.5150 - val_acc: 0.7552
Epoch 1452/1500
576/576 [==============================] - 0s 90us/step - loss: 0.3530 - acc: 0.8403 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1453/1500
576/576 [==============================] - 0s 102us/step - loss: 0.3529 - acc: 0.8403 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1454/1500
576/576 [==============================] - 0s 142us/step - loss: 0.3528 - acc: 0.8385 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1455/1500
576/576 [==============================] - 0s 94us/step - loss: 0.3528 - acc: 0.8385 - val_loss: 0.5151 - val_acc: 0.7552
Epoch 1456/1500
576/576 [==============================] - 0s 97us/step - loss: 0.3527 - acc: 0.8385 - val_loss: 0.5152 - val_acc: 0.7552
Epoch 1457/1500
576/576 [==============================] - 0s 113us/step - loss: 0.3527 - acc: 0.8403 - val_loss: 0.5153 - val_acc: 0.7552
Epoch 1458/1500
576/576 [==============================] - 0s 113us/step - loss: 0.3525 - acc: 0.8403 - val_loss: 0.5154 - val_acc: 0.7552
Epoch 1459/1500
576/576 [==============================] - 0s 109us/step - loss: 0.3526 - acc: 0.8385 - val_loss: 0.5153 - val_acc: 0.7552
Epoch 1460/1500
576/576 [==============================] - 0s 127us/step - loss: 0.3524 - acc: 0.8403 - val_loss: 0.5153 - val_acc: 0.7552
Epoch 1461/1500
576/576 [==============================] - 0s 97us/step - loss: 0.3524 - acc: 0.8420 - val_loss: 0.5155 - val_acc: 0.7552
Epoch 1462/1500
576/576 [==============================] - 0s 108us/step - loss: 0.3525 - acc: 0.8403 - val_loss: 0.5154 - val_acc: 0.7552
Epoch 1463/1500
576/576 [==============================] - 0s 90us/step - loss: 0.3522 - acc: 0.8403 - val_loss: 0.5155 - val_acc: 0.7552
Epoch 1464/1500
576/576 [==============================] - 0s 90us/step - loss: 0.3522 - acc: 0.8403 - val_loss: 0.5156 - val_acc: 0.7552
Epoch 1465/1500
576/576 [==============================] - 0s 95us/step - loss: 0.3521 - acc: 0.8403 - val_loss: 0.5156 - val_acc: 0.7552
Epoch 1466/1500
576/576 [==============================] - 0s 92us/step - loss: 0.3521 - acc: 0.8403 - val_loss: 0.5156 - val_acc: 0.7552
Epoch 1467/1500
576/576 [==============================] - 0s 111us/step - loss: 0.3520 - acc: 0.8403 - val_loss: 0.5157 - val_acc: 0.7552
Epoch 1468/1500
576/576 [==============================] - 0s 95us/step - loss: 0.3519 - acc: 0.8403 - val_loss: 0.5157 - val_acc: 0.7552
Epoch 1469/1500
576/576 [==============================] - 0s 95us/step - loss: 0.3519 - acc: 0.8403 - val_loss: 0.5158 - val_acc: 0.7552
Epoch 1470/1500
576/576 [==============================] - 0s 120us/step - loss: 0.3518 - acc: 0.8403 - val_loss: 0.5158 - val_acc: 0.7552
Epoch 1471/1500
576/576 [==============================] - 0s 92us/step - loss: 0.3518 - acc: 0.8403 - val_loss: 0.5158 - val_acc: 0.7552
Epoch 1472/1500
576/576 [==============================] - 0s 88us/step - loss: 0.3518 - acc: 0.8403 - val_loss: 0.5159 - val_acc: 0.7552
Epoch 1473/1500
576/576 [==============================] - 0s 106us/step - loss: 0.3516 - acc: 0.8420 - val_loss: 0.5160 - val_acc: 0.7552
Epoch 1474/1500
576/576 [==============================] - 0s 127us/step - loss: 0.3515 - acc: 0.8403 - val_loss: 0.5160 - val_acc: 0.7552
Epoch 1475/1500
576/576 [==============================] - 0s 92us/step - loss: 0.3516 - acc: 0.8403 - val_loss: 0.5161 - val_acc: 0.7552
Epoch 1476/1500
576/576 [==============================] - 0s 95us/step - loss: 0.3514 - acc: 0.8403 - val_loss: 0.5161 - val_acc: 0.7552
Epoch 1477/1500
576/576 [==============================] - 0s 92us/step - loss: 0.3514 - acc: 0.8403 - val_loss: 0.5162 - val_acc: 0.7552
Epoch 1478/1500
576/576 [==============================] - 0s 99us/step - loss: 0.3513 - acc: 0.8403 - val_loss: 0.5162 - val_acc: 0.7552
Epoch 1479/1500
576/576 [==============================] - 0s 99us/step - loss: 0.3512 - acc: 0.8403 - val_loss: 0.5162 - val_acc: 0.7604
Epoch 1480/1500
576/576 [==============================] - 0s 97us/step - loss: 0.3513 - acc: 0.8403 - val_loss: 0.5163 - val_acc: 0.7604
Epoch 1481/1500
576/576 [==============================] - 0s 101us/step - loss: 0.3511 - acc: 0.8403 - val_loss: 0.5163 - val_acc: 0.7604
Epoch 1482/1500
576/576 [==============================] - 0s 95us/step - loss: 0.3510 - acc: 0.8403 - val_loss: 0.5163 - val_acc: 0.7552
Epoch 1483/1500
576/576 [==============================] - 0s 97us/step - loss: 0.3510 - acc: 0.8403 - val_loss: 0.5164 - val_acc: 0.7604
Epoch 1484/1500
576/576 [==============================] - 0s 99us/step - loss: 0.3511 - acc: 0.8403 - val_loss: 0.5165 - val_acc: 0.7604
Epoch 1485/1500
576/576 [==============================] - 0s 101us/step - loss: 0.3509 - acc: 0.8403 - val_loss: 0.5165 - val_acc: 0.7604
Epoch 1486/1500
576/576 [==============================] - 0s 115us/step - loss: 0.3509 - acc: 0.8403 - val_loss: 0.5165 - val_acc: 0.7604
Epoch 1487/1500
576/576 [==============================] - 0s 111us/step - loss: 0.3508 - acc: 0.8403 - val_loss: 0.5166 - val_acc: 0.7552
Epoch 1488/1500
576/576 [==============================] - 0s 116us/step - loss: 0.3507 - acc: 0.8403 - val_loss: 0.5167 - val_acc: 0.7552
Epoch 1489/1500
576/576 [==============================] - 0s 113us/step - loss: 0.3506 - acc: 0.8403 - val_loss: 0.5168 - val_acc: 0.7604
Epoch 1490/1500
576/576 [==============================] - 0s 108us/step - loss: 0.3506 - acc: 0.8403 - val_loss: 0.5166 - val_acc: 0.7604
Epoch 1491/1500
576/576 [==============================] - 0s 106us/step - loss: 0.3505 - acc: 0.8403 - val_loss: 0.5168 - val_acc: 0.7604
Epoch 1492/1500
576/576 [==============================] - 0s 130us/step - loss: 0.3505 - acc: 0.8403 - val_loss: 0.5168 - val_acc: 0.7604
Epoch 1493/1500
576/576 [==============================] - 0s 116us/step - loss: 0.3505 - acc: 0.8420 - val_loss: 0.5169 - val_acc: 0.7604
Epoch 1494/1500
576/576 [==============================] - 0s 132us/step - loss: 0.3503 - acc: 0.8403 - val_loss: 0.5171 - val_acc: 0.7604
Epoch 1495/1500
576/576 [==============================] - 0s 108us/step - loss: 0.3504 - acc: 0.8420 - val_loss: 0.5171 - val_acc: 0.7604
Epoch 1496/1500
576/576 [==============================] - 0s 108us/step - loss: 0.3502 - acc: 0.8403 - val_loss: 0.5172 - val_acc: 0.7604
Epoch 1497/1500
576/576 [==============================] - 0s 115us/step - loss: 0.3502 - acc: 0.8403 - val_loss: 0.5171 - val_acc: 0.7604
Epoch 1498/1500
576/576 [==============================] - 0s 106us/step - loss: 0.3501 - acc: 0.8403 - val_loss: 0.5172 - val_acc: 0.7604
Epoch 1499/1500
576/576 [==============================] - 0s 113us/step - loss: 0.3500 - acc: 0.8403 - val_loss: 0.5172 - val_acc: 0.7604
Epoch 1500/1500
576/576 [==============================] - 0s 104us/step - loss: 0.3500 - acc: 0.8420 - val_loss: 0.5173 - val_acc: 0.7604
accuracy is 0.760
roc-auc is 0.820

we can even go futher and get more better results...

  • 76
  • 82

the numbers are promissing. Feel free to go wild.

In [ ]: