Visualization of DataSet, x and y as inputs, z as target outputs:

Error over per Iteration when Learning Rate= 0.1 and Error Rate=0.1:

Error over per Iteration when Learning Rate= 0.05 and Error Rate=0.01

Error over per Iteration when Learning Rate= 0.01 and Error Rate=0.05

Comparison between target values vs predicted values (Orange=target, Blue= Predicted)

When Learning Rate= 0.1 and Error Rate=0.1:

When Learning Rate= 0.05 and Error Rate=0.01:

When Learning Rate= 0.01 and Error Rate=0.05:

Comparison Between Keras Neural Network model optimized with sgd algorithm and neural network model i created by numpy