I'm trying to train a NN for binary classification but using multi-class approach, hence Class (C) =2. The accuracy on both train and test data sets is ~ 96%. However, manual checking reveals that Tensorflow always picks 0 for every example.
I'm interested in knowing how to go about debugging this issue and what I am doing wrong. Greatly appreciate your help. Thanks.
(Please let me know if I'm being too vague and not providing enough info in order for you to pinpoint a good solution. Thanks.)