Using Naive Bayes classifier

This is most basic classifier, It uses concept of probability in order to predict the class of input feature data . Read More

We gonna see how to use Naive Bayes Classifier very easily using python.

Bayes rule

Prerequisite:

• Python 2
• sklearn [Python Module]
• Numpy  [Python Module]

We are going to apply this algorithm on Iris dataset .

Iris dataset : There are total 150 training set in this dataset. and each training set consist of  4 feature and corresponding class ( There 3 class in Iris dataset. represented by 0 for setosa ,1 for versicolor ,2 for virginica ) .

These 4 feature used to classify data in 3 classes of flowers .Read More

We are going to use sklearn python package, we use inbuilt function in sklearn for naive bayes classifier. Fist train the our classifier then predict class for your input, then calculate accuracy of result.
Fallow code comments for better understanding.

Naive Bayes Classifier [ Python ] [Github Link]

1. __auther__='www.codecops.in'
2. # Classify Iris data Using Naive Bayes
3. #An Example Of Supervised Learning
5. from sklearn.datasets import load_iris
6. from sklearn.naive_bayes import GaussianNB
7. import numpy as np
9. #{{ Getting Iris Dataset
10. data=load_iris()
11. X=data.data #input Features
12. Y=data.target #Class of corresponding Input
13. #}}
15. if __name__=='__main__':
16.     # clsf == classifire :)
17.     clsf=GaussianNB()
18.     #{{training our classifire using Naive_bayes
19.     #!for IRis data Classification
20.     clsf.fit(X,Y)
21.     #}}
22. 
    
23.     # Test fot All data
24.     print '''  _______Input_______\
25.            __Real Class__\
26.            Prediction class '''
27.     pred=[]
28.     for i in range(len(X)):
29.         pred.append(clsf.predict(X[i])) #storing Pred result
30.         print X[i],'\t\t\t',Y[i],'\t\t\t',pred[-1]
32.     from sklearn.metrics import accuracy_score
33.     print "Accuracy Test Using accuracy_score function"
34.     pred=np.array(pred)
35.     print accuracy_score(pred,Y)*100,'%  Wow _/\_ Not Bad'

Output :

Naive Bayes classifire accuracy on Iris data