【Python-ML】SKlearn库Pipeline工作流和K折交叉验证

# -*- coding: utf-8 -*- ''' Created on 2018年1月18日 @author: Jason.F @summary: Pipeline，流水线工作流，串联模型拟合、数据转换等 K折交叉验证，采用无重复抽样技术，数据集划分k份，每次选择其中一份作为测试集，其他k-1作为训练集 ''' import pandas as pd from sklearn.preprocessing import LabelEncoder from sklearn.cross_validation import train_test_split from sklearn.preprocessing import StandardScaler from sklearn.decomposition import PCA from sklearn.linear_model import LogisticRegression from sklearn.pipeline import Pipeline import numpy as np from sklearn.cross_validation import StratifiedKFold from sklearn.cross_validation import cross_val_score #导入数据 df = pd.read_csv('https://archive.ics.uci.edu/ml/machine-learning-databases/breast-cancer-wisconsin/wdbc.data',header=None) X=df.loc[:,2:].values y=df.loc[:,1].values le=LabelEncoder() y=le.fit_transform(y)#类标整数化 print (le.transform(['M','B'])) #划分训练集合测试集 X_train,X_test,y_train,y_test = train_test_split (X,y,test_size=0.20,random_state=1) #标准化、PCA降维、模型训练串联 pipe_lr=Pipeline([('scl',StandardScaler()),\('pca',PCA(n_components=2)),\('clf',LogisticRegression(random_state=1))]) pipe_lr.fit(X_train,y_train) print ('Test Accuracy:%.3f' % pipe_lr.score(X_test, y_test)) #k折交叉验证 kfold=StratifiedKFold(y=y_train,n_folds=10,random_state=1) scores=[] for k,(train,test) in enumerate(kfold):pipe_lr.fit(X_train[train],y_train[train])score=pipe_lr.score(X_train[test],y_train[test])scores.append(score)print ('Fold: %s, Class dist.: %s,Acc: %.3f' % (k+1,np.bincount(y_train[train]),score)) print ('CV accuracy: %.3f +/- %.3f'%(np.mean(scores),np.std(scores)) ) #scikit-learn实现的k折交叉验证 scores=cross_val_score(estimator=pipe_lr,X=X_train,y=y_train,cv=10,n_jobs=1)#n_jobs分布到多少个cpu上执行 print ('Test Accuracy:%s' %scores) print ('CV accuracy: %.3f +/- %.3f'%(np.mean(scores),np.std(scores)) )

结果：

[1 0] Test Accuracy:0.947 Fold: 1, Class dist.: [256 153],Acc: 0.891 Fold: 2, Class dist.: [256 153],Acc: 0.978 Fold: 3, Class dist.: [256 153],Acc: 0.978 Fold: 4, Class dist.: [256 153],Acc: 0.913 Fold: 5, Class dist.: [256 153],Acc: 0.935 Fold: 6, Class dist.: [257 153],Acc: 0.978 Fold: 7, Class dist.: [257 153],Acc: 0.933 Fold: 8, Class dist.: [257 153],Acc: 0.956 Fold: 9, Class dist.: [257 153],Acc: 0.978 Fold: 10, Class dist.: [257 153],Acc: 0.956 CV accuracy: 0.950 +/- 0.029 Test Accuracy:[ 0.89130435 0.97826087 0.97826087 0.91304348 0.93478261 0.977777780.93333333 0.95555556 0.97777778 0.95555556] CV accuracy: 0.950 +/- 0.029

总结

以上是生活随笔为你收集整理的【Python-ML】SKlearn库Pipeline工作流和K折交叉验证的全部内容，希望文章能够帮你解决所遇到的问题。

如果觉得生活随笔网站内容还不错，欢迎将生活随笔推荐给好友。