數據挖掘 —— 無監督學習（聚類）

• 1. K-means
• • 1.1 生成指定形狀的隨機數據
  • 1.2 進行聚類
  • 1.3 結果
• 2. 系統聚類
• • 2.1 代碼
  • 2.2 結果
• 3 DBSCAN
• • 3.1 參數選擇
  • 3.2 代碼
  • 3.3 結果

1. K-means

K-Means為基于切割的聚類算法

1.1 生成指定形狀的隨機數據

import numpy as np import pandas as pd import matplotlib.pyplot as plt from sklearn.cluster import KMeans # *************** 生成指定形狀的隨機數據 ***************** from sklearn.datasets import make_circles,make_moons,make_blobs n_samples = 1000# 生成環裝數據 circles = make_circles(n_samples = n_samples,factor = 0.5,noise = 0.05) """ n_samples: 為樣本點個數 factor:為大圓與小圓的間距 """ # 生成月牙形數據 moons = make_moons(n_samples = n_samples,noise = 0.05)# 生成簇狀數據 blobs = make_blobs(n_samples = n_samples,random_state = 100,center_box = (-10,10),cluster_std = 1,centers = 3) """ random_state: 隨機數種子，多少代保持隨機數不變 center_box: 中心確定后的數據邊界 默認(-10,10) cluster_std：數據分布的標準差，決定各類數據的緊湊程度,默認為1.0 centers：產生數據點中心的個數 默認為3 """ # 產生隨機數 random_data = np.random.rand(n_samples,2),np.array([0 for i in range(n_samples)]) datasets = [circles,moons,blobs,random_data] fig = plt.figure(figsize=(20,8))

1.2 進行聚類

colors = "rgbykcm" for index,data in enumerate(datasets):X = data[0]Y_old = data[1]km_cluster = KMeans(n_clusters = 2)km_cluster.fit(X)Y_new = km_cluster.labels_fig.add_subplot(2,len(datasets),index+1)[plt.scatter(X[i,0],X[i,1],color = colors[Y_old[i]]) for i in range(len(X[:,0]))] fig.add_subplot(2,len(datasets),index+5)[plt.scatter(X[i,0],X[i,1],color = colors[Y_new[i]]) for i in range(len(X[:,0]))]

1.3 結果

2. 系統聚類

2.1 代碼

AgglomerativeClustering(n_clusters,affinity,linkage)

• affinity:

“euclidean”,歐幾里得距離

“l1”, “l2”,

“manhattan”, 曼哈頓距離

“cosine”, 余弦距離

“precomputed”預輸入 需要輸出距離矩陣

• linkage：{“ward”, “complete”, “average”, “single”}, default=”ward”

from sklearn.datasets import make_circles,make_blobs,make_moons from sklearn.cluster import AgglomerativeClustering import matplotlib.pyplot as plt import numpy as np import pandas as pd# 準備數據 n_samples = int(1e3) circles = make_circles(n_samples = n_samples,noise = 0.05,factor = 0.5,random_state = 10) moons = make_moons(n_samples = n_samples,noise = 0.05,random_state = 10) blobs = make_blobs(n_samples=n_samples,centers = 4,cluster_std = 0.1,center_box = (-1,1),random_state = 10) np.random.seed(10) random_data = (np.random.rand(n_samples,2),np.zeros((n_samples)).astype(np.int))datasets = [circles,moons,blobs,random_data] fig = plt.figure(figsize = (20,8),dpi = 72) colors = "rgbk" for index,data in enumerate(datasets):X = data[0]Y = data[1]agg_cluster = AgglomerativeClustering(n_clusters = 2,affinity = "euclidean",linkage = "average")Y_predict = agg_cluster.fit(X).labels_fig.add_subplot(2,len(datasets),index + 1)[plt.scatter(X[i,0],X[i,1],color = colors[Y[i]]) for i in range(len(X[:,0]))]fig.add_subplot(2,len(datasets),index + 5)[plt.scatter(X[i,0],X[i,1],color = colors[Y_predict[i]]) for i in range(len(X[:,0]))]

2.2 結果

3 DBSCAN

3.1 參數選擇

半徑：k距離幫助設置半徑，也就是要找到突變點，
即選中一個點，計算它和所有其他點的距離，
從小到大排序，發現距離突變點。
需要做大量實驗觀察。

MinPts：先設置偏小一些，然后進行多次嘗試

3.2 代碼

# 導入聚類數據 n_samples = 1000 from sklearn.datasets import make_circles,make_moons,make_blobs from sklearn.cluster import DBSCAN import pandas as pd import numpy as np import matplotlib.pyplot as plt circles = make_circles(n_samples = n_samples,noise = 0.05,factor = 0.5,random_state = 10) moons = make_moons(n_samples = n_samples,noise = 0.05,random_state = 10) blobs = make_blobs(n_samples = n_samples,centers = 3,cluster_std = 0.1,center_box = (-1,1),random_state = 10) np.random.seed(10) random_data = (np.random.rand(n_samples,2),np.zeros((n_samples)).astype(np.int)) datasets = [circles,moons,blobs,random_data] fig = plt.figure(figsize = (20,8),dpi = 72) colors = "rgbky" for index,data in enumerate(datasets):X = data[0]Y_old = data[1]dbscan_model = DBSCAN(eps = 0.1,min_samples = 20)dbscan_model.fit(X)Y_new = dbscan_model.labels_fig.add_subplot(2,len(datasets),index+1)[plt.scatter(X[i,0],X[i,1],color = colors[Y_old[i]]) for i in range(len(X[:,0]))]plt.title("original algorithm")fig.add_subplot(2,len(datasets),index + 5)[plt.scatter(X[i,0],X[i,1],color = colors[Y_new[i]]) for i in range(len(X[:,0]))]plt.title("DBSCA algorithm")

3.3 結果

by CyrusMay 2022 04 05

總結

以上是生活随笔為你收集整理的(数据挖掘 —— 无监督学习（聚类）的全部內容，希望文章能夠幫你解決所遇到的問題。

如果覺得生活随笔網站內容還不錯，歡迎將生活随笔推薦給好友。