卷机神经网络的可视化(可视化中间激活)
對于中間激活的可視化,我們使用之前在貓狗分類中從頭開始訓(xùn)練的小型卷積神經(jīng)網(wǎng)絡(luò)。
from keras.models import load_modelmodel = load_model('cats_and_dogs_small_2.h5') model.summary() Layer (type) Output Shape Param # ================================================================= conv2d_5 (Conv2D) (None, 148, 148, 32) 896 _________________________________________________________________ max_pooling2d_5 (MaxPooling2 (None, 74, 74, 32) 0 _________________________________________________________________ conv2d_6 (Conv2D) (None, 72, 72, 64) 18496 _________________________________________________________________ max_pooling2d_6 (MaxPooling2 (None, 36, 36, 64) 0 _________________________________________________________________ conv2d_7 (Conv2D) (None, 34, 34, 128) 73856 _________________________________________________________________ max_pooling2d_7 (MaxPooling2 (None, 17, 17, 128) 0 _________________________________________________________________ conv2d_8 (Conv2D) (None, 15, 15, 128) 147584 _________________________________________________________________ max_pooling2d_8 (MaxPooling2 (None, 7, 7, 128) 0 _________________________________________________________________ flatten_2 (Flatten) (None, 6272) 0 _________________________________________________________________ dropout_1 (Dropout) (None, 6272) 0 _________________________________________________________________ dense_3 (Dense) (None, 512) 3211776 _________________________________________________________________ dense_4 (Dense) (None, 1) 513 ================================================================= Total params: 3,453,121 Trainable params: 3,453,121 Non-trainable params: 0接下面,輸入一張不屬于網(wǎng)絡(luò)的貓的圖像
img_path = '/Users/fchollet/Downloads/cats_and_dogs_small/test/cats/cat.1700.jpg'from keras.preprocessing import image # 將圖像處理成為一個(gè)4D張量 import numpy as npimg = image.load_img(img_path, target_size=(150, 150)) img_tensor = image.img_to_array(img) img_tensor = np.expand_dims(img_tensor, axis=0) img_tensor /= 255.print(img_tensor.shape)(1, 150, 150, 3)
顯示測試圖像
import matplotlib.pyplot as pltplt.imshow(img_tensor[0]) plt.show()為了提取想要查看的特征圖,我們需要?jiǎng)?chuàng)建一個(gè)Keras模型,以圖像批量作為輸入,并輸出所有卷積層和池化層的激活。為此,我們需要使用Keras的Model類。模型實(shí)例化需要兩個(gè)參數(shù):一個(gè)輸入張量(或輸入張量的列表)和一個(gè)輸出張量(或輸出張量的列表)。
from keras import modelslayer_outputs = [layer.output for layer in model.layers[:8]] #提取前8層的輸出activation_model = models.Model(inputs=model.input, outputs=layer_outputs) #創(chuàng)建一個(gè)模型,給定模型的輸入,可以返回這些輸出這段語句是輸入一張圖像,這個(gè)模型將返回原始模型的前8層激活值。這個(gè)模型有一個(gè)輸入和8個(gè)輸出,即每層激活對應(yīng)一個(gè)輸出。
activations = activation_model.predict(img_tensor) # 返回8個(gè)Numpy數(shù)組組成的列表,每個(gè)層激活對應(yīng)一個(gè)Numpy數(shù)組first_layer_activation = activations[0] print(first_layer_activation.shape)(1, 148, 148, 32)
它是大小為148*148的特征圖,有32個(gè)通道。我們來繪制原始模型第3個(gè)通道:
再看看第30個(gè)通道:
我們可以看到,似乎不同通道對于圖像檢測有不同側(cè)重,比如第3個(gè)通道更側(cè)重于邊緣檢測,第30個(gè)通道更側(cè)于”綠色圓點(diǎn)“檢測。
下面我們來繪制網(wǎng)絡(luò)中所有激活的完整可視化圖。我們需要在8個(gè)特征圖里的每一個(gè)都提取并繪制一個(gè)通道,然后將結(jié)果疊加在一個(gè)大的圖像張量中,按通道并排。
import keraslayer_names = [] for layer in model.layers[:8]:layer_names.append(layer.name) # 用來存儲層的名稱,這樣你就可以把層的名稱畫到圖中images_per_row = 16for layer_name, layer_activation in zip(layer_names, activations): # 顯示特征圖n_features = layer_activation.shape[-1] # 特征圖中的特征個(gè)數(shù)size = layer_activation.shape[1] # 特征圖的形狀為(1, size, size, n_features)n_cols = n_features // images_per_row # 在這個(gè)矩陣中將激活通道平鋪display_grid = np.zeros((size * n_cols, images_per_row * size))for col in range(n_cols): #將每個(gè)過濾器平鋪到一個(gè)大的水平網(wǎng)格中for row in range(images_per_row):channel_image = layer_activation[0,:, :,col * images_per_row + row]channel_image -= channel_image.mean() #對特征進(jìn)行后處理,使其看起來更加美觀channel_image /= channel_image.std()channel_image *= 64channel_image += 128channel_image = np.clip(channel_image, 0, 255).astype('uint8')display_grid[col * size : (col + 1) * size,row * size : (row + 1) * size] = channel_image # 顯示網(wǎng)格scale = 1. / sizeplt.figure(figsize=(scale * display_grid.shape[1],scale * display_grid.shape[0]))plt.title(layer_name)plt.grid(False)plt.imshow(display_grid, aspect='auto', cmap='viridis')plt.show()
更多精彩內(nèi)容,歡迎關(guān)注我的微信公眾號:數(shù)據(jù)瞎分析
總結(jié)
以上是生活随笔為你收集整理的卷机神经网络的可视化(可视化中间激活)的全部內(nèi)容,希望文章能夠幫你解決所遇到的問題。
- 上一篇: 使用预训练的卷积神经网络(猫狗图片分类)
- 下一篇: 可视化卷及神经网络热力图