pip install beautifulsoup4
https://python123.io/ws/demo.html

使用方法
參數：1.html信息2.解析器

import requests r = requests.get('https://python123.io/ws/demo.html') demo=r.text from bs4 import BeautifulSoup soup = BeautifulSoup(demo,'html.parser') print(soup.prettify())

import requests r = requests.get('https://python123.io/ws/demo.html') demo=r.text from bs4 import BeautifulSoup soup = BeautifulSoup(demo,'html.parser') #此時soup代表demo頁面 soup.title tag =soup.a#只能獲取第一個a標簽內容 #name soup.a.name#查看a的名字 soup.a.parent.name soup.a.parent.parent.name #屬性 是個字典 tag.attrs tag.attrs['class'] tag.attrs['href'] type(tag.attrs) type(tag) #標簽內容 可以跨越多個標簽層次 soup.a.string soup.p soup.p.string type(soup.p.string)

無法處理注釋

summary

基于bs4庫的HTML遍歷方法

.contents用法

import requests r = requests.get('https://python123.io/ws/demo.html') demo=r.text from bs4 import BeautifulSoup soup = BeautifulSoup(demo,'html.parser') #此時soup代表demo頁面 soup.head soup.head.contents#獲得兒子節點 soup.body.contents len(soup.body.contents) soup.body.contents[1]#取第一個

遍歷兒子節點

上行遍歷

import requests r = requests.get('https://python123.io/ws/demo.html') demo=r.text from bs4 import BeautifulSoup soup = BeautifulSoup(demo,'html.parser') #此時soup代表demo頁面 soup.title.parent soup.html.parent#是自己 soup.parent#是空的

平行遍歷

標簽樹平行遍歷有條件

import requests r = requests.get('https://python123.io/ws/demo.html') demo=r.text from bs4 import BeautifulSoup soup = BeautifulSoup(demo,'html.parser') #此時soup代表demo頁面 soup.a.next_sibling # 標簽間的string也構成平行關系，所以是字符串 soup.a.next_sibling.next_sibling###之前的 soup.a.previous_sibling soup.a.previous_sibling.previous_sibling#沒了

summary

格式化和編碼

.prettify

import requests r = requests.get('https://python123.io/ws/demo.html') demo=r.text from bs4 import BeautifulSoup soup = BeautifulSoup(demo,'html.parser') #此時soup代表demo頁面 print(soup.prettify()) print(soup.a.prettify())

編碼
無
**

summary

**

標簽tag
標簽名Name
標簽屬性Attributes
標簽間字符串NavigableDtring
注釋的字符串Comment

總結

以上是生活随笔為你收集整理的丑憨批的爬虫笔记4BeautifulSoup4的全部內容，希望文章能夠幫你解決所遇到的問題。

如果覺得生活随笔網站內容還不錯，歡迎將生活随笔推薦給好友。