python爬虫简单示例_最简单爬虫示例(入门级)
【實例簡介】
【實例截圖】
【核心代碼】
from lxml import etree
import requests
def handle_request(url):
heades = {
'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/64.0.3282.140 Safari/537.36 Edge/17.17134',
}
response = requests.get(url=url,headers = heades).text
return response
def main():
url = 'https://voice.hupu.com/nba'
content = handle_request(url)
news = etree.HTML(content)
news_content = news.xpath(r'//div[@class="news-list"]/ul/li/div/h4/a/text()')
news_url = news.xpath(r'//div[@class="news-list"]/ul/li/div/h4/a/@href')
for new in zip(news_content ,news_url):
print(new)
if __name__ == '__main__':
main()
總結
以上是生活随笔為你收集整理的python爬虫简单示例_最简单爬虫示例(入门级)的全部內容,希望文章能夠幫你解決所遇到的問題。
- 上一篇: 内置h5 调用safari系统浏览器打开
- 下一篇: springboot redis 断线重