zoukankan      html  css  js  c++  java
  • python3用BeautifulSoup用re.compile来匹配需要抓取的href地址

    # -*- coding:utf-8 -*-
    #python 2.7
    #XiaoDeng
    #http://tieba.baidu.com/p/2460150866
    #标签操作
    
    
    from bs4 import BeautifulSoup
    import urllib.request
    import re
    
    
    #如果是网址,可以用这个办法来读取网页
    #html_doc = "http://tieba.baidu.com/p/2460150866"
    #req = urllib.request.Request(html_doc)  
    #webpage = urllib.request.urlopen(req)  
    #html = webpage.read()
    
    
    
    html="""
    <html><head><title>The Dormouse's story</title></head>
    <body>
    <p class="title" name="dromouse"><b>The Dormouse's story</b></p>
    <p class="story">Once upon a time there were three little sisters; and their names were
    <a href="http://example.com/elsie" class="sister" id="xiaodeng"><!-- Elsie --></a>,
    <a href="http://example.com/lacie" class="sister" id="link2">Lacie</a> and
    <a href="http://example.com/tillie" class="sister" id="link3">Tillie</a>;
    <a href="http://example.com/lacie" class="sister" id="xiaodeng">Lacie</a>
    and they lived at the bottom of a well.</p>
    <p class="story">...</p>
    """
    soup = BeautifulSoup(html, 'html.parser')   #文档对象
    
    
    #re.compile来匹配需要抓取的href地址
    for k in  soup.find_all(href=re.compile("lacie")):
        print(k)
    
    
    for k in  soup.find_all(string=re.compile("Lacie")):
        print(k)
  • 相关阅读:
    洛谷 P3413 【萌数】
    ANOI 2009 【同类分布】
    概率编程语言
    人类的视觉能力基本上是出生后逐渐习得的
    关“视觉神经系统是怎么形成的?”的思考
    MIPS指令集相关
    zookeeper源码之服务端
    zookeeper服务端
    c语言之结构
    c语言之函数
  • 原文地址:https://www.cnblogs.com/dengyg200891/p/6060094.html
Copyright © 2011-2022 走看看