zoukankan      html  css  js  c++  java
  • python pickle 模块的使用

    用于序列化的两个模块
      json:用于字符串和Python数据类型间进行转换
      pickle: 用于python特有的类型和python的数据类型间进行转换
      json提供四个功能:dumps,dump,loads,load
      pickle提供四个功能:dumps,dump,loads,load

    pickle可以存储什么类型的数据呢?

    1. 所有python支持的原生类型:布尔值,整数,浮点数,复数,字符串,字节,None。
    2. 由任何原生类型组成的列表,元组,字典和集合。
    3. 函数,类,类的实例

    pickle模块中常用的方法有:

        1. pickle.dump(obj, file, protocol=None,)

        必填参数obj表示将要封装的对象

        必填参数file表示obj要写入的文件对象,file必须以二进制可写模式打开,即“wb”

        可选参数protocol表示告知pickler使用的协议,支持的协议有0,1,2,3,默认的协议是添加在Python 3中的协议3。   

    • Protocol version 0 is the original “human-readable” protocol and is backwards compatible with earlier versions of Python.
    • Protocol version 1 is an old binary format which is also compatible with earlier versions of Python.
    • Protocol version 2 was introduced in Python 2.3. It provides much more efficient pickling of new-style classes. Refer to PEP 307 for information about improvements brought by protocol 2.
    • Protocol version 3 was added in Python 3.0. It has explicit support for bytes objects and cannot be unpickled by Python 2.x. This is the default protocol, and the recommended protocol when compatibility with other Python 3 versions is required.
    • Protocol version 4 was added in Python 3.4. It adds support for very large objects, pickling more kinds of objects, and some data format optimizations. Refer to PEP 3154 for information about improvements brought by protocol 4. 

        2. pickle.load(file,*,fix_imports=True, encoding="ASCII", errors="strict")

        必填参数file必须以二进制可读模式打开,即“rb”,其他都为可选参数

        3. pickle.dumps(obj):以字节对象形式返回封装的对象,不需要写入文件中

        4. pickle.loads(bytes_object): 从字节对象中读取被封装的对象,并返回

     pickle模块可能出现三种异常:

        1. PickleError:封装和拆封时出现的异常类,继承自Exception

        2. PicklingError: 遇到不可封装的对象时出现的异常,继承自PickleError

        3. UnPicklingError: 拆封对象过程中出现的异常,继承自PickleError

    应用:

    复制代码
    1 # dumps功能
    2 import pickle
    3 data = ['aa', 'bb', 'cc']  
    4 # dumps 将数据通过特殊的形式转换为只有python语言认识的字符串
    5 p_str = pickle.dumps(data)
    6 print(p_str)            
    7 b'x80x03]qx00(Xx02x00x00x00aaqx01Xx02x00x00x00bbqx02Xx02x00x00x00ccqx03e.
    复制代码
    1 # loads功能
    2 # loads  将pickle数据转换为python的数据结构
    3 mes = pickle.loads(p_str)
    4 print(mes)
    5 ['aa', 'bb', 'cc']
    1 # dump功能
    2 # dump 将数据通过特殊的形式转换为只有python语言认识的字符串,并写入文件
    3 with open('D:/tmp.pk', 'w') as f:
    4     pickle.dump(data, f)
    1 # load功能
    2 # load 从数据文件中读取数据,并转换为python的数据结构
    3 with open('D:/tmp.pk', 'r') as f:
    4     data = pickle.load(f)
  • 相关阅读:
    MySQL执行计划extra中的using index 和 using where using index 的区别
    Python + Apache Kylin 让数据分析更加简单!
    性能测试解读:Kyligence vs Spark SQL
    greenplum 表在各个节点数据的分布情况
    postgresql drop表后空间不释放
    PostgreSQL 查看表、索引等创建时间
    postgresql Kill掉正在执行的SQL语句
    linux ps命令查看最消耗CPU、内存的进程
    Linux shell
    TPC-H 下载参考
  • 原文地址:https://www.cnblogs.com/lincappu/p/8296078.html
Copyright © 2011-2022 走看看