zoukankan      html  css  js  c++  java
  • tensorflow 查看ckpt模型中参数值

    有时我们有查看tensor内部变量的值的变化情况,需要挖一下,现给出解析代码:

    """
    @Date   :2021/5/18
    @Author :xxx
    """
    import os
    from tensorflow.python import pywrap_tensorflow
    
    base_model_dir = r'model-ckp-20210222'
    target_model_dir = r'new_ckpt'
    checkpoint_path_01 = os.path.join(base_model_dir, "model.ckpt-11383419")
    checkpoint_path_02 = os.path.join(target_model_dir, "model.ckpt-94")
    reader_01 = pywrap_tensorflow.NewCheckpointReader(checkpoint_path_01)
    reader_02 = pywrap_tensorflow.NewCheckpointReader(checkpoint_path_02)
    base_var_shape_map = reader_01.get_variable_to_shape_map()
    target_shape_map = reader_02.get_variable_to_shape_map()
    cnt = 0
    tensor_name = 'output_weights'
    print(reader_01.get_tensor(tensor_name))
    print(reader_02.get_tensor(tensor_name))
    for key1 in base_var_shape_map:
        if tensor_name in key1:
            print(reader_01.get_tensor(key1))
            print('tensor name:{}'.format(key1))
    
    print('###############################')
    for key1 in target_shape_map:
        if tensor_name in key1:
            print(reader_02.get_tensor(key1))
            print('tensor name:{}'.format(key1))

    梯度没有更新

    梯度更新:

     由上我们知道,可以通过此方式进行训练参数冻结(如bert 12 layer),fintuing 指定参数完成特定任务

    时刻记着自己要成为什么样的人!
  • 相关阅读:
    《图解HTTP》确认访问用户身份的认证
    《图解HTTP》确保web安全的https
    《图解HTTP》HTTP首部(2)
    《图解HTTP》HTTP首部(1)
    App测试要点
    APP测试基本流程
    《图解HTTP》与HTTP协作的Web服务器
    《图解HTTP》返回结果的HTTP状态码
    centos7虚拟内存设置
    修改Centos SSH服务端口
  • 原文地址:https://www.cnblogs.com/demo-deng/p/14782182.html
Copyright © 2011-2022 走看看