zoukankan      html  css  js  c++  java
  • SQLBulkCopy 性能统计

    下面的C#代码可以利用SqlBulkCopy实现大数据量的上传:

        public void SaveDataTable(string connectionString, String tableName, int batchSize, DataTable table)
    {
    using (SqlConnection sqlConnection = new SqlConnection(connectionString))
    {
    sqlConnection.Open();
    var sqlTransaction = sqlConnection.BeginTransaction();
    try
    {
    //通过SqlBulkCopyOptions和ExternalTrasaction这两个参数我们可以对事务有很好的控制选择。
    using (SqlBulkCopy sqlBulkCopy = new SqlBulkCopy(sqlConnection, SqlBulkCopyOptions.TableLock, sqlTransaction))
    {
    sqlBulkCopy.BatchSize = batchSize;
    sqlBulkCopy.BulkCopyTimeout = 900;
    sqlBulkCopy.DestinationTableName = tableName;
    sqlBulkCopy.WriteToServer(table);
    sqlTransaction.Commit();
    }
    }
    catch (Exception)
    {
    sqlTransaction.Rollback();
    throw;
    }
    }
    }

    以下为此方法在实际使用中的统计数据(单位为毫秒):

    每次10000条数据:

    bulkcopy:4718.6594

    bulkcopy:1921.8381

    bulkcopy:2437.4532

    bulkcopy:1906.2134

    bulkcopy:2640.5743

    bulkcopy:2578.0755

    bulkcopy:2734.3225

    bulkcopy:2406.2038

    bulkcopy:2671.8237

    bulkcopy:2578.0755

    bulkcopy:2531.2014

    bulkcopy:2046.8357

    bulkcopy:2078.0851

    bulkcopy:2421.8285

    bulkcopy:2593.7002

    bulkcopy:2656.199

    bulkcopy:2640.5743

    bulkcopy:2421.8285

    bulkcopy:2578.0755

    bulkcopy:2593.7002

    bulkcopy:2890.5695

    每次50000条数据:

    bulkcopy:22030.827

    bulkcopy:6640.4975

    bulkcopy:7156.1126

    bulkcopy:8171.7181

    bulkcopy:7109.2385

    bulkcopy:6718.621

    bulkcopy:6734.2457

    bulkcopy:6187.3812

    bulkcopy:6734.2457

    bulkcopy:6937.3668

    bulkcopy:6796.7445

    bulkcopy:6812.3692

    bulkcopy:10327.9267

    bulkcopy:7859.2241

    bulkcopy:7624.8536

    bulkcopy:7390.4831

    每次100000条数据:

    bulkcopy:6296.7541

    bulkcopy:6843.6186

    bulkcopy:32311.8796

    bulkcopy:8062.3452

    bulkcopy:7702.9771

    bulkcopy:7577.9795

    bulkcopy:8109.2193

    bulkcopy:8577.9603

    bulkcopy:7734.2265

    bulkcopy:7499.856

    bulkcopy:7593.6042

    bulkcopy:7656.103

    bulkcopy:7765.4759

    每次200000条数据:

    bulkcopy:16138.3021

    bulkcopy:13833.7382

    bulkcopy:14786.1739

    bulkcopy:17549.7988

    bulkcopy:15629.3137

    bulkcopy:7135.4609

    bulkcopy:7307.2116

    bulkcopy:9368.22

    bulkcopy:8931.0364

    bulkcopy:10008.3817

    bulkcopy:8571.9213

    bulkcopy:9055.946

    bulkcopy:37832.6585

    每次500000条数据:

    bulkcopy:31163.097

    bulkcopy:26992.3968

    bulkcopy:26211.3668

  • 相关阅读:
    centos安装python3
    MongoDB 索引
    dockerfile
    docker端口映射与容器互联
    操作docker容器
    docker数据管理
    ubuntu安装docker
    MVC框架
    图像标签
    HTML的标签
  • 原文地址:https://www.cnblogs.com/zanxiaofeng/p/1687689.html
Copyright © 2011-2022 走看看