zoukankan      html  css  js  c++  java
  • sysbench的安装与使用(with MySQL)

    sysbench是一款开源的多线程性能测试工具,可以执行CPU/内存/线程/IO/数据库等方面的性能测试。

    项目主页: http://sysbench.sourceforge.net/

    安装文档http://sysbench.sourceforge.net/docs/#install

    但是好像这两天打不开,在这儿提供一个0.4.12版的下载:sysbench-0.4.12.tar.gz

    一.安装三步骤:

    1.configure

    ./configure --prefix=/u01/sysbench/ --with-mysql-includes=/usr/include/mysql/ --with-mysql-libs=/usr/lib/mysql/ --with-mysql

    其中标红的地方为mysql的2个路径,我在这个地方偷懒用的直接是yum install的方式安装的,所以路径为默认的这个。如果是自定义的,比如/u01/mysql之类的,那么路径就改成相应的就可以了。

    2.make

    这一步会根据上一步生成的makefile来进行make,但之前的configure里面,生成makefile的时候,是用的32位的包,所以需要ln一下,使用64位的包:

    ln -s /usr/lib64/mysql/* /usr/lib/mysql/,再执行autogen.sh,再执行make

    3.make install

    二.使用

    首先,看看sysbench支持哪些功能参数:

    [root@monsrv bin]# sysbench --hlp
    Unknown option: --hlp.
    Usage:
      sysbench [general-options]... --test=<test-name> [test-options]... command
    
    General options:
      --num-threads=N            number of threads to use [1]
      --max-requests=N           limit for total number of requests [10000]
      --max-time=N               limit for total execution time in seconds [0]
      --forced-shutdown=STRING   amount of time to wait after --max-time before forcing shutdown [off]
      --thread-stack-size=SIZE   size of stack per thread [32K]
      --init-rng=[on|off]        initialize random number generator [off]
      --test=STRING              test to run
      --debug=[on|off]           print more debugging info [off]
      --validate=[on|off]        perform validation checks where possible [off]
      --help=[on|off]            print help and exit
      --version=[on|off]         print version and exit
    
    Compiled-in tests:
      fileio - File I/O test
      cpu - CPU performance test
      memory - Memory functions speed test
      threads - Threads subsystem performance test
      mutex - Mutex performance test
      oltp - OLTP test
    
    Commands: prepare run cleanup help version
    
    See 'sysbench --test=<name> help' for a list of options for each test.

    从帮助可以看出,sysbench的测试主要包括以下几个方面:

    (1)磁盘io性能

    (2)cpu性能

    (3)内存分配及传输速度

    (4)线程性能

    (5)mutex性能

    (6)OLTP基准测试

     

    2.1 测试fileio命令帮助:

    [root@monsrv bin]# sysbench --test=fileio help 
    sysbench 0.4.12:  multi-threaded system evaluation benchmark
    
    fileio options:
      --file-num=N                  number of files to create [128]
      --file-block-size=N           block size to use in all IO operations [16384]
      --file-total-size=SIZE        total size of files to create [2G]
      --file-test-mode=STRING       test mode {seqwr, seqrewr, seqrd, rndrd, rndwr, rndrw}
      --file-io-mode=STRING         file operations mode {sync,async,fastmmap,slowmmap} [sync]
      --file-async-backlog=N        number of asynchronous operatons to queue per thread [128]
      --file-extra-flags=STRING     additional flags to use on opening files {sync,dsync,direct} []
      --file-fsync-freq=N           do fsync() after this number of requests (0 - don't use fsync()) [100]
      --file-fsync-all=[on|off]     do fsync() after each write operation [off]
      --file-fsync-end=[on|off]     do fsync() at the end of test [on]
      --file-fsync-mode=STRING      which method to use for synchronization {fsync, fdatasync} [fsync]
      --file-merged-requests=N      merge at most this number of IO requests if possible (0 - don't merge) [0]
      --file-rw-ratio=N             reads/writes ratio for combined test [1.5]

     

    参数详解:

    --file-num=N          代表生成测试文件的数量,默认为128。

    --file-block-size=N      测试时所使用文件块的大小,如果想磁盘针对innodb存储引擎进行测试,可以将其设置为16384,即innodb存储引擎页的大小。默认为16384。

    --file-total-size=SIZE     创建测试文件的总大小,默认为2G大小。

    --file-test-mode=STRING 文件测试模式,包含:seqwr(顺序写), seqrewr(顺序读写), seqrd(顺序读), rndrd(随机读), rndwr(随机写), rndrw(随机读写)。

    --file-io-mode=STRING   文件操作的模式,sync(同步),async(异步),fastmmap(快速mmap),slowmmap(慢速mmap),默认为sync同步模式。

    --file-async-backlog=N   对应每个线程队列的异步操作数,默认为128。

    --file-extra-flags=STRING 打开文件时的选项,这是与API相关的参数。

    --file-fsync-freq=N      执行fsync()函数的频率。fsync主要是同步磁盘文件,因为可能有系统和磁盘缓冲的关系。 0代表不使用fsync函数。默认值为100。

    --file-fsync-all=[on|off]  每执行完一次写操作,就执行一次fsync。默认为off。

    --file-fsync-end=[on|off] 在测试结束时执行fsync函数。默认为on。

    --file-fsync-mode=STRING文件同步函数的选择,同样是和API相关的参数,由于多个操作系统对于fdatasync支持不同,因此不建议使用fdatasync。默认为fsync。

    --file-merged-requests=N 大多情况下,合并可能的IO的请求数,默认为0。

    --file-rw-ratio=N         测试时的读写比例,默认时为1.5,即可3:2。

    示例:

    生成16个总共2G的文件,进行读写io测试

    准备工作:

    [root@monsrv bin]# sysbench --test=fileio --file-num=16 --file-total-size=2G prepare
    sysbench 0.4.12:  multi-threaded system evaluation benchmark
    
    16 files, 131072Kb each, 2048Mb total
    Creating files for the test...

    [root@monsrv bin]# ls -lrth
    total 2.1G
    -rwxr-xr-x 1 root root 293K Oct 15 16:20 sysbench
    -rw------- 1 root root 128M Oct 15 17:38 test_file.0
    -rw------- 1 root root 128M Oct 15 17:38 test_file.1
    -rw------- 1 root root 128M Oct 15 17:38 test_file.2
    -rw------- 1 root root 128M Oct 15 17:39 test_file.3
    -rw------- 1 root root 128M Oct 15 17:39 test_file.4
    -rw------- 1 root root 128M Oct 15 17:39 test_file.5
    -rw------- 1 root root 128M Oct 15 17:39 test_file.6
    -rw------- 1 root root 128M Oct 15 17:39 test_file.7
    -rw------- 1 root root 128M Oct 15 17:39 test_file.8
    -rw------- 1 root root 128M Oct 15 17:39 test_file.9
    -rw------- 1 root root 128M Oct 15 17:39 test_file.10
    -rw------- 1 root root 128M Oct 15 17:40 test_file.11
    -rw------- 1 root root 128M Oct 15 17:40 test_file.12
    -rw------- 1 root root 128M Oct 15 17:40 test_file.13
    -rw------- 1 root root 128M Oct 15 17:40 test_file.14
    -rw------- 1 root root 128M Oct 15 17:40 test_file.15

    开始测试:

    [root@monsrv bin]# sysbench --test=fileio --file-total-size=2G --file-test-mode=rndrd --max-time=180 --max-requests=100000000 --num-threads=16 --init-rng=on --file-num=16 --file-extra-flags=direct --file-fsync-freq=0 --file-block-size=16384 run
    sysbench 0.4.12:  multi-threaded system evaluation benchmark
    
    Running the test with following options:
    Number of threads: 16
    Initializing random number generator from timer.
    
    
    Extra file open flags: 16384
    16 files, 128Mb each
    2Gb total file size
    Block size 16Kb
    Number of random requests for random IO: 100000000
    Read/Write ratio for combined random IO test: 1.50
    Calling fsync() at the end of test, Enabled.
    Using synchronous I/O mode
    Doing random read test
    Threads started!
    Time limit exceeded, exiting...
    (last message repeated 15 times)
    Done.
    
    Operations performed:  314382 Read, 0 Write, 0 Other = 314382 Total
    Read 4.7971Gb  Written 0b  Total transferred 4.7971Gb  (27.288Mb/sec)
     1746.43 Requests/sec executed
    
    Test execution summary:
        total time:                          180.0138s
        total number of events:              314382
        total time taken by event execution: 2879.5979
        per-request statistics:
             min:                                  0.26ms
             avg:                                  9.16ms
             max:                                131.24ms
             approx.  95 percentile:              25.96ms
    
    Threads fairness:
        events (avg/stddev):           19648.8750/138.91
        execution time (avg/stddev):   179.9749/0.00
    
    [root@monsrv bin]# sysbench --test=fileio --file-total-size=2G --file-test-mode=rndrd --max-time=180 --max-requests=100000000 --num-threads=16 --init-rng=on --file-num=16 --file-extra-flags=direct --file-fsync-freq=0 --file-block-size=16384 run
    sysbench 0.4.12:  multi-threaded system evaluation benchmark
    
    Running the test with following options:
    Number of threads: 16
    Initializing random number generator from timer.
    
    
    Extra file open flags: 16384
    16 files, 128Mb each
    2Gb total file size
    Block size 16Kb
    Number of random requests for random IO: 100000000
    Read/Write ratio for combined random IO test: 1.50
    Calling fsync() at the end of test, Enabled.
    Using synchronous I/O mode
    Doing random read test
    Threads started!
    Time limit exceeded, exiting...
    (last message repeated 15 times)
    Done.
    
    Operations performed:  313704 Read, 0 Write, 0 Other = 313704 Total
    Read 4.7867Gb  Written 0b  Total transferred 4.7867Gb  (27.229Mb/sec)
     1742.62 Requests/sec executed
    
    Test execution summary:
        total time:                          180.0182s
        total number of events:              313704
        total time taken by event execution: 2879.6401
        per-request statistics:
             min:                                  0.25ms
             avg:                                  9.18ms
             max:                                121.35ms
             approx.  95 percentile:              26.06ms
    
    Threads fairness:
        events (avg/stddev):           19606.5000/85.96
        execution time (avg/stddev):   179.9775/0.00

    测试结果主要看标黄色的那一段。为了稳定,测了2次,看起来差不多。

    测试完成后,需要把测试文件给删掉。

    [root@monsrv bin]# sysbench --test=fileio --file-num=16 --file-total-size=2G cleanup
    sysbench 0.4.12:  multi-threaded system evaluation benchmark
    
    Removing test files...
    [root@monsrv bin]# ls -lrth
    total 300K
    -rwxr-xr-x 1 root root 293K Oct 15 16:20 sysbench

    2.2 测试cpu命令帮助:

    [root@monsrv bin]# sysbench --test=cpu help
    sysbench 0.4.12:  multi-threaded system evaluation benchmark
    
    cpu options:
      --cpu-max-prime=N      upper limit for primes generator [10000]

     参数详解:

      --cpu-max-prime=N      用来选项指定最大的素数,具体参数可以根据CPU的性能来设置,默认为10000

    2.3 测试memory命令帮助:

    [root@monsrv bin]# sysbench  --test=memory help
    sysbench 0.4.12:  multi-threaded system evaluation benchmark
    
    memory options:
      --memory-block-size=SIZE    size of memory block for test [1K]
      --memory-total-size=SIZE    total size of data to transfer [100G]
      --memory-scope=STRING       memory access scope {global,local} [global]
      --memory-hugetlb=[on|off]   allocate memory from HugeTLB pool [off]
      --memory-oper=STRING        type of memory operations {read, write, none} [write]
      --memory-access-mode=STRING memory access mode {seq,rnd} [seq]

     

    参数详解:

      --memory-block-size=SIZE      测试内存块的大小,默认为1K

      --memory-total-size=SIZE       数据传输的总大小,默认为100G

      --memory-scope=STRING       内存访问的范围,包括全局和本地范围,默认为global

      --memory-hugetlb=[on|off]     是否从HugeTLB池分配内存的开关,默认为off

      --memory-oper=STRING        内存操作的类型,包括read, write, none,默认为write

      --memory-access-mode=STRING 内存访问模式,包括seq,rnd两种模式,默认为seq

    2.4 测试threads命令帮助: 

    [root@monsrv bin]#  sysbench  --test=threads help
    sysbench 0.4.12:  multi-threaded system evaluation benchmark
    
    threads options:
      --thread-yields=N      number of yields to do per request [1000]
      --thread-locks=N       number of locks per thread [8]

    参数详解: 

      --thread-yields=N      指定每个请求的压力,默认为1000

      --thread-locks=N       指定每个线程的锁数量,默认为8

    2.5 测试mutex命令帮助:

    [root@monsrv bin]# sysbench  --test=mutex help 
    sysbench 0.4.12:  multi-threaded system evaluation benchmark
    
    mutex options:
      --mutex-num=N        total size of mutex array [4096]
      --mutex-locks=N      number of mutex locks to do per thread [50000]
      --mutex-loops=N      number of empty loops to do inside mutex lock [10000]

    参数详解

      --mutex-num=N    数组互斥的总大小。默认是4096

      --mutex-locks=N    每个线程互斥锁的数量。默认是50000

      --mutex-loops=N    内部互斥锁的空循环数量。默认是10000

    2.6 测试oltp命令帮助:  

    [root@monsrv bin]# sysbench --test=oltp help 
    sysbench 0.4.12:  multi-threaded system evaluation benchmark
    
    oltp options:
      --oltp-test-mode=STRING         test type to use {simple,complex,nontrx,sp} [complex]
      --oltp-reconnect-mode=STRING    reconnect mode {session,transaction,query,random} [session]
      --oltp-sp-name=STRING           name of store procedure to call in SP test mode []
      --oltp-read-only=[on|off]       generate only 'read' queries (do not modify database) [off]
      --oltp-skip-trx=[on|off]        skip BEGIN/COMMIT statements [off]
      --oltp-range-size=N             range size for range queries [100]
      --oltp-point-selects=N          number of point selects [10]
      --oltp-simple-ranges=N          number of simple ranges [1]
      --oltp-sum-ranges=N             number of sum ranges [1]
      --oltp-order-ranges=N           number of ordered ranges [1]
      --oltp-distinct-ranges=N        number of distinct ranges [1]
      --oltp-index-updates=N          number of index update [1]
      --oltp-non-index-updates=N      number of non-index updates [1]
      --oltp-nontrx-mode=STRING       mode for non-transactional test {select, update_key, update_nokey, insert, delete} [select]
      --oltp-auto-inc=[on|off]        whether AUTO_INCREMENT (or equivalent) should be used on id column [on]
      --oltp-connect-delay=N          time in microseconds to sleep after connection to database [10000]
      --oltp-user-delay-min=N         minimum time in microseconds to sleep after each request [0]
      --oltp-user-delay-max=N         maximum time in microseconds to sleep after each request [0]
      --oltp-table-name=STRING        name of test table [sbtest]
      --oltp-table-size=N             number of records in test table [10000]
      --oltp-dist-type=STRING         random numbers distribution {uniform,gaussian,special} [special]
      --oltp-dist-iter=N              number of iterations used for numbers generation [12]
      --oltp-dist-pct=N               percentage of values to be treated as 'special' (for special distribution) [1]
      --oltp-dist-res=N               percentage of 'special' values to use (for special distribution) [75]
    
    General database options:
    
      --db-driver=STRING  specifies database driver to use ('help' to get list of available drivers)
      --db-ps-mode=STRING prepared statements usage mode {auto, disable} [auto]
    
    
    Compiled-in database drivers:
      mysql - MySQL driver
    
    mysql options:
      --mysql-host=[LIST,...]       MySQL server host [localhost]
      --mysql-port=N                MySQL server port [3306]
      --mysql-socket=STRING         MySQL socket
      --mysql-user=STRING           MySQL user [sbtest]
      --mysql-password=STRING       MySQL password []
      --mysql-db=STRING             MySQL database name [sbtest]
      --mysql-table-engine=STRING   storage engine to use for the test table {myisam,innodb,bdb,heap,ndbcluster,federated} [innodb]
      --mysql-engine-trx=STRING     whether storage engine used is transactional or not {yes,no,auto} [auto]
      --mysql-ssl=[on|off]          use SSL connections, if available in the client library [off]
      --myisam-max-rows=N           max-rows parameter for MyISAM tables [1000000]
      --mysql-create-options=STRING additional options passed to CREATE TABLE []

    参数详解:

      --oltp-test-mode=STRING    执行模式{simple,complex(advanced transactional),nontrx(non-transactional),sp}。默认是complex

      --oltp-reconnect-mode=STRING 重新连接模式{session(不使用重新连接。每个线程断开只在测试结束),transaction(在每次事务结束后重新连接),query(在每个SQL语句执行完重新连接),random(对于每个事务随机选择以上重新连接模式)}。默认是session

      --oltp-sp-name=STRING   存储过程的名称。默认为空

      --oltp-read-only=[on|off]  只读模式。Update,delete,insert语句不可执行。默认是off

      --oltp-skip-trx=[on|off]   省略begin/commit语句。默认是off

      --oltp-range-size=N      查询范围。默认是100

      --oltp-point-selects=N          number of point selects [10]

      --oltp-simple-ranges=N          number of simple ranges [1]

      --oltp-sum-ranges=N             number of sum ranges [1]

      --oltp-order-ranges=N           number of ordered ranges [1]

      --oltp-distinct-ranges=N        number of distinct ranges [1]

      --oltp-index-updates=N          number of index update [1]

      --oltp-non-index-updates=N      number of non-index updates [1]

      --oltp-nontrx-mode=STRING   查询类型对于非事务执行模式{select, update_key, update_nokey, insert, delete} [select]

      --oltp-auto-inc=[on|off]      AUTO_INCREMENT是否开启。默认是on

      --oltp-connect-delay=N     在多少微秒后连接数据库。默认是10000

      --oltp-user-delay-min=N    每个请求最短等待时间。单位是ms。默认是0

      --oltp-user-delay-max=N    每个请求最长等待时间。单位是ms。默认是0

      --oltp-table-name=STRING  测试时使用到的表名。默认是sbtest

      --oltp-table-size=N         测试表的记录数。默认是10000

      --oltp-dist-type=STRING    分布的随机数{uniform(均匀分布),Gaussian(高斯分布),special(空间分布)}。默认是special

      --oltp-dist-iter=N    产生数的迭代次数。默认是12

      --oltp-dist-pct=N    值的百分比被视为'special' (for special distribution)。默认是1

      --oltp-dist-res=N    'special'的百分比值。默认是75

     示例:

    首先准备sbest测试表,因为脚本默认不会建库,那么需要先在MySQL中吧库建好,当然也可以用参数--mysql-db指定数据库。

    [root@monsrv ~]# sysbench --test=oltp --num-threads=1 --max-requests=80000 --oltp-test-mode=complex --db-driver=mysql --mysql-db=sbtest --mysql-host=192.168.0.155 --mysql-port=1234 --mysql-user=root --mysql-password=aostarit --oltp-nontrx-mode=select --db-ps-mode=disable prepare
    sysbench 0.4.12:  multi-threaded system evaluation benchmark
    
    Creating table 'sbtest'...
    Creating 10000 records in table 'sbtest'...

    接着就是测试了。我在这儿设置了80000个请求,也就是说这个测试需要做完80000个request才会停止,可以适当的调整。

    [root@monsrv ~]# sysbench --test=oltp --num-threads=1 --max-requests=80000 --oltp-test-mode=complex --db-driver=mysql --mysql-db=sbtest --mysql-host=192.168.0.155 --mysql-port=1234 --mysql-user=root --mysql-password=aostarit --oltp-nontrx-mode=select --db-ps-mode=disable run
    sysbench 0.4.12:  multi-threaded system evaluation benchmark
    
    Running the test with following options:
    Number of threads: 1
    
    Doing OLTP test.
    Running mixed OLTP test
    Using Special distribution (12 iterations,  1 pct of values are returned in 75 pct cases)
    Using "BEGIN" for starting transactions
    Using auto_inc on the id column
    Maximum number of requests for OLTP test is limited to 80000
    Threads started!
    Done.
    
    OLTP test statistics:
        queries performed:
            read:                            1120000
            write:                           400000
            other:                           160000
            total:                           1680000
        transactions:                        80000  (42.98 per sec.)
        deadlocks:                           0      (0.00 per sec.)
        read/write requests:                 1520000 (816.54 per sec.)
        other operations:                    160000 (85.95 per sec.)
    
    Test execution summary:
        total time:                          1861.5174s
        total number of events:              80000
        total time taken by event execution: 1860.8692
        per-request statistics:
             min:                                 18.08ms
             avg:                                 23.26ms
             max:                                886.62ms
             approx.  95 percentile:              34.32ms
    
    Threads fairness:
        events (avg/stddev):           80000.0000/0.00
        execution time (avg/stddev):   1860.8692/0.00
    
    [root@monsrv ~]# 

    最后就是清除

  • 相关阅读:
    jQurey中getJSON方法错误回调方法
    easyui-datagrid 假分页
    布局页
    SQL游标(cursor)详细说明及内部循环使用示例
    Jquery 实现事件冒泡
    Jquery 实现选项卡
    Jquery 实现折叠菜单
    Jquery 实现表格的隔行换色
    Html5 考点内容
    Html5 之Canvas [画布]
  • 原文地址:https://www.cnblogs.com/nazeebodan/p/4026467.html
Copyright © 2011-2022 走看看