TiDB学习笔记

文章7 |   阅读 3678 |   点赞0

来源：https://blog.csdn.net/weixin_43129750/category_9537641.html

TiDB 学习第 7 天：TiDB 性能测试

转x33g5p2x  于2021-12-19 转载在 其他  
字(5.1k)|赞(0)|评价(0)|浏览(435)

一、工具介绍

TiDB性能测试使用sysbench工具来进行压测，sysbench是数据库功能及性能测试工具，它的测试功能如下：

  • CPU 运算性能测试
  • 磁盘 IO 性能测试
  • 调度程序性能测试
  • 内存分配及传输速度测试
  • POSIX 线程性能测试
  • 数据库性能测试（OLTP 基准测试，需要通过 /usr/share/sysbench/ 目录中的 Lua 脚本执行，例如 oltp_read_only.lua 脚本执行只读测试）

二、sysbench工具安装及使用

1、 Centos的安装
  1. sudo yum install -y sysbench
2、查看帮助信息
  1. # 查看帮助信息
  2.  [tidb@cdh01 ~]$ sudo sysbench --help
  3.  # 查看测试帮助信息
  4.  sudo sysbench fileio help / sudo sysbench cpu help

####　3、CPU测试信息

  1. # 查看CPU帮助信息 sudo sysbench cpu help
  2. [tidb@cdh01 ~]$ sudo sysbench cpu help   
  3. sysbench 1.0.17 (using system LuaJIT 2.0.4)
  4. cpu options:
  5.   --cpu-max-prime=N upper limit for primes generator [10000]
4、CPU测试
  1. sudo sysbench --cpu-max-prime=10000 --threads=2 cpu run
5、磁盘IO性能测试
  1. # 磁盘准备阶段
  2. sysbench --test=fileio --num-threads=16 --file-total-size=30G --file-test-mode=rndrw prepare
  4. # 磁盘IO运行检测
  5. sysbench --test=fileio --num-threads=16 --file-total-size=30G --file-test-mode=rndrw run
  7. Extra file open flags: (none)
  8. 128 files, 240MiB each
  9. 30GiB total file size
  10. Block size 16KiB
  11. Number of IO requests: 0
  12. Read/Write ratio for combined random IO test: 1.50
  13. Periodic FSYNC enabled, calling fsync() each 100 requests.
  14. Calling fsync() at the end of test, Enabled.
  15. Using synchronous I/O mode
  16. Doing random r/w test
  17. Initializing worker threads...
  19. Threads started!
  21. File operations:
  22.     reads/s:                      757.99
  23.     writes/s:                     504.77
  24.     fsyncs/s:                     1811.27
  26. Throughput:
  27.     read, MiB/s:                  11.84    
  28.     written, MiB/s:               7.89
  30. General statistics:
  31.     total time:                          10.1038s
  32.     total number of events:              29017
  34. Latency (ms):
  35.          min:                                    0.00
  36.          avg:                                    5.53
  37.          max:                                  374.29
  38.          95th percentile:                       33.12
  39.          sum:                               160351.92
  41. Threads fairness:    
  42.     events (avg/stddev):           1813.5625/196.79       
  43.     execution time (avg/stddev):   10.0220/0.03
6、线程测试
  1. sysbench --test=threads --num-threads=64 --thread-yields=100 --thread-locks=2 run   
  2. 测试写入64线程请求，每个请求产生100个数据量，最后测试执行时间
  4. WARNING: the --test option is deprecated. You can pass a script name or path on the command line without any options.
  5. WARNING: --num-threads is deprecated, use --threads instead
  6. sysbench 1.0.17 (using system LuaJIT 2.0.4)
  8. Running the test with following options:
  9. Number of threads: 64
  10. Initializing random number generator from current time
  12. Initializing worker threads...
  14. Threads started!
  16. General statistics:
  17.     total time:                          10.0057s
  18.     total number of events:              134204
  20. Latency (ms):
  21.          min:                                    0.03
  22.          avg:                                    4.77
  23.          max:                                   74.11
  24.          95th percentile:                       16.71
  25.          sum:                               639949.82
  27. Threads fairness:
  28.     events (avg/stddev):           2096.9375/94.14
  29.     execution time (avg/stddev):   9.9992/0.00                   # 测试最后执行时间为9.9秒
7、内存测试
  1. sysbench --test=memory --memory-block-size=8k --memory-total-size=40G run
  3. WARNING: the --test option is deprecated. You can pass a script name or path on the command line without any options.
  4. sysbench 1.0.17 (using system LuaJIT 2.0.4)
  6. Running the test with following options:
  7. Number of threads: 1
  8. Initializing random number generator from current time
  10. Running memory speed test with the following options:
  11.   block size: 8KiB
  12.   total size: 40960MiB
  13.   operation: write
  14.   scope: global
  15. Initializing worker threads...
  16. Threads started!
  17. Total operations: 5242880 (1073492.41 per second)
  18. 40960.00 MiB transferred (8386.66 MiB/sec)
  19. General statistics:
  20.     total time:                          4.8814s
  21.     total number of events:              5242880
  23. Latency (ms):
  24.          min:                                    0.00
  25.          avg:                                    0.00
  26.          max:                                    1.30
  27.          95th percentile:                        0.00
  28.          sum:                                 3911.72
  30. Threads fairness:
  31.     events (avg/stddev):           5242880.0000/0.00
  32.     execution time (avg/stddev):   3.9117/0.00         # 测试内存总大小40G 内存缓冲区大小为8k
8、TiDB OLTP基准测试

基准测试分为3个步骤进行：基准测试脚本如下：

1）首先需要先生成测试表
  1. 运行命令查看mysql数据库测试参数标准：sudo sysbeach --help
  2.   --mysql-host=[LIST,...]          MySQL server host [localhost]    mysql主机ip
  3.   --mysql-port=[LIST,...]          MySQL server port [3306]         端口/mysql默认端口3306   tidb端口 4000
  4.   --mysql-socket=[LIST,...]        MySQL socket                     mysql安装路径
  5.   --mysql-user=STRING              MySQL user [sbtest]               数据库用户名
  6.   --mysql-password=STRING          MySQL password []                  密码
  7.   --mysql-db=STRING                MySQL database name [sbtest]       需要进行压测的数据库名称
  8.   --mysql-ssl[=on|off]             use SSL connections, if available in the client library [off]
  9.   --mysql-ssl-cipher=STRING        use specific cipher for SSL connections []
  10.   --mysql-compression[=on|off]     use compression, if available in the client library [off]
  11.   --mysql-debug[=on|off]           trace all client library calls [off]
  12.   --mysql-ignore-errors=[LIST,...] list of errors to ignore, or "all" [1213,1020,1205]
  13.   --mysql-dry-run[=on|off]         Dry run, pretend that all MySQL client API calls are successful without executing them [off]
  1. # 运行语句生成测试表 
  2. sudo sysbench --db-driver=mysql --mysql-host=ip --mysql-port=4000 \
  3. 				   --mysql-user=root --mysql-password= --mysql-db=BIGDATA \
  4. 				   --range_size=100 --table_size=10000 --threads=2 --events=0 --time=60 \
  5. 				   --rand-type=uniform /usr/share/sysbench/oltp_read_only.lua prepare

2）运行语句进行测试（表的读性能统计基于表的数据是10000）
  1. 运行测试.lua测试语句并指定线程数
  2.  sudo sysbench --db-driver=mysql --mysql-host=ip --mysql-port=4000 \
  3. 				   --mysql-user=root --mysql-password= --mysql-db=BIGDATA \
  4. 				   --range_size=100 --table_size=10000 --threads=2 --events=0 --time=60 \
  5. 				   --rand-type=uniform /usr/share/sysbench/oltp_read_only.lua run

程序运行结果如下：

  1. Threads started!
  2. SQL statistics:
  3.     queries performed:                    #性能统计
  4.         read:                            63854   # 读统计 （select语句）
  5.         write:                           0       # 写统计 （insert、delete、update语句）
  6.         other:                           9122    # 其他语句 （如commit等）
  7.         total:                           72976   # 总执行语句之和
  8.     transactions:                        4561   (76.00 per sec.)   #总事务数（每秒处理的事务）
  9.     queries:                             72976  (1216.08 per sec.)  #查询性能（每秒的查询性能）
  10.     ignored errors:                      0      (0.00 per sec.)
  11.     reconnects:                          0      (0.00 per sec.)
  13. General statistics:
  14.     total time:                          60.0072s    # 总时长
  15.     total number of events:              4561        # 事务总数
  16.  
  17. Latency (ms):                                   #延迟时间
  18.          min:                                   19.30   # 最小延迟时间
  19.          avg:                                   26.30   # 平均延迟
  20.          max:                                 1238.63   # 最大延迟
  21.          95th percentile:                       33.12   # 95%以上语句响应时间
  22.          sum:                               119963.62   # 总延迟时长
  24. Threads fairness:                      # 线程公平性
  25.     events (avg/stddev):           2280.5000/0.50
  26.     execution time (avg/stddev):   59.9818/0.00
3、清除测试表
  1. # 清除测试表
  2.  sudo sysbench --db-driver=mysql --mysql-host=ip --mysql-port=4000 \
  3. 				   --mysql-user=root --mysql-password= --mysql-db=BIGDATA \
  4. 				   --range_size=100 --table_size=10000 --threads=2 --events=0 --time=60 \
  5. 				   --rand-type=uniform /usr/share/sysbench/oltp_read_only.lua clearnup

版权说明 : 本文为转载文章, 版权归原作者所有 版权申明

原文链接 : https://blog.csdn.net/weixin_43129750/article/details/103368374

内容来源于网络，如有侵权，请联系作者删除！

tidb

相关文章

    查看更多
    • 蜀ICP备13028337号-1 大数据知识库 https://www.saoniuhuo.com © All rights reserved
    • 本站内容来源互联网,如果侵犯您的权益请联系我们删除, 联系方式：448109455@qq.com