Changes between Version 22 and Version 23 of lustre_bonnie++


Ignore:
Timestamp:
Jun 16, 2008, 2:32:27 PM (17 years ago)
Author:
chris
Comment:

--

Legend:

Unmodified
Added
Removed
Modified

  • lustre_bonnie++

    v22 v23  
    1818[[BR]]
    1919= Lustre Performance =
    20  * '''without''' NFS tunning, kernel io scheduler = '''default'''[[BR]]
     20 * 設定不同的 kernel i/o scheduler，根據 lustre 官方文件 3-8 頁所描述，最適合 Lustre 的 kernel i/o scheduler 為 deadline。[[BR]]
     21[[Image(Lustre with diff kernel_scheduler.PNG)]]
     22 * 在 Create/Delete檔案方面，則是以 as 有較佳的表現。
     23[[Image(Lustre create with diff kernel_scheduler.PNG)]]
     24 * 當多個 Client 同時存取時，lustre file system 的效能有顯著的提升。
     25[[Image(fake multi-clients.PNG)]]
     26
     27 * 以下是一些測試的數據：
     28  * '''without''' NFS tunning, kernel io scheduler = '''default'''[[BR]]
    2129{{{
    2230[root@lustre bonnie++-1.03c]# ./bonnie++ -d /mnt/client_fs01/ -s 16000:1048576  -r 1024 -u root -m first
    … …  
    4553
    4654}}}
    47  * with NFS tunning, kernel io scheduler='''default'''[[BR]]
     55  * with NFS tunning, kernel io scheduler='''default'''[[BR]]
    4856{{{
    4957[root@lustre bonnie++-1.03c]# ./bonnie++ -d /mnt/client_fs01/ -s 16000:1048576  -r 1024 -u root -m first
    … …  
    7179first,16000M:1024k,41030,75,59535,9,26237,10,47504,96,64738,17,68.0,21,16,6802,36,3005,32,5248,36,6308,38,3029,35,5351,35
    7280}}}
    73  * with NFS tunning, kernel io scheduler = '''deadline'''[[BR]]
     81  * with NFS tunning, kernel io scheduler = '''deadline'''[[BR]]
    7482{{{
    7583[root@lustre bonnie++-1.03c]# ./bonnie++ -d /mnt/client_fs01/ -s 16000:1048576  -r 1024 -u root -m first
    … …  
    97105first,16000M:1024k,48900,79,59534,10,26680,10,47398,96,66517,18,70.0,22,16,6954,38,3050,33,6233,35,7125,34,2981,34,5416,36
    98106}}}
    99  * without nfs tunning, kernel io scheduler = '''cfq'''[[BR]]
     107  * without nfs tunning, kernel io scheduler = '''cfq'''[[BR]]
    100108{{{
    101109[root@lustre bonnie++-1.03c]# ./bonnie++ -d /mnt/client_fs01/ -s 16000:1048576  -r 1024 -u root
    … …  
    123131lustre,16000M:1024k,50986,80,46204,8,21749,8,46982,95,56664,15,65.2,21,16,8117,37,3062,31,6504,38,7041,35,2963,33,5579,34
    124132}}}
    125  * with nfs tunning, kernel io scheduler = '''cfq''' [[BR]]
     133  * with nfs tunning, kernel io scheduler = '''cfq''' [[BR]]
    126134{{{
    127135[root@lustre bonnie++-1.03c]# ./bonnie++ -d /mnt/client_fs01/ -s 16000:1048576  -r 1024 -u root
    … …  
    149157lustre,16000M:1024k,51603,85,48624,7,22740,8,46542,97,59096,16,67.7,21,16,6940,33,2944,34,5327,41,6141,35,2999,33,5549,39
    150158}}}
    151  * with nfs tunning, kernel io scheduler = '''as'''
     159  * with nfs tunning, kernel io scheduler = '''as'''
    152160{{{
    153161[root@lustre bonnie++-1.03c]# ./bonnie++ -d /mnt/client_fs01/ -s 16000:1048576  -r 1024 -u root
    … …  
    175183lustre,16000M:1024k,48623,78,51374,8,23598,9,47865,96,60014,16,68.6,21,16,8914,36,3153,31,7046,38,8020,39,3108,32,6087,39
    176184}}}
    177  * with nfs tunning, kernel io scheduler = '''noop'''
     185  * with nfs tunning, kernel io scheduler = '''noop'''
    178186{{{
    179187[root@lustre bonnie++-1.03c]# ./bonnie++ -d /mnt/client_fs01/ -s 16000:1048576  -r 1024 -u root
    … …  
    201209lustre,16000M:1024k,46297,74,54749,9,24791,9,47547,96,61390,16,68.4,21,16,7982,34,3036,33,5398,36,7063,35,3056,33,5341,39
    202210}}}
    203  * with nfs tunning, kernel io scheduler = noop, isolated client.
     211  * with nfs tunning, kernel io scheduler = noop, isolated client.
    204212{{{
    205213[root@lustre005 bonnie++-1.03c]# ./bonnie++ -d /mnt/client_fs/ -s 16000:1048576  -r 1024 -u root
    … …  
    227235lustre005,16000M:1024k,35309,98,51334,8,24285,8,35666,98,58716,14,68.2,19,16,2090,9,1593,14,1877,9,2024,9,1638,11,1891,9
    228236}}}
    229  * with nfs tunning, kernel io scheduler = '''default''', just sdb mounted , total 881 GB
     237  * with nfs tunning, kernel io scheduler = '''default''', just sdb mounted , total 881 GB
    230238{{{
    231239[root@lustre bonnie++-1.03c]# ./bonnie++ -d /mnt/client_fs01/ -s 16000:1048576  -r 1024 -u root -m first
    … …  
    253261first,16000M:1024k,62065,98,64754,10,27672,10,47468,96,64299,17,67.2,20,16,8385,38,3080,31,5924,37,6350,37,3056,33,5901,35
    254262}}}
    255  * without DRBL, kernel io scheduler = '''default''', just sdb mounted , total 881 GB
     263  * without DRBL, kernel io scheduler = '''default''', just sdb mounted , total 881 GB
    256264{{{
    257265[root@lustre bonnie++-1.03c]# ./bonnie++ -d /mnt/client_fs01/ -s 16000:1048576  -r 1024 -u root -m first