DragonFly BSD
DragonFly kernel List (threaded) for 2011-07
[Date Prev][Date Next]  [Thread Prev][Thread Next]  [Date Index][Thread Index]

Re: Blogbench RAID benchmarks


From: Francois Tigeot <ftigeot@xxxxxxxxxxxx>
Date: Tue, 12 Jul 2011 08:52:04 +0200

On Mon, Jul 11, 2011 at 04:34:50PM -0700, Matthew Dillon wrote:
> 
>     I haven't reviewed the interrupt handling code to determine how safe
>     the functions it calls internally are.  arcmsr does get its own lock
>     in arcmsr_intr_handler().  It could very well be safe for us to set
>     the INTR_MPSAFE flag there but someone will have to life-test it.

I gave it a try.

[arcmsr.c]
-               bus_setup_intr(dev, irqres, 0, arcmsr_intr_handler, acb, &acb->ih, NULL)) {
+               bus_setup_intr(dev, irqres, INTR_MPSAFE, arcmsr_intr_handler, acb, &acb->ih, NULL)) {

The good news is there was no obvious stability issue; the tests completed
successfully.
But there was no real performance change either. blogbench results were
624 / 176300, in line with previous ones.

>     In anycase, I'm not sure it's even the bottleneck for the earlier tests
>     since blockbench didn't run long enough (with default options) to use
>     up 32G of ram.

On the contrary, shouldn't performance be higher if the disks are not touched ?

Looking at iostat history, newfs pushed almost 8000 iops to the raid volume.
blogbench was much lower at first and the number of iops was almost divided
by ten after some time.

I've attached a log of iostat /dev/da0 1

Two activity periods are shown in the file:
- newfs_hammer -L RAID_VOL /dev/da0
- blogbench -d /mnt/blogbench

-- 
Francois Tigeot
      tty             da0             cpu
 tin tout  KB/t tps   MB/s  us ni sy in id
   0    4  0.00    0  0.00   0  0  1  0 99
   0   79  0.00    0  0.00   0  0  0  0 100
   0    3  0.00    0  0.00   0  0  0  0 100
   0    4  0.00    0  0.00   0  0  0  0 100
   1    4  0.00    0  0.00   0  0  0  0 100
   0   19  0.00    0  0.00   0  0  0  0 100
   0    7  0.75    4  0.00   0  0  0  0 100
   0    3  0.00    0  0.00   0  0  0  0 100
   0    7  0.00    0  0.00   0  0  0  0 100
   0   17 16.00 5922 92.51   3  0  2  0 95
   0  144 16.00 7439 116.24   3  0  2  0 94
   0    6 16.00 7672 119.88   3  0  2  0 95
   0    6 16.00 7316 114.32   3  0  3  0 94
   0    6 16.00 7559 118.11   3  0  2  0 95
   0    6 16.00 7694 120.22   3  0  2  0 95
   0   87 16.00 7694 120.22   3  0  2  0 95
   0  146 16.00 7694 120.22   3  0  2  0 94
   0    6 16.00 7187 112.30   3  0  2  0 95
   0  167 15.93  926 14.41   0  0  1  0 99
   0    3  0.00    0  0.00   0  0  0  0 100
      tty             da0             cpu
 tin tout  KB/t tps   MB/s  us ni sy in id
   0    8  0.00    0  0.00   0  0  0  0 100
   0   13 12.00    8  0.09   0  0  0  0 100
   1    9  0.00    0  0.00   0  0  0  0 100
   0   10  0.00    0  0.00   0  0  0  0 100
   0    3  0.00    0  0.00   0  0  0  0 100
   0    7  0.00    0  0.00   0  0  0  0 100
   1    4  0.00    0  0.00   0  0  0  0 100
   1    4  0.00    0  0.00   0  0  0  0 100
   1    3  0.00    0  0.00   0  0  0  0 100
   0    3  0.00    0  0.00   0  0  0  0 100
   0   47 12.31   13  0.16   0  0 15  0 84
   0  147  0.00    0  0.00   2  0 64  0 33
   0    6 16.00 3409 53.25   4  0 91  0  5
   0    6 16.00 2018 31.54   4  0 92  0  4
   0    5 15.99 3804 59.40   5  0 95  0  0
   0    5 16.00  827 12.92   5  0 95  0  1
   0    5 15.99 4591 71.70   4  0 96  0  0
   0    5 15.98  938 14.64   5  0 95  0  0
   0    5 15.99 4487 70.08   4  0 96  0  0
   0   34 16.00  446  6.97   5  0 95  0  0
      tty             da0             cpu
 tin tout  KB/t tps   MB/s  us ni sy in id
   0   15 15.99 4605 71.92   5  0 95  0  0
   0  152 15.92  200  3.11   4  0 96  0  0
   0    6 15.99 4762 74.38   5  0 95  0  0
   0    5 15.99 2615 40.82   4  0 84  0 12
   0    5 15.98 7683 119.86   3  0 73  0 24
   0    6 15.64 1741 26.59   3  0 84  0 13
   0    5 15.65 1310 20.01   3  0 70  0 27
   0    5 15.81 1108 17.11   4  0 90  0  6
   0    6 15.93 1470 22.87   4  0 95  0  0
   0    5 15.90  628  9.75   4  0 95  0  0
   0   11 15.94 1290 20.07   5  0 95  0  0
   0    6 15.98 2960 46.20   4  0 96  0  0
   0    5 15.95 1174 18.28   4  0 96  0  0
   0    6 15.98 2959 46.18   4  0 95  0  0
   0    5 15.95 1599 24.90   4  0 96  0  0
   0   39 15.98 2712 42.33   5  0 95  0  0
   0  148 15.96 1749 27.26   5  0 95  0  0
   0    6 15.98 3104 48.44   5  0 95  0  0
   0    5 15.97 2265 35.32   5  0 95  0  0
   0    5 15.97 2495 38.92   5  0 95  0  0
      tty             da0             cpu
 tin tout  KB/t tps   MB/s  us ni sy in id
   0   11 15.98 1993 31.10   5  0 95  0  0
   0   16 15.97 2455 38.27   5  0 95  0  0
   0    6 15.99 2585 40.35   4  0 96  0  0
   0    6 15.97 2065 32.20   4  0 95  0  0
   0    5 15.98 2898 45.22   5  0 95  0  0
   0    5 15.96 1310 20.42   4  0 96  0  0
   0    5 15.99 3557 55.54   5  0 95  0  0
   0   46 15.94 1072 16.68   5  0 95  0  0
   0    3 15.99 3351 52.31   5  0 95  0  0
   0  147 15.96 1698 26.46   5  0 95  0  0
   0   11 15.98 2882 44.99   5  0 95  0  0
   0    5 15.96 1766 27.53   5  0 95  0  0
   0    5 15.98 2954 46.10   4  0 96  0  0
   0    5 15.97 2236 34.87   5  0 95  0  0
   0    5 15.99 3476 54.27   4  0 90  0  6
   0    5 15.99 7425 115.94   3  0 65  0 32
   0    6 15.87 2858 44.30   5  0 93  0  2
   0    5 15.78 2096 32.29   4  0 93  0  3
   0    5 15.72 1079 16.56   5  0 82  0 13
   0    5 15.80 1489 22.96   4  0 90  0  6
      tty             da0             cpu
 tin tout  KB/t tps   MB/s  us ni sy in id
   0   11 15.93 1110 17.26   5  0 95  0  0
   0   16 15.95 1223 19.04   5  0 95  0  0
   0    5 15.96 1717 26.77   6  0 94  0  0
   0   54 15.98 1726 26.93   5  0 95  0  0
   0    3 15.98 1744 27.22   5  0 95  0  0
   0    3 15.96 1758 27.40   5  0 94  0  0
   0    3 15.99 2159 33.70   6  0 94  0  0
   0    3 15.97  994 15.51   5  0 95  0  0
   0    3 15.98 2549 39.78   6  0 94  0  0
   0    3 15.96  914 14.25   4  0 96  0  0
   0   15 15.99 2369 36.99   6  0 93  0  0
   0    3 15.98 1477 23.04   6  0 93  0  0
   0  147 15.99 2196 34.29   6  0 93  0  0
   0    5 15.98 1607 25.07   5  0 94  0  0
   0    5 15.98 1583 24.71   6  0 94  0  0
   0    5 15.99 1733 27.06   6  0 94  0  0
   0    6 15.98 1445 22.54   5  0 94  0  1
   0    5 15.99 2538 39.63   6  0 94  0  0
   0    5 15.96  872 13.59   6  0 93  0  1
   0    5 15.99 2318 36.19   5  0 94  0  1
      tty             da0             cpu
 tin tout  KB/t tps   MB/s  us ni sy in id
   0   11 15.99 1139 17.77   5  0 94  0  0
   0   16 15.99 1262 19.70   5  0 94  0  1
   0    6 15.98 1946 30.37   5  0 95  0  1
   0    5 15.96  852 13.27   5  0 94  0  1
   0    6 16.00 1798 28.10   5  0 94  0  1
   0    5 15.98 1659 25.89   5  0 86  0  9
   0    5 16.00 2555 39.92   1  0 58  0 41
   0    6 16.00 1845 28.82   1  0 71  0 28
   0    5 15.99 1743 27.22   1  0 73  0 26
   0    6 16.00 1021 15.96   1  0 71  0 28
   0   75 15.96  792 12.35   2  0 81  0 17
   0    3 15.91  178  2.76   2  0 84  0 14
   0    3 15.90  161  2.50   2  0 84  0 13
   0    3 15.88  259  4.01   3  0 85  0 12
   0    3 15.90  163  2.53   1  0 83  0 15
   0    3 15.94  265  4.12   1  0 83  0 16
   0    3 15.90  166  2.58   2  0 79  0 19
   0    3 15.92  379  5.89   1  0 82  0 17
   0    3 15.88  130  2.01   1  0 81  0 17
   0    3 15.91  368  5.72   2  0 81  0 17
      tty             da0             cpu
 tin tout  KB/t tps   MB/s  us ni sy in id
   0   15 15.97  562  8.76   1  0 79  0 20
   0    8 16.00  608  9.50   1  0 82  0 17
   0    3 15.97  470  7.32   1  0 83  0 16
   0    3 15.96  378  5.89   2  0 86  0 12
   0    3 15.98  679 10.59   1  0 83  0 16
   0    3 15.93  482  7.50   1  0 83  0 15
   0    3 15.98  905 14.12   1  0 84  0 16
   0    3 16.00  235  3.67   2  0 82  0 17
   0    3 15.97  569  8.87   1  0 83  0 16
   0    3 15.98  664 10.35   2  0 81  0 17
   0   15 15.94  259  4.03   1  0 85  0 14
   0    3 15.97  613  9.56   1  0 82  0 17
   0    3 15.98 1011 15.77   1  0 83  0 16
   0    3 15.88  417  6.47   2  0 80  0 19
   0    3 15.98  781 12.18   2  0 84  0 14
   0    3 16.00  244  3.81   1  0 84  0 15
   0    3 15.98  681 10.62   1  0 84  0 16
   0    3 15.97  543  8.47   1  0 82  0 17
   0    3 15.97 1046 16.31   1  0 83  0 16
   0    3 15.98  689 10.74   1  0 81  0 18
      tty             da0             cpu
 tin tout  KB/t tps   MB/s  us ni sy in id
   0   15 15.98 1323 20.63   1  0 74  0 25
   0    8 16.00  444  6.94   1  0 76  0 23
   0    3 15.98  867 13.53   1  0 76  0 22
   0    3 16.00  495  7.73   1  0 80  0 19
   0    3 15.99 1223 19.09   1  0 78  0 21
   0  144 16.00  524  8.20   1  0 78  0 21
   0    6 15.99 1838 28.70   2  0 75  0 23
   0    5 15.98  915 14.28   1  0 76  0 24
   0    5 15.81  517  7.98   1  0 81  0 18
   0    5 15.75  252  3.87   2  0 80  0 18
   0   11 15.80  240  3.71   1  0 84  0 15
   0    5 15.74  310  4.76   1  0 86  0 13
   0    5 15.79  231  3.56   1  0 83  0 16
   0    6 15.79  233  3.59   1  0 82  0 17
   0    5 15.96  735 11.45   1  0 82  0 16
   0    6 15.95  630  9.81   1  0 83  0 16
   0    5 15.98  644 10.04   1  0 82  0 17
   0    6 15.97  506  7.89   0  0 82  0 18
   0    6 16.00  258  4.03   1  0 82  0 17
   0   82 15.95  671 10.46   1  0 85  0 14
      tty             da0             cpu
 tin tout  KB/t tps   MB/s  us ni sy in id
   0   15 15.98  711 11.09   1  0 86  0 13
   0    8 16.00  465  7.26   2  0 81  0 18
   0    3 15.95  679 10.58   1  0 85  0 13
   0    3 16.00  347  5.42   1  0 84  0 14
   0    3 15.97  617  9.63   1  0 81  0 18
   0    3 15.98  647 10.09   1  0 81  0 18
   0    3 15.93  462  7.18   1  0 79  0 20
   0    3 15.98  658 10.26   1  0 81  0 18
   0    3 15.97  639  9.96   1  0 84  0 15
   0    3 15.92  201  3.12   1  0 81  0 18
   0   15 15.93  652 10.14   1  0 83  0 16
   0    3 15.96  409  6.37   1  0 83  0 16
   0    3 15.97  524  8.17   1  0 85  0 14
   0    3 15.94  288  4.48   1  0 85  0 14
   0    3 16.00  620  9.69   1  0 79  0 20
   0    3 16.00  352  5.50   1  0 84  0 15
   0    3 15.76  202  3.10   1  0 81  0 18
   0    3 15.99 1264 19.73   1  0 81  0 18
   0    3 16.00 1777 27.77   1  0 71  0 28
   0    3 16.00  911 14.23   1  0 77  0 22
      tty             da0             cpu
 tin tout  KB/t tps   MB/s  us ni sy in id
   0   15 16.00  547  8.54   1  0 81  0 18
   0    8 15.98  720 11.24   1  0 74  0 25
   0    3 16.00  420  6.56   1  0 78  0 21
   0  145 15.98  698 10.89   1  0 77  0 22
   0    5 16.00  567  8.86   1  0 77  0 22
   0    6 16.00  296  4.62   1  0 77  0 22
   0    8 15.98  663 10.34   1  0 76  0 23
   0    4 15.70   54  0.83   1  0 80  0 19
   0  327  0.00    0  0.00   1  0 83  0 16
   0    9 15.75   64  0.98   1  0 83  0 16
   0    9 15.69   52  0.80   1  0 81  0 18
   0    3 15.80   79  1.22   1  0 80  0 20
   0    3 15.87  123  1.90   1  0 81  0 18
   0   19 15.75   64  0.98   1  0 83  0 16
   0    3 16.00  325  5.08   1  0 83  0 16
   0    3 15.97  524  8.17   1  0 82  0 17
   0    3 15.94  262  4.08   1  0 80  0 19
   0    3 15.96  431  6.71   1  0 83  0 16
   0   55 16.00  392  6.12   1  0 85  0 14
   0    3 15.97  461  7.18   1  0 83  0 16
      tty             da0             cpu
 tin tout  KB/t tps   MB/s  us ni sy in id
   0    9 15.87  127  1.97   1  0 81  0 18
   0    8 16.00  264  4.13   1  0 83  0 15
   0    3 16.00  661 10.33   1  0 82  0 17
   0   16 15.96  403  6.27   1  0 84  0 15
   0    3 15.90  164  2.55   1  0 85  0 14
   0    3 16.00  361  5.64   1  0 84  0 15
   0  100 15.97  630  9.82   0  0 79  0 21
   0    3 15.94  268  4.17   1  0 82  0 17
   0   16 16.00  270  4.22   1  0 84  0 15
   0    3 15.97  547  8.53   0  0 83  0 17
   0   15 15.92  195  3.02   1  0 82  0 17
   0    3 16.00  224  3.50   1  0 80  0 19
   0    3 15.97  622  9.70   1  0 83  0 16
   0   20 16.00  437  6.83   0  0 85  0 14
   0    3 15.95  349  5.43   1  0 82  0 17
   0    3 15.94  247  3.84   1  0 85  0 14
   0    3 16.00  677 10.57   1  0 84  0 15
   0    3 16.00  913 14.26   1  0 81  0 19
   0   20 15.98 1039 16.22   1  0 72  0 27
   0    3 15.98  786 12.27   1  0 76  0 23
      tty             da0             cpu
 tin tout  KB/t tps   MB/s  us ni sy in id
   0   15 16.00  361  5.64   1  0 77  0 22
   0    8 16.00  395  6.17   1  0 80  0 19
   0    3 16.00  526  8.21   1  0 79  0 21
   0   10 15.98  989 15.43   1  0 80  0 19
   0    3 16.00  555  8.67   1  0 79  0 20
   0    3 15.98  790 12.33   0  0 79  0 21
   0    3 16.00  431  6.73   1  0 78  0 22
   0    3 15.98  754 11.77   1  0 79  0 20
   0   37 15.90  336  5.21   1  0 81  0 18
   0    3 15.91  179  2.78   1  0 85  0 14
   0   15 15.91  185  2.87   1  0 85  0 14
   0    3 15.91  175  2.72   1  0 87  0 13
   0    3 15.92  201  3.12   1  0 82  0 18
   0   46 15.96  445  6.94   1  0 80  0 19
   0    3 15.97  958 14.94   1  0 84  0 15
   0    3 15.96  360  5.61   1  0 84  0 15
   0    3 15.97  492  7.68   1  0 82  0 18
   0    3 15.98  849 13.24   1  0 84  0 15
   0   33 15.97  614  9.57   1  0 83  0 17
   0    3 15.96  448  6.98   1  0 84  0 15
      tty             da0             cpu
 tin tout  KB/t tps   MB/s  us ni sy in id
   0   15 15.97  577  9.01   1  0 83  0 16
   0    8 15.97  638  9.95   1  0 81  0 19
   0    3 15.95  333  5.19   1  0 85  0 13
   0    9 16.00  422  6.59   1  0 87  0 12
   0    3 15.96  732 11.40   1  0 85  0 14
   0    3 15.98  861 13.43   1  0 84  0 16
   0  145 16.00  229  3.57   1  0 86  0 13
   0    5 15.97  476  7.42   1  0 82  0 17
   0   39 16.00  147  2.30   1  0 81  0 18
   0    6 15.97  516  8.04   1  0 85  0 14
   0   11 16.00  327  5.10   1  0 82  0 18
   0    5 15.92  192  2.98   1  0 83  0 16
   0    5 16.00  437  6.83   1  0 84  0 15
   0   18 15.97  542  8.45   1  0 82  0 17
   0    5 16.00  362  5.65   1  0 83  0 17
   0    5 15.97  613  9.56   1  0 81  0 18
   0    5 15.91  180  2.80   1  0 85  0 15
   0    6 16.00  725 11.33   1  0 83  0 16
   0   11 15.98  989 15.44   1  0 80  0 19
   0    6 16.00 1066 16.65   1  0 73  0 26
      tty             da0             cpu
 tin tout  KB/t tps   MB/s  us ni sy in id
   0   11 15.99 1286 20.07   1  0 74  0 25
   0   16 15.97  563  8.78   1  0 78  0 21
   0    5 15.98  807 12.59   1  0 77  0 22
   0   12 16.00  369  5.76   1  0 79  0 21
   0    5 15.98  848 13.23   1  0 80  0 19
   0    6 15.92  628  9.77   0  0 76  0 24
   0    6 15.98  820 12.79   1  0 77  0 22
   0    5 15.98  768 11.98   1  0 78  0 21
   0   11 15.92  200  3.11   1  0 81  0 18
   0    5 15.89  433  6.72   1  0 84  0 15
   0   11 15.88  265  4.11   1  0 80  0 19
   0  164 15.93  223  3.47   1  0 83  0 16
   0    3 15.89  432  6.70   1  0 85  0 14
   0   67 15.98  753 11.74   1  0 80  0 19
   0    3 15.93  720 11.21   1  0 86  0 13
   0    3 15.97  479  7.47   1  0 85  0 15
   0    3 15.97  495  7.71   1  0 82  0 16
   0    3 16.00  543  8.48   1  0 85  0 15
   0   64 15.95  635  9.89   1  0 82  0 17
   0  127 15.96  413  6.43   1  0 81  0 18
      tty             da0             cpu
 tin tout  KB/t tps   MB/s  us ni sy in id
   0   15 15.97  594  9.26   1  0 82  0 17
   0    8 15.96  822 12.81   1  0 84  0 15
   0    3 16.00  257  4.01   0  0 82  0 17
   0    9 15.96  730 11.38   1  0 82  0 17
   0    3 15.97  488  7.61   1  0 82  0 17
   0    3 16.00  425  6.64   1  0 81  0 18
   0    3 15.98  681 10.63   1  0 86  0 13
   0    3 15.96  720 11.22   1  0 83  0 16
   0  153 15.98  855 13.35   1  0 85  0 14
   0    5 15.96  428  6.67   1  0 83  0 16
   0   11 15.98  779 12.16   1  0 84  0 16
   0    5 15.97  461  7.19   1  0 83  0 16
   0    5 15.97  534  8.33   1  0 80  0 19
   0   30 16.00  542  8.46   1  0 84  0 15
   0    5 15.94  578  8.99   1  0 83  0 16
   0    5 16.00  271  4.23   1  0 85  0 14
   0    6 15.98 1399 21.83   1  0 84  0 15
   0    5 16.00  455  7.10   1  0 83  0 16
   0   19 15.98 1358 21.19   1  0 86  0 13
   0    5 15.97  583  9.09   1  0 80  0 19
      tty             da0             cpu
 tin tout  KB/t tps   MB/s  us ni sy in id
   0   11 15.97 1041 16.23   1  0 81  0 18
   0  173 15.96  735 11.45   1  0 79  0 20
   0    9 15.96  419  6.53   1  0 77  0 22
   0  139 15.97  607  9.47   1  0 80  0 19
   0    3 16.00  457  7.14   1  0 77  0 22
   0    3 16.00  421  6.57   1  0 79  0 21
   0    3 15.98  860 13.42   1  0 79  0 20
   0  145 16.00  538  8.40   1  0 76  0 23
   0  166 15.98  764 11.92   1  0 80  0 19
   0    3 15.88  139  2.16   1  0 83  0 16
   0    9 15.84   97  1.50   3  0 80  0 18
   0    3 15.79   77  1.18   5  0 82  0 13
   0    3 15.95  348  5.42   1  0 85  0 15
   1    4 15.98  654 10.20   1  0 81  0 18
   0    3 15.95  614  9.56   1  0 83  0 16
   0    3 15.98  669 10.44   1  0 84  0 15
   0    3 15.98  643 10.04   1  0 86  0 13
   0    3 15.96  787 12.27   1  0 83  0 16
   0    3 15.97  521  8.12   1  0 86  0 13
   0    3 15.97  627  9.77   1  0 85  0 15
      tty             da0             cpu
 tin tout  KB/t tps   MB/s  us ni sy in id
   0    9 15.94  567  8.82   1  0 82  0 17
   0    8 16.00  146  2.28   1  0 84  0 15
   0    3 15.95  697 10.86   1  0 83  0 16
   1    4 15.98 1013 15.81   1  0 82  0 17
   0    3 15.97  487  7.60   1  0 88  0 11
   0   23 15.97  978 15.24   1  0 83  0 16
   0   21 15.97  521  8.12   1  0 84  0 16
   0    3 15.96  740 11.53   1  0 84  0 16
   0    3 15.98  643 10.03   1  0 85  0 15
   0  113 15.90  475  7.37   1  0 84  0 16
   0   23 15.93 3816 59.37   0  0 44  0 55
   1    4 15.87 6451 99.99   0  0  6  0 94
   0  114 15.90 7360 114.30   0  0  6  0 94
   0    3 15.85 5415 83.80   0  0  6  0 94
   0    3 15.86 5582 86.46   0  0  5  0 95
   0    3 15.78 1241 19.12   0  0  2  0 98
   1    4  0.00    0  0.00   0  0  0  0 100
   1    4  0.00    0  0.00   0  0  0  0 100
   0  330 16.00 4290 67.01   0  0  4  0 96
   0    3 15.95 4056 63.17   0  0  2  0 98
      tty             da0             cpu
 tin tout  KB/t tps   MB/s  us ni sy in id
   0  142  0.00    0  0.00   0  0  0  0 100
   0    8  0.00    0  0.00   0  0  0  0 100
   0    3  0.00    0  0.00   0  0  0  0 100
   0    9  0.00    0  0.00   0  0  0  0 100
   0    4  0.00    0  0.00   0  0  0  0 100


[Date Prev][Date Next]  [Thread Prev][Thread Next]  [Date Index][Thread Index]