빅

mdadm 소프트 레이드 raid1과 multipath 속도 테스트

· 2012-04-24 (화) 18:44:19 · 2983
 
/dev/md0 raid1로 구성
/dev/md1 multipath 로 구성
 
Personalities : [raid0] [multipath] [raid1] 
md1 : active multipath xvda8[0] xvda7[1]
      104320 blocks [2/2] [UU]
      
md0 : active raid1 xvda6[1] xvda5[0]
      104320 blocks [2/2] [UU]
 
 
 
hdparm 테스트
 
raid1 
 
1차: 
 
 Timing cached reads:   18036 MB in  1.99 seconds = 9048.53 MB/sec
 Timing buffered disk reads:  100 MB in  0.79 seconds = 126.93 MB/sec
 
2차:
 
 Timing cached reads:   15768 MB in  1.99 seconds = 7906.37 MB/sec
 Timing buffered disk reads:  100 MB in  0.92 seconds = 108.52 MB/sec
 
3차:
 
 Timing cached reads:   15724 MB in  1.99 seconds = 7885.65 MB/sec
 Timing buffered disk reads:  100 MB in  0.86 seconds = 116.37 MB/sec
 
 
multipath
 
1차:
 
 Timing cached reads:   17672 MB in  1.99 seconds = 8864.20 MB/sec
 Timing buffered disk reads:  100 MB in  0.47 seconds = 212.10 MB/sec
 
2차:
 
 Timing cached reads:   16460 MB in  1.99 seconds = 8256.26 MB/sec
 Timing buffered disk reads:  100 MB in  0.40 seconds = 248.29 MB/sec
 
3차:
 
 Timing cached reads:   16076 MB in  1.99 seconds = 8062.19 MB/sec
 Timing buffered disk reads:  100 MB in  0.44 seconds = 228.45 MB/sec
 
2. 데이터 복사 속도
 
 
20M 데이터
 
raid1 
real    0m3.290s
user    0m0.004s
sys     0m0.036s
 
multipath
real    0m0.305s
user    0m0.020s
sys     0m0.040s
 
 
3. 하드 fail 테스트
 
하드 1개씩 fail 상태로 만들기
 
초기상태 
 
[root@www local]# cat /proc/mdstat 
Personalities : [raid0] [multipath] [raid1] 
md1 : active multipath xvda8[0] xvda7[1]
      104320 blocks [2/2] [UU]
      
md0 : active raid1 xvda6[1] xvda5[0]
      104320 blocks [2/2] [UU]
      
unused devices: <none>
 
 
하드1개 fail 
 
[root@www local]# mdadm /dev/md0 -f /dev/xvda5
mdadm: set /dev/xvda5 faulty in /dev/md0
 
[root@www local]# mdadm /dev/md1 -f /dev/xvda7
mdadm: set /dev/xvda7 faulty in /dev/md1
 
 
Personalities : [raid0] [multipath] [raid1] 
md1 : active multipath xvda8[0] xvda7[2](F)
      104320 blocks [2/1] [U_]
      
md0 : active raid1 xvda6[1] xvda5[2](F)
      104320 blocks [2/1] [_U]
 
 
 
용량 및 파일 갯수
 
[root@www data1]# du -sh
20M     .
[root@www data1]# find ./ -name "*" | wc -l
593
 
[root@www data2]# du -sh
20M     .
[root@www data2]# find ./ -name "*" | wc -l
593
 
 
데이터 6M 복사
 
[root@www data2]# du -sh /data1
25M     /data1
[root@www data2]# du -sh /data2
25M     /data2
 
 
문제있는 하드 hot remove
 
[root@www data2]# mdadm /dev/md0 -r /dev/xvda5
mdadm: hot removed /dev/xvda5
[root@www data2]# mdadm /dev/md1 -r /dev/xvda7
mdadm: hot removed /dev/xvda7
 
md1 : active multipath xvda8[0]
      104320 blocks [2/1] [U_]
      
md0 : active raid1 xvda6[1]
      104320 blocks [2/1] [_U]
 
 
fail 되었던 하드 다시 포맷
 
 mkfs -j /dev/xvda5
 mkfs -j /dev/xvda7
 
새하드 hot add
 
[root@www data2]# mdadm /dev/md0 -a /dev/xvda5
mdadm: added /dev/xvda5
[root@www data2]# mdadm /dev/md1 -a /dev/xvda7
mdadm: added /dev/xvda7
 
 
하드 용량 및 파일 갯수 확인
 
[root@www data2]# du -sh /data1
25M     /data1
[root@www data2]# find /data1 -name "*" | wc -l
768
[root@www data2]# du -sh /data2
25M     /data2
[root@www data2]# find /data2 -name "*" | wc -l
768
 
 
결론: 
raid1 로 했을때 보다 multipath 로 했을때 속도도 더 잘 나옴.
자료 유실 없음.
 
차이점:
 
md1 : active multipath xvda7[2](S) xvda8[0]
      104320 blocks [2/1] [U_]
      
      --->  State : clean, degraded
 
md0 : active raid1 xvda5[0] xvda6[1]
      104320 blocks [2/2] [UU]
 
 
 
/dev/md1의 상태
 
    Number   Major   Minor   RaidDevice State
       0     202        8        0      active sync   /dev/xvda8
       1       0        0        1      removed
 
       2     202        7        -      spare   /dev/xvda7
 
리부팅후 mdadm -a /dev/md1 /dev/xvda7 하면 정상 상태로 됨.
 
[root@www data2]# cat /proc/mdstat 
Personalities : [raid1] [multipath] 
md1 : active multipath xvda7[2] xvda8[0]
      104320 blocks [2/2] [UU]
      
md0 : active raid1 xvda5[0] xvda6[1]
      104320 blocks [2/2] [UU]
 
 
[root@www data2]# du -sh /data1 ; find /data1 -name "*" | wc -l
25M     /data1
768
 
[root@www data2]# du -sh /data2 ; find /data1 -name "*" | wc -l
25M     /data2
768
댓글을 작성하시려면 로그인이 필요합니다.

프로그램

8,188건
+
제목 글쓴이 날짜 조회
12-08-29 조회 4,202
12-08-07 조회 3,864
12-08-03 조회 3,671
12-07-31 조회 3,772
12-07-30 조회 3,721
12-07-16 조회 3,926
12-07-15 조회 3,760
12-07-07 조회 3,615
12-07-06 조회 3,817
12-07-03 조회 3,774
12-06-29 조회 3,404
12-06-22 조회 3,769
12-06-17 조회 4,034
12-05-21 조회 3,949
12-05-02 조회 3,470
12-05-02 조회 4,258
12-05-02 조회 3,381
12-04-30 조회 3,584
12-04-30 조회 3,263
12-03-17 조회 4,137
12-03-10 조회 3,460
12-03-08 조회 3,996
12-03-03 조회 3,700
12-02-27 조회 5,119
12-02-17 조회 4,416
12-02-16 조회 4,693
12-02-03 조회 3,353
12-01-31 조회 3,262
12-01-24 조회 3,261
12-01-17 조회 3,966
12-01-05 조회 3,512
11-12-30 조회 3,241
11-12-23 조회 4,793
11-12-08 조회 3,570
11-12-07 조회 4,523
11-11-27 조회 3,957
11-11-25 조회 4,283
11-11-23 조회 3,722
11-11-22 조회 3,580
11-11-09 조회 3,288
11-10-23 조회 3,229
11-10-19 조회 3,193
11-10-08 조회 2,869
11-10-04 조회 2,869
11-10-04 조회 5,328
11-09-01 조회 4,407
11-08-13 조회 2,582
11-08-06 조회 3,263
11-07-11 조회 3,658
11-06-27 조회 3,014
11-06-21 조회 2,684
11-06-13 조회 2,485
11-06-07 조회 2,496
11-05-26 조회 2,452
11-04-20 조회 2,784
11-03-21 조회 2,878
11-03-18 조회 2,576
11-03-11 조회 2,590
11-02-07 조회 2,425
11-01-18 조회 2,747
11-01-12 조회 2,466
11-01-06 조회 2,555
10-12-10 조회 2,815
10-12-09 조회 2,665
10-12-08 조회 5,095
10-11-29 조회 2,929
10-11-28 조회 2,836
10-11-28 조회 2,665
10-11-19 조회 2,864
10-11-04 조회 2,740
10-10-21 조회 2,462
10-10-19 조회 3,427
10-10-12 조회 2,745
10-10-07 조회 2,584
10-09-30 조회 3,543
10-09-17 조회 3,956
10-09-17 조회 3,892
10-05-31 조회 3,610
09-12-31 조회 3,743
09-07-23 조회 5,063
08-09-16 조회 3,266
08-09-06 조회 3,012
08-09-04 조회 3,435
08-08-16 조회 4,463
08-08-15 조회 3,329
08-08-14 조회 4,545
08-08-12 조회 4,010
08-07-23 조회 2,824
08-07-10 조회 3,781
08-07-04 조회 3,003
08-06-27 조회 7,640
08-06-19 조회 4,953
08-05-27 조회 5,565
08-05-25 조회 5,397
08-05-23 조회 3,472
08-05-23 조회 4,639
08-05-21 조회 4,988
08-05-20 조회 4,100
08-05-20 조회 3,326
08-04-18 조회 4,404