Thứ Sáu, 20 tháng 5, 2022

Các câu lệnh kiểm tra, giám sát, khắc phục lỗi storage trên Solaris

 Mục đích: Hướng dẫn các câu lệnh kiểm tra, giám sát, khắc phục lỗi storage trên Solaris (phần tạo các File system có mục riềng)

1.Scan để nhận phân vùng SAN (2 node)


echo |format

root@dbaviet # luxadm -e port

/devices/pci@400/pci@2/pci@0/pci@4/SUNW,emlxs@0/fp@0,0:devctl  NOT CONNECTED

/devices/pci@400/pci@2/pci@0/pci@4/SUNW,emlxs@0,1/fp@0,0:devctl CONNECTED

/devices/pci@500/pci@2/pci@0/pci@a/SUNW,emlxs@0/fp@0,0:devctl  NOT CONNECTED

/devices/pci@500/pci@2/pci@0/pci@a/SUNW,emlxs@0,1/fp@0,0:devctl CONNECTED

-- Nhan phan vung moi

luxadm -e forcelip /devices/pci@400/pci@2/pci@0/pci@4/SUNW,emlxs@0,1/fp@0,0:devctl

luxadm -e forcelip /devices/pci@500/pci@2/pci@0/pci@a/SUNW,emlxs@0,1/fp@0,0:devctl

devfsadm -Cv

echo |format

fcinfo hba-port -l 10000000c9b0a311

Echo |format |grep 00000036

2.Check thông tin phân vùng SAN


root@dbaviet # echo |format

Searching for disks...done

AVAILABLE DISK SELECTIONS:

    0. c0t35B6ABAAA5339684d0 <LSI-LogicalVolume-3000 cyl 65533 alt 2 hd 32 sec 557>

          /pci@400/pci@1/pci@0/pci@0/LSI,sas@0/iport@v0/disk@w35b6abaaa5339684,0

    1. c0t3086A5C588639079d0 <LSI-LogicalVolume-3000 cyl 65533 alt 2 hd 32 sec 557>

          /pci@400/pci@1/pci@0/pci@0/LSI,sas@0/iport@v0/disk@w3086a5c588639079,0

    2. c2t3BC2581E333FE460d0 <LSI-LogicalVolume-3000 cyl 65533 alt 2 hd 32 sec 557>

          /pci@700/pci@1/pci@0/pci@0/LSI,sas@0/iport@v0/disk@w3bc2581e333fe460,0

    3. c2t3E41E2D0DDBE6F6Ed0 <LSI-LogicalVolume-3000 cyl 65533 alt 2 hd 32 sec 557>

          /pci@700/pci@1/pci@0/pci@0/LSI,sas@0/iport@v0/disk@w3e41e2d0ddbe6f6e,0

    4. c15t60060E8004A53B000000A53B00000040d0 <HITACHI-OPEN-V  -SUN-5009-1.83TB>  fpayu01

          /scsi_vhci/ssd@g60060e8004a53b000000a53b00000040

    5. c15t60060E8004A53B000000A53B00000220d0 <HITACHI-OPEN-V  -SUN-5009-1.83TB>  fpays01

          /scsi_vhci/ssd@g60060e8004a53b000000a53b00000220

Specify disk (enter its number): Specify disk (enter its number):

 

-- Check logical path

root@dbaviet # luxadm probe

No Network Array enclosures found in /dev/es


Found Fibre Channel device(s):

  Node WWN:50060e8004a53b00  Device Type:Disk device

Logical Path:/dev/rdsk/c15t60060E8004A53B000000A53B00000040d0s2

  Node WWN:50060e8004a53b00  Device Type:Disk device

Logical Path:/dev/rdsk/c15t60060E8004A53B000000A53B00000220d0s2

-- Cổng vật lý: 4 cổng

-- Serial Number: Khác nhau thể hiện 4 Card, mỗi card 1 cổng

root@dbaviet # fcinfo hba-port

HBA Port WWN: 10000000c9a0d2a1

     OS Device Name: /dev/cfg/c3

     Manufacturer: Emulex

     Model: LPe11000-S

     Firmware Version: 2.82a4 (Z3D2.82A4)

     FCode/BIOS Version: Boot:5.02a1 Fcode:1.50a9

     Serial Number: 0999BT0-1013000CYV

     Driver Name: emlxs

     Driver Version: 2.60k (2011.03.24.16.45)

     Type: N-port

     State: online

     Supported Speeds: 1Gb 2Gb 4Gb

     Current Speed: 4Gb

     Node WWN: 20000000c9a0d2a1

HBA Port WWN: 10000000c9a0d291

     OS Device Name: /dev/cfg/c1

     Manufacturer: Emulex

     Model: LPe11000-S

     Firmware Version: 2.82a4 (Z3D2.82A4)

     FCode/BIOS Version: Boot:5.02a1 Fcode:1.50a9

     Serial Number: 0999BT0-1013000CZV

     Driver Name: emlxs

     Driver Version: 2.60k (2011.03.24.16.45)

     Type: N-port

     State: online

     Supported Speeds: 1Gb 2Gb 4Gb

     Current Speed: 4Gb

     Node WWN: 20000000c9a0d291

HBA Port WWN: 10000000c9a0d271

     OS Device Name: /dev/cfg/c4

     Manufacturer: Emulex

     Model: LPe11000-S

     Firmware Version: 2.82a4 (Z3D2.82A4)

     FCode/BIOS Version: Boot:5.02a1 Fcode:1.50a9

     Serial Number: 0999BT0-1013000D26

     Driver Name: emlxs

     Driver Version: 2.60k (2011.03.24.16.45)

     Type: unknown

     State: offline

     Supported Speeds: 1Gb 2Gb 4Gb

     Current Speed: not established

     Node WWN: 20000000c9a0d271

HBA Port WWN: 10000000c9a0d255

     OS Device Name: /dev/cfg/c5

     Manufacturer: Emulex

     Model: LPe11000-S

     Firmware Version: 2.82a4 (Z3D2.82A4)

     FCode/BIOS Version: Boot:5.02a1 Fcode:1.50a9

     Serial Number: 0999BT0-1013000CYS

     Driver Name: emlxs

     Driver Version: 2.60k (2011.03.24.16.45)

     Type: unknown

     State: offline

     Supported Speeds: 1Gb 2Gb 4Gb

     Current Speed: not established

     Node WWN: 20000000c9a0d255

 

-- Serial Number: Khác nhau thể hiện 2 Card, mỗi card 2 cổng

root@dbaviet # fcinfo hba-port

HBA Port WWN: 10000000c963ab60

     OS Device Name: /dev/cfg/c2

     Manufacturer: Emulex

     Model: LP10000DC-S

     Firmware Version: 1.92a1 (T2D1.92A1)

     FCode/BIOS Version: Boot:5.02a1 Fcode:1.50a9

     Serial Number: 0999BG0-07150000RP

     Driver Name: emlxs

     Driver Version: 2.60k (2011.03.24.16.45)

     Type: N-port

     State: online

     Supported Speeds: 1Gb 2Gb

     Current Speed: 2Gb

     Node WWN: 20000000c963ab60 --> Đại diện cho port HBA

HBA Port WWN: 10000000c963ab61

     OS Device Name: /dev/cfg/c5

     Manufacturer: Emulex

     Model: LP10000DC-S

     Firmware Version: 1.92a1 (T2D1.92A1)

     FCode/BIOS Version: Boot:5.02a1 Fcode:1.50a9

     Serial Number: 0999BG0-07150000RP

     Driver Name: emlxs

     Driver Version: 2.60k (2011.03.24.16.45)

     Type: N-port

     State: online

     Supported Speeds: 1Gb 2Gb

     Current Speed: 2Gb

     Node WWN: 20000000c963ab61

HBA Port WWN: 10000000c963a9da

     OS Device Name: /dev/cfg/c8

     Manufacturer: Emulex

     Model: LP10000DC-S

     Firmware Version: 1.92a1 (T2D1.92A1)

     FCode/BIOS Version: Boot:5.02a1 Fcode:1.50a9

     Serial Number: 0999BG0-07150000NW

     Driver Name: emlxs

     Driver Version: 2.60k (2011.03.24.16.45)

     Type: N-port

     State: online

     Supported Speeds: 1Gb 2Gb

     Current Speed: 2Gb

     Node WWN: 20000000c963a9da

HBA Port WWN: 10000000c963a9db

     OS Device Name: /dev/cfg/c9

     Manufacturer: Emulex

     Model: LP10000DC-S

     Firmware Version: 1.92a1 (T2D1.92A1)

     FCode/BIOS Version: Boot:5.02a1 Fcode:1.50a9

     Serial Number: 0999BG0-07150000NW

     Driver Name: emlxs

     Driver Version: 2.60k (2011.03.24.16.45)

     Type: N-port

     State: online

     Supported Speeds: 1Gb 2Gb

     Current Speed: 2Gb

     Node WWN: 20000000c963a9db

-- Check số đường đi và thông tin phân vùng khác loại SAN, số controller, WWN,

-- 4 đường (4 dòng Controller và ở trạng thái ONLINE-Đang sử dụng) (Nếu Offline là không được kích hoạt, hoặc ONLINE-Disable I/O)

root@dbaviet # luxadm display /dev/rdsk/c6t6005076307FFD2BD000000000000001Fd0s2

DEVICE PROPERTIES for disk: /dev/rdsk/c6t6005076307FFD2BD000000000000001Fd0s2

  Vendor:           IBM --> IBM DS8700

  Product ID:       2107900    

  Revision:         1400

  Serial Num:       75FDZ81001F

  Unformatted capacity: 1843200.000 MBytes

  Write Cache:      Enabled

  Read Cache:       Enabled

Minimum prefetch:   0x0

Maximum prefetch:   0x16

  Device Type:      Disk device

  Path(s):

 

  /dev/rdsk/c6t6005076307FFD2BD000000000000001Fd0s2

  /devices/scsi_vhci/ssd@g6005076307ffd2bd000000000000001f:c,raw

 

Controller           /devices/pci@1,700000/SUNW,emlxs@0/fp@0,0

Device Address          50050763070812bd,0

Host controller port WWN 10000000c9a0d291

Class                   primary

State                   ONLINE

 

Controller           /devices/pci@1,700000/SUNW,emlxs@0/fp@0,0

Device Address          50050763070312bd,0

Host controller port WWN 10000000c9a0d291

Class                   primary

State                   ONLINE

 

Controller           /devices/pci@5,700000/SUNW,emlxs@0/fp@0,0

Device Address          50050763070892bd,0

Host controller port WWN 10000000c9a0d2a1

Class                   primary

State                   ONLINE

 

   Controller           /devices/pci@5,700000/SUNW,emlxs@0/fp@0,0

Device Address          50050763070392bd,0

Host controller port WWN 10000000c9a0d2a1

Class                   primary

State                   ONLINE

State                   ONLINE

  • 8 đường:

  • root@mobicard2 # luxadm display /dev/rdsk/c7t60060E801663D800000163D800000300d0s2

    DEVICE PROPERTIES for disk: /dev/rdsk/c7t60060E801663D800000163D800000300d0s2

      Vendor:           HITACHI

      Product ID:       OPEN-V  -SUN

      Revision:         7006

      Serial Num:       50 163D80300

      Unformatted capacity: 1888256.250 MBytes

      Write Cache:      Enabled

      Read Cache:       Enabled

    Minimum prefetch:   0x0

    Maximum prefetch:   0x0

      Device Type:      Disk device

      Path(s):

     

      /dev/rdsk/c7t60060E801663D800000163D800000300d0s2

      /devices/scsi_vhci/ssd@g60060e801663d800000163d800000300:c,raw

        Controller           /devices/ssm@0,0/pci@19,700000/SUNW,emlxs@1/fp@0,0

    Device Address          50060e801663d822,0

    Host controller port WWN 10000000c963a97c

    Class                   primary

    State                   ONLINE

        Controller           /devices/ssm@0,0/pci@19,700000/SUNW,emlxs@1/fp@0,0

    Device Address          50060e801663d851,0

    Host controller port WWN 10000000c963a97c

    Class                   primary

    State                   ONLINE

        Controller           /devices/ssm@0,0/pci@18,600000/SUNW,emlxs@1,1/fp@0,0

    Device Address          50060e801663d812,0

    Host controller port WWN 10000000c963aac3

    Class                   primary

    State                   ONLINE

        Controller           /devices/ssm@0,0/pci@18,600000/SUNW,emlxs@1,1/fp@0,0

    Device Address          50060e801663d800,0

    Host controller port WWN 10000000c963aac3

    Class                   primary

    State                   ONLINE

        Controller           /devices/ssm@0,0/pci@19,700000/SUNW,emlxs@1,1/fp@0,0

    Device Address          50060e801663d822,0

    Host controller port WWN 10000000c963a97d

    Class                   primary

    State                   ONLINE

        Controller           /devices/ssm@0,0/pci@19,700000/SUNW,emlxs@1,1/fp@0,0

    Device Address          50060e801663d851,0

    Host controller port WWN 10000000c963a97d

    Class                   primary

    State                   ONLINE

        Controller           /devices/ssm@0,0/pci@18,600000/SUNW,emlxs@1/fp@0,0

    Device Address          50060e801663d812,0

    Host controller port WWN 10000000c963aac2

    Class                   primary

    State                   ONLINE

        Controller           /devices/ssm@0,0/pci@18,600000/SUNW,emlxs@1/fp@0,0

    Device Address          50060e801663d800,0

    Host controller port WWN 10000000c963aac2

    Class                   primary

    State                   ONLINE

     

    • Check số đường trên 1 máy chủ SAN đi qua: count số đường, ít dùng

root@dbaviet # mpathadm list lu /dev/rdsk/c7t60060E80056F530000006F5300000004d0s2

mpath-support:  libmpscsi_vhci.so

        /dev/rdsk/c7t60060E80056F530000006F5300000004d0s2

            Total Path Count: 8

            Operational Path Count: 8

root@dbaviet # mpathadm list lu

        /dev/rdsk/c7t60060E80056F530000006F5300000004d0s2

            Total Path Count: 8

            Operational Path Count: 8

        /dev/rdsk/c7t60060E8004A53B000000A53B00000212d0s2

            Total Path Count: 3

            Operational Path Count: 3

        /dev/rdsk/c7t60060E801663D800000163D800000402d0s2

            Total Path Count: 8

            Operational Path Count: 8

        /dev/rdsk/c7t60060E801663D800000163D800000401d0s2

            Total Path Count: 8

            Operational Path Count: 8

        /dev/rdsk/c7t60060E801663D800000163D800000400d0s2

            Total Path Count: 8

            Operational Path Count: 8

        /dev/rdsk/c7t60060E801663D800000163D800000306d0s2

            Total Path Count: 8

            Operational Path Count: 8

        /dev/rdsk/c7t60060E801663D800000163D800000305d0s2

            Total Path Count: 8

            Operational Path Count: 8

        /dev/rdsk/c7t60060E801663D800000163D800000304d0s2

            Total Path Count: 8

            Operational Path Count: 8

        /dev/rdsk/c7t60060E801663D800000163D800000303d0s2

            Total Path Count: 8

            Operational Path Count: 8

        /dev/rdsk/c7t60060E801663D800000163D800000302d0s2

            Total Path Count: 8

            Operational Path Count: 8

        /dev/rdsk/c7t60060E801663D800000163D800000301d0s2

            Total Path Count: 8

            Operational Path Count: 8

        /dev/rdsk/c7t60060E801663D800000163D800000300d0s2

            Total Path Count: 8

            Operational Path Count: 8

        /dev/rdsk/c7t60060E801026C5B00511448B00000001d0s2

            Total Path Count: 3

            Operational Path Count: 3

        /dev/rdsk/c7t60060E801026C5B00511448B00000000d0s2

            Total Path Count: 3

            Operational Path Count: 3

        /dev/rdsk/c7t60060E801026C5B00511448B0000005Bd0s2

            Total Path Count: 3

            Operational Path Count: 3

        /dev/rdsk/c7t60060E801036ABE0057DAEEE000001F8d0s2

            Total Path Count: 4

            Operational Path Count: 4

multipath den VSP 8 path anh nhe

 

# mpathadm show lu /dev/rdsk/c7t6000B08414B30303336313930300000Bd0s2

Logical Unit:  /dev/rdsk/c7t6000B08414B30303336313930300000Bd0s2

        mpath-support:  libmpscsi_vhci.so

        Vendor:  Oracle

        Product:  Oracle FS1-2

        Revision:  6203

        Name Type:  unknown type

        Name:  6000b08414b30303336313930300000b

        Asymmetric:  yes

        Current Load Balance:  round-robin

        Logical Unit Group ID:  NA

        Auto Failback:  off

        Auto Probing:  NA

 

        Paths:

                Initiator Port Name:  10000000c96dd78e

                Target Port Name:  2100000e1ec7cde1

                Override Path:  NA

                Path State:  OK

                Disabled:  no

 

                Initiator Port Name:  10000000c96dd78e

                Target Port Name:  2100000e1ec7d181

                Override Path:  NA

                Path State:  OK

                Disabled:  no

 

                Initiator Port Name:  10000000c96dd78e

                Target Port Name:  2100000e1ec7ce11

                Override Path:  NA

                Path State:  OK

                Disabled:  no

 

                Initiator Port Name:  10000000c96dd78e

                Target Port Name:  2100000e1ec78991

                Override Path:  NA

                Path State:  OK

                Disabled:  no

 

                Initiator Port Name:  10000000c96dd78e

                Target Port Name:  2100000e1ec7ce51

                Override Path:  NA

                Path State:  OK

                Disabled:  no

 

                Initiator Port Name:  10000000c96dd78e

                Target Port Name:  2100000e1ec78981

                Override Path:  NA

                Path State:  OK

                Disabled:  no

 

                Initiator Port Name:  10000000c96dd7e2

                Target Port Name:  2100000e1ec7cde0

                Override Path:  NA

                Path State:  OK

                Disabled:  no

 

                Initiator Port Name:  10000000c96dd7e2

                Target Port Name:  2100000e1ec7d180

                Override Path:  NA

                Path State:  OK

                Disabled:  no

 

                Initiator Port Name:  10000000c96dd7e2

                Target Port Name:  2100000e1ec7ce10

                Override Path:  NA

                Path State:  OK

                Disabled:  no

 

                Initiator Port Name:  10000000c96dd7e2

                Target Port Name:  2100000e1ec78990

                Override Path:  NA

                Path State:  OK

                Disabled:  no

 

                Initiator Port Name:  10000000c96dd7e2

                Target Port Name:  2100000e1ec7ce50

                Override Path:  NA

                Path State:  OK

                Disabled:  no

 

                Initiator Port Name:  10000000c96dd7e2

                Target Port Name:  2100000e1ec78980

                Override Path:  NA

                Path State:  OK

                Disabled:  no

 

        Target Port Groups:

                ID:  2

                Explicit Failover:  no

                Access State:  active optimized

                Target Ports:

                        Name:  2100000e1ec7cde1

                        Relative ID:  69

 

                        Name:  2100000e1ec7d181

                        Relative ID:  65

 

                        Name:  2100000e1ec7ce11

                        Relative ID:  67

 

                        Name:  2100000e1ec7cde0

                        Relative ID:  68

 

                        Name:  2100000e1ec7d180

                        Relative ID:  64

 

                        Name:  2100000e1ec7ce10

                        Relative ID:  66

 

                ID:  1

                Explicit Failover:  no

                Access State:  active not optimized

                Target Ports:

                        Name:  2100000e1ec78991

                        Relative ID:  33

 

                        Name:  2100000e1ec7ce51

                        Relative ID:  35

 

                        Name:  2100000e1ec78981

                        Relative ID:  37

 

                        Name:  2100000e1ec78990

                        Relative ID:  32

 

                        Name:  2100000e1ec7ce50

                        Relative ID:  34

 

                        Name:  2100000e1ec78980

                        Relative ID:  36

 

 

Check LUN được cấp từ SAN tập trung nào

-- Check LUN được cấp từ SAN tập trung nào

root@dbaviet:~# luxadm display /dev/rdsk/c0t60060E80056F530000006F5300000000d0s2

DEVICE PROPERTIES for disk: /dev/rdsk/c0t60060E80056F530000006F5300000000d0s2

  Vendor:           HITACHI

  Product ID:       OPEN-V  -SUN

  Revision:         6008 --> ST9990v; 7006 là VSP; 5009 ST9985;  Oracle FS1-2 6203. Đối soát

  Serial Num:       50 06F530000

  Unformatted capacity: 1017177.000 MBytes

  Read Cache:       Enabled

Minimum prefetch:   0x0

Maximum prefetch:   0x0

  Device Type:      Disk device

  Path(s):

 

  /dev/rdsk/c0t60060E80056F530000006F5300000000d0s2

  /devices/scsi_vhci/ssd@g60060e80056f530000006f5300000000:c,raw

   Controller           /devices/pci@300/pci@1/pci@0/pci@4/SUNW,emlxs@0/fp@0,0

Device Address          50060e80056f5362,4

Host controller port WWN 10000090fa6d736a

Class                   primary

State                   ONLINE

Check HBA

WWN của cặp server cài DB RAC: 

root@dbaviet:~# fcinfo hba-port

HBA Port WWN: 10000090fa9b6ca0

HBA Port WWN: 10000090fa9b6ca1

 

root@dbaviet:~# fcinfo hba-port

HBA Port WWN: 10000090fa0d31bc

HBA Port WWN: 10000090fa0d31bd

Controller A, B trên Storage

Storage có 2 controller A & B. Nhưng theo cấu hình hiện tại chỉ có 1 controller A được cấu hình đi qua san switch (controller B hiện tại ko được dùng).

 

Do vậy để đảm bảo tính dự phòng trong trường hợp controller A bị reset thì hệ thống vẫn hoạt động được. Phương án như sau:

 1. Bổ sung thêm 2 dây quang sau đó kết nối tới 2 san swich.

  1. Cấu hình zoning cho hệ thống để bổ sung controller B

 

Sơ đồ hiện tại và bổ sung thêm dây quang như sau:

 

 

Machine generated alternative text:
MSA storage 
MSA 
storage 
Controller A 
Controller A • 
Controller B 
Controller B 
OR 
EVA storage 
Controller A 
Controller B 
Switch 
Switch 2 
HEA 1 
NBA I 
HBA 
NBA I 
Management 
Server 1 
Saver 2 
Sever 3 
LAN

 

Storage hiện tại đang dùng firmware version 7xxx vẫn đang hoạt động ổn định.  

3.Check dung lượng metadata

root@app-01 # samcmd m

 

Mass storage status samcmd 4.6.85 00:38:00 Feb  1 2013

samcmd on app-01

 

ty  eq  status   use state  ord   capacity  free ra  part high low

 

ma     810  m----2c--r-   1% on            1.796T 1.796T 1M    16   80% 70%

 mm     811               1% on   0   40.000G   39.991G  [83867104 inodes]

 mr     812               1% on   1    1.796T 1.796T

 

ma     820  m----2c--r-   1% on            1.796T 1.796T 1M    16   80% 70%

 mm     821               1% on       0   40.000G   39.991G  [83867104 inodes]

 mr     822               1% on   1    1.796T 1.796T

 

ma     830  m----2c--r-   1% on            1.796T 1.796T 1M    16   80% 70%

 mm     831               1% on   0   40.000G   39.991G  [83867104 inodes]

 mr     832               1% on   1    1.796T 1.796T

Check thông tin các partition

# format

-- chọn 1 đĩa

format> pa

partition> pr

Disable

dbaviet, Bước 1: disable 2 đường này (1 port vật lý tương đương với 2 đường logic; Card1 có 2 Card HBA, mỗi port 2 port)

mpathadm disable path -i 10000000c963ab61 -t 50060e80056f5325 –l /dev/rdsk/c7t60060E80056F530000006F5300000004d0s2

mpathadm disable path -i 10000000c963ab61 -t 50060e80056f5307 –l /dev/rdsk/c7t60060E80056F530000006F5300000004d0s2

(10000000c963ab61 là WWN của 1 port trên 1 card)

 

root@dbaviet # luxadm probe

No Network Array enclosures found in /dev/es

 

Found Fibre Channel device(s):

  Node WWN:50060e8004a53b34  Device Type:Disk device

Logical Path:/dev/rdsk/c7t60060E8004A53B000000A53B00000212d0s2

  Node WWN:50060e80056f5335  Device Type:Disk device

Logical Path:/dev/rdsk/c7t60060E80056F530000006F5300000004d0s2

  Node WWN:50060e801026c5b2  Device Type:Disk device

Logical Path:/dev/rdsk/c7t60060E801026C5B00511448B00000000d0s2

  Node WWN:50060e801026c5b2  Device Type:Disk device

Logical Path:/dev/rdsk/c7t60060E801026C5B00511448B00000001d0s2

  Node WWN:50060e801026c5b2  Device Type:Disk device

Logical Path:/dev/rdsk/c7t60060E801026C5B00511448B0000005Bd0s2

  Node WWN:50060e801036abe2  Device Type:Disk device

Logical Path:/dev/rdsk/c7t60060E801036ABE0057DAEEE000001F8d0s2

  Node WWN:50060e801663d812  Device Type:Disk device

Logical Path:/dev/rdsk/c7t60060E801663D800000163D800000300d0s2

  Node WWN:50060e801663d812  Device Type:Disk device

Logical Path:/dev/rdsk/c7t60060E801663D800000163D800000301d0s2

  Node WWN:50060e801663d812  Device Type:Disk device

Logical Path:/dev/rdsk/c7t60060E801663D800000163D800000302d0s2

  Node WWN:50060e801663d812  Device Type:Disk device

Logical Path:/dev/rdsk/c7t60060E801663D800000163D800000303d0s2

  Node WWN:50060e801663d812  Device Type:Disk device

Logical Path:/dev/rdsk/c7t60060E801663D800000163D800000304d0s2

  Node WWN:50060e801663d812  Device Type:Disk device

Logical Path:/dev/rdsk/c7t60060E801663D800000163D800000305d0s2

  Node WWN:50060e801663d812  Device Type:Disk device

Logical Path:/dev/rdsk/c7t60060E801663D800000163D800000306d0s2

  Node WWN:50060e801663d812  Device Type:Disk device

Logical Path:/dev/rdsk/c7t60060E801663D800000163D800000400d0s2

  Node WWN:50060e801663d812  Device Type:Disk device

Logical Path:/dev/rdsk/c7t60060E801663D800000163D800000401d0s2

  Node WWN:50060e801663d812  Device Type:Disk device

Logical Path:/dev/rdsk/c7t60060E801663D800000163D800000402d0s2

 

root@dbaviet # luxadm display /dev/rdsk/c7t60060E80056F530000006F5300000004d0s2

DEVICE PROPERTIES for disk: /dev/rdsk/c7t60060E80056F530000006F5300000004d0s2

  Vendor:           HITACHI

  Product ID:       OPEN-V  -SUN

  Revision:         6008

  Serial Num:       50 06F530004

  Unformatted capacity: 1520435.250 MBytes

  Write Cache:      Enabled

  Read Cache:       Enabled

Minimum prefetch:   0x0

Maximum prefetch:   0x0

  Device Type:      Disk device

  Path(s):

 

  /dev/rdsk/c7t60060E80056F530000006F5300000004d0s2

  /devices/scsi_vhci/ssd@g60060e80056f530000006f5300000004:c,raw

 

   Controller           /devices/ssm@0,0/pci@18,600000/SUNW,emlxs@1/fp@0,0

Device Address          50060e80056f5335,0

Host controller port WWN 10000000c963a9da

Class                   primary

State                   ONLINE

 

   Controller           /devices/ssm@0,0/pci@18,600000/SUNW,emlxs@1/fp@0,0

Device Address          50060e80056f5317,0

Host controller port WWN 10000000c963a9da

Class                   primary

State                   ONLINE

 

   Controller           /devices/ssm@0,0/pci@18,600000/SUNW,emlxs@1,1/fp@0,0

Device Address          50060e80056f5317,0

Host controller port WWN 10000000c963a9db

Class                   primary

State                   ONLINE

 

   Controller           /devices/ssm@0,0/pci@18,600000/SUNW,emlxs@1,1/fp@0,0

Device Address          50060e80056f5335,0

Host controller port WWN 10000000c963a9db

Class                   primary

State                   ONLINE

 

   Controller           /devices/ssm@0,0/pci@19,700000/SUNW,emlxs@1/fp@0,0

Device Address          50060e80056f5325,0

Host controller port WWN 10000000c963ab60

Class                   primary

State                   ONLINE

 

   Controller           /devices/ssm@0,0/pci@19,700000/SUNW,emlxs@1/fp@0,0

Device Address          50060e80056f5307,0

Host controller port WWN 10000000c963ab60

Class                   primary

State                   ONLINE

 

   Controller           /devices/ssm@0,0/pci@19,700000/SUNW,emlxs@1,1/fp@0,0

Device Address          50060e80056f5325,0

Host controller port WWN 10000000c963ab61

Class                   primary

State                   ONLINE

    I/Os disabled on this ONLINE path

 

   Controller           /devices/ssm@0,0/pci@19,700000/SUNW,emlxs@1,1/fp@0,0

Device Address          50060e80056f5307,0

Host controller port WWN 10000000c963ab61

Class                   primary

State                   ONLINE

I/Os disabled on this ONLINE path

 

-- Disable cả port 10000000c963ab61  (trên server) trên tất cả các phân vùng:

mpathadm disable path -i 10000000c963ab61 -t 50060e801036abea -l /dev/rdsk/c7t60060E801036ABE0057DAEEE000001F8d0s2

 

 

mpathadm disable path -i 10000000c963ab61 -t 50060e801663d851 -l /dev/rdsk/c7t60060E801663D800000163D800000300d0s2

mpathadm disable path -i 10000000c963ab61 -t 50060e801663d822 -l /dev/rdsk/c7t60060E801663D800000163D800000300d0s2

 

mpathadm disable path -i 10000000c963ab61 -t 50060e801663d851 -l /dev/rdsk/c7t60060E801663D800000163D800000301d0s2

mpathadm disable path -i 10000000c963ab61 -t 50060e801663d822 -l /dev/rdsk/c7t60060E801663D800000163D800000301d0s2

 

mpathadm disable path -i 10000000c963ab61 -t 50060e801663d851 -l /dev/rdsk/c7t60060E801663D800000163D800000302d0s2

mpathadm disable path -i 10000000c963ab61 -t 50060e801663d822 -l /dev/rdsk/c7t60060E801663D800000163D800000302d0s2

 

mpathadm disable path -i 10000000c963ab61 -t 50060e801663d851 -l /dev/rdsk/c7t60060E801663D800000163D800000303d0s2

mpathadm disable path -i 10000000c963ab61 -t 50060e801663d822 -l /dev/rdsk/c7t60060E801663D800000163D800000303d0s2

 

mpathadm disable path -i 10000000c963ab61 -t 50060e801663d851 -l /dev/rdsk/c7t60060E801663D800000163D800000304d0s2

mpathadm disable path -i 10000000c963ab61 -t 50060e801663d822 -l /dev/rdsk/c7t60060E801663D800000163D800000304d0s2

 

mpathadm disable path -i 10000000c963ab61 -t 50060e801663d851 -l /dev/rdsk/c7t60060E801663D800000163D800000305d0s2

mpathadm disable path -i 10000000c963ab61 -t 50060e801663d822 -l /dev/rdsk/c7t60060E801663D800000163D800000305d0s2

 

mpathadm disable path -i 10000000c963ab61 -t 50060e801663d851 -l /dev/rdsk/c7t60060E801663D800000163D800000306d0s2

mpathadm disable path -i 10000000c963ab61 -t 50060e801663d822 -l /dev/rdsk/c7t60060E801663D800000163D800000306d0s2

 

mpathadm disable path -i 10000000c963ab61 -t 50060e801663d851 -l /dev/rdsk/c7t60060E801663D800000163D800000400d0s2

mpathadm disable path -i 10000000c963ab61 -t 50060e801663d822 -l /dev/rdsk/c7t60060E801663D800000163D800000400d0s2

 

mpathadm disable path -i 10000000c963ab61 -t 50060e801663d851 -l /dev/rdsk/c7t60060E801663D800000163D800000401d0s2

mpathadm disable path -i 10000000c963ab61 -t 50060e801663d822 -l /dev/rdsk/c7t60060E801663D800000163D800000401d0s2

 

mpathadm disable path -i 10000000c963ab61 -t 50060e801663d851 -l /dev/rdsk/c7t60060E801663D800000163D800000402d0s2

mpathadm disable path -i 10000000c963ab61 -t 50060e801663d822 -l /dev/rdsk/c7t60060E801663D800000163D800000402d0s2

 

mpathadm disable path -i 10000000c963ab61 -t 50060e80056f5307 -l /dev/rdsk/c7t60060E80056F530000006F5300000004d0s2

mpathadm disable path -i 10000000c963ab61 -t 50060e80056f5325 -l /dev/rdsk/c7t60060E80056F530000006F5300000004d0s2

4.Đặt tên cho phân vùng (volname)

root@poc:/export/home/guds# format

Searching for disks...done

 

 

AVAILABLE DISK SELECTIONS:

    0. c0t5000C500480FAF33d0 <SEAGATE-ST960005SSUN600G-0606-558.91GB>

          /scsi_vhci/disk@g5000c500480faf33

          /dev/chassis/SYS/SASBP/HDD0/disk

    1. c0t5000C50047831DD7d0 <SEAGATE-ST960005SSUN600G-0606-558.91GB>

          /scsi_vhci/disk@g5000c50047831dd7

          /dev/chassis/SYS/SASBP/HDD1/disk

Specify disk (enter its number): 0

selecting c0t5000C500480FAF33d0

[disk formatted]

/dev/dsk/c0t5000C500480FAF33d0s0 is part of active ZFS pool rpool. Please see zpool(1M).

 

 

FORMAT MENU:

     disk   - select a disk

     type   - select (define) a disk type

        partition  - select (define) a partition table

     current - describe the current disk

     format - format and analyze the disk

     repair - repair a defective sector

     label  - write label to the disk

     analyze - surface analysis

     defect - defect list management

     backup - search for backup labelsve

     verify - read and display labels

     inquiry - show disk ID

     volname - set 8-character volume name

        !<cmd> - execute <cmd>, then return

     quit

format> vol

Enter 8-character volume name (remember quotes)[""]:"OS"

Ready to label disk, continue? y

 

format> ve

 

Volume name = <      OS>

ascii name  = <SEAGATE-ST960005SSUN600G-0606-558.91GB>

bytes/sector    =  512

sectors = 1172123567

accessible sectors = 1172123534

Part  Tag Flag     First Sector      Size      Last Sector

  0    usr    wm           256   558.90GB       1172107150

  1 unassigned wm             0        0            0

  2 unassigned wm             0        0            0

  3 unassigned wm             0        0            0

  4 unassigned wm             0        0            0

  5 unassigned wm             0        0            0

  6 unassigned wm             0        0            0

  8   reserved    wm    1172107151     8.00MB       1172123534

 

format> q

root@poc:/export/home/guds# format

Searching for disks...done

5.Format


4.1.Label: Format lại ổ đĩa mới hoặc ổ đĩa cũ

 

EFI Label (>=1TB chỉ định dạng như sau)

SMI Label (<1TB)

root@dbaviet # format -e  --> Chọn đĩa  8 chang han

 

/dev/rdsk/c6t60060E801663D800000163D800000034d0s2

selecting /dev/rdsk/c6t60060E801663D800000163D800000034d0s2: Billu07

 

format> la

[0] SMI Label

[1] EFI Label

Specify Label type[0]: 1 --> y

 

format> pa

 

partition> pr

Volume:  GGATE

Current partition table (original):

Total disk sectors available: 3113834871 + 16384 (reserved sectors)

 

Part  Tag    Flag First Sector      Size      Last Sector

  0        usr wm            34    20.00GB       41943073

  1        usr wu      41943074     1.43TB       3113834870

  2 unassigned wm             0        0            0

  3 unassigned wm             0        0            0

  4 unassigned wm             0        0            0

  5 unassigned wm             0        0            0

  6 unassigned wm             0        0            0

  7 unassigned wm             0        0            0

  8   reserved wm    3113834871     8.00MB       3113851254

(Lãng phí 20G -->Nếu add vào ASM partition lại bỏ 33 sector đầu tiên, sử dụng từ sector 34)

Thực hiện bước Partition bên dưới

root@dbaviet # format -e /dev/rdsk/c6t60060E801663D800000163D800000034d0s2

selecting /dev/rdsk/c6t60060E801663D800000163D800000034d0s2: Billu07

 

format> la

[0] SMI Label

[1] EFI Label

Specify Label type[0]: 0 -> y

 

format> pa

 

partition> pr

 

-- Theo cylinder: s6

Volume:  data1 (FastPay)

Current partition table (original):

Total disk cylinders available: 57598 + 2 (reserved cylinders)

 

Part  Tag    Flag Cylinders     Size        Blocks

  0       root wm   0 - 7      128.00MB (8/0/0)     262144

  1       swap wu   8 - 15      128.00MB (8/0/0)     262144

  2     backup wu   0 - 57597  899.97GB (57598/0/0) 1887371264

  3 unassigned wm       0            0     (0/0/0)          0

  4 unassigned wm       0            0     (0/0/0)          0

  5 unassigned wm       0            0     (0/0/0)          0

  6        usr wm  16 - 57597  899.72GB (57582/0/0) 1886846976

  7 unassigned wm       0            0     (0/0/0)          0

 

Partition: Thực hiện trên 1 node

--ASM: Bỏ 33 sector đầu tiên, sử dụng từ sector 34

partition> 0

Part  Tag    Flag First Sector      Size      Last Sector

  0        usr wm            34    20.00GB       41943073

 

Enter partition id tag[usr]:

Enter partition permission flags[wm]:

Enter new starting Sector[34]:

Enter partition size[41943040b, 41943073e, 20480mb, 20gb, 0tb]: $

 

partition> 1

Part  Tag    Flag First Sector      Size      Last Sector

  1        usr wu      41943074     1.43TB       3113834870

 

Enter partition id tag[usr]:

Enter partition permission flags[wu]:

Enter new starting Sector[41943074]:

Enter partition size[3071891797b, 3113834870e, 1499947mb, 1464gb, 1tb]: 0

 

partition> p

Volume:  mcdata4

Current partition table (unnamed):

Total disk sectors available: 3113834871 + 16384 (reserved sectors)

 

partition> q

format> type --> Chọn 0. Auto configure

 

Format> p

Partition> p

 

Part  Tag    Flag First Sector      Size      Last Sector

  0        usr wm            34     1.45TB       3113834870

  1 unassigned wu             0        0            0

  2 unassigned wm             0        0            0

  3 unassigned wm             0        0            0

  4 unassigned wm             0        0            0

  5 unassigned wm             0        0            0

  6 unassigned wm             0        0            0

  8   reserved wm    3113834871     8.00MB       3113851254

 

Có thể phát sinh khi quit ra ngoài thì bị mất thông tin vừa cấu hình thì phải thực hiện cách 2 (modify partition)

 

m --> chia partition --> label

 

(m: Chon tiep

partition> m

Select partitioning base:

     0. Current partition table (original)

     1. All Free Hog

Choose base (enter number) [0]? 

--> Enter

 

Do you wish to continue creating a new partition

table based on above table[yes]?

--> Enter

Free Hog partition[6]?

--> Enter

Enter size of partition 0 [0b, 33e, 0mb, 0gb, 0tb]: 0

Enter size of partition 1 [0b, 33e, 0mb, 0gb, 0tb]: 0

Enter size of partition 2 [0b, 33e, 0mb, 0gb, 0tb]: 0

Enter size of partition 3 [0b, 33e, 0mb, 0gb, 0tb]: 0

Enter size of partition 4 [0b, 33e, 0mb, 0gb, 0tb]: 0

Enter size of partition 5 [0b, 33e, 0mb, 0gb, 0tb]: 0

Enter size of partition 6 [0b, 33e, 0mb, 0gb, 0tb]: $

Enter size of partition 7 [0b, 33e, 0mb, 0gb, 0tb]: 0

 

partition> p

Volume:  mcdata4

Current partition table (original):

Total disk sectors available: 3113834871 + 16384 (reserved sectors)

 

Part  Tag    Flag First Sector      Size      Last Sector

  0 unassigned wm             0        0            0

  1 unassigned wm             0        0            0

  2 unassigned wm             0        0            0

  3 unassigned wm             0        0            0

  4 unassigned wm             0        0            0

  5 unassigned wm             0        0            0

  6        usr wm            34     1.45TB       3113834870

  8   reserved wm    3113834871     8.00MB       3113851254

 

 

 

--QFS: Dùng 50GB đầu tiên cho thông tin của QFS, 8MB cuối cho metadata

partition> 0

Part  Tag    Flag First Sector      Size      Last Sector

  0        usr wm            34     1.76TB       3774857182

 

Enter partition id tag[usr]:

Enter partition permission flags[wm]:

Enter new starting Sector[34]:

Enter partition size[3774857149b, 3774857182e, 1843191mb, 1799gb, 1tb]: 50gb

 

partition> 1

Part  Tag    Flag First Sector      Size      Last Sector

  1 unassigned wm             0        0            0

 

Enter partition id tag[usr]:

Enter partition permission flags[wm]:

Enter new starting Sector[104857634]: 

Enter partition size[0b, 104857633e, 0mb, 0gb, 0tb]: $

 

partition> p

Current partition table (unnamed):

Total disk sectors available: 3774857182 + 16384 (reserved sectors)

 

 

Part  Tag    Flag First Sector      Size      Last Sector

  0        usr wm            34    50.00GB       104857633

  1        usr wm     104857634     1.71TB       3774857181

  2 unassigned wm             0        0            0

  3 unassigned wm             0        0            0

  4 unassigned wm             0        0            0

  5 unassigned wm             0        0            0

  6 unassigned wm             0        0            0

  7 unassigned wm             0        0            0

  8   reserved wm    3774857183     8.00MB       3774873566

 

-- ZFS, UFS: Dùng hết trừ 8MB cuối cho metadata

partition> 0

Part  Tag    Flag First Sector      Size      Last Sector

  0        usr wm            34     1.76TB       3774857182

 

Enter partition id tag[usr]:

Enter partition permission flags[wm]:

Enter new starting Sector[34]:

Enter partition size[3774857149b, 3774857182e, 1843191mb, 1799gb, 1tb]: $

 

Volume:  bg2gprs

Current partition table (original):

Total disk sectors available: 1887420382 + 16384 (reserved sectors)

 

Part  Tag    Flag First Sector      Size      Last Sector

  0        usr wm           256   899.99GB       1887420382

  1 unassigned wm             0        0            0

  2 unassigned wm             0        0            0

  3 unassigned wm             0        0            0

  4 unassigned wm             0        0            0

  5 unassigned wm             0        0            0

  6 unassigned wm             0        0            0

  8   reserved wm    1887420383     8.00MB       1887436766

 

-- Đánh nhãn lại sau khi format

format>volname

 

Cách 2: Partition modify (chưa test)

Format —>select disk -->type --> 0. Auto configure

 

Format —select disk —> p --> p --> m --> chia partition --> label

 

(m: Chon tiep

partition> m

Select partitioning base:

     0. Current partition table (original)

     1. All Free Hog

Choose base (enter number) [0]?  --> Next --> Partition 0: 20.00gb --> Partition 1: $  --> Next (5 lan) --> label (Y)

)

-- Partition nao chua OK thi format lai: Chon so partition 6 (chang han) --> size 0

 

-- Sau kh partition xong đảm bảo: format --> Chọn đĩa (6) --> p --> p

 


6.Mount

Theo các loại file system

7.Umount

umount /dev/dsk/c0t2d0s7

  umount: /dev/dsk/c0t2d0s7: device is busy

 

 # fuser -u /dev/dsk/c0t2d0s7

  /dev/dsk/c0t2d0s7: 1313co(oracle) 1223c(root)

 

# fuser -k /dev/dsk/c0t2d0s7

  /dev/dsk/c0t2d0s7: 1313co    1223c

 

From <http://www.idevelopment.info/data/Unix/General_UNIX/GENERAL_Troubleshootingthedeviceisbusy.shtml>

8.Xác định tiến trình đang sử dụng SAN

fuser

9.Giả lập tải IO

 

 

Read: dd if=/dev/rdsk/c7t60060E80056F530000006F5300000560d0s0 of=/dev/null bs=1024k count=1000000

iostat -xncpzM 3

iostat -xnd 3

 

Write: dd if=/dev/zero of=/dev/rdsk/c7t60060E80056F530000006F5300000560d0s0 bs=1024kb count=1024*100 &

Iostat -xnd 5

10.Troubleshooting IO

# uname -a

# pagesize

# echo ::memstat | mdb -k

# df -h

# echo | format

# zpool list

# zfs list

# zpool iostat 5 10

# vmstat 5 10

# vmstat -s

# sar -rbc 5 10

# sar -d 5 10

Monitoring

iostat -xncpzM 3

 

May 27 03:11:03 dbaviet scsi: [ID 107833 kern.warning] WARNING: /scsi_vhci/ssd@g60060e801036abe0057daeee000001f8 (ssd32): --> Phân vùng 01f8 (s05)

May 27 03:11:03 dbaviet   Error for Command: write(10)           Error Level: Retryable

May 27 03:11:03 dbaviet scsi: [ID 107833 kern.notice]     Requested Block: 2038930082            Error Block: 2038930082

May 27 03:11:03 dbaviet scsi: [ID 107833 kern.notice]     Vendor: HITACHI                        Serial Number: 9212286201F8

May 27 03:11:03 dbaviet scsi: [ID 107833 kern.notice]     Sense Key: Aborted_Command

May 27 03:11:03 dbaviet scsi: [ID 107833 kern.notice]     ASC: 0x4b (data phase error), ASCQ: 0x0, FRU: 0x0

--> Bị lỗi block, nếu liên tục thì thường DB có vấn đề, còn thi thoảng gặp cảnh báo thì không sao do SAN đã sử dụng > 95% nên có thể sẽ phát sinh

 

May 27 11:52:38 dbaviet       /scsi_vhci/ssd@g60060e801663d800000163d800000304 (ssd20): Command failed to complete (3) on path fp0/ssd@w50060e801663d822,4 --> đường đi qua cổng 50060e801663d822 của SAN Director

 

May 27 11:52:38 dbaviet scsi: [ID 107833 kern.warning] WARNING: /scsi_vhci/ssd@g60060e801663d800000163d800000304 (ssd20):

May 27 11:52:38 dbaviet   SCSI transport failed: reason 'tran_err': retrying command

May 27 11:52:38 dbaviet scsi: [ID 243001 kern.info] /scsi_vhci (scsi_vhci0):

May 27 11:52:38 dbaviet       /scsi_vhci/ssd@g60060e801663d800000163d800000305 (ssd19): Command failed to complete (3) on path fp0/ssd@w50060e801663d822,5

May 27 11:55:58 dbaviet scsi: [ID 243001 kern.info] /scsi_vhci (scsi_vhci0):

May 27 11:55:58 dbaviet       /scsi_vhci/ssd@g60060e801663d800000163d800000303 (ssd21): Command failed to complete (3) on path fp0/ssd@w50060e801663d822,3

May 27 11:55:58 dbaviet scsi: [ID 107833 kern.warning] WARNING: /scsi_vhci/ssd@g60060e801663d800000163d800000303 (ssd21):

May 27 11:55:58 dbaviet   SCSI transport failed: reason 'tran_err': retrying command

May 27 11:55:58 dbaviet scsi: [ID 243001 kern.info] /scsi_vhci (scsi_vhci0):

May 27 11:55:58 dbaviet       /scsi_vhci/ssd@g60060e801663d800000163d800000305 (ssd19): Command failed to complete (3) on path fp0/ssd@w50060e801663d822,5

May 27 11:55:58 dbaviet scsi: [ID 243001 kern.info] /scsi_vhci (scsi_vhci0):

May 27 11:55:58 dbaviet       /scsi_vhci/ssd@g60060e801663d800000163d800000304 (ssd20): Command failed to complete (3) on path fp0/ssd@w50060e801663d822,4

May 27 11:58:54 dbaviet scsi: [ID 243001 kern.warning] WARNING: /scsi_vhci (scsi_vhci0):

May 27 11:58:54 dbaviet       /scsi_vhci/ssd@g60060e801663d800000163d800000304 (ssd20): Command Timeout on path fp0/ssd@w50060e801663d822,4

May 27 12:02:18 dbaviet scsi: [ID 243001 kern.info] /scsi_vhci (scsi_vhci0):

May 27 12:02:18 dbaviet       /scsi_vhci/ssd@g60060e801663d800000163d800000303 (ssd21): Command failed to complete (3) on path fp0/ssd@w50060e801663d822,3

May 27 12:02:18 dbaviet scsi: [ID 243001 kern.info] /scsi_vhci (scsi_vhci0):

May 27 12:02:18 dbaviet       /scsi_vhci/ssd@g60060e801663d800000163d800000304 (ssd20): Command failed to complete (3) on path fp0/ssd@w50060e801663d822,4

May 27 12:02:18 dbaviet scsi: [ID 107833 kern.warning] WARNING: /scsi_vhci/ssd@g60060e801663d800000163d800000304 (ssd20):

May 27 12:02:18 dbaviet   SCSI transport failed: reason 'tran_err': retrying command

May 27 12:04:42 dbaviet scsi: [ID 243001 kern.info] /scsi_vhci (scsi_vhci0):

May 27 12:04:42 dbaviet       /scsi_vhci/ssd@g60060e801663d800000163d800000304 (ssd20): Command failed to complete (3) on path fp0/ssd@w50060e801663d822,4

May 27 12:04:42 dbaviet scsi: [ID 243001 kern.info] /scsi_vhci (scsi_vhci0):

May 27 12:04:42 dbaviet       /scsi_vhci/ssd@g60060e801663d800000163d800000303 (ssd21): Command failed to complete (3) on path fp0/ssd@w50060e801663d822,3

May 27 12:04:42 dbaviet scsi: [ID 243001 kern.info] /scsi_vhci (scsi_vhci0):

May 27 12:04:42 dbaviet       /scsi_vhci/ssd@g60060e801663d800000163d800000305 (ssd19): Command failed to complete (3) on path fp0/ssd@w50060e801663d822,5

May 27 12:06:05 dbaviet scsi: [ID 243001 kern.warning] WARNING: /scsi_vhci (scsi_vhci0):

May 27 12:06:05 dbaviet       /scsi_vhci/ssd@g60060e801663d800000163d800000304 (ssd20): Command Timeout on path fp0/ssd@w50060e801663d822,4

May 27 12:06:05 dbaviet scsi: [ID 107833 kern.warning] WARNING: /scsi_vhci/ssd@g60060e801663d800000163d800000304 (ssd20):

May 27 12:06:05 dbaviet   SCSI transport failed: reason 'timeout': retrying command

May 27 12:07:13 dbaviet scsi: [ID 107833 kern.warning] WARNING: /scsi_vhci/ssd@g60060e801036abe0057daeee000001f8 (ssd32):

May 27 12:07:13 dbaviet   Error for Command: write(10)           Error Level: Retryable

May 27 12:07:13 dbaviet scsi: [ID 107833 kern.notice]     Requested Block: 112772434             Error Block: 112772434

May 27 12:07:13 dbaviet scsi: [ID 107833 kern.notice]     Vendor: HITACHI                        Serial Number: 9212286201F8

May 27 12:07:13 dbaviet scsi: [ID 107833 kern.notice]     Sense Key: Aborted_Command

May 27 12:07:13 dbaviet scsi: [ID 107833 kern.notice]     ASC: 0x4b (data phase error), ASCQ: 0x0, FRU: 0x0

May 27 12:09:23 dbaviet scsi: [ID 243001 kern.info] /scsi_vhci (scsi_vhci0):

May 27 12:09:23 dbaviet       /scsi_vhci/ssd@g60060e801663d800000163d800000304 (ssd20): Command failed to complete (3) on path fp0/ssd@w50060e801663d822,4

May 27 12:09:23 dbaviet scsi: [ID 107833 kern.warning] WARNING: /scsi_vhci/ssd@g60060e801663d800000163d800000304 (ssd20):

May 27 12:09:23 dbaviet   SCSI transport failed: reason 'tran_err': retrying command

May 27 12:09:23 dbaviet scsi: [ID 243001 kern.info] /scsi_vhci (scsi_vhci0):

May 27 12:09:23 dbaviet       /scsi_vhci/ssd@g60060e801663d800000163d800000303 (ssd21): Command failed to complete (3) on path fp0/ssd@w50060e801663d822,3

May 27 12:15:29 dbaviet scsi: [ID 243001 kern.info] /scsi_vhci (scsi_vhci0):

May 27 12:15:29 dbaviet       /scsi_vhci/ssd@g60060e801663d800000163d800000304 (ssd20): Command failed to complete (3) on path fp0/ssd@w50060e801663d822,4

May 27 12:15:29 dbaviet scsi: [ID 243001 kern.info] /scsi_vhci (scsi_vhci0):

May 27 12:15:29 dbaviet       /scsi_vhci/ssd@g60060e801663d800000163d800000305 (ssd19): Command failed to complete (3) on path fp0/ssd@w50060e801663d822,5

 

--> Phân vùng 0305 đi qau cổng trên SAN Director 50060e801663d822 bị fail, nếu nhiều là có vấn đề, UD timeout (trường device Address trong luxadm display <path>)

grep "Command failed to complete"  messages  |more

 

oracle@dbaviet$ grep 10000000c963ab61 messages

May 27 03:12:25 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric --> 1 port trên cạc HBA Card1 (fcinfo hba-port)

May 27 03:12:26 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric

May 27 03:23:27 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric

May 27 03:23:29 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric

May 27 06:32:55 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric

May 27 07:09:07 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric

May 27 07:26:40 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric

May 27 07:42:58 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric

May 27 08:26:51 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric

May 27 08:39:34 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric

May 28 03:52:01 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric

May 28 03:52:03 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric

May 28 05:02:20 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric

May 28 05:02:22 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric

May 29 03:07:34 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric

May 29 03:07:35 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric

May 29 04:28:01 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric

May 29 04:28:02 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric

May 29 17:10:44 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric

May 29 17:10:46 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric

May 30 01:11:49 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 reappeared in fabric

May 30 01:46:26 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric

May 30 01:46:28 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric

May 30 04:15:11 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric

May 30 04:15:13 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric

May 30 04:53:13 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric

May 30 04:53:14 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric

May 30 21:18:09 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric

May 30 21:18:11 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric

May 30 21:20:02 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 reappeared in fabric

May 30 21:25:00 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric

May 30 21:25:02 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric

May 30 23:10:50 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric

May 31 00:29:22 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric

May 31 00:29:48 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric

May 31 01:02:29 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric

May 31 01:03:04 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric

May 31 01:30:49 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric

May 31 01:30:50 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric

May 31 02:18:23 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric

May 31 02:18:24 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric

May 31 02:48:44 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric

May 31 02:48:45 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 reappeared in fabric

May 31 02:50:46 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric

May 31 03:20:48 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric

May 31 03:20:49 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric

May 31 05:22:06 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric

May 31 05:22:08 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 reappeared in fabric

May 31 08:06:34 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric

May 31 08:14:52 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric

May 31 08:14:54 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric

Jun  1 03:12:00 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric

Jun  1 03:12:26 dbaviet fctl: [ID 517869 kern.warning] WARNING: fp(4)::N_x Port with D_ID=18300, PWWN=10000000c963ab61 disappeared from fabric

-->

 

Machine generated alternative text:
Storage URI 
In order to identify storage resources uniquely between nodes tie concept of Storage URIs was 
introduced in Oracle Solaris 1 1 _ For example they are used for Zones on Shared Storage to 
identify the shared storage objects 
Looking up a Storage URI for a device 
# suriadm lookup-uri /dev/dsk/cOt600144F00833C0000000573865760001dO 
Looking up the mapping of an device to a Storage URI 
# suriadm lookup—mapping \ 
iscsi: / O . 2 . 10/1uname . naa. 600144f00833c0000000573865760001

 

*****

- Server DBAViet iện tại băng thông sẽ đạt 250MB/s theo lý thuyết, do các card HBA đang kết nối đên Bus B Controller1. Nên tốc độc restore trên mobicard đặt tốc độ 150Mb ( write vsp) + 30MB ( read sata) là gần đúng lý     thuyết. Ngoài ra việc đọc trên phân vùng SATA chậm cũng ảnh hưởng đến việc write trên VSP nên kết quả report bởi lệnh iostat là bình thường.


- Kiểm tra hoạt động trên VSP thời điểm mobicard restore, các chỉ số performance đều ở mức bình thường của storage: cache write pending 5%, disk busy 20%, iops 300.


- Để đạt được băng thông cao hơn cần chuyển một card HBA qua Slot5 hoặc slot1 của server. Khi chuyển qua các slot1 ( Bus B, controller ) sẻ ảnh hưởng đến băng thông đường mạng, khi chuyển qua slot5 sẻ ảnh hưởng đến truy nhập ổ cứng internal. Nên để tăng băng thông có thể chọn option lắp vào slot5 ( Bus A) để tăng băng thông đến storage.

 

Các thông tin tham khảo:

- Vị trí các slot đã sử dụng trên e2900

 

 

- Tốc độ các Bus system trong hệ thống:

 

 

Link: http://docs.oracle.com/cd/E19095-01/sfe2900.srvr/817-5233-10/troubleshooting.html

 

 

 

 

 



=============================
* KHOÁ HỌC ORACLE DATABASE A-Z ENTERPRISE trực tiếp từ tôi giúp bạn bước đầu trở thành những chuyên gia DBA, đủ kinh nghiệm đi thi chứng chỉ OA/OCP, đặc biệt là rất nhiều kinh nghiệm, bí kíp thực chiến trên các hệ thống Core tại VN chỉ sau 1 khoá học.
* CÁCH ĐĂNG KÝ: Gõ (.) hoặc để lại số điện thoại hoặc inbox https://m.me/tranvanbinh.vn hoặc Hotline/Zalo 090.29.12.888
* Chi tiết tham khảo:
https://bit.ly/oaz_w
=============================
KẾT NỐI VỚI CHUYÊN GIA TRẦN VĂN BÌNH:
📧 Mail: binhoracle@gmail.com
☎️ Mobile: 0902912888
⚡️ Skype: tranbinh48ca
👨 Facebook: https://www.facebook.com/BinhOracleMaster
👨 Inbox Messenger: https://m.me/101036604657441 (profile)
👨 Fanpage: https://www.facebook.com/tranvanbinh.vn
👨 Inbox Fanpage: https://m.me/tranvanbinh.vn
👨👩 Group FB: https://www.facebook.com/groups/DBAVietNam
👨 Website: https://www.tranvanbinh.vn
👨 Blogger: https://tranvanbinhmaster.blogspot.com
🎬 Youtube: http://bit.ly/ytb_binhoraclemaster
👨 Tiktok: https://www.tiktok.com/@binhoraclemaster?lang=vi
👨 Linkin: https://www.linkedin.com/in/binhoracle
👨 Twitter: https://twitter.com/binhoracle
👨 Địa chỉ: Tòa nhà Sun Square - 21 Lê Đức Thọ - Phường Mỹ Đình 1 - Quận Nam Từ Liêm - TP.Hà Nội

=============================
học oracle database, Tự học Oracle, Tài liệu Oracle 12c tiếng Việt, Hướng dẫn sử dụng Oracle Database, Oracle SQL cơ bản, Oracle SQL là gì, Khóa học Oracle Hà Nội, Học chứng chỉ Oracle ở đầu, Khóa học Oracle online,khóa học pl/sql, học dba, học dba ở việt nam, khóa học dba, khóa học dba sql, tài liệu học dba oracle, Khóa học Oracle online, học oracle sql, học oracle ở đâu tphcm, học oracle bắt đầu từ đâu, học oracle ở hà nội, oracle database tutorial, oracle database 12c, oracle database là gì, oracle database 11g, oracle download, oracle database 19c, oracle dba tutorial, oracle tunning, sql tunning , oracle 12c, oracle multitenant, Container Databases (CDB), Pluggable Databases (PDB), oracle cloud, oracle security, oracle fga, audit_trail, oracle dataguard, oracle goldengate, mview, oracle exadata, oracle oca, oracle ocp, oracle ocm , oracle weblogic, middleware, hoc solaris, hoc linux, hoc aix, unix, securecrt, xshell, mobaxterm, putty

ĐỌC NHIỀU

Trần Văn Bình - Oracle Database Master