Port Binding을 이용한 iSCSI Multipath 구성

# vSphere 기준

 

[Environment]

iSCSI Initiator

1. 1번 호스트 : 192.168.1.31

• iSCSI vmk2 : 192.168.10.31<-> uplink : vmnic2
• iSCSI vmk4: 192.168.10.41<-> uplink : vmnic4

 

2. 2번 호스트 : 192.168.1.32

• iSCSI vmk2 : 192.168.10.32<-> uplink : vmnic2
• iSCSI vmk4 : 192.168.10.42<-> uplink : vmnic4

 

3. 3번 호스트 : 192.168.1.33

• iSCSI vmk3 : 192.168.10.32 <-> uplink : vmnic2
• iSCSI vmk4 : 192.168.10.43 <-> uplink : vmnic4

 

iSCSI Target

192.168.10.2:3260 (Windows Server 2012 R2)

 

[Setup]

1. Port Binding 설정

 

2. 테스트를 위해 Multipath Policy를 Round Robin으로 변경

변경 전

 

변경 후

 

변경 전에는 Path의 Status가 하나는 Active(I/O), 나머지는 Active 였으나 변경 후에는 둘 다 Active(I/O)로 표시

 

[iSCSI 정보]

iSCSI Session

[root@esxi02:~] esxcli iscsi session list

vmhba65,iqn.1991-05.com.microsoft:ad01-iscsitarget1-target,00023d000001

   Adapter: vmhba65

   Target: iqn.1991-05.com.microsoft:ad01-iscsitarget1-target

   ISID: 00023d000001

   TargetPortalGroupTag: 1

   AuthenticationMethod: none

   DataPduInOrder: true

   DataSequenceInOrder: true

   DefaultTime2Retain: 0

   DefaultTime2Wait: 2

   ErrorRecoveryLevel: 0

   FirstBurstLength: 65536

   ImmediateData: true

   InitialR2T: false

   MaxBurstLength: 262144

   MaxConnections: 1

   MaxOutstandingR2T: 1

   TSIH: 6

 

vmhba65,iqn.1991-05.com.microsoft:ad01-iscsitarget1-target,00023d000002

   Adapter: vmhba65

   Target: iqn.1991-05.com.microsoft:ad01-iscsitarget1-target

   ISID: 00023d000002

   TargetPortalGroupTag: 1

   AuthenticationMethod: none

   DataPduInOrder: true

   DataSequenceInOrder: true

   DefaultTime2Retain: 0

   DefaultTime2Wait: 2

   ErrorRecoveryLevel: 0

   FirstBurstLength: 65536

   ImmediateData: true

   InitialR2T: false

   MaxBurstLength: 262144

   MaxConnections: 1

   MaxOutstandingR2T: 1

   TSIH: 4

 

iSCSI Connection

[root@esxi02:~] esxcli iscsi session connection list

vmhba65,iqn.1991-05.com.microsoft:ad01-iscsitarget1-target,00023d000001,0

   Adapter: vmhba65

   Target: iqn.1991-05.com.microsoft:ad01-iscsitarget1-target

   ISID: 00023d000001

   CID: 0

   DataDigest: NONE

   HeaderDigest: NONE

   IFMarker: false

   IFMarkerInterval: 0

   MaxRecvDataSegmentLength: 131072

   MaxTransmitDataSegmentLength: 65536

   OFMarker: false

   OFMarkerInterval: 0

   ConnectionAddress: 192.168.10.2

   RemoteAddress: 192.168.10.2

   LocalAddress: 192.168.10.31

   SessionCreateTime: 08/22/22 06:37:32

   ConnectionCreateTime: 08/22/22 06:37:32

   ConnectionStartTime: 08/22/22 06:37:33

   State: logged_in

 

vmhba65,iqn.1991-05.com.microsoft:ad01-iscsitarget1-target,00023d000002,0

   Adapter: vmhba65

   Target: iqn.1991-05.com.microsoft:ad01-iscsitarget1-target

   ISID: 00023d000002

   CID: 0

   DataDigest: NONE

   HeaderDigest: NONE

   IFMarker: false

   IFMarkerInterval: 0

   MaxRecvDataSegmentLength: 131072

   MaxTransmitDataSegmentLength: 65536

   OFMarker: false

   OFMarkerInterval: 0

   ConnectionAddress: 192.168.10.2

   RemoteAddress: 192.168.10.2

   LocalAddress: 192.168.10.41

   SessionCreateTime: 08/22/22 07:19:26

   ConnectionCreateTime: 08/22/22 07:19:26

   ConnectionStartTime: 08/22/22 07:19:27

   State: logged_in

 

iSCSI Device

[root@esxi02:~] esxcli storage core device list

<snippet>

naa.60003ff44dc75adcb756ff12a17abc5c

   Display Name: MSFT iSCSI Disk (naa.60003ff44dc75adcb756ff12a17abc5c)

   Has Settable Display Name: true

   Size: 1048200

   Device Type: Direct-Access

   Multipath Plugin: NMP

   Devfs Path: /vmfs/devices/disks/naa.60003ff44dc75adcb756ff12a17abc5c

   Vendor: MSFT

   Model: Virtual HD

   Revision: 6.3

   SCSI Level: 5

   Is Pseudo: false

   Status: on

   Is RDM Capable: true

   Is Local: false

   Is Removable: false

   Is SSD: false

   Is VVOL PE: false

   Is Offline: false

   Is Perennially Reserved: false

   Queue Full Sample Size: 0

   Queue Full Threshold: 0

   Thin Provisioning Status: unknown

   Attached Filters: VAAI_FILTER

   VAAI Status: unsupported

   Other UIDs: vml.020000000060003ff44dc75adcb756ff12a17abc5c566972747561

   Is Shared Clusterwide: true

   Is SAS: false

   Is USB: false

   Is Boot Device: false

   Device Max Queue Depth: 128

   No of outstanding IOs with competing worlds: 32

   Drive Type: unknown

   RAID Level: unknown

   Number of Physical Drives: unknown

   Protection Enabled: false

   PI Activated: false

   PI Type: 0

   PI Protection Mask: NO PROTECTION

   Supported Guard Types: NO GUARD SUPPORT

   DIX Enabled: false

   DIX Guard Type: NO GUARD SUPPORT

   Emulated DIX/DIF Enabled: false

 

Device Path 정보

[root@esxi02:~] esxcfg-mpath -bd naa.60003ff44dc75adcb756ff12a17abc5c

naa.60003ff44dc75adcb756ff12a17abc5c : MSFT iSCSI Disk (naa.60003ff44dc75adcb756ff12a17abc5c)

 

   vmhba65:C1:T0:L0 LUN:0 state:active iscsi Adapter: iqn.1998-01.com.vmware:esxi02:1418432433:65  Target: IQN=iqn.1991-05.com.microsoft:ad01-iscsitarget1-target Alias= Session=00023d000002 PortalTag=1

 

   vmhba65:C0:T0:L0 LUN:0 state:active iscsi Adapter: iqn.1998-01.com.vmware:esxi02:1418432433:65  Target: IQN=iqn.1991-05.com.microsoft:ad01-iscsitarget1-target Alias= Session=00023d000001 PortalTag=1

 

Multipath 정보

[root@esxi02:~] esxcli storage nmp device list

<snippet>

naa.60003ff44dc75adcb756ff12a17abc5c

   Device Display Name: MSFT iSCSI Disk (naa.60003ff44dc75adcb756ff12a17abc5c)

   Storage Array Type: VMW_SATP_DEFAULT_AA

   Storage Array Type Device Config: {action_OnRetryErrors=off}

   Path Selection Policy: VMW_PSP_RR

   Path Selection Policy Device Config: {policy=rr,iops=1000,bytes=10485760,useANO=0; lastPathIndex=1: NumIOsPending=0,numBytesPending=0}

   Path Selection Policy Device Custom Config:

   Working Paths: vmhba65:C1:T0:L0, vmhba65:C0:T0:L0

 

[Multipath 검증]

iSCSI Device로 만든 Datastore에 파일 복사 시 vmk2와 vmk4 사용 여부 확인

[root@esxi02:/var/log] cp * /vmfs/volumes/iSCSIDatastore/

 

복사하는 중, esxtop(network view)으로 vmk2,vmk4가 사용하는 Traffic 확인 : vmk2와 vmk4가 균등하게 사용 중