Classifications

• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
  • H04L61/00—Network arrangements, protocols or services for addressing or naming
  • H04L61/50—Address allocation
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04B—TRANSMISSION
  • H04B10/00—Transmission systems employing electromagnetic waves other than radio-waves, e.g. infrared, visible or ultraviolet light, or employing corpuscular radiation, e.g. quantum communication
  • H04B10/25—Arrangements specific to fibre transmission
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
  • H04L61/00—Network arrangements, protocols or services for addressing or naming
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
  • H04L2101/00—Indexing scheme associated with group H04L61/00
  • H04L2101/60—Types of network addresses
  • H04L2101/618—Details of network addresses
  • H04L2101/622—Layer-2 addresses, e.g. medium access control [MAC] addresses

Definitions

• the present invention relates to a method, a system, and a computer program product for managing virtual instances of a physical port attached to a network.
• the invention relates to a network, in which each connected computer or device has a unique identifier.
• a network with Fibre Channel connections is described.
• Fibre Channel is a bi-directional, full-duplex, point-to-point, serial data channel structured for high performance data communication.
• the FC provides a generalized transport mechanism that has no protocol of its own or a native input/output command set, but can transport any existing Upper Level Protocols (ULPs) such as FCP, the "Fibre Channel Protocol for SCSI (Small Computer System Interface)", and IP, the Internet Protocol.
• ULPs Upper Level Protocols
• FC The smallest, indivisible unit of information transfer used by FC is called a frame.
• Frames are used for transferring data.
• the frame size depends on the hardware implementation and is independent of the ULP or the application software.
• These frames are aggregated to form messages called sequences.
• the frames of a sequence can be received out of order.
• One or more sequences form an exchange, which is a basic transaction.
• the frames are divided in two categories: link control frames without data payloads, which are used for the flow control, and data frames with data payloads such as encapsulated ULP data .
• FC-FS Fibre Channel Framing and Signalling Interface
• FC hardware is usually provided in the form of FC adapter cards which are plugged in existing input/output (I/O) hardware such as PCl/PCI-X/PCI-Express slots of a computer system. Every FC adapter contains at least one N_Port, a FC hardware entity which performs the actual data communication over the FC link.
• I/O input/output
• An N_Port is identifiable by a unique Worldwide Port Name (WWPN) implemented as a 64-bit value. This WWPN is normally assigned at manufacturing time of the FC hardware, but may also be assigned by other means, provided that the port name can be guaranteed to be unique worldwide.
• WWPN Worldwide Port Name
• An N_Port can act as an originator or a responder.
• FC connections may be implemented as a point-to-point link, or an arbitrated loop or a switching network, called a fabric.
• a FC fabric is an interconnection network that allows multiple N_Ports to intercommunicate. The entry/exit ports on a fabric are called F_Ports, and each N_Port has to connect to one F_Port. The fabric allows each connected N_Port to communicate with any other N_Port that is attached to the fabric.
• the FC fabric assigns to each attached N_Port an identifier, which is an address by which an N_Port is uniquely known for the fabric. Since the N_Port identifier is a 24-bit value, a FC fabric can support up to 16.7 million N_Ports.
• the N_Port identifier consists of a Domain (most significant byte) , an Area, and a Port, each 1 byte long.
• the N_Port identifier is used in the Source Identifier (S_ID) and Destination Identifier (D_ID) fields of the header of a FC frame.
• Initiating communications in a fabric requires a multistage login process in which communications are first established between an N-port and an F-port in the fabric and then with the destination N-port.
• the fabric login of the N_Port establishes the classes of service to be used within the fabric and other communications parameters including flow control information.
• the initiating and recipient N-ports in the network establish communications with each other through a second login process called node login.
• node login Several communication parameters are exchanged and the transmission starts.
• FC can be used to connect systems with multiple types of internal resources and processes within, an additional login called a process login is used.
• the process login is used to select parameters related to an ULP supported by processes within two communicating N_Ports.
• FC adapters provide one N_Port only. In a computer executing multiple operating system (OS) instances, the problem occurs how to share such an N_Port among these instances. Such sharing would be advantageous to minimize the number of FC adapters, to reduce cost and to maximize adapter utilization, especially for large scale virtualisation environments. The problem exists even when using FC adapters providing multiple N_Ports since the number of processes needing to be supported often exceeds the number of N_Ports provided by the FC adapters.
• OS operating system
• hypervisor The capability to execute multiple OS instances is usually provided by a software layer called (execution) hypervisor that encapsulates the underlying hardware and provides virtual hardware interfaces either for the underlying hardware or for different hardware architectures.
• a hypervisor can be part of the firmware of a computer system, it can be part of an operating system, or it can be a regular program running as a process within an OS instance.
• the work of the hypervisor is often supported by additional hardware features, for example special processor instructions or firmware layers.
• Some hypervisors can effectively create multiple virtual images of a computer system, giving an OS instance executing in such a virtual computer system almost the illusion as if it was running exclusively on the real server.
• These OS instances access real I/O entities (like adapters) via I/O ports, which can be defined and assigned to a virtual computer system in a configuration step.
• An OS instance may only perform I/O operations using I/O ports assigned to the particular virtual server on which it is running.
• FC Storage Area Networks
• Another disadvantage is that it is not possible to initiate a FC transaction to a particular OS instance from outside of the computer system executing the multiple OS instances.
• This limitation is caused by the need for the unequivocal response identifier that gets added to the frame header when it gets intercepted.
• SAN access control for the connected storage controllers of a fabric is typically implemented by methods like zoning and SCSI Logical Unit (LUN) masking.
• Zoning and LUN masking rely on WWPNs to identify users of controlled assets.
• a FC host can address multiple peripheral devices that may share a common controller. Zoning allows partitioning the N_Ports of a fabric into N_Port groups, called zones. The N_Port within a zone can only communicate with other N_Ports in the same zone.
• FC- FS FC Framing and Signalling
• the N_Port In order to obtain an N_Port identifier, the N_Port first logs in with the fabric by sending a "Fabric Login” (FLOGI) extended link service (ELS) command (a special link control frame) to the attached F_Port. In this step additional service parameters will be transferred, and the first N_Port identifier is assigned. After FLOGI is complete, the fabric prepares itself to assign additional N_Port identifiers. In order to obtain another N_Port identifier, the N_Port sends a "Fabric Discover” (FDISC) ELS command using an S_ID of zero. The FDISC ELS is used instead of additional FLOGI commands to avoid disruption of the operating environment. When the N_Port sends the FDISC ELS to the fabric, it provides the following functions :
• the physical N_Port can associate the new N_Port ID with a virtual adapter, which is an entity behind the physical N_Port that generates and receives frames using the new N_Port ID on behalf of an OS instance. Therefore, multiple virtual adapters can be associated with a physical adapter and its N_Port, where each virtual adapter uses a unique N_Port ID.
• the present invention proposes a FC adapter virtualisation entity that can be used to provide multiple virtual FC adapters for a single physical FC adapter as a way to share this FC adapter among multiple OS instances.
• Each virtual adapter has a single N_Port ID. If the physical FC adapter has multiple physical N_Ports, then independent sets of virtual adapters can be associated with each of the N_Ports of that physical adapter.
• the FC adapter virtualisation entity obtains a WWPN for each I/O port that is defined in a hypervisor system configuration from a FC virtual adapter name controller entity. This entity may create a WWPN using a scheme or just take it from a pool of WWPNs. It is possible that the WWPN of a physical N_Port of the physical FC adapter is used for a virtual FC adapter.
• the FC virtual adapter name controller ensures the worldwide uniqueness for a WWPN that it provides.
• a virtual FC adapter may be created when an OS instance activates an I/O port, or it maybe created in advance in order to save the time for its initialisation, and be associated to the I/O port when that I/O port is activated.
• the virtual adapter when the virtual adapter is associated to an I/O port, it uses the WWPN of that I/O port in order to perform a fabric login using the FDISC ELS command and to acquire a corresponding FC N_Port ID.
• the WWPN remains associated with the virtual adapter as long as the virtual adapter is tied to that particular I/O port.
• the association of an I/O port and its WWPN can be made persistent by storing related tables on a storage device coupled to the computer system. This way a power-off/power-on cycle of the computer system or a restart of the hypervisor has no influence to the mapping of a WWPN to an I/O port.
• the WWPN through the issuance of FDISC and the assignment of an N_Port ID for the WWPN, ensures that only properly authorized virtual servers and operating system instances can reach their assigned resources.
• the present invention allows sharing a single physical FC adapter among multiple OS instances transparently.
• the adapter is shared automatically without any special commands required by the OS instances.
• a further important aspect of the invention is that it supports the regular SAN management and administration models such as zoning and LUN masking transparently. This avoids host-based SAN management and administration steps and the attendant problems previously described. This also reduces the SAN management and administration complexity significantly. This eliminates restrictions for ULPs such as FCP.
• Another aspect of the invention is that a FC transaction using a virtual adapter can get initiated from outside of the computer system and directed to a particular OS instance.
• the invention allows defining virtual adapter characteristics, for example performance characteristics such as adapter bandwidth. This allows balancing between the virtual adapters that share the same physical N_Port based on the performance needs of each virtual adapter.
• FIG. 1 Is a block diagram of a computer system into which the invention can be implemented
• FIG. 2 Is a block diagram of the encapsulation of a FC adapter by a hypervisor that controls multiple OS instances;
• FIG. 3 Is a block diagram of a hypervisor embodiment in accordance with the invention.
• FIG. 4 Is an illustrative flow chart of an embodiment of a method in accordance with the invention.
• FIG. 5 Is an illustrative flow chart of an embodiment of a method in accordance with the invention.
• FIG. 1 illustrates a computer system 10 in which the present invention can be used.
• a shared memory 11 is coupled to one or more Central Processing Units (CPUs) 12. These CPUs 12 are also coupled to an I/O subsystem 13.
• CPUs Central Processing Units
• a separate storage device 14 can also be accessed by the CPUs 12. The content of the storage device 14 is persistent: It survives a power off/power-on cycle.
• a FC adapter 15 is accessible for the CPUs 12 via the I/O subsystem 13, and this FC adapter 15 is connected to a FC fabric 16.
• the FC adapter 15 has a physical N_Port 17 that is connected to an F_Port 18 of the fabric 16.
• the computer system is running a hypervisor 20 on the CPUs 12, which controls multiple OS instances 21 that are executed concurrently.
• the hypervisor 20 emulates the FC adapter 15; the OS instances 21 perceive the normal FC adapter interface, but in fact have I/O requests processed through the hypervisor 20 in order to access the FC adapter 15.
• the component of the hypervisor that is responsible for the interface to the OS instances 21 is called the virtual machine interface (VMI) 22.
• the VMI 22 can be any kind of computer interface usable by software.
• the storage device 14 is used to store internal data of the hypervisor 20 and not directly accessible by the OS instances 21.
• a FC Adapter Virtualisation Entity (AVE) 30 is now implemented as a component of the hypervisor 20 shown in FIG. 3. Its purpose is to intercept I/O requests from the OS instances 21 accessing the FC adapter 15. Typically, an OS instance 21a makes I/O requests in a communication unit 31. Such a communication unit 31 can be implemented as a device driver for example.
• the communication unit 31 uses an I/O port 32 to communicate with a FC adapter 15.
• the I/O port 32 comprises a request queue and a response queue. These queues will be used by the AVE 30 and the communication unit 31.
• the communication unit places requests for the FC adapter 15 in the request queue.
• a request contains addresses of the memory 11 that allow the AVE 30 to access data stored in the memory 11 that can be associated with such a request.
• This data comprises FC frames that will be forwarded by the AVE 30 to the FC adapter 15.
• the hypervisor 20 places responses from the FC adapter 15 in the response queue.
• a response contains addresses of the memory 11 that allow the communication unit to access data stored in the memory 11 by the hypervisor 20.
• the data in the memory 11 also comprises FC frames that have been received by the FC adapter 15.
• the AVE 30 creates special data structures in the memory 11. These data structures are called a virtual FC adapter. Among associated interfaces of the hypervisor 20 are interfaces that allow an OS instance 21a to send and receive FC frames. The special data structures are used for the implementation of these interfaces .
• the AVE 30 obtains a new N_Port identifier from the fabric 16 (as described earlier) that is associated with the I/O port 32 and stored in the corresponding virtual adapter. For each frame that is sent from a communication unit 31 using this I/O port 32 the AVE 30 puts the N_Port ID associated with this I/O port 32 in the S_ID field of the FC frame header. Accordingly, all FC frames received by the AVE 30 from the fabric 16 that carry this N_Port ID in the D_ID field of the frame header are forwarded via this I/O port 32 to the corresponding OS instance 21a.
• An I/O port 32 is generated by the hypervisor 20 in a special system configuration step.
• the AVE 30 uses a Virtual Adapter Name Controller (VA-NC) 33 entity to assign a WWPN to the I/O port 32.
• VA-NC 33 maintains a pool 34 of WWPNs, from which it takes one WWPN that is assigned to the I/O port 32 and removed from the pool 34. WWPNs that have been assigned to an I/O port 32 are maintained by the VA-NC 33 in a table 35 called the Virtual Adapter Name Assignment Table (VA- NAT), which is stored on the persistent storage device 14.
• VA- NAT Virtual Adapter Name Assignment Table
• the association of an I/O port 32 to an OS instance 21a is also defined. There is no restriction that a communication unit 31 can use one I/O port only.
• the steps for the I/O port 32 activation are shown in FIG. 4.
• the communication unit 31 triggers the activation of the I/O port 32 (step 40) . If (step 41) the I/O port 32 is already activated, then (step 42) the AVE 30 presents an error to the communication unit 31. Otherwise the WWPN of the I/O port 32 will be used to log in the fabric 16 using the FDISC ELS command (step 43) . If (step 44) the login is not successful, then (step 45) the AVE 30 presents an error to the communication unit. Otherwise the AVE 30 marks the I/O port 32 as activated, stores the N_Port ID provided by the fabric 16 in the virtual adapter (step 46), and returns to the communication unit 31 (step 47) .
• Fig. 5 shows the steps for the I/O port 32 deactivation.
• the communication unit 31 triggers the deactivation of an I/O port 32 (step 50) . If (step 51) the I/O port 32 is not activated, the AVE presents an error to the communication unit 31 (step 52) . Otherwise the N_Port ID associated to the I/O port 32 will be logged out of the fabric 16 (step 53) using well-known methods described in reference 2. If (step 54) the logout is not successful, then the AVE 30 presents an error to the communication unit 31 (step 55) . Otherwise (step 56) the I/O port 32 will be marked as deactivated, and the associated N_Port ID entry for the WWPN will be deleted in the virtual adapter. Afterwards the AVE 30 finishes the deactivation successfully (step 57).
• I/O ports that have been generated in a configuration step of the hypervisor 20 can be removed from the system configuration. If an I/O port is removed from the system configuration, the corresponding WWPN is added to the pool of WWPNs 34 again and marked as "locked”. The VA-NC 33 will not use a WWPN that is marked "locked” for the assignment to a newly created I/O port 32, i.e. I/O ports that are subsequently added to the system configuration.
• the VA-NC 33 adds an interface to the hypervisor 20 that allows unlocking a WWPN. So for example a system administrator can unlock a WWPN for which it was verified that no unintended access rights are in place, and therefore it is safe to reassign this WWPN to an I/O port 32 that can be assigned to any operating system instance 21a.
• WWPNs that were associated to I/O ports that have been removed from the system configuration of the hypervisor 20 are added to a least- recently-used list 36 stored in the memory 11 (or on the persistent storage device 14).
• This least-recently-used list 36 is implemented as a first-in first-out list.
• An entry of this list 36 contains a WWPN together with an identifier for the I/O port 32 to which the WWPN was assigned. Should the same I/O port 32 (as indicated by the identifier) be redefined again while the corresponding WWPN is still in the least-recently-used list 36, then the same WWPN will be assigned to that I/O port 32 again. This way there is no need to reconfigure the SAN as would be the case when an I/O port 32 is temporarily removed from the system configuration of the hypervisor 20, and another WWPN would be assigned to the I/O port 32 when the I/O port 32 gets added to the system configuration of the hypervisor 20 again.
• the length of the least-recently-used list 36 may be limited such that not all possible WWPNs that fall out of the AV-NAT 35 can be kept in this table. If a WWPN falls out of the least-recently-used list, it will be added to the pool of WWPNs 34 again and still remain marked as "locked". Instead of maintaining the least-recently-used list 36 as a first-in first-out list, various other strategies are possible for the decision to remove an entry from the list 36.
• the use of the least-recently-used list 36 may save a considerable amount of the memory 11 for large and dynamically changing system configurations of the hypervisor 20 as all the memory allocated for the special data structures of the virtual adapters associated with the locked WWPNs can be released. Otherwise it would be required to keep the I/O ports and their associated virtual adapters in order to avoid the SAN reconfiguration.
• the WWPNs stored in the pool 34 are assigned to the computer system 10 and the pool 34 is stored on the persistent storage device 14. If the WWPNs do not need to be worldwide unique because they will be used in a configuration that is completely isolated from all other SANs, the VA-NC 33 can also use a scheme to generate a WWPN for a new I/O port definition instead of taking it out of the pool 34 of WWPNs. A possible scheme is to use a common prefix that will be combined with an identifier for the I/O port 32.
• a scheme can also be used to generate WWPNs that are really unique worldwide. For this scheme a worldwide unique prefix would be assigned to the computer system 10, and this prefix would be combined with the identifier for the I/O port 32 for example.
• the physical N_Port and its associated WWPN is used in shared mode as described in the U.S. patent application No. 2003/0200247A1, using the access control mechanism as described in the U.S. patent application No. 2004/0025166A1. This can be exploited if the number of OS instances 21 that need to concurrently share a physical N_Port - Il ⁇
• one or more virtual adapters with their associated configured WWPNs can be used as shared virtual adapters in the same way.
• the VA-NC 32 adds an interface to the hypervisor 20 that allows querying for the WWPN and the N_Port ID currently assigned to an I/O port. This can be used by an OS instance 21a for SAN management and administration purposes.
• the first login from a physical N_Port 17 to the fabric 16 must always be done using the FLOGI ELS command.
• the WWPN assigned to the physical N_Port 17 is used for this FLOGI-type login.
• FC-FS standard see reference 1
• FC-FS standard would allow the logout of the N_Port 17, which did the FLOGI login from the fabric 16 while other fabric 16 logins from virtual adapters associated with the N_Port 17 are still active, it may cause problems when the N_Port 17 is logged in the fabric 16 again.
• the WWPN specified with the FLOGI is used as a permanent port name for the physical N_Port, and remains associated with this N_Port and maintained by the fabric 16 as long as any login for this physical N_Port is still active.
• the fabric 16 may see the same WWPN twice, which may cause disturbances to SAN management applications.
• the N_Port ID assigned by the fabric 16 for the WWPN of the N_Port 17 used for the FLOGI-type login is not logged out (see step 54) during the deactivation of an I/O port 32 associated to this N_Port ID when additional N_Port IDs for this physical N_Port are still logged in the fabric 16, which means that I/O ports 32 associated to these N_Port IDs are still active.
• an N_Port can become disconnected from the fabric 16. If this occurs all the FC frames for incomplete exchanges using the N_Port are invalidated and all the N_Port IDs are automatically logged out of the fabric 16.
• a disconnection is indicated by the FC adapter 15 by either sending a FC frame indicating unsolicited status to the AVE 30 or by storing a special value in a register of the FC adapter 15 that is accessible for the AVE 30.
• the AVE 30 informs an affected OS instance 21b that its virtual adapters have been logged out. For each N_Port ID that was logged out as a result of the disconnection, the affected communication units 31 need to deactivate their affected I/O ports 32 and activate them again.
• I/O ports 32 can be prioritised for re ⁇ activation.
• a simple prioritisation solution is that the AVE 30 uses a priority list of I/O ports in the memory 11 that were active before. For every I/O port 32 activation, the AVE 30 searches this priority list and if it finds the I/O port in the priority list (that is, the activation is a re-activation of a disconnected I/O port) , the activation continues immediately. Otherwise the AVE 30 waits a certain amount of time before it continues the activation so as to not consume an N_Port ID before a previously-active I/O port can be re ⁇ activated. An entry in the priority list is deleted when it is found during I/O port activation, and it is removed after some expiration time,
• characteristics for a virtual adapter For example, it is possible to define certain performance characteristics in order to balance between the virtual adapters that share the same physical N_Port 17 based on the performance needs of each OS instance 21a using the virtual adapters; e.g. a "high bandwidth” could define the use of bigger memory buffers by the AVE 30 in order to increase the bandwidth for a virtual adapter; “low bandwidth” could define the use of small memory buffers by the AVE 30 in order to decrease the bandwidth for a virtual adapter.
• the separate storage device 14 does not need to be directly attached to the computer system 10. It can also be attached to another computer system that provides indirect access to this storage device 14 via a network service for example.
• This invention is preferably implemented as software, a sequence of machine-readable instructions, especially as so- called firmware executing on one or more hardware machines that controls and monitors these hardware machines and is often used to implement well-defined interfaces to the hardware, which other programs (especially operating systems) can use. While a particular embodiment has been shown and described, various modifications of the present invention will be apparent to those skilled in the art.

Priority Applications (8)

Applications Claiming Priority (2)

Publications (1)

Family

ID=36623290

Family Applications (1)

Country Status (10)

Cited By (3)

Families Citing this family (23)

Citations (2)

Family Cites Families (5)

• 2006
  • 2006-03-16 EP EP06708782A patent/EP1900178B1/en active Active
  • 2006-03-16 CN CN2006800241590A patent/CN101213818B/zh not_active Expired - Fee Related
  • 2006-03-16 KR KR1020087000040A patent/KR101054698B1/ko not_active IP Right Cessation
  • 2006-03-16 CA CA002611697A patent/CA2611697A1/en not_active Abandoned
  • 2006-03-16 AT AT06708782T patent/ATE430436T1/de not_active IP Right Cessation
  • 2006-03-16 JP JP2008518769A patent/JP4620776B2/ja not_active Expired - Fee Related
  • 2006-03-16 WO PCT/EP2006/060782 patent/WO2007003448A1/en active Application Filing
  • 2006-03-16 DE DE602006006574T patent/DE602006006574D1/de active Active
  • 2006-03-16 AU AU2006265303A patent/AU2006265303B2/en active Active
  • 2006-06-30 US US11/479,847 patent/US7739415B2/en not_active Expired - Fee Related
• 2008
  • 2008-03-27 US US12/056,937 patent/US7757007B2/en not_active Expired - Fee Related

Patent Citations (2)

Also Published As

Similar Documents

Legal Events