<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 3.2 Transitional//EN">
<HTML>
<HEAD>
  <!--
    *************************************************************************************
    * Copyright (c) 2005 VERITAS Software Corporation. All rights reserved. *

      For third-party license citations, please see the bottom of this file.
    *************************************************************************************
  -->
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
<meta name="TEMPLATEBASE" content="vx_vxhelp_2005c">
<meta name="LASTUPDATED" content="06/15/05 07:49:47">
<meta name="PRODUCTNAME" content="VERITAS Software Documentation">
<meta name="FILENAME" content="03_installsfrac.fm">
     
<title>Testing Disks Using vxfentsthdw</title>

</HEAD>

<BODY bgcolor="#FFFFFF" link="#000066" vlink="#0000ff" marginheight="0" topmargin="0">
<basefont=1>

<a name="361367"></a>

<div align="left">
<table border="0" cellspacing="0" cellpadding="0" width="100%">
 <tr>
   <td height="2" border="0" cellspacing="0" cellpadding="0" colspan="2" bgcolor="#000000">
   </td>
 </tr>
 <tr>
   <td height="15" width="50%" border="0" cellspacing="0" cellpadding="0" bgcolor="#cccccc">
    <img src="images/vxsymbol.gif" height="20" width="31" border="0" cellspacing="0" cellpadding="0" align="left">
     
     
   </td>
   <td align="right" width="50%" bgcolor="#cccccc">

<!-- Header Breadcrumbs -->
<font face="Verdana, Arial, Helvetica, Geneva, sansserif, sans serif" size="-2">&lt;&nbsp;<a href="03_installsfrac_sf_ora_rac31_157546.html" title="Previous - Setting Up Shared Storage and I/O Fencing for SFRAC">Previous</a>&nbsp;&nbsp;|&nbsp;&nbsp;<a href="03_installsfrac_sf_ora_rac33_383356.html" title="Next - Running gabconfig -a to Verify GAB Port Membership">Next</a>
&nbsp;&gt;&nbsp;&nbsp;</font>
   </td>
 </tr>

 <tr>
  <td bgcolor="#CCCCCC" colspan="2" height="15" align="right">
  <font face="Verdana, Arial, Helvetica, Geneva, sansserif, sans serif" size="1">Product:  
<a href="sf_ora_rac_splashpage_docCD_sf_ora_rac1_103036.vxhd" title="Storage Foundation for Oracle RAC Guides title page ">Storage Foundation for Oracle RAC Guides</a>
  &nbsp;&nbsp;
  </font>
  </td>
 </tr>
 <tr>
  <td bgcolor="#CCCCCC" colspan="2" height="15" align="right">
  <font face="Verdana, Arial, Helvetica, Geneva, sansserif, sans serif" size="1">Manual:  
<a href="sfrac_icg_titlepage_docCD_sf_ora_rac2_73700.vxhd" title="Storage Foundation 4.1 for Oracle RAC Installation and Configuration title page ">Storage Foundation 4.1 for Oracle RAC Installation and Configuration</a>
  &nbsp;&nbsp;
  </font>
  </td>
 </tr>


</table>
</div>

<div align="left">
 <table border="0" width="100%" bgcolor="#FFFFFF">
  <tr>
   <td width="100%" valign="top" bgcolor="#FFFFFF">

<!-- Start Main Topic Content -->
        <a name="startcontent"></a>
	
<h2><font face="Arial, Helvetica, Geneva, sansserif, sans serif, Verdana" size="3" color="#000000"><a name="361367"></a> Testing Disks Using vxfentsthdw</font>
</h2>

        
<p>
<font face="Verdana, Arial, Helvetica, Geneva, sansserif, sans serif" size="2"><a name="361368"></a>Use the <font face="Courier New, Courier, sansserif, sans serif" size="2">vxfentsthdw</font> utility to test the shared storage arrays support SCSI-3 persistent reservations and I/O fencing. Make sure to test disks serving as coordinator disks; see <a href="03_installsfrac_sf_ora_rac32_361367.html#149851">Setting Up Coordinator Disks</a>.</font>
</p>




<h3><font face="Arial, Helvetica, Geneva, sansserif, sans serif, Verdana" size="2" color="#000000"><a name="368787"></a>Reviewing Guidelines on vxfentsthdw</font>
</h3>
<p>
<ul type="disc"><li><font face="Verdana, Arial, Helvetica, Geneva, sansserif, sans serif" size="2"><a name="193438"></a>Verify the connection of the shared storage for data to two of the nodes on which you installed Storage Foundation <em>for Oracle RAC</em>.</font>
</li>
<hr noshade size="2" width="100%" color="#000000">
<img src="images/caution.gif" alt="Caution " height="16" width="16">&nbsp;<font face="Arial, Helvetica, Geneva, sansserif, sans serif, Verdana" size="2" color="#000000"><a name="193451"></a><b>Caution  &nbsp;&nbsp;</b></font>
<font face="Verdana, Arial, Helvetica, Geneva, sansserif, sans serif" size="2" color="#000000"> The tests overwrite and destroy data on the disks unless you use the <font face="Courier New, Courier, sansserif, sans serif" size="2">-r</font> option.</font>
<hr noshade size="2" width="100%" color="#000000">
<li><font face="Verdana, Arial, Helvetica, Geneva, sansserif, sans serif" size="2"><a name="193439"></a>The two nodes must have <font face="Courier New, Courier, sansserif, sans serif" size="2">remsh</font> permission set to ensure each node has root user access to the other. Temporarily modify the <font face="Courier New, Courier, sansserif, sans serif" size="2">/.rhosts</font> file to enable cluster communications for the <font face="Courier New, Courier, sansserif, sans serif" size="2">vxfentsthdw</font> utility, placing a &quot;+ +&quot; character in the first line of the file. You can also limit the remote access to specific systems. Refer to the manual page for the <font face="Courier New, Courier, sansserif, sans serif" size="2">/.rhosts</font> file for more information. See <a href="03_installsfrac_sf_ora_rac32_361367.html#376482">Removing remsh Permissions and Restoring Public Network Connections</a> after completing the testing process.</font>
</li>
<li><font face="Verdana, Arial, Helvetica, Geneva, sansserif, sans serif" size="2"><a name="174308"></a>To ensure both nodes are connected to the same disk during the testing, use the <font face="Courier New, Courier, sansserif, sans serif" size="2">vxfenadm -i </font><font face="Courier New, Courier, sansserif, sans serif" size="2"><i>diskpath</i></font> command to verify the disk serial number. See <a href="03_installsfrac_sf_ora_rac31_157546.html#181195">Verifying the Nodes See the Same Disk</a>.</font>
</li>
</ul>
</p>



<h3><font face="Arial, Helvetica, Geneva, sansserif, sans serif, Verdana" size="2" color="#000000"><a name="376065"></a>Running vxfentsthdw</font>
</h3>
<p>
<font face="Verdana, Arial, Helvetica, Geneva, sansserif, sans serif" size="2"><a name="328271"></a>This procedure uses the <font face="Courier New, Courier, sansserif, sans serif" size="2">/dev/rdsk/c4t8d0</font> disk in the steps.</font>
</p>

<ol>
<li value="1">
<font face="Verdana, Arial, Helvetica, Geneva, sansserif, sans serif" size="2"><a name="152174"></a>Make sure system-to-system communication is functioning properly. See <a href="02_prep_install_rep_sf_ora_rac23_267936.html#276422">System-to-System Communication</a>.
</font>
<li value="2">
<font face="Verdana, Arial, Helvetica, Geneva, sansserif, sans serif" size="2"><a name="137995"></a>From one node, start the utility:
</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="137996"></a>&nbsp;&nbsp;#&nbsp;<font face="Courier New, Courier, sansserif, sans serif" size="2"><b>/opt/VRTSvcs/vxfen/bin/vxfentsthdw</b></font>
</font>
<li value="3">
<font face="Verdana, Arial, Helvetica, Geneva, sansserif, sans serif" size="2"><a name="368838"></a>After reviewing the overview and warning that the tests overwrite data on the disks, confirm to continue the process and enter the node names.
</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="368840"></a>********&nbsp;WARNING!!!!!!!!&nbsp;********
</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="368841"></a>&nbsp;&nbsp;THIS&nbsp;UTILITY&nbsp;WILL&nbsp;DESTROY&nbsp;THE&nbsp;DATA&nbsp;ON&nbsp;THE&nbsp;DISK!!
</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="149118"></a>&nbsp;&nbsp;
</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="149119"></a>&nbsp;&nbsp;Do&nbsp;you&nbsp;still&nbsp;want&nbsp;to&nbsp;continue&nbsp;:&nbsp;[y/n]&nbsp;(default:&nbsp;n)&nbsp;
</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="149581"></a><font face="Courier New, Courier, sansserif, sans serif" size="2"><b>&nbsp;&nbsp;y</b></font>
</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="375422"></a>&nbsp;&nbsp;Enter&nbsp;the&nbsp;first&nbsp;node&nbsp;of&nbsp;the&nbsp;cluster:&nbsp;
</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="375423"></a><font face="Courier New, Courier, sansserif, sans serif" size="2"><b>&nbsp;&nbsp;slpas06</b></font>
</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="375424"></a>&nbsp;&nbsp;Enter&nbsp;the&nbsp;second&nbsp;node&nbsp;of&nbsp;the&nbsp;cluster:&nbsp;
</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="368853"></a><font face="Courier New, Courier, sansserif, sans serif" size="2"><b>&nbsp;&nbsp;slpas07</b></font>
</font>
<li value="4">
<font face="Verdana, Arial, Helvetica, Geneva, sansserif, sans serif" size="2"><a name="368854"></a>Enter the names of the disks you are checking. For each node, the disk may be known by the same name:
</font>
<a name="379417"></a><br><font face="Courier New, Courier, sansserif, sans serif" size="2">		Enter the disk name to be checked for SCSI-3 PGR on node slpas06<br>			in the format: /dev/rdsk/cxtxdx </font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="379420"></a><font face="Courier New, Courier, sansserif, sans serif" size="2"><b>&nbsp;&nbsp;&nbsp;/dev/rdsk/c4t8d0</b></font>
</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="379421"></a>
</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="149165"></a>&nbsp;&nbsp;Enter&nbsp;the&nbsp;disk&nbsp;name&nbsp;to&nbsp;be&nbsp;checked&nbsp;for&nbsp;SCSI-3&nbsp;PGR&nbsp;on&nbsp;node&nbsp;slpas07
</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="375498"></a>&nbsp;&nbsp;in&nbsp;the&nbsp;format:&nbsp;/dev/rdsk/cxtxdx
</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="375499"></a>&nbsp;&nbsp;Make&nbsp;sure&nbsp;it's&nbsp;the&nbsp;same&nbsp;disk&nbsp;as&nbsp;seen&nbsp;by&nbsp;nodes&nbsp;slpas06&nbsp;and&nbsp;slpas07
</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="375501"></a>&nbsp;&nbsp;<font face="Courier New, Courier, sansserif, sans serif" size="2"><b>/dev/rdsk/c4t8d0</b></font>
</font>
<p>
<font face="Verdana, Arial, Helvetica, Geneva, sansserif, sans serif" size="2"><a name="149989"></a>The disk names, regardless if they are identical, must refer to the same physical disk to facilitate the testing.</font>
</p>
<li value="5">
<font face="Verdana, Arial, Helvetica, Geneva, sansserif, sans serif" size="2"><a name="207169"></a>Review the output as the utility performs the checks and report its activities:
</font>
<a name="379434"></a><br><font face="Courier New, Courier, sansserif, sans serif" size="2">		Evaluating the disk before testing 0 Pre-existing keys........<br>			......................................................Passed.</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="388416"></a>&nbsp;&nbsp;Registering&nbsp;keys&nbsp;on&nbsp;disk&nbsp;/dev/rdsk/c4t8d0&nbsp;from&nbsp;node
</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="232140"></a>&nbsp;&nbsp;&nbsp;slpas06&nbsp;.............................................&nbsp;Passed.
</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="388435"></a>&nbsp;&nbsp;Verifying&nbsp;registrations&nbsp;for&nbsp;disk&nbsp;/dev/rdsk/c4t8d0&nbsp;on&nbsp;node
</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="235134"></a>&nbsp;&nbsp;&nbsp;slpas06&nbsp;.............................................&nbsp;Passed.&nbsp;
</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="149179"></a>&nbsp;&nbsp;Reads&nbsp;from&nbsp;disk&nbsp;/dev/rdsk/c4t8d0&nbsp;on&nbsp;node&nbsp;slpas06&nbsp;......&nbsp;Passed.&nbsp;
</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="173441"></a>&nbsp;&nbsp;Writes&nbsp;to&nbsp;disk&nbsp;/dev/rdsk/c4t8d0&nbsp;from&nbsp;node&nbsp;slpas06&nbsp;.....&nbsp;Passed.&nbsp;
</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="149886"></a>&nbsp;&nbsp;Reads&nbsp;from&nbsp;disk&nbsp;/dev/rdsk/c4t8d0&nbsp;on&nbsp;node&nbsp;slpas07&nbsp;......&nbsp;Passed.&nbsp;
</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="149884"></a>&nbsp;&nbsp;Writes&nbsp;to&nbsp;disk&nbsp;/dev/rdsk/c4t8d0&nbsp;from&nbsp;node&nbsp;slpas07&nbsp;.....&nbsp;Passed.&nbsp;
</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="388528"></a>&nbsp;&nbsp;Reservations&nbsp;to&nbsp;disk&nbsp;/dev/rdsk/c4t8d0&nbsp;from&nbsp;node&nbsp;slpas06&nbsp;.......
</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="232145"></a>&nbsp;&nbsp;&nbsp;......................................................&nbsp;Passed.&nbsp;
</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="388547"></a>&nbsp;&nbsp;Verifying&nbsp;reservation&nbsp;for&nbsp;disk&nbsp;/dev/rdsk/c4t8d0s2&nbsp;on&nbsp;node&nbsp;
</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="235135"></a>&nbsp;&nbsp;&nbsp;slpas06&nbsp;..............................................&nbsp;Passed.&nbsp;
</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="149696"></a>&nbsp;&nbsp;.
</font>
<p>
<font face="Verdana, Arial, Helvetica, Geneva, sansserif, sans serif" size="2"><a name="375868"></a>If a disk is ready for I/O fencing on each node, the utility reports success:</font>
</p>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="149188"></a>&nbsp;&nbsp;ALL&nbsp;tests&nbsp;on&nbsp;the&nbsp;disk&nbsp;/dev/rdsk/c4t8d0&nbsp;have&nbsp;PASSED.
</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="238200"></a>&nbsp;&nbsp;The&nbsp;disk&nbsp;is&nbsp;now&nbsp;ready&nbsp;to&nbsp;be&nbsp;configured&nbsp;for&nbsp;I/O&nbsp;Fencing&nbsp;on&nbsp;node
</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="238792"></a>&nbsp;&nbsp;&nbsp;slpas06.
</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="368928"></a>
</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="238797"></a>&nbsp;&nbsp;ALL&nbsp;tests&nbsp;on&nbsp;the&nbsp;disk&nbsp;/dev/rdsk/c4t8d0&nbsp;have&nbsp;PASSED.
</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="238798"></a>&nbsp;&nbsp;The&nbsp;disk&nbsp;is&nbsp;now&nbsp;ready&nbsp;to&nbsp;be&nbsp;configured&nbsp;for&nbsp;I/O&nbsp;Fencing&nbsp;on&nbsp;node
</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="238795"></a>&nbsp;&nbsp;&nbsp;slpas07.
</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="173471"></a>&nbsp;
</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="368931"></a>&nbsp;&nbsp;Removing&nbsp;test&nbsp;keys&nbsp;and&nbsp;temporary&nbsp;files,&nbsp;if&nbsp;any&nbsp;...
</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="379553"></a>&nbsp;&nbsp;.
</font>
<li value="6">
<font face="Verdana, Arial, Helvetica, Geneva, sansserif, sans serif" size="2"><a name="149848"></a>Run the <font face="Courier New, Courier, sansserif, sans serif" size="2">vxfentsthdw</font> utility for each disk you intend to verify.
</font>
<hr noshade size="2" width="100%" color="#000000">
<img src="images/note.gif" alt="Note " height="16" width="16">&nbsp;
<font face="Arial, Helvetica, Geneva, sansserif, sans serif, Verdana" size="2" color="#000000">
<a name="330456"></a><b>Note  &nbsp;&nbsp;</b>
</font>
<font face="Verdana, Arial, Helvetica, Geneva, sansserif, sans serif" size="2" color="#000000">The <font face="Courier New, Courier, sansserif, sans serif" size="2">vxfentsthdw</font> utility has additional options suitable for testing many disks. The options for testing disk groups (<font face="Courier New, Courier, sansserif, sans serif" size="2">-g</font>) and disks listed in a file (<font face="Courier New, Courier, sansserif, sans serif" size="2">-f</font><font face="Courier New, Courier, sansserif, sans serif" size="2">)</font> are described in detail in <a href="07_fenc_conf_sf_ora_rac58_120175.html#120865">vxfentsthdw Options</a>. You can also test disks without destroying data using the <font face="Courier New, Courier, sansserif, sans serif" size="2">-r</font> option.
</font>
<hr noshade size="2" width="100%" color="#000000">
</ol>



<h2><font face="Arial, Helvetica, Geneva, sansserif, sans serif, Verdana" size="3" color="#000000"><a name="149851"></a>Setting Up Coordinator Disks</font>
</h2>
 
<p>
<font face="Verdana, Arial, Helvetica, Geneva, sansserif, sans serif" size="2"><a name="319213"></a>I/O fencing requires coordinator disks that are configured in a disk group and accessible to each node in the cluster. These disks enables the <font face="Courier New, Courier, sansserif, sans serif" size="2">vxfen</font> driver to resolve potential split-brain conditions and prevent data corruption. See <a href="01_oview_rep_sf_ora_rac19_269179.html#269179">I/O Fencing</a> for a description of I/O fencing and the role of coordinator disks.</font>
</p>

<p>
<font face="Verdana, Arial, Helvetica, Geneva, sansserif, sans serif" size="2"><a name="319217"></a>Because a coordinator disk does not apply to data storage, configure the disk as the smallest possible LUN on a disk array to avoid wasting space. Make sure you already added and initialized disks for use as coordinator disks, as described in the requirements below.</font>
</p>

<p>
<font face="Verdana, Arial, Helvetica, Geneva, sansserif, sans serif" size="2"><a name="376206"></a>However, to use the <font face="Courier New, Courier, sansserif, sans serif" size="2">vxfentsthdw</font> utility to verify SCSI-3 persistent reservation support, use disks of at least 1 MB. Disks smaller than 1 MB can be tested manually; contact VERITAS support (http://support.veritas.com) for the procedure.)</font>
</p>




<h3><font face="Arial, Helvetica, Geneva, sansserif, sans serif, Verdana" size="2" color="#000000"><a name="319218"></a>Requirements for Coordinator Disks</font>
</h3>
<ul><p><img src="images/check.gif" alt="Checkmark">&nbsp;
<a name="319220"></a><font face="Verdana, Arial, Helvetica, Geneva, sansserif, sans serif" size="2">You must have at least three coordinator disks and the total number of coordinator disks must be an odd number. This requirement ensures a majority of disks can be achieved.</font>
</p><p><img src="images/check.gif" alt="Checkmark">&nbsp;
<a name="319221"></a><font face="Verdana, Arial, Helvetica, Geneva, sansserif, sans serif" size="2">Each of the coordinator disks must use a physically separate disk or LUN.</font>
</p><p><img src="images/check.gif" alt="Checkmark">&nbsp;
<a name="319222"></a><font face="Verdana, Arial, Helvetica, Geneva, sansserif, sans serif" size="2">Each of the coordinator disks should exist on a different disk array, if possible.</font>
</p><p><img src="images/check.gif" alt="Checkmark">&nbsp;
<a name="319223"></a><font face="Verdana, Arial, Helvetica, Geneva, sansserif, sans serif" size="2">You must initialize each disk as a VxVM disk. VERITAS recommends the default (CDS) format.</font>
</p><p><img src="images/check.gif" alt="Checkmark">&nbsp;
<a name="319226"></a><font face="Verdana, Arial, Helvetica, Geneva, sansserif, sans serif" size="2">The coordinator disks must support SCSI-3 persistent reservations. See <a href="03_installsfrac_sf_ora_rac32_361367.html#319270">Requirements for Testing the Coordinator Disk Group</a>. </font>
</p><p><img src="images/check.gif" alt="Checkmark">&nbsp;
<a name="319228"></a><font face="Verdana, Arial, Helvetica, Geneva, sansserif, sans serif" size="2">The coordinator disks must exist in a disk group (for example, <font face="Courier New, Courier, sansserif, sans serif" size="2">vxfencoorddg</font>). See <a href="03_installsfrac_sf_ora_rac32_361367.html#319237">Creating the vxfencoorddg Disk Group</a>.</font>
</p></ul><p>
<font face="Verdana, Arial, Helvetica, Geneva, sansserif, sans serif" size="2"><a name="319232"></a>VERITAS recommends using hardware-based mirroring for coordinator disks.</font>
</p>




<h3><font face="Arial, Helvetica, Geneva, sansserif, sans serif, Verdana" size="2" color="#000000"><a name="319237"></a>Creating the vxfencoorddg Disk Group</font>
</h3>
<p>
<font face="Verdana, Arial, Helvetica, Geneva, sansserif, sans serif" size="2"><a name="319260"></a>From one node, create a disk group named <font face="Courier New, Courier, sansserif, sans serif" size="2">vxfencoorddg</font>. This group must contain an odd number of disks or LUNs and a minimum of three disks. For example, assume the disks have the device names <font face="Courier New, Courier, sansserif, sans serif" size="2">c1t1d0</font>, <font face="Courier New, Courier, sansserif, sans serif" size="2">c2t1d0</font>, and <font face="Courier New, Courier, sansserif, sans serif" size="2">c3t1d0</font>. Refer to the <em>VERITAS Volume Manager Administrator's Guide </em>for details on creating disk groups.</font>
</p>

<ol>
<li value="1">
<font face="Verdana, Arial, Helvetica, Geneva, sansserif, sans serif" size="2"><a name="376248"></a>On any node, create the disk group by specifying the device name of the disks:
</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="376250"></a>&nbsp;&nbsp;#&nbsp;<font face="Courier New, Courier, sansserif, sans serif" size="2"><b>vxdg&nbsp;init&nbsp;vxfencoorddg&nbsp;c1t1d0&nbsp;c2t1d0&nbsp;c3t1d0</b></font>
</font>
<p>
<font face="Verdana, Arial, Helvetica, Geneva, sansserif, sans serif" size="2"><a name="376251"></a>Refer to the <em>VERITAS Volume Manager Administrator's Guide </em>for details on creating disk groups.</font>
</p>
</ol>



<h3><font face="Arial, Helvetica, Geneva, sansserif, sans serif, Verdana" size="2" color="#000000"><a name="319270"></a>Requirements for Testing the Coordinator Disk Group</font>
</h3>
<p>
<ul type="disc"><li><font face="Verdana, Arial, Helvetica, Geneva, sansserif, sans serif" size="2"><a name="319271"></a>The utility requires that the coordinator disk group, <font face="Courier New, Courier, sansserif, sans serif" size="2">vxfencoorddg</font>, be accessible from two nodes.</font>
</li>
<li><font face="Verdana, Arial, Helvetica, Geneva, sansserif, sans serif" size="2"><a name="319272"></a>The two nodes must have <font face="Courier New, Courier, sansserif, sans serif" size="2">remsh</font> permission set such that each node has root user access to the other. Temporarily modify the <font face="Courier New, Courier, sansserif, sans serif" size="2">/.rhosts</font> file to enable cluster communications for the <font face="Courier New, Courier, sansserif, sans serif" size="2">vxfentsthdw</font> utility, placing a &quot;+ +&quot; character in the first line of the file. You can also limit the remote access to specific systems. Refer to the manual page for the <font face="Courier New, Courier, sansserif, sans serif" size="2">/.rhosts</font> file for more information. See <a href="03_installsfrac_sf_ora_rac32_361367.html#376482">Removing remsh Permissions and Restoring Public Network Connections</a> when you complete the testing process.</font>
</li>
<li><font face="Verdana, Arial, Helvetica, Geneva, sansserif, sans serif" size="2"><a name="319276"></a>To ensure both nodes are connected to the same disks during the testing process, use the <font face="Courier New, Courier, sansserif, sans serif" size="2">vxfenadm -i </font><font face="Courier New, Courier, sansserif, sans serif" size="2"><i>diskpath</i></font> command to verify the serial number. See <a href="03_installsfrac_sf_ora_rac31_157546.html#181195">Verifying the Nodes See the Same Disk</a>.</font>
</li>
</ul>
</p>



<h3><font face="Arial, Helvetica, Geneva, sansserif, sans serif, Verdana" size="2" color="#000000"><a name="319280"></a>Using vxfentsthdw -c to Test the Coordinator Disk Group</font>
</h3>
<p>
<font face="Verdana, Arial, Helvetica, Geneva, sansserif, sans serif" size="2"><a name="319281"></a>Use the vxfentsthdw utility to verify disks are configured to support I/O fencing. In this procedure, the <font face="Courier New, Courier, sansserif, sans serif" size="2">vxfentsthdw</font> utility tests the three disks one disk at a time from each node. From the node <font face="Courier New, Courier, sansserif, sans serif" size="2">slpas06</font>, the disks are <font face="Courier New, Courier, sansserif, sans serif" size="2">/dev/rdsk/c1t1d0</font>, <font face="Courier New, Courier, sansserif, sans serif" size="2">/dev/rdsk/c2t1d0</font>, and <font face="Courier New, Courier, sansserif, sans serif" size="2">/dev/rdsk/c3t1d0</font>. From the node <font face="Courier New, Courier, sansserif, sans serif" size="2">slpas07</font>, the same disks are seen as <font face="Courier New, Courier, sansserif, sans serif" size="2">/dev/rdsk/c4t1d0</font>, <font face="Courier New, Courier, sansserif, sans serif" size="2">/dev/rdsk/c5t1d0</font>, and <font face="Courier New, Courier, sansserif, sans serif" size="2">/dev/rdsk/c6t1d0</font>.</font>
</p>

<ol>
<li value="1">
<font face="Verdana, Arial, Helvetica, Geneva, sansserif, sans serif" size="2"><a name="319282"></a>Use the <font face="Courier New, Courier, sansserif, sans serif" size="2">vxfentsthdw</font> command with the <font face="Courier New, Courier, sansserif, sans serif" size="2">-c</font> option. For example:
</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="319283"></a>#&nbsp;<font face="Courier New, Courier, sansserif, sans serif" size="2"><b>/opt/VRTSvcs/vxfen/bin/vxfentsthdw&nbsp;-c&nbsp;vxfencoorddg</b></font>
</font>
<li value="2">
<font face="Verdana, Arial, Helvetica, Geneva, sansserif, sans serif" size="2"><a name="319284"></a>Enter the nodes you are using to test the coordinator disks:
</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="319285"></a>&nbsp;&nbsp;Enter&nbsp;the&nbsp;first&nbsp;node&nbsp;of&nbsp;the&nbsp;cluster:
</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="319286"></a>&nbsp;&nbsp;<font face="Courier New, Courier, sansserif, sans serif" size="2"><b>slpas06</b></font>
</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="319287"></a>&nbsp;&nbsp;Enter&nbsp;the&nbsp;second&nbsp;node&nbsp;of&nbsp;the&nbsp;cluster:
</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="319288"></a>&nbsp;&nbsp;<font face="Courier New, Courier, sansserif, sans serif" size="2"><b>slpas07</b></font>
</font>
<li value="3">
<font face="Verdana, Arial, Helvetica, Geneva, sansserif, sans serif" size="2"><a name="319290"></a>Review the output of the testing process:
</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="319291"></a>&nbsp;Testing&nbsp;slpas06&nbsp;/dev/rdsk/c1t1d0&nbsp;slpas07&nbsp;/dev/rdsk/c4t1d0
</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="319293"></a>&nbsp;Evaluating&nbsp;the&nbsp;disk&nbsp;before&nbsp;testing&nbsp;0&nbsp;Pre-existing&nbsp;keys.........
</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="379783"></a>&nbsp;&nbsp;........................................................Passed.
</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="319294"></a>&nbsp;Registering&nbsp;keys&nbsp;on&nbsp;disk&nbsp;/dev/rdsk/c1t1d0&nbsp;from&nbsp;node
</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="363426"></a>&nbsp;&nbsp;slpas06&nbsp;...............................................&nbsp;Passed.
</font>
<a name="319296"></a><br><font face="Courier New, Courier, sansserif, sans serif" size="2"> Verifying registrations for disk /dev/rdsk/c1t1d0 on node<br>		slpas06 ............................................... Passed.</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="319298"></a>&nbsp;Registering&nbsp;keys&nbsp;on&nbsp;disk&nbsp;/dev/rdsk/c4t1d0&nbsp;from&nbsp;node
</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="363427"></a>&nbsp;&nbsp;slpas07&nbsp;...............................................&nbsp;Passed.
</font>
<a name="319300"></a><br><font face="Courier New, Courier, sansserif, sans serif" size="2"> Verifying registrations for disk /dev/rdsk/c1t1d0 on node<br>		slpas06 .............................................. Passed.</font>
<a name="319302"></a><br><font face="Courier New, Courier, sansserif, sans serif" size="2"> Verifying registrations for disk /dev/rdsk/c4t1d0 on node<br>		slpas07 .............................................. Passed.</font>
<a name="319304"></a><br><font face="Courier New, Courier, sansserif, sans serif" size="2"> Preempt and aborting key KeyA using key KeyB on node<br>		slpas07 .............................................. Passed.</font>
<a name="319306"></a><br><font face="Courier New, Courier, sansserif, sans serif" size="2"> Verifying registrations for disk /dev/rdsk/c1t1d0 on node<br>		slpas06 .............................................. Passed.</font>
<a name="319308"></a><br><font face="Courier New, Courier, sansserif, sans serif" size="2"> Verifying registrations for disk /dev/rdsk/c4t1d0 on node<br>		slpas07 .............................................. Passed.</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="319310"></a>&nbsp;Removing&nbsp;key&nbsp;KeyB&nbsp;on&nbsp;node&nbsp;slpas07&nbsp;.....................&nbsp;Passed.
</font>
<a name="319312"></a><br><font face="Courier New, Courier, sansserif, sans serif" size="2"> Check to verify there are no keys from node slpas06 ..........<br>		...................................................... Passed.</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="319315"></a>&nbsp;ALL&nbsp;tests&nbsp;on&nbsp;the&nbsp;disk&nbsp;/dev/rdsk/c1t1d0&nbsp;have&nbsp;PASSED.
</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="319316"></a>&nbsp;The&nbsp;disk&nbsp;is&nbsp;now&nbsp;ready&nbsp;to&nbsp;be&nbsp;configured&nbsp;for&nbsp;I/O&nbsp;Fencing&nbsp;on&nbsp;node
</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="363432"></a>&nbsp;&nbsp;slpas06&nbsp;as&nbsp;a&nbsp;COORDINATOR&nbsp;DISK.
</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="319318"></a>&nbsp;ALL&nbsp;tests&nbsp;on&nbsp;the&nbsp;disk&nbsp;/dev/rdsk/c4t1d0&nbsp;have&nbsp;PASSED.
</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="319319"></a>&nbsp;The&nbsp;disk&nbsp;is&nbsp;now&nbsp;ready&nbsp;to&nbsp;be&nbsp;configured&nbsp;for&nbsp;I/O&nbsp;Fencing&nbsp;on&nbsp;node
</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="363433"></a>&nbsp;slpas07&nbsp;as&nbsp;a&nbsp;COORDINATOR&nbsp;DISK.
</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="379804"></a>&nbsp;********************************************
</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="379807"></a>&nbsp;Testing&nbsp;slpas06&nbsp;/dev/rdsk/c1t1d0&nbsp;slpas07&nbsp;/dev/rdsk/c1t1d0
</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="379808"></a>&nbsp;.
</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="319324"></a>&nbsp;.
</font>
<p>
<font face="Verdana, Arial, Helvetica, Geneva, sansserif, sans serif" size="2"><a name="319325"></a>After you test all disks in the disk group, the <font face="Courier New, Courier, sansserif, sans serif" size="2">vxfencoorddg</font> disk group is ready for use.</font>
</p>
</ol>
<br>
<p>
<font face="Font_SingleByte;" size="2"><a name="319326"></a><b>Removing and Replacing a Failed Disk</b></font>
</p>
<p>
<font face="Verdana, Arial, Helvetica, Geneva, sansserif, sans serif" size="2"><a name="319327"></a>If a disk in the coordinator disk group fails verification, remove the failed disk or LUN from the <font face="Courier New, Courier, sansserif, sans serif" size="2">vxfencoorddg</font> disk group, replace it with another, and retest the disk group.</font>
</p>

<p>
<ul type="disc"><li><font face="Verdana, Arial, Helvetica, Geneva, sansserif, sans serif" size="2"><a name="319855"></a>Use the <font face="Courier New, Courier, sansserif, sans serif" size="2">vxdiskadm</font> utility to remove the failed disk from the disk group. Refer to the <em>VERITAS Volume Manager Administrator's Guide</em>.</font>
</li>
<li><font face="Verdana, Arial, Helvetica, Geneva, sansserif, sans serif" size="2"><a name="319872"></a>Add a new disk to the node, initialize it, and add it to the coordinator disk group. See <a href="03_installsfrac_sf_ora_rac32_361367.html#319237">Creating the vxfencoorddg Disk Group</a>.</font>
</li>
<li><font face="Verdana, Arial, Helvetica, Geneva, sansserif, sans serif" size="2"><a name="319876"></a>Retest the disk group. See <a href="03_installsfrac_sf_ora_rac32_361367.html#319270">Requirements for Testing the Coordinator Disk Group</a>.</font>
</li>
<hr noshade size="2" width="100%" color="#000000">
<img src="images/note.gif" alt="Note " height="16" width="16">&nbsp;
<font face="Arial, Helvetica, Geneva, sansserif, sans serif, Verdana" size="2" color="#000000">
<a name="362298"></a><b>Note  &nbsp;&nbsp;</b>
</font>
<font face="Verdana, Arial, Helvetica, Geneva, sansserif, sans serif" size="2" color="#000000">If you need to replace a disk in an active coordinator disk group, refer to the troubleshooting procedure, <a href="13_troubleshoot_sf_ora_rac127_107004.html#132935">Removing or Adding Coordinator Disks</a>.
</font>
<hr noshade size="2" width="100%" color="#000000">
</ul>
</p>



<h3><font face="Arial, Helvetica, Geneva, sansserif, sans serif, Verdana" size="2" color="#000000"><a name="362304"></a>Configuring /etc/vxfendg Disk Group for I/O Fencing</font>
</h3>
<p>
<font face="Verdana, Arial, Helvetica, Geneva, sansserif, sans serif" size="2"><a name="362305"></a>After setting up and testing the coordinator disk group, configure it for use.</font>
</p>

<ol>
<li value="1">
<font face="Verdana, Arial, Helvetica, Geneva, sansserif, sans serif" size="2"><a name="319347"></a>Deport the disk group:
</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="319348"></a>&nbsp;&nbsp;#&nbsp;<font face="Courier New, Courier, sansserif, sans serif" size="2"><b>vxdg&nbsp;deport&nbsp;vxfencoorddg</b></font>
</font>
<li value="2">
<font face="Verdana, Arial, Helvetica, Geneva, sansserif, sans serif" size="2"><a name="319349"></a>Import the disk group with the <font face="Courier New, Courier, sansserif, sans serif" size="2">-t</font> option to avoid automatically importing it when the nodes restart:
</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="319350"></a>&nbsp;&nbsp;#&nbsp;<font face="Courier New, Courier, sansserif, sans serif" size="2"><b>vxdg&nbsp;-t&nbsp;import&nbsp;vxfencoorddg</b></font>
</font>
<li value="3">
<font face="Verdana, Arial, Helvetica, Geneva, sansserif, sans serif" size="2"><a name="319351"></a>Deport the disk group. Deporting the disk group prevents the coordinator disks from serving other purposes:
</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="319352"></a>&nbsp;&nbsp;#&nbsp;<font face="Courier New, Courier, sansserif, sans serif" size="2"><b>vxdg&nbsp;deport&nbsp;vxfencoorddg</b></font>
</font>
<li value="4">
<font face="Verdana, Arial, Helvetica, Geneva, sansserif, sans serif" size="2"><a name="319353"></a>On all nodes, type:
</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="319354"></a>&nbsp;&nbsp;#&nbsp;<font face="Courier New, Courier, sansserif, sans serif" size="2"><b>echo&nbsp;&quot;vxfencoorddg&quot;&nbsp;&gt;&nbsp;/etc/vxfendg</b></font>
</font>
<p>
<font face="Verdana, Arial, Helvetica, Geneva, sansserif, sans serif" size="2"><a name="319355"></a>No spaces should appear between the quotes in the &quot;<font face="Courier New, Courier, sansserif, sans serif" size="2">vxfencoorddg</font>&quot; text.</font>
</p>
<p>
<font face="Verdana, Arial, Helvetica, Geneva, sansserif, sans serif" size="2"><a name="319356"></a>This command creates the <font face="Courier New, Courier, sansserif, sans serif" size="2">/etc/vxfendg</font> file, which includes the name of the coordinator disk group.</font>
</p>
<p>
<font face="Verdana, Arial, Helvetica, Geneva, sansserif, sans serif" size="2"><a name="319357"></a>Based on the contents of the  <font face="Courier New, Courier, sansserif, sans serif" size="2">/etc/vxfendg</font> file, the <font face="Courier New, Courier, sansserif, sans serif" size="2">rc</font> script creates the  <font face="Courier New, Courier, sansserif, sans serif" size="2">/etc/vxfentab</font> file for use by the <font face="Courier New, Courier, sansserif, sans serif" size="2">vxfen</font> driver when the system starts. <font face="Courier New, Courier, sansserif, sans serif" size="2">/etc/vxfentab</font> invokes the <font face="Courier New, Courier, sansserif, sans serif" size="2">vxfenconfig</font> command, which configures the <font face="Courier New, Courier, sansserif, sans serif" size="2">vxfen</font> driver to start and use the coordinator disks listed in <font face="Courier New, Courier, sansserif, sans serif" size="2">/etc/vxfentab</font>. <font face="Courier New, Courier, sansserif, sans serif" size="2">/etc/vxfentab</font> is a generated file; do not modify this file.</font>
</p>
</ol>
<br>
<p>
<font face="Font_SingleByte;" size="2"><a name="319363"></a><b>Example /etc/vxfentab File</b></font>
</p>
<p>
<font face="Verdana, Arial, Helvetica, Geneva, sansserif, sans serif" size="2"><a name="319364"></a>The list of coordinator disks is in the <font face="Courier New, Courier, sansserif, sans serif" size="2">/etc/vxfentab</font> file on each node. The same disks may appear using different names on each node. For example, a device could appear as c0t1d2 on one node and c4t1d2 on another node. In this case, use the commands <font face="Courier New, Courier, sansserif, sans serif" size="2">vxfenadm -i /dev/rdsk/c0t1d2</font> on the first node and <font face="Courier New, Courier, sansserif, sans serif" size="2">vxfenadm -i /dev/rdsk/c4t1d2</font> on the second node to verify if the serial number is the same number.</font>
</p>

<p>
<font face="Verdana, Arial, Helvetica, Geneva, sansserif, sans serif" size="2"><a name="380493"></a>An example of the <font face="Courier New, Courier, sansserif, sans serif" size="2">/etc/vxfentab</font> file on one node resembles:</font>
</p>

<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="319365"></a>/dev/rdsk/c1t1d0&nbsp;
</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="319366"></a>/dev/rdsk/c2t1d0&nbsp;&nbsp;
</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="319367"></a>/dev/rdsk/c3t1d0&nbsp;
</font>
<p>
<font face="Verdana, Arial, Helvetica, Geneva, sansserif, sans serif" size="2"><a name="202397"></a>If you must remove disks from or add disks to an existing coordinator disk group, refer to <a href="13_troubleshoot_sf_ora_rac127_107004.html#132935">Removing or Adding Coordinator Disks</a>.</font>
</p>




<h2><font face="Arial, Helvetica, Geneva, sansserif, sans serif, Verdana" size="3" color="#000000"><a name="380367"></a>Starting I/O Fencing</font>
</h2>
 
<p>
<font face="Verdana, Arial, Helvetica, Geneva, sansserif, sans serif" size="2"><a name="380368"></a>On each node, start the I/O fencing driver:</font>
</p>

<p>
<font face="Verdana, Arial, Helvetica, Geneva, sansserif, sans serif" size="2"><a name="380356"></a># <font face="Courier New, Courier, sansserif, sans serif" size="2"><b>/sbin/init.d/vxfen start</b></font></font>
</p>




<h3><font face="Arial, Helvetica, Geneva, sansserif, sans serif, Verdana" size="2" color="#000000"><a name="376482"></a>Removing remsh Permissions and Restoring Public Network Connections</font>
</h3>
<p>
<font face="Verdana, Arial, Helvetica, Geneva, sansserif, sans serif" size="2"><a name="376486"></a>After completing the installation of VERITAS <em>Storage Foundation for Oracle RAC </em>and verification of disk support for I/O fencing, remove the temporary <font face="Courier New, Courier, sansserif, sans serif" size="2">remsh</font> access permissions you set for the nodes and restore the connections to the public network.</font>
</p>

<hr noshade size="2" width="100%" color="#000000">
<img src="images/note.gif" alt="Note " height="16" width="16">&nbsp;
<font face="Arial, Helvetica, Geneva, sansserif, sans serif, Verdana" size="2" color="#000000">
<a name="363574"></a><b>Note  &nbsp;&nbsp;</b>
</font>
<font face="Verdana, Arial, Helvetica, Geneva, sansserif, sans serif" size="2" color="#000000">If the nodes use <font face="Courier New, Courier, sansserif, sans serif" size="2">ssh</font> for secure communications, and you temporarily removed the connections to the public network, restore the connections at this time.
</font>
<hr noshade size="2" width="100%" color="#000000">



<h2><font face="Arial, Helvetica, Geneva, sansserif, sans serif, Verdana" size="3" color="#000000"><a name="363576"></a>Editing the UseFence Attribute in VCS Configuration</font>
</h2>
 
<p>
<font face="Verdana, Arial, Helvetica, Geneva, sansserif, sans serif" size="2"><a name="363577"></a>After adding coordinator disks and configuring I/O fencing, add the <font face="Courier New, Courier, sansserif, sans serif" size="2">UseFence&nbsp;=&nbsp;SCSI3</font> cluster attribute to the VCS configuration file, <font face="Courier New, Courier, sansserif, sans serif" size="2">/etc/VRTSvcs/conf/config/main.cf</font>. This entry gives the user the flexibility to disable or enable I/O fencing by modifying the <font face="Courier New, Courier, sansserif, sans serif" size="2">UseFence</font> attribute.</font>
</p>

<ol>
<li value="1">
<font face="Verdana, Arial, Helvetica, Geneva, sansserif, sans serif" size="2"><a name="199174"></a> Save the existing configuration:
</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="199144"></a>&nbsp;&nbsp;#&nbsp;<font face="Courier New, Courier, sansserif, sans serif" size="2"><b>haconf&nbsp;-dump&nbsp;-makero</b></font>
</font>
<li value="2">
<font face="Verdana, Arial, Helvetica, Geneva, sansserif, sans serif" size="2"><a name="199143"></a>Stop VCS on all nodes:
</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="199137"></a>&nbsp;&nbsp;#&nbsp;<font face="Courier New, Courier, sansserif, sans serif" size="2"><b>hastop&nbsp;-all</b></font>
</font>
<li value="3">
<font face="Verdana, Arial, Helvetica, Geneva, sansserif, sans serif" size="2"><a name="199145"></a>Make a backup copy of the <font face="Courier New, Courier, sansserif, sans serif" size="2">main.cf</font> file:
</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="199154"></a>&nbsp;&nbsp;#&nbsp;<font face="Courier New, Courier, sansserif, sans serif" size="2"><b>cd&nbsp;/etc/VRTSvcs/conf/config</b></font>&nbsp;
</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="199152"></a>&nbsp;&nbsp;#&nbsp;<font face="Courier New, Courier, sansserif, sans serif" size="2"><b>cp&nbsp;main.cf&nbsp;main.orig</b></font>
</font>
<li value="4">
<font face="Verdana, Arial, Helvetica, Geneva, sansserif, sans serif" size="2"><a name="199138"></a>On one node, use <font face="Courier New, Courier, sansserif, sans serif" size="2">vi</font> or another text editor to edit the <font face="Courier New, Courier, sansserif, sans serif" size="2">main.cf</font> file. Modify the list of cluster attributes by adding the <font face="Courier New, Courier, sansserif, sans serif" size="2">UseFence</font> attribute and assigning its value of <font face="Courier New, Courier, sansserif, sans serif" size="2">SCSI3</font>. 
</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="199182"></a>&nbsp;&nbsp;cluster&nbsp;rac_cluster1&nbsp;(
</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="199183"></a>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;UserNames&nbsp;=&nbsp;{&nbsp;admin&nbsp;=&nbsp;&quot;cDRpdxPmHpzS.&quot;&nbsp;}
</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="199184"></a>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;Administrators&nbsp;=&nbsp;{&nbsp;admin&nbsp;}
</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="199185"></a>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;HacliUserLevel&nbsp;=&nbsp;COMMANDROOT
</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="199186"></a>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;CounterInterval&nbsp;=&nbsp;5
</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="199190"></a>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<font face="Courier New, Courier, sansserif, sans serif" size="2"><b>UseFence&nbsp;=&nbsp;SCSI3</b></font>
</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="199187"></a>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;)
</font>
<li value="5">
<font face="Verdana, Arial, Helvetica, Geneva, sansserif, sans serif" size="2"><a name="199193"></a>Save and close the file.
</font>
<li value="6">
<font face="Verdana, Arial, Helvetica, Geneva, sansserif, sans serif" size="2"><a name="199201"></a>Verify the syntax of the file <font face="Courier New, Courier, sansserif, sans serif" size="2">/etc/VRTSvcs/conf/config/main.cf</font>:
</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="199199"></a>&nbsp;&nbsp;#&nbsp;<font face="Courier New, Courier, sansserif, sans serif" size="2"><b>hacf&nbsp;-verify&nbsp;</b></font><font face="Courier New, Courier, sansserif, sans serif" size="2"><b>/etc/VRTSvcs/conf/config</b></font>
</font>
<li value="7">
<font face="Verdana, Arial, Helvetica, Geneva, sansserif, sans serif" size="2"><a name="199257"></a>Using <font face="Courier New, Courier, sansserif, sans serif" size="2">rcp</font> or another utility, copy the VCS configuration file from a node (for example, <font face="Courier New, Courier, sansserif, sans serif" size="2">slpas06</font>) to the remaining cluster nodes. On each remaining node, enter:		
</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="380042"></a>&nbsp;&nbsp;#&nbsp;<font face="Courier New, Courier, sansserif, sans serif" size="2"><b>rcp&nbsp;slpas06:/etc/</b></font><font face="Courier New, Courier, sansserif, sans serif" size="2"><b>VRTSvcs/conf/config</b></font><font face="Courier New, Courier, sansserif, sans serif" size="2"><b>/main.cf&nbsp;&nbsp;</b></font>
</font>
<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="380043"></a><font face="Courier New, Courier, sansserif, sans serif" size="2"><b>&nbsp;&nbsp;&nbsp;&nbsp;/etc/</b></font><font face="Courier New, Courier, sansserif, sans serif" size="2"><b>VRTSvcs/conf/config</b></font>
</font>
</ol>



<h2><font face="Arial, Helvetica, Geneva, sansserif, sans serif, Verdana" size="3" color="#000000"><a name="202808"></a>Starting VCS, CVM, and CFS on All Nodes</font>
</h2>
 
<p>
<font face="Verdana, Arial, Helvetica, Geneva, sansserif, sans serif" size="2"><a name="303536"></a>With the configuration file in place on each system, start VCS, CVM, and CFS:</font>
</p>

<br>
<font face="Courier New, Courier, sansserif, sans serif" size="2"><a name="303537"></a>#&nbsp;<font face="Courier New, Courier, sansserif, sans serif" size="2"><b>hastart</b></font>
</font>
<p>
<font face="Verdana, Arial, Helvetica, Geneva, sansserif, sans serif" size="2"><a name="390030"></a>Make sure to run this command from each node.</font>
</p>


<!-- End Main Topic Content -->

   </td>
  </tr>
 </table>
</div>

<div>
<table border="0" cellspacing="0" cellpadding="0" width="100%">
 <tr>
  <td height="18" border="0" cellspacing="0" cellpadding="0" colspan="2" bgcolor="#FFFFFF">
  </td>
 </tr>
  <td align="left"><font face="Verdana, Arial, Helvetica, Geneva, sansserif, sans serif" size="-2">&nbsp;&#94;&nbsp;<a href="03_installsfrac_sf_ora_rac32_361367.html" title="Testing Disks Using vxfentsthdw">Return to Top</a></font>

  </td>
  <td align="right"><font face="Verdana, Arial, Helvetica, Geneva, sansserif, sans serif" size="-2">&lt;&nbsp;<a href="03_installsfrac_sf_ora_rac31_157546.html" title="Previous - Setting Up Shared Storage and I/O Fencing for SFRAC">Previous</a>&nbsp;&nbsp;|&nbsp;&nbsp;<a href="03_installsfrac_sf_ora_rac33_383356.html" title="Next - Running gabconfig -a to Verify GAB Port Membership">Next</a>
&nbsp;&gt;&nbsp;&nbsp;</font>
  </td>
 <tr>
   <td height="9" border="0" cellspacing="0" cellpadding="0" colspan="2" bgcolor="#FFFFFF">
   </td>
 </tr>

<!-- Footer Breadcrumbs -->
<tr>
<td bgcolor="#FFFFFF" colspan="2" height="15" align="right">
<font face="Verdana, Arial, Helvetica, Geneva, sansserif, sans serif" size="1">Product:  
<a href="sf_ora_rac_splashpage_docCD_sf_ora_rac1_103036.vxhd" title="Storage Foundation for Oracle RAC Guides title page ">Storage Foundation for Oracle RAC Guides</a>&nbsp;&nbsp;</font></td>
</tr>

<tr>
<td bgcolor="#FFFFFF" colspan="2" height="15" align="right">
<font face="Verdana, Arial, Helvetica, Geneva, sansserif, sans serif" size="1">Manual:  
<a href="sfrac_icg_titlepage_docCD_sf_ora_rac2_73700.vxhd" title="Storage Foundation 4.1 for Oracle RAC Installation and Configuration title page ">Storage Foundation 4.1 for Oracle RAC Installation and Configuration</a>&nbsp;&nbsp;</font></td>
</tr>


 <tr>
  <td colspan="2" align="left"><font face="Verdana, Arial, Helvetica, Geneva, sansserif, sans serif" color="#000000" align="right" size="-2">
<em>VERITAS Software Corporation
</em></font><br>

<font face="Verdana, Arial, Helvetica, Geneva, sansserif, sans serif" size="-2">www.veritas.com</font><br>
  </td>
 </tr>
</table>
</div>

</BODY>
  <!--
    *************************************************************************************
    * Copyright (c) 2005 VERITAS Software Corporation. All rights reserved. *

    VERITAS, VERITAS SOFTWARE, the VERITAS Logo, and VERITAS Software Documentation 
    are trademarks or registered trademarks of VERITAS Software Corporation 
    or its affiliates in the U.S. and other countries. Other names may be 
    trademarks of their respective owners. 

    Apache Jakarta Lucene:
    Apache Software License
    Version 1.1

    Copyright (c) 2000 The Apache Software Foundation. All rights reserved.

    Redistribution and use in source and binary forms, with or without modification, 
    are permitted provided that the following conditions are met:

    1. Redistributions of source code must retain the above copyright notice, this 
    list of conditions and the following disclaimer.

    2. Redistributions in binary form must reproduce the above copyright notice, this 
    list of conditions and the following disclaimer in the documentation and/or other 
    materials provided with the distribution.

    3. The end-user documentation included with the redistribution, if any, must include 
    the following acknowledgment: "This product includes software developed by the Apache 
    Software Foundation (http://www.apache.org/)." Alternately, this acknowledgment may 
    appear in the software itself, if and wherever such third-party acknowledgments 
    normally appear.

    4. The names "Apache" and "Apache Software Foundation" must not be used to endorse or 
    promote products derived from this software without prior written permission. For 
    written permission, please contact apache@apache.org.

    5. Products derived from this software may not be called "Apache", nor may "Apache" 
    appear in their name, without prior written permission of the Apache Software Foundation.

    THIS SOFTWARE IS PROVIDED "AS IS" AND ANY EXPRESSED OR IMPLIED WARRANTIES, INCLUDING, 
    BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A 
    PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE APACHE SOFTWARE FOUNDATION 
    OR ITS CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, 
    OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS 
    OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND 
    ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT (INCLUDING 
    NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE, EVEN IF 
    ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.

    This software consists of voluntary contributions made by many individuals on behalf 
    of the Apache Software Foundation. For more information on the Apache Software Foundation, 
    please see <http://www.apache.org/>. Portions of this software are based upon public domain 
    software originally written at the National Center for Supercomputing Applications, University 
    of Illinois, Urbana-Champaign.
    
    This product includes WebWindow Software developed by Horst Heistermann.
    *************************************************************************************
  -->
</HTML>
