Akraino JIRA https://jira.akraino.org This file is an XML representation of an issue en-us 9.4.5 940005 11-04-2023 [ICN-481] metal3 provisioning fails for nvme devices https://jira.akraino.org/browse/ICN-481 Integrated Cloud Native NFV <p>As found in a specific deploy, if the root device of the provisioned node is not /dev/sda, provisioning fails.</p> <p> </p> ICN-481 metal3 provisioning fails for nvme devices Bug Medium Done Done Todd Malsbary Todd Malsbary Fri, 9 Oct 2020 20:05:20 +0000 Thu, 17 Dec 2020 00:54:14 +0000 Mon, 16 Nov 2020 21:11:43 +0000 0 1 <p><a href="https://gerrit.akraino.org/r/c/icn/+/3893" class="external-link" target="_blank" rel="nofollow noopener">https://gerrit.akraino.org/r/c/icn/+/3893</a></p> <p>Proof of concept is at <a href="https://github.com/malsbat/icn/tree/upgrade-baremetal-operator." class="external-link" target="_blank" rel="nofollow noopener">https://github.com/malsbat/icn/tree/upgrade-baremetal-operator</a>, using an unofficial baremetal-operator image.  The integratedcloudnative/baremetal-operator image needs to be built from the capm3-v0.3.2 tag of the upstream repo.</p> <p>From <a href="https://github.com/metal3-io/baremetal-operator/blob/master/docs/api.md" class="external-link" target="_blank" rel="nofollow noopener">https://github.com/metal3-io/baremetal-operator/blob/master/docs/api.md</a>:</p> <h4><a name="hardwareProfile"></a>hardwareProfile</h4> <p><b>This field is deprecated. See rootDeviceHints instead.</b></p> <p>The name of the hardware profile to use. The following are the current supported hardwareProfile settings and their corresponding root devices.</p> <div class='table-wrap'> <table class='confluenceTable'><tbody> <tr> <td class='confluenceTd'><b>hardwareProfile</b></td> <td class='confluenceTd'><b>Root Device</b></td> </tr> <tr> <td class='confluenceTd'>unknown</td> <td class='confluenceTd'>/dev/sda</td> </tr> <tr> <td class='confluenceTd'>libvirt</td> <td class='confluenceTd'>/dev/vda</td> </tr> <tr> <td class='confluenceTd'>dell</td> <td class='confluenceTd'>HCTL: 0:0:0:0</td> </tr> <tr> <td class='confluenceTd'>dell-raid</td> <td class='confluenceTd'>HCTL: 0:2:0:0</td> </tr> <tr> <td class='confluenceTd'>openstack</td> <td class='confluenceTd'>/dev/vdb</td> </tr> </tbody></table> </div> <p><b>NOTE:</b> These are subject to change.</p> <p>This table is located in baremetal-operator/pkg/hardware/profile.go:<br/>  </p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java"> profiles[DefaultProfileName] = Profile{ Name: DefaultProfileName, RootDeviceHints: RootDeviceHints{ DeviceName: <span class="code-quote">"/dev/sda"</span>, }, RootGB: 10, LocalGB: 50, CPUArch: <span class="code-quote">"x86_64"</span>, } </pre> </div></div> <p>The code that makes the choice is in baremetal-operator/pkg/provisioner/ironic/ironic.go:</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java"> hwProf, err := hardware.GetProfile(p.host.HardwareProfile()) ... <span class="code-keyword">if</span> _, ok := ironicNode.Properties[<span class="code-quote">"root_device"</span>]; !ok { op = nodes.AddOp p.log.Info(<span class="code-quote">"adding root_device"</span>) } <span class="code-keyword">else</span> { op = nodes.ReplaceOp p.log.Info(<span class="code-quote">"updating root_device"</span>) } hints := map[string]string{} <span class="code-keyword">switch</span> { <span class="code-keyword">case</span> hwProf.RootDeviceHints.DeviceName != "": hints[<span class="code-quote">"name"</span>] = hwProf.RootDeviceHints.DeviceName <span class="code-keyword">case</span> hwProf.RootDeviceHints.HCTL != "": hints[<span class="code-quote">"hctl"</span>] = hwProf.RootDeviceHints.HCTL } p.log.Info(<span class="code-quote">"using root device"</span>, <span class="code-quote">"hints"</span>, hints) </pre> </div></div> <p>Now, let's take a look at the BareMetalHost:</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java"># kubectl -n metal3 get bmh NAME          STATUS   PROVISIONING STATUS   CONSUMER   BMC                   HARDWARE PROFILE   ONLINE   ERROR pod11-node2   OK       provisioned                      ipmi:<span class="code-comment">//10.10.110.12   unknown            <span class="code-keyword">true</span>      </span> </pre> </div></div> <p>The profile is confirmed in the logs from the baremetal-operator:</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java">{<span class="code-quote">"level"</span>:<span class="code-quote">"info"</span>,<span class="code-quote">"ts"</span>:1602018807.7891486,<span class="code-quote">"logger"</span>:<span class="code-quote">"baremetalhost_ironic"</span>,<span class="code-quote">"msg"</span>:<span class="code-quote">"adding root_device"</span>,<span class="code-quote">"host"</span>:<span class="code-quote">"pod11-node2"</span>}{<span class="code-quote">"level"</span>:<span class="code-quote">"info"</span>,<span class="code-quote">"ts"</span>:1602018807.7891557,<span class="code-quote">"logger"</span>:<span class="code-quote">"baremetalhost_ironic"</span>,<span class="code-quote">"msg"</span>:<span class="code-quote">"using root device"</span>,<span class="code-quote">"host"</span>:<span class="code-quote">"pod11-node2"</span>,<span class="code-quote">"hints"</span>:{<span class="code-quote">"name"</span>:<span class="code-quote">"/dev/sda"</span>}} </pre> </div></div> <p> </p> Development Rank 0|i004v8: