Skc baremetal environment #2017

claudia-lola · 2025-11-28T17:15:16Z

No description provided.

skc-baremetal-environment

…hpc-kayobe-config into skc-baremetal-environment

…books

…pc/stackhpc-kayobe-config into skc-baremetal-environment

JohnGarbutt · 2025-12-02T10:12:30Z

etc/kayobe/environments/stackhpc-baremetal/ansible/baremetal-0-enroll-overcloud.yml

+  vars:
+    venv: "{{ virtualenv_path }}/openstack-cli"
+  tasks:
+    - name: Set up openstack cli virtualenv


I wonder if this should be a separate script that we add into baremetal-all? like baremetal-env.yml or similar? With a clear error message if the venv is missing.

assumptionsandg · 2025-12-02T11:30:29Z

etc/kayobe/environments/stackhpc-baremetal/ansible/baremetal-1-check-bmc-up.yml

+            - kayobe_bmc_up == ""
+            - ironic_redfish_username is defined
+
+        # - name: Wait 300 seconds for port 443 to become open


If we don't need these we should remove them I think.

+1 lets remove it.

etc/kayobe/environments/stackhpc-baremetal/ansible/diagnose-baremetal.yml

etc/kayobe/environments/stackhpc-baremetal/ansible/download-host-image.yml

assumptionsandg · 2025-12-02T11:33:46Z

etc/kayobe/environments/stackhpc-baremetal/ironic.yml

@@ -0,0 +1,135 @@
+---


Are we assuming this as a global configuration on the conductor? Or do we want to configure this via group_vars and apply it to nodes during enrollment.

yes, lets move this into ensure-redfish playbook.

where in the ensure-redfish playbook should this go?

move this to baremetal-0, baremetal-0 becomes an enroll-baremetal playbook

JohnGarbutt · 2025-12-03T09:34:35Z

etc/kayobe/environments/stackhpc-baremetal/ansible/baremetal-0-enroll-overcloud.yml

+        extra_args: "{% if pip_upper_constraints_file %}-c {{ pip_upper_constraints_file }}{% endif %}"
+
+- name: Ensure overcloud baremetal nodes are registered in ironic
+  hosts: baremetal-overcloud


Its probably worth a quick comment here to note that this is because "kayobe baremetal compute register" doesn't currently touch the overcloud nodes, but we want them here.

etc/kayobe/environments/stackhpc-baremetal/ansible/baremetal-1-check-bmc-up.yml

JohnGarbutt · 2025-12-03T09:35:49Z

etc/kayobe/environments/stackhpc-baremetal/ansible/baremetal-1-check-bmc-up.yml

+        #   ansible.builtin.debug:
+        #     msg: "{{ firmware_inventory.redfish_facts.firmware | to_nice_json }}"
+
+        - name: Reboot BMC


as above, I think we need to remove this for now, until we have a generic version. Its possible we could add this as an extra step.

Maybe we should add something here, like a TODO, saying lets add an optional BMC reboot into the flow here.

JohnGarbutt · 2025-12-03T09:36:12Z

etc/kayobe/environments/stackhpc-baremetal/ansible/baremetal-1-check-bmc-up.yml

@@ -0,0 +1,129 @@
+---


we should maybe rename these steps as 10,20,30,40... to allow people to add things in the middle.

etc/kayobe/environments/stackhpc-baremetal/ansible/baremetal-1-check-bmc-up.yml

JohnGarbutt · 2025-12-03T10:00:03Z

etc/kayobe/environments/stackhpc-baremetal/inventory/group_vars/baremetal-redfish/ironic

+ironic_provision_network: "provision-net"
+ironic_provision_flavor: "example_resource_class"
+ironic_provision_image: "overcloud-rocky-9-2025.1-20250930T144255"
+ironic_provision_key_name: "stack"


FWIW, I think this is where the stuff like --management-interface=redfish might want to live, although maybe we want a baremetal-redfish group more like we have in jack's proposal?

JohnGarbutt · 2025-12-03T10:06:22Z

etc/kayobe/environments/stackhpc-sushy-baremetal/ansible/create-virtual-baremetal.yml

+        libvirt_vms:
+          - state: present
+            name: "{{ inventory_hostname }}"
+            xml_file: "{{ sushy_directory }}/vbmc-node.xml.j2"


I think we need to consider removing the XML file all together here.

Probably, we want to have a uuid that is either predictable, or better, discovered after the VM has been created, so we know what to tell sushi to look for.

But I think we need that rather than the large xml blob, for maintainability in the medium term.

JohnGarbutt · 2025-12-03T10:07:16Z

etc/kayobe/environments/stackhpc-sushy-baremetal/ansible/auto-setup.yml

+    - name: Run Sushy Emulator playbook
+      ansible.builtin.shell: |
+          source "$VIRTUAL_ENV/bin/activate"
+          kayobe playbook run "$KAYOBE_CONFIG_PATH/environments/stackhpc-sushy-baremetal/ansible/sushy-emulator.yml"


Do we need this split into two, so we can discover the VM uuid, then configure sushi with the uuid we get given?

JohnGarbutt · 2025-12-03T10:08:37Z

etc/kayobe/environments/stackhpc-sushy-baremetal/ansible/sushy-emulator.yml

+        name: devel
+        state: enabled
+
+    - name: Install package dependencies


Doesn't kayobe already do a bunch of this virt setup, on the seed host, at least? This feels like duplication here.

I am OK if we need the duplication, but I think this worth a double check we can't reuse the "standard" kayobe way to add these.

JohnGarbutt · 2025-12-03T10:09:50Z

etc/kayobe/environments/stackhpc-sushy-baremetal/ansible/vbmc-net.xml.j2

@@ -0,0 +1,6 @@
+<network connections='1'>
+  <name>vbmc-net</name>


Do we still need this one? I think it can be removed now.

delete the whole file?

etc/kayobe/environments/stackhpc-sushy-baremetal/ansible/vbmc-node.xml.j2

JohnGarbutt · 2025-12-03T10:10:43Z

etc/kayobe/environments/stackhpc-sushy-baremetal/ansible/vbmc-pool.xml.j2

+<pool type='dir'>
+  <name>default</name>
+  <uuid>{{ 'default' | to_uuid }}</uuid>
+  <capacity unit='bytes'>68509761536</capacity>


Feels like this should be configurable via a variable in some role default?

JohnGarbutt · 2025-12-03T10:11:09Z

etc/kayobe/environments/stackhpc-sushy-baremetal/inventory/group_vars/controllers/lvm.yml

@@ -0,0 +1,3 @@
+---
+
+stackhpc_lvm_lv_var_size: 10g


lets add a comment around why we need this here.

etc/kayobe/ipa.yml

JohnGarbutt · 2025-12-05T16:34:19Z

etc/kayobe/environments/stackhpc-baremetal/ansible/recover-baremetal.yml

+
+    - name: Undeploy baremetals in 'deploy failed' or 'error' state
+      ansible.builtin.command:
+        cmd: "{{ venv }}/bin/openstack baremetal node undeploy {{ inventory_hostname }}"


Maybe lets move this into ./baremetal-4-clean.yml, at least for deploy failed.

JohnGarbutt · 2025-12-05T16:34:40Z

etc/kayobe/environments/stackhpc-baremetal/ansible/recover-baremetal.yml

+            delay: 20
+            timeout: 300
+
+        - name: Check BMC back up again


I think we should remove most of this script for now, while we get the minimum merged.

JohnGarbutt · 2025-12-05T16:38:45Z

etc/kayobe/environments/stackhpc-baremetal/ansible/baremetal-0-enroll-overcloud.yml

+            {% for key, value in ironic_properties.items() %}
+            --property {{ key }}={{ value }} \
+            {% endfor %}
+            --resource-class {{ ironic_resource_class }}


I think we need to extend this to allow us to specify all the interfaces that match the driver e.g. boot-interface, inspect-interface, etc.

Annoyingly this means we should change this playbook to run over both compute nodes and baremetal nodes for now.

JohnGarbutt · 2025-12-05T16:41:24Z

etc/kayobe/environments/stackhpc-baremetal/inventory/group_vars/baremetal-redfish/ironic

+  redfish_system_id: "{{ ironic_redfish_system_id }}"
+  redfish_address: "{{ ironic_redfish_address }}"
+  redfish_username: "{{ ironic_redfish_username | default(omit) }}"
+  redfish_password: "{{ ironic_redfish_password | default(omit) }}"


This default omit isn't working, I think we need to do a very complicated dictionary merge expression, where we default the merge to either {} or {"redfish_username": "{{ ironic_redfish_username }}"} or something like that.

JohnGarbutt · 2025-12-05T16:49:40Z

etc/kayobe/environments/stackhpc-baremetal/ansible/baremetal-0-enroll-overcloud.yml

+            {{ venv }}/bin/openstack baremetal node create \
+            --name {{ inventory_hostname }} \
+            --driver {{ ironic_driver }} \
+            {% for key, value in ironic_driver_info.items() %}


actually maybe don't do this as a dictionary, so fix the omit.

claudia-lola · 2025-12-08T10:14:45Z

etc/kayobe/environments/stackhpc-baremetal/ansible/baremetal-0-enroll-overcloud.yml

+        extra_args: "{% if pip_upper_constraints_file %}-c {{ pip_upper_constraints_file }}{% endif %}"
+
+- name: Ensure overcloud baremetal nodes are registered in ironic
+  hosts: baremetal-overcloud


change host to baremetal

claudia-lola · 2025-12-08T10:17:09Z

etc/kayobe/environments/stackhpc-baremetal/ansible/baremetal-0-enroll-overcloud.yml

+            --name {{ inventory_hostname }} \
+            --driver {{ ironic_driver }} \
+            {% for key, value in ironic_driver_info.items() %}
+            --driver-info {{ key }}={{ value }} \


--driver-info refish_username = {{ ironic_redfish_username }}
... and same for password and resource id etc

claudia-lola · 2025-12-08T10:20:39Z

etc/kayobe/environments/stackhpc-baremetal/ansible/baremetal-0-enroll-overcloud.yml

+            {% for key, value in ironic_properties.items() %}
+            --property {{ key }}={{ value }} \
+            {% endfor %}
+            --resource-class {{ ironic_resource_class }}


add for other variable

{% if ironic_management_interface %}
--management-interface {{ ironic_management_interface }}
{% endif %}

and then ironic_management_interface defined in group_vars/baremetal-redfish/ironic

assumptionsandg and others added 17 commits November 3, 2025 11:55

Initial skc baremetal commit

3eeadec

ansible directory and playbooks added to

f190830

skc-baremetal-environment

created stackhpc-sushy-baremetal environment

4725d97

Add baremetal config

6f7e510

editing playbooks and config

ea55fc3

config edits

a7df156

edit to controllers.yml

02e6321

lvm config

cb543de

config edits

bb16a3e

config edits

7b62965

Merge branch 'skc-baremetal-environment' of github.com:stackhpc/stack…

d89cc63

…hpc-kayobe-config into skc-baremetal-environment

edits baremetal 2 script in stackhpc-baremetal env

8071839

playbook and xml file edits

9ced382

config changes

0e41ba3

Merge branch 'stackhpc/2025.1' into skc-baremetal-environment

b0bc901

added auto-setup playbook for sushy env, edits for baremetal env play…

f83cfa4

…books

Merge branch 'skc-baremetal-environment' of https://github.com/stackh…

6b51b00

…pc/stackhpc-kayobe-config into skc-baremetal-environment

claudia-lola self-assigned this Nov 28, 2025

claudia-lola closed this Nov 28, 2025

claudia-lola temporarily deployed to Leafcloud November 28, 2025 17:22 — with GitHub Actions Inactive

claudia-lola temporarily deployed to SMS Lab November 28, 2025 17:22 — with GitHub Actions Inactive

claudia-lola temporarily deployed to Leafcloud November 28, 2025 17:22 — with GitHub Actions Inactive

claudia-lola temporarily deployed to SMS Lab November 28, 2025 17:22 — with GitHub Actions Inactive

claudia-lola had a problem deploying to SMS Lab November 28, 2025 17:22 — with GitHub Actions Failure

claudia-lola had a problem deploying to Leafcloud November 28, 2025 17:22 — with GitHub Actions Failure

claudia-lola had a problem deploying to SMS Lab November 28, 2025 17:22 — with GitHub Actions Failure

claudia-lola had a problem deploying to SMS Lab November 28, 2025 17:23 — with GitHub Actions Failure

JohnGarbutt reviewed Dec 2, 2025

View reviewed changes

assumptionsandg reviewed Dec 2, 2025

View reviewed changes

JohnGarbutt reviewed Dec 3, 2025

View reviewed changes

etc/kayobe/environments/stackhpc-baremetal/ansible/baremetal-1-check-bmc-up.yml Show resolved Hide resolved

JohnGarbutt reviewed Dec 3, 2025

View reviewed changes

etc/kayobe/environments/stackhpc-baremetal/ansible/baremetal-1-check-bmc-up.yml Show resolved Hide resolved

JohnGarbutt reviewed Dec 3, 2025

View reviewed changes

etc/kayobe/environments/stackhpc-baremetal/ansible/baremetal-1-check-bmc-up.yml Show resolved Hide resolved

JohnGarbutt reviewed Dec 3, 2025

View reviewed changes

etc/kayobe/environments/stackhpc-sushy-baremetal/ansible/vbmc-node.xml.j2 Show resolved Hide resolved

JohnGarbutt reviewed Dec 3, 2025

View reviewed changes

etc/kayobe/ipa.yml Show resolved Hide resolved

JohnGarbutt reviewed Dec 3, 2025

View reviewed changes

etc/kayobe/ipa.yml Show resolved Hide resolved

JohnGarbutt reviewed Dec 5, 2025

View reviewed changes

claudia-lola commented Dec 8, 2025

View reviewed changes

		@@ -0,0 +1,6 @@
		<network connections='1'>
		<name>vbmc-net</name>

Skc baremetal environment #2017

Skc baremetal environment #2017

Uh oh!

Conversation

claudia-lola commented Nov 28, 2025

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants