SpectroCloud/VertexInstall

Vertex Installation Instructions

Vertex Installation

Pre Requisites

1. Needed Downloads

• Binaries: airgap-base-ova (ex. spectro-airgap-podman-v3.1.4.ova)
• Binaries: airgap-fips (ex. airgap-vertex-v4.5.11.bin)
• Binaries: airgap-fips-scar-zip (ex. scar-airgap-vertex-v4.5.11.zip)
• Capi OS Image: k8s_fips (ex. u-2004-0-k-1305-fips.ova)
• Airgap Binaries: kubernetes-<version> (ex. airgap-vertex-pack-kubernetes-1.30.5.bin)
• Airgap Binaries: kubernetes-<version> (ex. airgap-vertex-pack-kubernetes-1.29.9.bin)

2. vCenter Prep

• Tag the DataCenter with k8s-region
• Tag the Cluster with k8s-zone
• Create a VM Folder called spectro-templates
• Create a VM Folder called spectro-vms
• Import the k8s_fips OVA (ex. u-2004-0-k-1305-fips.ova)
  • Rename Image to "r_u-2004-0-k-<version>-fips" (ex. r_u-2004-0-k-1305-fips)
  • Convert VM to Template.

3. Harbor Prep

• Create a new Public Project (spectro-images)

4. OVA Setup

DOCS REFERENCE: https://docs.spectrocloud.com/vertex/install-palette-vertex/install-on-vmware/airgap-install/environment-setup/vmware-vsphere-airgap-instructions/

• Deploy the OVA to vCenter (airgap-base-ova).

1. Machine name: sc-deploy
2. Folder: spectro-vms
3. Acknowledge the certificate.
4. Storage: DERS-HDD
5. Network: DERS-87
6. Set SSH Public Key: <opsman-key>
7. Default User Password: <ders>

• Copy the vertex bin to the sc-deploy vm.

export SC_DEPLOY_IP="172.16.87.51"
scp -i ~/.ssh/opsman /nfs/Download/airgap-vertex-v4.5.11.bin ubuntu@$SC_DEPLOY_IP:/tmp/
scp -i ~/.ssh/opsman /nfs/Download/airgap-vertex-pack-kubernetes-1.30.5.bin ubuntu@$SC_DEPLOY_IP:/tmp/
scp -i ~/.ssh/opsman /nfs/Download/airgap-vertex-pack-kubernetes-1.29.9.bin ubuntu@$SC_DEPLOY_IP:/tmp/

• SSH to the sc-deploy VM.

ssh -i ~/.ssh/opsman ubuntu@$SC_DEPLOY_IP
sudo --login

• Run the BIN Files

#################
# SET VARIABLES #
#################
export OCI_IMAGE_REGISTRY=harbor.dersllc.com
export OCI_PACK_BASE=spectro-images
export OCI_PACK_REGISTRY=harbor.dersllc.com
export OCI_IMAGE_BASE=spectro-images
export SC_VERSION='v4.5.11'

####################
# Trust DERS Certs #
####################
sudo curl --insecure https://ders-gitlab.dersllc.com/ders/ders-proxy/-/raw/master/AddTrustExternalCARoot.crt > /usr/local/share/ca-certificates/ders-star-ca.crt
sudo curl --insecure https://ders-gitlab.dersllc.com/ders/vmware-se/-/raw/main/HomeLab/DERS-CA-CERT/ders-ca.cer > /usr/local/share/ca-certificates/ders-ssca.crt
sudo update-ca-certificates

###################
# Log-in via ORAS #
###################
oras login harbor.dersllc.com --username 'admin' --password '<Password>'

##################################
# Setup NFS Mount (NOT REQUIRED) #
##################################
apt-get -y install snapd unzip nfs-common ca-certificates
echo "172.16.85.15:/Download      /nfs/Download    nfs vers=4.0    0 0" >> /etc/fstab
mkdir -p /nfs/Download
mount -a

#################################
# Import Containers into Harbor #
#################################
chmod +x /tmp/airgap-vertex-*
/tmp/airgap-vertex-$SC_VERSION.bin --nodiskspace --target /nfs/Download/airgap-vertex-$SC_VERSION/
# If Setting up CLI is not present in the output run the following:
source /nfs/Download/airgap-vertex-$SC_VERSION/bin/functions.sh; cli_copy
/tmp/airgap-vertex-pack-kubernetes-*

####################################################################
# UNZIP Manifest in /var/www/html/manifests/<Version> on ders-plex #
####################################################################
# ssh to ders-plex
export SC_VERSION='v4.5.11'
mkdir -p /var/www/html/manifests/${SC_VERSION}
mv /nfs/Download/scar-airgap-vertex-${SC_VERSION}.zip /var/www/html/manifests/${SC_VERSION}
cd /var/www/html/manifests/${SC_VERSION}
unzip scar-airgap-vertex-${SC_VERSION}.zip
systemctl restart httpd

curl http://172.16.84.22:8710/manifests/${SC_VERSION}/roar/nickfury/versions.yaml

Vertex Install Steps

# SSH to sc-deploy and run:
palette ec install

# No palette CLI config file detected. One will be created.
# Management Plane Type: 
     Palette VerteX 
# Operating System: 
     ubuntu 
# Enable Ubuntu Pro (required for production)? [y/N]:  Yes 
# Ubuntu Pro token:  C12HPMun5ibCKAqtW%cqBpaL66RNjd 
# enabling experimental podman provider
# No kind clusters found.
# Cloud Type: 
     VMware vSphere 
##########################################################
# Spectro Cloud Artifact Repository (SCAR) Configuration #                                                                                                             
##########################################################                                                                                                                                                                                                                                                                                
# SCAR location: 
     http://172.16.84.22:8710/manifests/v4.5.11/ 
# SCAR username: 
     admin 
# SCAR password: 
     ******** 
# Allow Insecure Connection (Bypass x509 Verification)? [Y/n]: 
     Yes 
###################################
# Enter Environment Configuration #
###################################
# HTTPS Proxy (optional, hit enter to skip): 
# HTTP Proxy (optional, hit enter to skip): 
# Pod CIDR: 192.168.0.0/16
# Service IP Range: 10.96.0.0/12
# Retrieved version metadata. Using Spectro Cloud Version: 4.5.11
#######################
# Collecting Metadata #
#######################
# Kind Cluster Name: 
     spectro-mgmt-cluster 
#############################################
# Enter Pack & Image Registry Configuration #
#############################################                                                                                                                  
# Registry Type: 
     OCI 
# Registry Name: 
    harbor.dersllc.com 
# Registry Endpoint: 
    https://harbor.dersllc.com 
# Registry Base Content Path (optional, hit enter to skip): 
    spectro-images
# Allow Insecure Connection (Bypass x509 Verification)? [Y/n]: 
    Yes
# Registry Username (optional, hit enter to skip): 
    admin
# Registry Password (optional, hit enter to skip): 
    *********
# Enter 'Y' to pull images from public registries or 'N' to specify an OCI image registry
# Pull images from public registries? [Y/n]: 
    No
# Use the same OCI Registry for packs & images? [Y/n]: 
    Yes
# Registry Base Content Path (optional, hit enter to skip): 
    spectro-images
#####################################
# Enter vSphere Account Information #
#####################################
# vSphere Endpoint: 
    vcenter.dersllc.com
# vSphere Username (with domain): 
    [email protected]
# vSphere Password: 
    *********
# Allow Insecure Connection (Bypass x509 Verification)? [Y/n]: 
    Yes
##################################################
# Enter vSphere Enterprise Cluster configuration #
##################################################                                                                                                               
# Datacenter: 
    DERSLLC
# VM Folder: 
    spectro-vms
# Image Template Folder: 
    spectro-templates
# Cluster for Fault Domain: 
    Lab
# Network: 
    DERS-87
# Resource Pool: 
    Default (root resource pool for cluster: Lab)
# Select specific Datastore or use a VM Storage Policy: 
    Datastore
# Datastore: 
    DERS-HDD
# Unable to add another Fault Domain as no Clusters remain in Datacenter DERSLLC
# NTP servers (comma-separated domain names or IP addresses, optional) (optional, hit enter to skip): 
    172.16.84.21
# Configure SSH public key(s)
    ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDngCrc1Na1xES5nnSBHxw1MMcwEwFL4TpwbSTq4BlcKb4WUGE4AOXr4W4RenB6OTyLkHOeLNc2ptILF3PZQG44SZ+uZMBLhx82DYbMq75F6WDSd7wnHA0cL90ncXGoLnwk+UnNEg59zmhYbrMEVM5OS3k0Ll/EXUb9PUsE+SdEoKDG+84OiwCQnQ+DWr9R79NHwLKflOvIMtoZuFwjObQ7xbsTO27FhL8wbcUDqygVqq+6r6adyZ1yEuqhXRkzUgQWv/rIzATaLTZp5r3kCGRe+EkB6AlapwE1O139ZGuY4m/FlIeXO1Ty0mmF88dI0CsbFUJcKKnO07nzSBhQevRr
# Specify a static IP range for assigning static IPs to cluster node(s).
# The IP range must contain at least 5 IPs.	
# Start IP: 
    172.16.85.200
# End IP: 
    172.16.85.220
# Network Prefix: 
    22
# Gateway IP Address: 
    172.16.84.1
# Name servers (comma-separated IP addresses): 
    172.16.84.10
# Name server search suffixes (Optional) (optional, hit enter to skip): 
    dersllc.com
###################################################################
#  Enter vSphere Machine configuration for the Enterprise Cluster #
###################################################################
# Select combination: 
    S: 16 CPU, 32 GB memory, 60 GB storage, 20 GB database with 4 CPU limit and 8 GB memory limit
# Node Affinity: Enter 'y' to schedule all Palette pods on control plane nodes? [y/N]: 
    No

Troubleshooting

ERROR

spectro mgmt self link creation is still pending

FIX

Restart the spectrocluster Deployment

ERROR

Failed to apply cert renewal plan for first time push of certs

FIX

Restart the Palette-Controller-Manager Deployment

• ??Download Certs

curl --insecure https://ders-gitlab.dersllc.com/ders/ders-proxy/-/raw/master/STAR_dersllc_com.crt > /opt/spectro/ssl/server.crt
curl --insecure https://ders-gitlab.dersllc.com/ders/ders-proxy/-/raw/master/dersllc-new.key > /opt/spectro/ssl/server.key