SpectroCloud/VertexInstall

From DER's LLC
Jump to navigation Jump to search

Vertex Installation Instructions

Vertex Installation

Pre Requisites

1. Needed Downloads

  • Binaries: airgap-base-ova (ex. spectro-airgap-podman-v3.1.4.ova)
  • Binaries: airgap-fips (ex. airgap-vertex-v4.5.11.bin)
  • Binaries: airgap-fips-scar-zip (ex. scar-airgap-vertex-v4.5.11.zip)
  • Capi OS Image: k8s_fips (ex. u-2004-0-k-1305-fips.ova)
  • Airgap Binaries: kubernetes-<version> (ex. airgap-vertex-pack-kubernetes-1.30.5.bin)
  • Airgap Binaries: kubernetes-<version> (ex. airgap-vertex-pack-kubernetes-1.29.9.bin)

2. vCenter Prep

  • Tag the DataCenter with k8s-region
  • Tag the Cluster with k8s-zone
  • Create a VM Folder called spectro-templates
  • Create a VM Folder called spectro-vms
  • Import the k8s_fips OVA (ex. u-2004-0-k-1305-fips.ova)
    • Rename Image to "r_u-2004-0-k-<version>-fips" (ex. r_u-2004-0-k-1305-fips)
    • Convert VM to Template.

3. Harbor Prep

  • Create a new Public Project (spectro-images)

4. OVA Setup

DOCS REFERENCE: https://docs.spectrocloud.com/vertex/install-palette-vertex/install-on-vmware/airgap-install/environment-setup/vmware-vsphere-airgap-instructions/

  • Deploy the OVA to vCenter (airgap-base-ova).
1. Machine name: sc-deploy
2. Folder: spectro-vms
3. Acknowledge the certificate.
4. Storage: DERS-HDD
5. Network: DERS-87
6. Set SSH Public Key: <opsman-key>
7. Default User Password: <ders>
  • Copy the vertex bin to the sc-deploy vm.
export SC_DEPLOY_IP="172.16.87.51"
scp -i ~/.ssh/opsman /nfs/Download/airgap-vertex-v4.5.11.bin ubuntu@$SC_DEPLOY_IP:/tmp/
scp -i ~/.ssh/opsman /nfs/Download/airgap-vertex-pack-kubernetes-1.30.5.bin ubuntu@$SC_DEPLOY_IP:/tmp/
scp -i ~/.ssh/opsman /nfs/Download/airgap-vertex-pack-kubernetes-1.29.9.bin ubuntu@$SC_DEPLOY_IP:/tmp/
  • SSH to the sc-deploy VM.
ssh -i ~/.ssh/opsman ubuntu@$SC_DEPLOY_IP
sudo --login
  • Run the BIN Files
#################
# SET VARIABLES #
#################
export OCI_IMAGE_REGISTRY=harbor.dersllc.com
export OCI_PACK_BASE=spectro-images
export OCI_PACK_REGISTRY=harbor.dersllc.com
export OCI_IMAGE_BASE=spectro-images
export SC_VERSION='v4.5.11'

####################
# Trust DERS Certs #
####################
sudo curl --insecure https://ders-gitlab.dersllc.com/ders/ders-proxy/-/raw/master/AddTrustExternalCARoot.crt > /usr/local/share/ca-certificates/ders-star-ca.crt
sudo curl --insecure https://ders-gitlab.dersllc.com/ders/vmware-se/-/raw/main/HomeLab/DERS-CA-CERT/ders-ca.cer > /usr/local/share/ca-certificates/ders-ssca.crt
sudo update-ca-certificates

###################
# Log-in via ORAS #
###################
oras login harbor.dersllc.com --username 'admin' --password '<Password>'

##################################
# Setup NFS Mount (NOT REQUIRED) #
##################################
apt-get -y install snapd unzip nfs-common ca-certificates
echo "172.16.85.15:/Download      /nfs/Download    nfs vers=4.0    0 0" >> /etc/fstab
mkdir -p /nfs/Download
mount -a

#################################
# Import Containers into Harbor #
#################################
chmod +x /tmp/airgap-vertex-*
/tmp/airgap-vertex-$SC_VERSION.bin --nodiskspace --target /nfs/Download/airgap-vertex-$SC_VERSION/
# If Setting up CLI is not present in the output run the following:
source /nfs/Download/airgap-vertex-$SC_VERSION/bin/functions.sh; cli_copy
/tmp/airgap-vertex-pack-kubernetes-*

####################################################################
# UNZIP Manifest in /var/www/html/manifests/<Version> on ders-plex #
####################################################################
# ssh to ders-plex
export SC_VERSION='v4.5.11'
mkdir -p /var/www/html/manifests/${SC_VERSION}
mv /nfs/Download/scar-airgap-vertex-${SC_VERSION}.zip /var/www/html/manifests/${SC_VERSION}
cd /var/www/html/manifests/${SC_VERSION}
unzip scar-airgap-vertex-${SC_VERSION}.zip
systemctl restart httpd

curl http://172.16.84.22:8710/manifests/${SC_VERSION}/roar/nickfury/versions.yaml

Vertex Install Steps

# SSH to sc-deploy and run:
palette ec install

# No palette CLI config file detected. One will be created.
# Management Plane Type: 
     Palette VerteX 
# Operating System: 
     ubuntu 
# Enable Ubuntu Pro (required for production)? [y/N]:  Yes 
# Ubuntu Pro token:  C12HPMun5ibCKAqtW%cqBpaL66RNjd 
# enabling experimental podman provider
# No kind clusters found.
# Cloud Type: 
     VMware vSphere 
##########################################################
# Spectro Cloud Artifact Repository (SCAR) Configuration #                                                                                                             
##########################################################                                                                                                                                                                                                                                                                                
# SCAR location: 
     http://172.16.84.22:8710/manifests/v4.5.11/ 
# SCAR username: 
     admin 
# SCAR password: 
     ******** 
# Allow Insecure Connection (Bypass x509 Verification)? [Y/n]: 
     Yes 
###################################
# Enter Environment Configuration #
###################################
# HTTPS Proxy (optional, hit enter to skip): 
# HTTP Proxy (optional, hit enter to skip): 
# Pod CIDR: 192.168.0.0/16
# Service IP Range: 10.96.0.0/12
# Retrieved version metadata. Using Spectro Cloud Version: 4.5.11
#######################
# Collecting Metadata #
#######################
# Kind Cluster Name: 
     spectro-mgmt-cluster 
#############################################
# Enter Pack & Image Registry Configuration #
#############################################                                                                                                                  
# Registry Type: 
     OCI 
# Registry Name: 
    harbor.dersllc.com 
# Registry Endpoint: 
    https://harbor.dersllc.com 
# Registry Base Content Path (optional, hit enter to skip): 
    spectro-images
# Allow Insecure Connection (Bypass x509 Verification)? [Y/n]: 
    Yes
# Registry Username (optional, hit enter to skip): 
    admin
# Registry Password (optional, hit enter to skip): 
    *********
# Enter 'Y' to pull images from public registries or 'N' to specify an OCI image registry
# Pull images from public registries? [Y/n]: 
    No
# Use the same OCI Registry for packs & images? [Y/n]: 
    Yes
# Registry Base Content Path (optional, hit enter to skip): 
    spectro-images
#####################################
# Enter vSphere Account Information #
#####################################
# vSphere Endpoint: 
    vcenter.dersllc.com
# vSphere Username (with domain): 
    [email protected]
# vSphere Password: 
    *********
# Allow Insecure Connection (Bypass x509 Verification)? [Y/n]: 
    Yes
##################################################
# Enter vSphere Enterprise Cluster configuration #
##################################################                                                                                                               
# Datacenter: 
    DERSLLC
# VM Folder: 
    spectro-vms
# Image Template Folder: 
    spectro-templates
# Cluster for Fault Domain: 
    Lab
# Network: 
    DERS-87
# Resource Pool: 
    Default (root resource pool for cluster: Lab)
# Select specific Datastore or use a VM Storage Policy: 
    Datastore
# Datastore: 
    DERS-HDD
# Unable to add another Fault Domain as no Clusters remain in Datacenter DERSLLC
# NTP servers (comma-separated domain names or IP addresses, optional) (optional, hit enter to skip): 
    172.16.84.21
# Configure SSH public key(s)
    ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDngCrc1Na1xES5nnSBHxw1MMcwEwFL4TpwbSTq4BlcKb4WUGE4AOXr4W4RenB6OTyLkHOeLNc2ptILF3PZQG44SZ+uZMBLhx82DYbMq75F6WDSd7wnHA0cL90ncXGoLnwk+UnNEg59zmhYbrMEVM5OS3k0Ll/EXUb9PUsE+SdEoKDG+84OiwCQnQ+DWr9R79NHwLKflOvIMtoZuFwjObQ7xbsTO27FhL8wbcUDqygVqq+6r6adyZ1yEuqhXRkzUgQWv/rIzATaLTZp5r3kCGRe+EkB6AlapwE1O139ZGuY4m/FlIeXO1Ty0mmF88dI0CsbFUJcKKnO07nzSBhQevRr
# Specify a static IP range for assigning static IPs to cluster node(s).
# The IP range must contain at least 5 IPs.	
# Start IP: 
    172.16.85.200
# End IP: 
    172.16.85.220
# Network Prefix: 
    22
# Gateway IP Address: 
    172.16.84.1
# Name servers (comma-separated IP addresses): 
    172.16.84.10
# Name server search suffixes (Optional) (optional, hit enter to skip): 
    dersllc.com
###################################################################
#  Enter vSphere Machine configuration for the Enterprise Cluster #
###################################################################
# Select combination: 
    S: 16 CPU, 32 GB memory, 60 GB storage, 20 GB database with 4 CPU limit and 8 GB memory limit
# Node Affinity: Enter 'y' to schedule all Palette pods on control plane nodes? [y/N]: 
    No

Vertex UI

https://vertex.dersllc.com

Troubleshooting

spectro mgmt self link creation is still pending

Error: 

spectro mgmt self link creation is still pending

Fix: 

Restart the spectrocluster Deployment

Failed to apply cert renewal plan for first time push of certs

Error: 

Failed to apply cert renewal plan for first time push of certs

Fix: 

Restart the Palette-Controller-Manager Deployment

No Helm Charts Showing up in Profile creation

Error: 

Helm results empty

Fix: 

Navigate to "Tenant Settings" -> Platform -> Platform Settings
Enable "Allow non-FIPS packs"
Enable "Allow non-FIPS features"


  • ??Download Certs
curl --insecure https://ders-gitlab.dersllc.com/ders/ders-proxy/-/raw/master/STAR_dersllc_com.crt > /opt/spectro/ssl/server.crt
curl --insecure https://ders-gitlab.dersllc.com/ders/ders-proxy/-/raw/master/dersllc-new.key > /opt/spectro/ssl/server.key
Retrieved from "http://wiki.dersllc.com/index.php?title=SpectroCloud/VertexInstall&oldid=343"