This section is the part of the OnApp installation procedure.

Install Control Panel Server > Install Compute Resources > Install Data Stores > Install Backup Server > Download and Configure Templates on Control Panel Server > Configure Cloud

Once the Control Panel server has been installed successfully, you can follow one of two processes to set up Xen or KVM compute resources:

To deploy OnApp and vCloud integration, refer to vCloud Setup and Upgrade section of OnApp and vCloud Director Configuration Guide.

We strongly recommend that you avoid creating mixed compute zones:

  • do not add CloudBoot and static boot compute resources to one compute zone
  • do not add both XEN and KVM compute resources to one zone

The reason is that XEN VSs cannot migrate/failover to a KVM compute resource and KVM VSs cannot migrate/failover to a XEN compute resource.



Install CloudBoot Compute Resources


Follow this method to enable CloudBoot for your compute resources. CloudBoot compute resource installation enables dynamic boot of compute resource servers without any persistent installation requirements. The servers must support and have PXE boot enabled on the Network Interface Card (setup in the BIOS if not already enabled by default). See Configure CloudBoot Settings in BIOS for details. We strongly recommend you to deploy one or more backup servers for backups and VS provisioning when using CloudBoot functionality.

  1. Enable CloudBoot in the Control Panel:

    1. Go to Settings > Configuration > System > CloudBoot

    2. Scroll down to the CloudBoot section and check the Enable box.

  2. Enable Storage in the Control Panel:

    1. Go to Settings > Configuration > System OnApp Storage
    2. Scroll down to the OnApp Storage section and check the Enable OnApp Storage box. 

    3. Tick the Use Local Read Path check box to minimise the network throughput dependency for read heavy workloads.

  3. Enter IP addresses for static content target and Control Panel server CloudBoot interface:

    Static content, such as CloudBoot images, kernels, virtual server templates, can be hosted on a standalone NFS server if you wish. The default configuration is to install everything on the Control Panel server.
    Enter the relevant IPs in Settings > Configuration > System CloudBoot

  4. Add IP address range for compute resources:

    Settings > Compute resources > CloudBootIPs > New IP Address

  5. Power on servers and allow them to boot the default image.

    Add servers to the Control Panel by selecting MAC addresses and assigning IP address

    Settings > Compute resources > Add a new CloudBoot Compute resource

    If you want to expose drives in compute resources to OnApp Storage, our integrated storage platform, then you must select them at this point.
    For more information on setting up and configuring CloudBoot, see the CloudBoot Compute resources section of the Admin guide.

    To increase dom0 memory for all new Xen compute resources,  edit the dom0 value in the /tftpboot/pxelinux.cfg/template-xen file on the CP server.

    To increase dom0 memory for a single Xen compute resource, edit the /tftpboot/pxelinux.cfg/xx-xx-xx-xx-xx-xx file, where you have to replace the x's with your compute resource's management NIC MAC address.

  6. CloudBoot compute resources mount the following locations automatically at boot:
    • /tftpboot/export/centos5/xen to /.ro
      The path may vary depending on the compute resource template used.

    • /data to /onapp/tools/recovery

    • /tftpboot/images/centos5/ramdisk-xen to /cloudboot/centos5/ramdisk-xen
      The path may vary depending on the compute resource template.

    The NFS server from which these are mounted is defined by the Static Config target parameter (see Edit System Configuration section for details). You can set the default Control Panel server IP to any other server. This change will affect all CloudBoot compute resources.

    The following paths must be available in the static config target to make it possible to use CloudBoot:

    • /tftpboot/export
    • /data
    • /tftpboot/images

    Compute resources will use local templates (mounted from Static Config target) during the server provisioning if the Use SSH file transfer configuration setting is disabled or the template has null backup_server_id.

  7. If you do not have a Dedicated Backup Server in place, please use Custom Config to mount /onapp/templates and /onapp/backup from your Control Panel server or another NFS export.

  8. After you have installed CloudBoot compute resource procced to the Configure CloudBoot Settings in BIOS section.


    If you do not have a dedicated backup server you must mount your Template and Backup repository to the Compute resource for VS provisioning and backups to work, for example from your Control Panel server:

    Add to /etc/exports on the Control Panel server:




    Add to Custom Config on the Compute resource and run them manually on the command line (In this example we are mounting from

    mkdir -p /onapp/backups && mount -t nfs /onapp/backups

    mkdir -p /onapp/templates && mount -t nfs /onapp/templates


Configure CloudBoot Settings in BIOS


Your BIOS settings may vary from the example provided in this section.

To use PXE boot, you have to make sure it is enabled in BIOS. To do so:

  1. Select the required ethernet card supporting PXE as a boot device:

  2. After that, go to the Advanced settings > PCI/PnP configuration.

  3. In the Advanced settings, select the first/primary Onboard LAN/NIC Option ROM and press Enter.

    Use up and down arrow keys to set Option ROM settings to enabled and press Enter.

    Press Escape key to return to the Advanced menu.

  4. Set local disk as a second boot device.


Configure InfiniBand


Your hardware must meet the following requirements for Ethernet mode utilization:

  • VPI enabled switches (including a proper license key).
  • VPI adapter cards (HCAs).

To set up a compute resource to operate in IB/Ethernet mode on the SAN network:

  1. Add new compute resource based on boot MAC from UI, but do not configure storage yet .
  2. Log in to the compute resource via SSH and run the following commands:  

     HV# /sbin/connectx_port_config -n 

     Choose Ethernet mode, and run:

    HV# mkdir -p /.rw/overlay/etc/infiniband
    HV# cp -a /etc/infiniband/connectx.conf /.rw/overlay/etc/infiniband
    HV# init 6
  3. After the compute resource reboots, perform the CloudBoot compute resource setup, as described in Create CloudBoot Compute resource.
  4. Run the following script on the Control Panel server:

    CP# cd /tftpboot/images/centos5/diskless/snapshot
    CP# cp -Rp default/overlay <MAC_OF_HV_MGT_NIC>/
  5. Reboot the compute resource via UI.
  6. After that, you will be able to select the InfiniBand interface as a storage NIC.
  7. Then you can safely remove the /tftpboot/images/centos5/diskless/snapshot/default/overlay directory.

Current limitations:

  • IB in Ethernet mode is only supported for Centos6/KVM nodes. It will not work with CentOS5 / Xen.
  • InfiniBand is only supported for the SAN network, not PXE boot.

Install Static Compute Resources


Before you proceed

  1. Install base CentOS packages on the local drive before compute resource installation, depending which virtualization method you choose:
    • Xen 3 compute resources: CentOS 5.x x64  
    • Xen 4 compute resources: CentOS 6.x x64  
    • KVM compute resources: CentOS 5.x x64 or CentOS 6.x x64
  2. We recommend installing CentOS from the minimal CentOS ISO for static compute resources.
  3. Disable CPU power-saving features in BIOS before you proceed to the compute resource installation.
  4. If you are not using a dedicated backup server in your cloud setup, configure NFS server with the following options to preserve files owner and group settings during template unpacking on NFS storage:  
    • no_root_squash
    • no_all_squas
  5. Pay attention that smart and baremetal servers cannot be installed using the static compute resource installation method.


To install a compute resource:

  1. Add the compute resource to your cloud using the OnApp Control Panel: Settings > Compute resources > Add New Compute resource
    Make sure the compute resource is visible in the Control Panel, and at this point showing as inactive.

  2. Update your server:

    bash# yum update
  3. Download the OnApp repository:

    bash#> rpm -Uvh
  4. Install the OnApp compute resource installer package:

    bash#> yum install onapp-hv-install 
  5. Update OS components using the following command:

    For XEN

    bash# /onapp/onapp-hv-install/ -y


    For KVM

    bash# /onapp/onapp-hv-install/ -y
  6. Edit custom compute resource configuration. Custom values must be set before the installer script runs.

    If deploying XEN onto a server running CentOS 6, it is important to specify a number for XEN_DOM0_MAX_VCPUS. We recommend that this is set to 2 if the compute resource has 12 cores or less. Or 4 if the compute resource has more than 12 cores.

    #vi /onapp/onapp-hv.conf
    • Default server to sync time on the compute resource
    • Xen HV (Domain-0) related configuration
    4.2.x and higher versions only:
    • The number of loopback devices created
    • The maximum size of the connection tracking table.

      The value can't be greater than 65536 if the total memory of Xen Domain-0 or KVM is less thn 1Gb.
      The value could be doubled (or even more, depends on memory amount).
    • The divisor to calculate the hash table. The recommended value is 8.
    hashsize = nf_conntrack_max / 8
    • Outdated Xen compute resource's (Domain-0) configuration parameters
  7. Run the OnApp compute resource installer script:



    /onapp/onapp-hv-install/ [-c CONFIG_FILE] [-a] [-y] [-t] [-s] [-v HV_VERSION] [-p API_VERSION] [-h]



    custom installer configuration file. Otherwise, preinstalled one is used.


    do NOT be interactive. Process with automatic installation.


    custom Compute resource Tools version


    custom StorageAPI version


    update OS packages (except for OnApp provided) on the box with 'yum update'.


    initiate Recovery templates and ISO(s), which are used to provision FreeBSD guests, download

    The download is initiated if '-a' option is used


    skip packages management: install, remove, upgrade


    print this info


    • Run the OnApp compute resource installer script for Xen compute resources:

      bash#> /onapp/onapp-hv-install/ 
    • Run the OnApp compute resource installer script for KVM compute resources:

      bash#> /onapp/onapp-hv-install/
  8. Configure the compute resource for your cloud. This step is also required for the SNMP statistics receiver configuration:

    bash#> /onapp/onapp-hv-install/ -h <CP_HOST_IP> -p [HV_HOST_IP] -f <FILE_TRANSFER_SERVER_IP> -b <HV_BSNET_IP>


    /onapp/onapp-hv-install/[-h CP_HOST_IP] [-p HV_HOST_IP] [-b HV_BSNET_IP] [-f FTS_IP] [-a|-i [USER:PASSWD]] [-s] -? 


    -h CP_HOST_IP

    FQDN or IP Address of the management server which should receive all status reports and is authoritative for this compute resource

    -p HV_HOST_IP

    FQDN or IP Address of Server (the Compute resource) which will serve all stats related and other requests send by the CP_HOST_IP.

    Used by snmpd, snmptrapd and StorageAPI.

    -b HV_BSNET_IP

    Compute resource's IP Address from Backup Servers' network

    Used to bind the SCSI target daemon.

    -f FTS_IP

     File Transfer Server FQDN or IP address, used for daily cron update recovery ISO by


     Install AoE


     Install sshfs


     Print this help info

  9. Reboot the compute resource to complete the installation:

    bash#> shutdown -r now
  10. Generate SSH keys:

    OnApp requires SSH keys to access various elements of the cloud. The script provided will generate and transfer keys as necessary. The script needs to run on your Control Panel server. It will overwrite any keys that already exist, so if you have custom keys already installed you will need to add them again after running the script. The script will ask you for login details to various servers during the execution. Please follow the onscreen instructions.


  11. If you are installing a new cloud, SSH into your Control Panel server then download and run the script:

    bash#> wget
    bash#> /bin/sh
  12. If you are adding additional compute resources to an existing cloud, update the authorized_keys file by running the following script on the Control Panel server:

    bash#> ssh-copy-id -i /home/onapp/.ssh/ root@HV_HOST_IP
  13. Mount the locations for templates and backups:

     If you do not have a dedicated backup server you must mount your Template and Backup repository to the compute resource for VS provisioning and backups to work, for example from your Control Panel server:

    Add to /etc/exports on the Control Panel server then reboot:



     Add to /etc/rc.local on the Compute resource and run them manually on the command line (In this example we are mounting from

    mkdir -p /onapp/backups && mount -t nfs /onapp/backups

    mkdir -p /onapp/templates && mount -t nfs /onapp/templates

  14. Mount ISO locations:

    To rebuild a VS from ISO, it is required to mount and share the location where the ISOs are stored at CP with all the compute resources. When the virtual servers are booted from the ISOs, the ISO is taken from the compute resource server. The location is preconfigured at onapp.yml config file:

    • iso_path_on_cp - specifies the location where ISOs are stored on the Control Panel server. By default the location is /data. You can change it to any other suitable location. Make sure that this location is shared with the specified iso_path_on_hv location.
    • iso_path_on_hv - specifies the location where ISOs are located on the compute resource servers. By default the location is /data.  You can change it to any other suitable location with the onappowner and read/write access. Make sure that this location is mounted to the specified iso_path_on_cp location.

    CloudBoot compute resources mount the /data location automatically at boot to the /onapp/tools/recovery on compute resource.

    ISOs can be hosted on a dedicated server at any desired location with an arbitrary name if you wish. In this case it is necessary to mount the ISOs' location on this server to the Control Panel iso_path_on_cp directory and all the compute resources' iso_path_on_hv locations. This can be a backup server to avoid the excess usage of the Control Panel's space.


#trackbackRdf ($trackbackUtils.getContentIdentifier($page) $page.title $trackbackUtils.getPingUrl($page))
  • No labels