Search…
TVO-4.2
Offline upgrade TrilioVault Appliance
The offline upgrade of the TrilioVault Appliance is only recommended for hotfix upgrades. For major upgrades in offline environments, it is recommended to download the latest qcow2 image and redeploy the appliance.

Generic Pre-requisites

  • Please ensure to complete the upgrade of all the TVault components on the Openstack controller & compute nodes before starting the rolling upgrade of TVO.
  • The mentioned gemfury repository should be accessible from a VM/Server.
  • Please ensure the following points before starting the upgrade process:
    • No snapshot OR restore to be running.
    • Global job-scheduler should be disabled.
    • wlm-cron should be disabled & any lingering process should be killed. (This should already have been done during TrilioVault components upgrade on Openstack)
      • pcs resource disable wlm-cron
      • Check: systemctl status wlm-cron OR pcs resource show wlm-cron
      • Additional step: To ensure that cron is actually stopped, search for any lingering processes against wlm-cron and kill them. [Cmd : ps -ef | grep -i workloadmgr-cron]

Download and copy packages from VM/server to TVM node(s)

VM/Server must have internet connectivity and connectivity to Trilio gemfury repo

Download the required system packages

Download latest pip package
1
> pip download pip
Copied!

Download Trilio packages

Export the index URL
1
> export PIP_EXTRA_INDEX_URL=https://pypi.fury.io/triliodata-4-2/
Copied!
Download s3fuse package
1
> pip download --extra-index-url $PIP_EXTRA_INDEX_URL s3fuse --no-cache-dir --no-deps
Copied!
Download tvault-configurator package
1
> pip download --extra-index-url $PIP_EXTRA_INDEX_URL tvault-configurator --no-cache-dir --no-deps
Copied!
Download workloadmgr package
1
> pip download --extra-index-url $PIP_EXTRA_INDEX_URL workloadmgr --no-cache-dir --no-deps
Copied!
Download workloadmgrclient package
1
> pip download --extra-index-url $PIP_EXTRA_INDEX_URL workloadmgrclient --no-cache-dir --no-deps
Copied!
Download contegoclient package
1
> pip download --extra-index-url $PIP_EXTRA_INDEX_URL contegoclient --no-cache-dir --no-deps
Copied!

Copy the downloaded packages from VM/Server to TVM node(s)

All downloaded packages need to be copied from VM/server to all the TVM nodes.
  • Copy all the downloaded packages(listed below) from the VM/server to all the TVM nodes
    1. 1.
      pip
    2. 2.
      s3fuse
    3. 3.
      tvault-configurator
    4. 4.
      workloadmgr
    5. 5.
      workloadmgrclient
    6. 6.
      contegoclient

Upgrade packages on all TVO Node(s)

If any of the packages are already on the latest, the upgrade won’t happen. Make sure you should be present at right dir that means run below commands from where there all packages should be present

Preparation

Take a backup of the configuration files
1
> tar -czvf tvault_backup.tar.gz /etc/tvault /etc/tvault-config /etc/workloadmgr /home/stack/myansible/lib/python3.6/site-packages/tvault_configurator/conf/users.json
2
> cp tvault_backup.tar.gz /root/
Copied!
Activate the virtual environment
1
> source /home/stack/myansible/bin/activate
Copied!

Upgrade system packages

Run the following command on all TVM nodes to upgrade the pip package
1
> pip install --upgrade pip-21.1.3-py3-none-any.whl --no-deps
Copied!

Upgrade s3fuse/tvault-object-store

Run the following command on all TVM nodes to upgrade s3fuse
1
> pip install --upgrade s3fuse-4.1.94.3.tar.gz --no-deps
Copied!

Upgrade tvault-configurator

Run the following command on all TVM nodes to upgrade tvault-configurator
1
> pip install --upgrade tvault_configurator-4.1.94.5.tar.gz --no-deps
Copied!

Upgrade workloadmgr

Run the upgrade command on all TVM nodes to upgrade workloadmgr
1
> pip install --upgrade workloadmgr-4.1.94.5.tar.gz --no-deps
Copied!

Upgrade workloadmgrclient

Run the upgrade command on all TVM nodes to upgrade workloadmgrclient
1
> pip install --upgrade workloadmgrclient-4.1.94.tar.gz --no-deps
Copied!

Upgrade contegoclient

Run the upgrade command on all TVM nodes to upgrade contegoclient
1
> pip install --upgrade contegoclient-4.1.94.tar.gz --no-deps
Copied!

Post Upgrade Steps

Verify if the upgrade successfully completed or not.
1
> source /home/stack/myansible/bin/activate
2
> pip list | grep <package_name>
3
4
e.g.
5
(myansible) [[email protected] ~]# pip list | grep s3fuse
6
s3fuse 4.1.94.3
7
(myansible) [[email protected] ~]# pip list | grep configurator
8
tvault-configurator 4.1.94.5
9
(myansible) [[email protected] ~]# pip list | grep workloadmgr
10
workloadmgr 4.1.94.5
11
workloadmgrclient 4.1.94
12
(myansible) [[email protected] ~]# pip list | grep contego
13
contegoclient 4.1.94
Copied!
Restore the backed-up configuration files
1
> cd /root 2> tar -xzvf tvault_backup.tar.gz -C /
Copied!
Restart following services on all node(s) using respective commands
1
> systemctl restart wlm-api
2
> systemctl restart wlm-scheduler
3
> systemctl restart wlm-workloads
4
> systemctl restart tvault-config
5
6
(Required ONLY if TVault configured with S3 backend storage)
7
> systemctl restart tvault-object-store
Copied!
Enable wlm-cron service through pcs cmd, if TVO is configured with Openstack
1
> pcs resource enable wlm-cron
2
3
## run below command to check status of wlm-cron
4
> pcs status
Copied!
Enable Global Job Scheduler
Verify the status of the services, if TVO is configured with Openstack.
tvault-object-store will run only if TVault is configured with S3 backend storage
1
1## On All nodes 2> systemctl status wlm-api wlm-scheduler wlm-workloads tvault-config tvault-object-store | grep -E 'Active|loaded' 3## On primary node 4> pcs status 5> systemctl status wlm-cron
Copied!
Additional check for wlm-cron on the primary node, if TVO is configured with Openstack.
1
> ps -ef | grep workloadmgr-cron | grep -v grep
2
3
## Above command should show only 2 processes running; sample below
4
5
[[email protected] ~]# ps -ef | grep workloadmgr-cron | grep -v grep
6
nova 8841 1 2 Jul28 ? 00:40:44 /home/stack/myansible/bin/python3 /home/stack/myansible/bin/workloadmgr-cron --config-file=/etc/workloadmgr/workloadmgr.conf
7
nova 8898 8841 0 Jul28 ? 00:07:03 /home/stack/myansible/bin/python3 /home/stack/myansible/bin/workloadmgr-cron --config-file=/etc/workloadmgr/workloadmgr.conf
Copied!
Check the mount point using the “df -h” command if TVO is configured with Openstack