Release Notes

​
From TVK version 2.9.0 forward, documentation will only be released for major versions. However, release notes shall still be added to this page for minor versions.
2.10.5
Release Date
2022-09-02
What's New
1.With this feature, TVK can accept the annotations as input. These annotations can be passed to all jobs and deployments. This feature is specifically implemented to skip the sidecar insertion by service mesh like Istio or a security platform like Portshift.
2.Added support to specify the log level for data mover. Earlier, we had to run some temporary data mover pod, enable the log level and debug the issue. Users can specify the logging level in the k8s-triliovault-config now. In case of data mover failures, the user needs to specify datamoverLogLevel: Debug in k8s-triliovault-config configmap and check the logs.
3.In the case of non-CSI volumes, we are taking backup of PV and PVC configuration. While restoring such configuration, the transformation for PV configuration was not supported with the old TVK version. PV transformation support has been added now.
Bugs Fixed
1.Fixed invalid encryption key issues. Webhook was validating the encryption key to avoid backup failures because of an invalid encryption key.
2.The cluster backup plan continuously went in InProgress and Unavailable state if namespace matching labelSelectors is not present. This has been fixed.
3.Fixed the ambiguous license error message
4.On OCP 4.11 version, the triliovault-dex pod failed because of recent k8s changes in handling SA and tokens. This has been fixed.
Known Issues:
A known issue exists in which some users may experience TrilioVault pods going into an OOMKilled state. This can happen in environments where many objects exist, for which additional processing power is needed. Users may easily adjust their environment’s memory and CPU limits as a workaround for this issue. Please refer to the troubleshooting section to find more details on achieving this.
Data browsing for encrypted backups is not yet supported.
2.10.4
Release Date
2022-08-20
Bugs Fixed
Restore from a backup using the target browser functionality was not working. It is fixed in this release.
2.10.3
Release Date
2022-08-17
What's New
UI Customization
1.Logo: Logo of our app (Places affected are Login page, Left navbar).
2.Favicon: The icon which we see on the tab.
3.CSS: The whole CSS (theme, font, alignment) of the app can be changed by targeting those elements classes and writing custom CSS
4.Login page text: It should be a JSON file where the custom text will be provided based on that login page text will get changed.
Introduced a new option on S3 target spec to ignore client certification validation
DEX support is enhanced to support multiple connector types in a generic format
Added support for custom resource transformation during a restore operation
Bugs Fixed
Cinder snapshots were not getting deleted when Kubernetes was configured to use the OpenStack Cinder CSI snapshot driver.
Target PVCs were getting backed up when the backup plan was using gvkSelector. Now TVK will exclude Target PVCs from backup.
Container image backups were failing with immutable backup targets. This has been fixed.
NFS Target PVC storage class names were created with a random name. Since the name is random, it is difficult to exclude the storage from the storage quota. 2.10.3 creates a storage class with a well-known name.
Increased resource limits of the control plane and web backend pods.
Known Issues
A known issue exists in which some users may experience TrilioVault pods going into an OOMKilled state. This can happen in environments where many objects exist, for which additional processing power is needed.  users may easily adjust their environment’s memory and CPU limits as a workaround for this issue. Please refer to the troubleshooting section to find more details on achieving this.
Data browsing for encrypted backups is not yet supported.
2.10.2
Release Date
2022-08-01
What's New
No new features are provided as part of this release.
Bugs Fixed
TVK Versions <= TVK-2.10.1 had a timeout issue (OpenShift login not happening because of application timeout). We have handled this and increased the timeout to 300 seconds. This timeout value will be configurable in a future release.
With previous TVK versions, the exporter was failing while serving metrics. This has been fixed.
With previous TVK, Image backups were failing with service account issues. This has been fixed.
Known Issues/Limitations
​
A known issue exists in which some users may experience TrilioVault pods going into an OOMKilled state. This can happen in environments where a large number of objects exist, for which additional processing power is needed. As a workaround for this issue, users may easily adjust their environment’s memory and CPU limits. Please refer to the troubleshooting section to find more details on achieving this.
Data browsing for encrypted backups is not yet supported.
Image backups are failing with immutable targets. This will be handled in an upcoming release.
Restore operation along with container images might fail in one case. If the user is restoring container images in a different registry/repository, then we need to update the image field in all the resources at the time of restore. But if a user is restoring container images in a different registry/repository and having an operator to restore with custom resources which are creating resources like deployment, jobs, pods, statefulsets, then the logic to update the image field in these resources is not supported yet. So, resources created by custom resources will end up using old images i.e. not the restored container images.
2.10.0
Release Date
2022-07-11
What's New
The TVK UI has been updated for the backup and restore workflows. Form wizards have been added to make workflows simpler and easy to access for users.
Backup and restore support has been added for user application's container images. For any application in kubernetes, the container images are an important building block on which the entire application relies on to run. These images are pulled from a registry for the containers to use. 

Previously, we supported the backup of the application, but the container images were not backed up. Given that the registry image could be deprecated and deleted, there was always the potential that you could not restore your backup and run the restored application. Our backups were dependent on the external registries to have the images we used in our application. This image backup and restore feature enables backups to be self-reliant, which can be restored in any environment, without depending upon the registries of the backup.
Data browsing support has been added from this release, enabling users to browse any application's backed up data. Previously, target browser support was added in TVK which enabled users to browse the backup stored on the target. As part of backups, we store the data part of the application in a disk, but until now, support for browsing the content of data disk was not part of target browser. From this release, we have added support to browse the content of data disk. Users can view the backend application's data as a part of data browsing.
Bugs Fixed
The cleanup sequence has been updated to fix a bug causing the VolumeSnapshot to not be deleted. This is specific to Cinder storage.
With several Kubernetes distributions, a login issue was experienced whilst using kubeconfig. This issue has been fixed from this version.
A fix has been provided for an issue where configmaps for backups were not being cleaned up after backups. 
In previous versions, incremental backup was working for addition/deletion of files/directories. If the same file was updated, then the complete file was being backed up in incremental backups. This bug is now fixed, so that only the incremented data of the file will be backed up.
An intermittent issue which caused the backup-cleanup pod to get stuck in the containerCreating state has now been fixed. 
In previous versions, the order of clusters in a multiple cluster scenario was random. This has been fixed now, so that clusters are displayed in alphabetical order.
Previously, during licensing an error message was wrongly displayed, but this has now been fixed so that the message shows the CPU count.
Known Issues/Limitations
A known issue exists in which some users may experience TrilioVault pods going into a OOMKilled state. This can happen in environments where a lot of objects exist, for which additional processing power is needed. As a workaround for this issue, users may easily adjust their environment's memory and CPU limits. Please refer to the troubleshooting guideOOMKilled Issues to find more details on achieving this.
Data browsing for encrypted backups is not yet supported.
There is one case where the restore operation with the container images restore can fail. If a user is restoring container images in a different registry/repository, then the image field must be updated in all the resources at the time of the restore. However, if a user is restoring container images in a different registry/repository, with an operator restoring with custom resources (which create resources like deployment, jobs, pods, and statefulesets), then logic to update the image field in these resources is not supported yet. So, resources created by custom resources will end up using old images; i.e. not the restored container images.
2.9.4
Release Date
2022-06-27
What's New
No new features are provided as part of this release.
Bugs Fixed
A fix has been provided for an issue where the metamover snapshot job occasionally failed with a 'backupScope is not supported' error displayed.
A fix relating to the offline installer has been implemented. Previously it was failing to push images if the local registry container was not in a running state. The fix causes the trilio-registry container to be deleted and then recreated, if it is not in a running state.
Support has been added for multi-namespace. An additional field has been added in the metrics. The new Kind field differentiates between backup plans associated with cluster backup and those associated with normal backup.
The resources restore sequence has been fixed as per helm standard practice.
Known Issues/Limitations
A known issue exists in which some users may experience TrilioVault pods going into a OOMKilled state. This can happen in environments where a lot of objects exist, for which additional processing power is needed. As a workaround for this issue, users may easily adjust their environment's memory and CPU limits. Please refer to the troubleshooting section to find more details on achieving this.
2.9.3
Release Date
2022-06-16
What's New
Support has been added for NFS-based PVs, which can also be used for non-CSI PVs. The user must specify the provisioner in the k8s-triliovault-config configuration map. TVK will not take data backup of the PVs created by that provisioner.
The TVK configuration map has been updated to improve structure and make it more generic.
In the UI, it is now possible to create a namespace in all restore workflows.
A Darksite installer has been added.
PriorityClass support has been added to enable TVK pod scheduling decisions to be made according to user requirements.
Logging has been enhanced across all components in TVK, including addition of an effective logging structure and configurable logging level.
A stack has been added for Observability. Logging and monitoring can now be executed easily with Grafana.
Bugs Fixed
A workaround has been added for a rsync connection timeout. Previously, during incremental data backup, rysnc disconnected and the user experienced an error connection time out. If this issue is experienced, now the workaround fix is to re-attempt the rsync operation execution during incremental backup of the data.
An LDAP connector SSL issue has been fixed.
An issue has been fixed relating to a restored application not working. A flag has been added to decide whether to use the NS UID range or restore the UID along with restore operation.
Multiple minor issue fixes and improvements were made to the UI.
Known Issues/Limitations
A known issue exists in which some users may experience TrilioVault pods going into a OOMKilled state. This can happen in environments where a lot of objects exist, for which additional processing power is needed. As a workaround for this issue, users may easily adjust their environment's memory and CPU limits. Please refer to the troubleshooting section to find more details on achieving this.
If a user specifies the cleanupOnFailure flag in restore CR, then sometimes the cleanup job is created infinitely. We are working on this issue with priority and will create patch as soon as this is fixed.
Multi-namespace support is not yet available in the Observability stack, but it is currently in progress.
2.9.2
Release Date
2022-05-13
What's New
No new features are provided as part of this release.
Bugs Fixed
In previous versions of TVK, the Dex pod was going into a CrashLoopBackOff state on OCP IBM cloud. This issue has now been fixed.
Previously, if the user application had symlinks in the data that pointed to an external data source, then backups failed. This symlink behaviour has now been fixed.
The cleanupOnFailure flag in restore was previously causing an issue where an infinite number of cleanup pods were being created. This issue is now fixed.
In the case of helm application backups, if any helm application use subcharts with local repositories, we allow the restore of such backup in the namespace with same name. This means that in this scenario, the restore is restricted. Previously there was no warning available to advise users of this restriction, but a UI warning has now been added to make things clearer.
Known Issues/Limitations
A known issue exists in which some users may experience TrilioVault pods going into a OOMKilled state. This can happen in environments where a lot of objects exist, for which additional processing power is needed. As a workaround for this issue, users may easily adjust their environment's memory and CPU limits. Please refer to the troubleshooting section to find more details on achieving this.
If a user specifies the cleanupOnFailure flag in restore CR, then sometimes the cleanup job is created infinitely. We are working on this issue with priority and will create patch as soon as this is fixed.
2.9.1
Release Date
2022-05-06
What's New
No new features are provided as part of this release.
Bugs Fixed
Previously, in the case of swift storage with s3proxy, get_object_lock_configuration API was not throwing an exception if object lock was not enabled on the storage. Normally, the API should return an error in response to this scenario, but instead it was returning a success with an empty response. This issue has now been fixed in this version.
Known Issues/Limitations
A known issue exists in which some users may experience TrilioVault pods going into a OOMKilled state. This can happen in environments where a lot of objects exist, for which additional processing power is needed. As a workaround for this issue, users may easily adjust their environment's memory and CPU limits. Please refer to the troubleshooting section to find more details on achieving this.
If a user specifies the cleanupOnFailure flag in restore CR, then sometimes the cleanup job is created infinitely. We are working on this issue with priority and will create patch as soon as this is fixed.
2.9.0
Release Date
2022-05-05
What's New
From this version forward, documentation will only be released for major versions., e.g. 2.8.0 and 2.9.0. However, release notes shall be published and added to this page for all versions.
A new flag has been added to Backup that enables a user to specify how helm resources are to be backed up. In previous versions of TVK, users were not able to backup helm applications as a helm applications in namespace backups. Instead, helm applications were backed up by resources like label-based backups. After restoring from such backups, the helm consistency is not maintained. 

From this version, a RetainHelmApps flag is provided for namespace/multi-namespace backups, which can be specified in backup plans and subsequently propagated to associated backups. If this flag is specified as true, TVK will backup helm applications using helm way during namespace-level backup. In other words, after the restore of this kind of backup, the user will find the helm application exactly as it is supposed to be. To use this feature, it is recommended for the user to create a new namespace/multi-namespace backupplan.
A limit on the number of queued backups has now been introduced. With previous versions of TVK, no such limit existed. 
The Mirantis MKE symbol is now added for Mirantis clusters.
Bugs Fixed
Previously, some customers were experiencing olm-operator restarts. This issue has now been fixed.
Previously, in some cases, the restore CR update was failing and it was causing subsequent failures in overall restore operation. This issue has now been fixed.
An issue related to Namespace backups has been fixed. Previously one of the TVK resources was being included as a part of Namespace backup. 
Previously, following TVK  upgrade, proxy variables were not being propagated. This has been fixed from this version.
In previous versions, mutation and validation configurations were not being updated in some upgrade scenarios. This has now been fixed.
For multi-cluster scenarios, previously the secondary added cluster entered an inactive state. This issue has now been fixed.
Known Issues/Limitations
A known issue exists in which some users may experience TrilioVault pods going into a OOMKilled state. This can happen in environments where a lot of objects exist, for which additional processing power is needed. As a workaround for this issue, users may easily adjust their environment's memory and CPU limits. Please refer to the troubleshooting section to find more details on achieving this.
If a user specifies the cleanupOnFailure flag in restore CR, then sometimes the cleanup job is created infinitely. We are working on this issue with priority and will create patch as soon as this is fixed.
2.8.2
Release Date
2022-04-19
What's New
No new features are provided as part of this release.
Bugs Fixed
In the previous version, installation issues were experienced by some customers. This issue has now been resolved in v2.8.2.
Known Issues/Limitations
A known issue exists in which some users may experience TrilioVault pods going into a OOMKilled state. This can happen in environments where a lot of objects exist, for which additional processing power is needed. As a workaround for this issue, users may easily adjust their environment's memory and CPU limits. Please refer to the troubleshooting section to find more details on achieving this.
2.8.1
Release Date
2022-04-18
What's New
A status filter has been added and a creationTimestamp, completionTimestamp ordering filters for backup in targetBrowser. Those filters are required for latest backup selection while Disaster Recovery plan creation.
Support has been added for reusing restore transforms. Previously created transforms can now be reused while creating a new restore.
The TVM name is now displayed instead of primary in left side nav panel.
Previously in the UI, the primary cluster was displayed in the side panel with the name Primary. From 2.8.1, the instance name is displayed in the navigation for the primary cluster.
The More/Less link has been removed within the Tile view of cluster management. Now the additional parts are displayed by default in a scrollable container.
All time zone calculation has shifted from Asia time zone to UTC.
With previous TVK versions, backup and restore performance was slow, especially when there were a large number of files. From 2.8.1, backup and restore performance has been improved.
When users are prompted to select a Hook, Target, or Policy option when performing tasks like Backupplan creation, all existing options are listed first. This means that users must scroll to the bottom of the respective dropdown list to see the Create New option. Create New is now fixed to the top of each of these dropdown lists, making it easier for users.
Bugs Fixed
Previously, Preflight created the volumesnapshotclass with fix name and it caused issue with multiple storage classes. From 2.8.1, Preflight creates a random suffix, so that a separate snapshot class gets created for the different storage class.
In the previous version of TVK, metadata restore was taking too much time restoring the instance template. From 2.8.1, this has been fixed and a timeout has been added, which enables the restore process to proceed. The timeout option is user configurable. Use the field ResourcesReadyWaitSeconds to configure the timeout while performing a restore.
In previous versions, an issue in TVK OpenShift operator was causing the reinstallation of operator. This has now been fixed in v2.8.1.
Previously, the Restore controller was not adding the start time stamp and the completion time stamp to some restore failures, which led to failed migration. A fix has been added, which adds the start timestamp and completion timestamp in all cases.
Previously, if Retention policies were created without specifying latest, then latest was being assigned to 1, which caused some retention issues. The latest should be 2, so that no current backup is merged with the previous backup. This issue has been fixed from this version.
Known Issues/Limitations
A known issue exists in which some users may experience TrilioVault pods going into a OOMKilled state. This can happen in environments where a lot of objects exist, for which additional processing power is needed. As a workaround for this issue, users may easily adjust their environment's memory and CPU limits. Please refer to the troubleshooting section to find more details on achieving this.
2.8.0
Release Date
2022-03-31
What's New
Improved Helm sub-chart handling:
Improvements have been made to how Trilio handles Helm sub-charts that do not conform to Helm standards, including checking of local sub-charts. If a helm application contains sub-charts hosted either locally, or on an ftp server, the backup will not push the corresponding sub-charts to the target. The snapshot process also displays a warning in the backup CR. While restoring an application like this, restores are restricted to the same namespace and the transformation feature is disabled.
TVK Preflight Tool:
TVK Pre-flight as a Helm hook with volumesnapshot CRD handling
****Preflight can be now run as a pre-install helm hook in Trilio operator. Configuration defaults can be found here: https://github.com/trilioData/docs-public-k8s/blob/2.8.2/overview/use-triliovault/installing-triliovault.md#tvk-quickstart-preflight-configuration-defaults​
For preflight feature addons, find more here: https://github.com/trilioData/docs-public-k8s/blob/2.8.2/overview/support/support-and-issue-filing/tvk-preflight-checks.md#checks-performed-during-preflight​

Preflight installs volume snapshot CRDs if not present on your cluster environment (based on k8s server version). Additionally, preflight installs volume snapshot class if not already present.
Preflight tool bundled with upstream operator
Previously, it was a separate entity, which the user needed to run it before installing TVK. It can now be run as a pre-install helm hook with upstream operator. Preflight installs VolumeSnapshot CRDs if not already present and also VolumeSnapshotClass if not already present on the cluster.
OpenShift Virtualization Support
TVK can now support backup and restores of OpenShift Virtualization VMs.
Specify restored resources wait time
In previous TVK versions, users were not able to specify the wait time to assess the status of restored resources. This led to dependent restored resources failing. TVK 2.8.0 gives users the option to specify this wait time in Restore and ClusterRestore Restore operations. Then it checks the restored resources status and waits for no longer than the maximum wait time specified. If restored resources fail to run in the specified time, a warning is logged and the restore process continues.
TVK UI:
Net calculated immutability is now displayed in the UI in relation to backupplans. Whilst creating a backupplan; when Scheduling Policy, Retention Policy and Bucket Retention are selected, a RetainUntilDate field is then displayed in the UI. RetainUntilDate is the date that the complete backup chain is retained to.
New columns have been added to the namespace list within TVK UI console's Backup and Recovery page. The new columns display the backup summary, number of pods and number of PVs for each namespace. An further column has been added to display the backup/restore summary for each backupplan.
For the TVK UI console login screen, the Sign in using kubeconfig/credentials button is now disabled if the user has not selected an associated file. Secondly, for some distributions, selecting a credentials file is disallowed. In these cases, the Sign in using kubeconfig/credentials button is not visible. Thirdly, following log in to the TVK UI, a user can choose tiles view, which displays all clusters along with a summary of each.
A table displaying the top 10 backups and a second table displaying the top 10 backupplans, along with various filters for different parameters, has been added to the Monitoring page in the TVK UI.
For all tables in the TVK UI, the pagination is now sticky; i.e. the user does not have to scroll down to see the page numbers. Also, all table columns are now sortable. Clicking on the column header will sort column data.
Under the namespace Details view in the TVK UI, objects are now clubbed together based on API group.
On the Backupplans page in the TVK UI, when creating a backupplan, a widget has been added to display the net immutability; i.e. the 'retain until' date based on the selected scheduling and retention policy.
When creating a restore in the TVK UI, support has been added for enabling target browsing when the user is unable to add a restore transform.
When creating a backup on the TVK UI, if a user selects applications from different namespaces, validation has been added to block the user and show the appropriate warning.
In the Backup and Recovery section in the TVK UI, a Cleanup policy page has been added to list/create cleanup policies. Also, in the applications objects list, users can now search in the Application Type dropdown.
Under the Disaster Recovery section in the TVK UI, support has been added for searching by instance name and pagination.
Bugs Fixed
In VMware Tanzu, for container networking through Antrea, the NetworkPolicyStats list API call would cause an issue with TVK deployment if the featureGate was not enabled. This resource, since it has no bearing on the application captures has been added in the TVK's BackupIgnoreList and won't be considered in the backup.
Known Issues/Limitations
A known issue exists in which some users may experience TrilioVault pods going into a OOMKilled state. This can happen in environments where a lot of objects exist, for which additional processing power is needed. As a workaround for this issue, users may easily adjust their environment's memory and CPU limits. Please refer to the troubleshooting section to find more details on achieving this.
2.7.1
Release Date
2022-03-08
What's New
Better Helm application restoration: The method for restoring Helm applications has changed slightly, so that it is reliant on Helm's own internal process. Previously some hooks were missing following restoration of Helm applications. The new approach executes hooks correctly, by considering the pre-post hooks during the restoration process.
Persistent Volume (PV) Resizing: Logic has been introduced to determine if a user has resized the PV before making a backup. Previously if the PV was resized, when the user tried to execute the next incremental backup, the backup would fail with the error: "No space left on device." Now, when a user resizes the PV following a backup, then logic will force the next backup to be a full backup.
TVK instance name support: Users should now provide a TVK instance name. Previously, during one-click deployment, the following pre-install error was displayed:

Error: INSTALLATION FAILED: failed pre-install: warning: Hook pre-install k8s-triliovault-operator/templates/TVMCustomResource.yaml failed: TrilioVaultManager.triliovault.trilio.io "triliovault-manager" is invalid: spec.tvkInstanceName: Invalid value: "null": spec.tvkInstanceName in body must be of type string: "null"

Now, as a part of TVM CR, you can mention the tvkInstanceName in the specification. Alternatively, in the case of OCP, you can edit the k8s-triliovault-config configmap to provide the instance name. This clears the error and enables users to proceed with installation.
Bugs Fixed
Backup failures following upgrade: A bug has been fixed to solve backup failures experienced by some users following execution of an upgrade. In all cases, old pre-upgrade backups stuck in the Coalescing status were causing newer post-upgrade backups to fail. This only happened for backups where retention was running, which caused the backup controller and retention logic to conflict. This conflict has now been removed and backup no longer becomes stuck in the Coalescing state.
Failed Deployment: A bug has been fixed to address an issue faced by some users when trying to install TVK 2.7.0 on RKE(v1.20.14) as upstream. In these instances, the TVM CR installs the TVK, but displays the wrong status in TVM CR as 'ReleaseFailed'. This issue has now been successfully resolved and TVM CR displays the correct 'Deployed' state.
Known Issues/Limitations
A known issue exists in which some users may experience TrilioVault pods going into a OOMKilled state. This can happen in environments where a lot of objects exist, for which additional processing power is needed. As a workaround for this issue, users may easily adjust their environment's memory and CPU limits. Please refer to the troubleshooting section to find more details on achieving this.
2.7.0
Release Date
2022-02-11
What's New
1.Redesign of UI Navigation: The TVK management console has been redesigned to make it easier to use. For an overview of the new design and the navigation, refer to this UI video.
2.Ingress Wildcard(*) Support: To access the UI, a mandatory hostname is no longer required for the ingress resource. Instead, the UI can be directly accessed from the external IP of your ingress.
3.Backup Queuing Mechanism: A backup queue mechanism has been added to this version, which successfully removes a known limitation item from the list below. This enables a user to create multiple backups, even if their schedules overlap. These backup jobs are then queued internally to prevent issues.
Bugs Fixed
1.When more than one backup is scheduled for the same time, the day-zero bug no longer causes any issues around the backing chain.
2.Previously, successful cron jobs for backup schedules left behind three successful jobs. This has now been fixed, so that it no longer keeps any successful jobs.
Known Issues/Limitations
1.If Pods go into an OOMKilled state, the environment requires more than the default CPU and Memory values on the TrilioVault Pods. Please refer to the troubleshooting section to find more details on increasing these limits in your environment.
2.Helm charts with restore hooks have a logical error in terms of execution, as per the detailed issue filed here.
2.6.7
Release Date
2022-01-24
What's New
1.No new features are provided as part of this release.
Bugs Fixed
1.TK-4965 - Out of Space Issue on Datamover Pod. TrilioVault now leverages the PV size instead of snapshot size for backup file creation.
Known Issues/Limitations
1.If Pods are going into an OOMKilled state, the environment will need more than the provided default CPU and Memory values on the TrilioVault Pods. Please refer to the troubleshooting section to increase the limits in your environment
2.Helm charts with restore hooks have a logical error in terms of execution as per the issue filed here​
3.When adding multiple scheduling policies and those schedule policies intersect with each other at the exact same time, it is possible that two incremental backups could get triggered at the same time and result in an orphaned backup. You can avoid this bug by avoiding the backup schedules from colliding with each other. If you are defining a daily schedule and weekly schedule, make sure that these two schedule time doesn't collide with each other
2.6.6
Release Date
2022-01-12
What's New
1.No new features are provided as part of this release
Bugs Fixed
1.TK-4957 - Fix for BuildConfig EnvVars parsing error
2.Rancher app version fix of extra zeros appending to app version during one click installation
3.Update default ingressController service type from NodePort to LoadBalancer for one click installation
Known Issues/Limitations
1.If Pods are going into an OOMKilled state, the environment will need more than the provided default CPU and Memory values on the TrilioVault Pods. Please refer to the troubleshooting section to increase the limits in your environment
2.Helm charts with restore hooks have a logical error in terms of execution as per the issue filed here​
3.When adding multiple scheduling policies and those schedule policies intersect with each other at the exact same time, it is possible that two incremental backups could get triggered at the same time and result in an orphaned backup. You can avoid this bug by avoiding the backup schedules from colliding with each other. If you are defining a daily schedule and weekly schedule, make sure that these two schedule time doesn't collide with each other
2.6.5
Release Date
2022-01-11
What's New
1.Added One-Click install support.
2.Added Azure Blob as a target for backup and restore.
3.Dynamic handling of default ingress-controller custom TLS cert with provisions to fallback to HTTP if any error occurs.
Bugs Fixed
1.TK-4903 - Fixed an issue with Multi-Namespace restores using transformations.
Known Issues/Limitations
1.If Pods are going into an OOMKilled state, the environment will need more than the provided default CPU and Memory values on the TrilioVault Pods. Please refer to the troubleshooting section to increase the limits in your environment
2.Helm charts with restore hooks have a logical error in terms of execution as per the issue filed here​
3.When adding multiple scheduling policies and those schedule policies intersect with each other at the exact same time, it is possible that two incremental backups could get triggered at the same time and result in an orphaned backup. You can avoid this bug by avoiding the backup schedules from colliding with each other. If you are defining a daily schedule and weekly schedule, make sure that these two schedule time doesn't collide with each other.
2.6.4
Release Date
2021-12-23
What's New
1.Support for GKE/EKS UI authentication using GCP/AWS credentials.
Bugs Fixed
1.MixedContent bug while attaching two clusters in TVK: When a user tries to connect two clusters where one is running on https and the other one is running on http, the UI now shows proper instruction how to allow the addition of cluster.
2.TK-4788 Adding TVK cluster on Red Hat OpenShift using Dex (Sign in via OpenShift)
3.TK-4761 Backup failure when using the BuildConfig resource within OpenShift is fixed.
4.Upstream Operator support for Kubernetes v1.22
Known Issues/Limitations
1.If Pods are going into an OOMKilled state, the environment will need more than the provided default CPU and Memory values on the TrilioVault Pods. Please refer to the troubleshooting section to increase the limits in your environment
2.Helm charts with restore hooks have a logical error in terms of execution as per the issue filed here​
3.When adding multiple scheduling policies and those schedule policies intersect with each other at the exact same time, it is possible that two incremental backups could get triggered at the same time and result in an orphaned backup. You can avoid this bug by avoiding the backup schedules from colliding with each other. If you are defining a daily schedule and weekly schedule, make sure that these two schedule time doesn't collide with each other.
2.6.3
Release Date
2021-11-29
What's New
1.No new features are provided as part of this release
Bugs Fixed
1.TK-4610 - User created from Rancher server is not able to login to Trilio UI via kubeconfig file
2.TK-4640 - "backupPlan not found for provided details" Error while View yaml of the backup resources
3.TK-4601/4606/4636 - Automatic configuration of HTTPS access for OCP environments
4.TK-4633 - Fixed bugs around filter scope query param in web-backend
5.TK-4629 - Fixed flakyness issue across view YAML in metadata details & hooks actions button.
6.TK-4631 - Fixed restore flags migration issues**.**
7.TK-4689 - Ignored the attributes and ACLs failures while uploading the data on target (TK-4689)
Known Issues/Limitations
1.If Pods are going into an OOMKilled state, the environment will need more than the provided default CPU and Memory values on the TrilioVault Pods. Please refer to the troubleshooting section to increase the limits in your environment
2.Helm charts with restore hooks have a logical error in terms of execution as per the issue filed here​
2.6.2
Release Date
2021-11-22
What's New
1.No new features are provided as part of this release
Bugs Fixed
1.TK-4634 - Fix for namespace listing issue. Show only the namespaces to which the user has access.
2.TK-4606 - Fix around minion ingress to not to revert workaround suggested to the customer for HTTPS when upgrading to the new 2.6.2 version
Known Issues/Limitations
1.If Pods are going into an OOMKilled state, the environment will need more than the provided default CPU and Memory values on the TrilioVault Pods. Please refer to the troubleshooting section to increase the limits in your environment
2.6.1
Release Date
2021-11-14
What's New
1.No new features are provided as part of this release
Bugs Fixed
1.TK-4605 - After automatic upgrade to 2.6 web-backend pod fails to start
1.Default memory and CPU limits have been increased on pods to align with heavier customer environments.
Known Issues/Limitations
1.If Pods are going into an OOMKilled state, the environment will need more than the provided default CPU and Memory values on the TrilioVault Pods. Please refer to the troubleshooting section to increase the limits in your environment
2.6.0
Release Date
2021-11-11
What's New
1.TLS Proxy Support: TrilioVault can run behind a TLS proxy and will utilize the proxy certificates to make a secure connection to the target.
2.Ingress Controller Optional: Deploying an ingress controller as part of the deployment of TrilioVault is optional. Users can select to install the Trilio ingress controller or use an existing ingress controller available within the cluster to support TVK.
For, OpenShift environments TrilioVault uses the built-in ingress controller. As a result, users can install TVK from OperatorHub and access the UI by simply clicking the route created for it.
3.Encryption and Retention: Full support for encrypted backups including retentions.
4.OnlyMeta and OnlyData Support: Ability to restore only metadata or data components as part of a restore operation.
5.ClusterBackupPlan Namespace Selector: Users can capture namespaces based on labels.
6.Dex Support for MCM: Multi-cluster management authentication is supported using dex (OIDC/LDAP etc.)
7.Dex Login Custom Port Support: Now you can also access TVK UI using Node Port & Port-forwarding endpoints by mentioning custom URL in the triliovault-dex secret.
8.Preview YAML for Helm and custom transform: Users can preview YAML files as part of transformation workflows along with the ability to track deltas.
9.Dark Mode: TrilioVault Management Console now supports Dark Mode
Bugs Fixed
1.TK-3843 - In Namespace and Application Summary Ingress shows twice
2.TK-3780 - UI: only GVK cannot be provided for excludeResources in Restore form [advanced configuration]
3.TK-3861 - Alignment issue for Restore Transformation Accordion, once transform component added
4.TK-3999 - 8 EB threshold capacity value shows "9223372036854775807" & dropdown is empty for edit NFS & AWS target
5.TK-4138 - gutter icon for navigation is visible in Backup metadata details
6.TK-4139 - Autoscaler is observed duplicate in Resources
7.TK-4158 - Search Backupplan dropdown shows no options when time range is Hour & Day - Listing of backup plans is not visible in the dropdown
8.TK-4160 - Edit transformation should not ask to update "Transform Name''
9.TK-4094 - Edit In Progress Backup Plan gives an error -"the object has been modified; please apply your changes to the latest version and try again
Known Issues/Limitations
1.TK-4477 - Kubeconfig files for the TrilioVault management console created via the Rancher server do not work for cloud-provider deployments. As a temporary workaround please follow the procedure mentioned here​
2.For HTTPS access to the management console in OpenShift environments, the certificates need to be provided in the ingress resource
3.TK-4094 - Backup summary shows count 0 when namespace associated with multi ns backup - it shows the summary correctly when multi-ns are selected.
4.If Pods are going into an OOMKilled state, the environment will need more than the provided default CPU and Memory values on the TrilioVault Pods. Please refer to the troubleshooting section to increase the limits in your environment
2.5.4 - OpenShift Only
Release Date
2021-11-01
What's New
1.No new features as part of this release.
2.This release is specific to OpenShift environments only. Please use version 2.5.3 for all other distributions
Bugs Fixed
1.Fix to ensure that management console settings in OCP are not reset upon an upgrade.
Known Issues/Limitations
1.TK-3843 - In Namespace and Application Summary Ingress shows twice
2.TK-3780 - UI: only GVK cannot be provided for excludeResources in Restore form [advanced configuration]
3.TK-3861 - Alignment issue for Restore Transformation Accordion, once transform component added
4.TK-3999 - 8 EB threshold capacity value shows "9223372036854775807" & dropdown is empty for edit NFS & AWS target
5.TK-4138 - gutter icon for navigation is visible in Backup metadata details
6.TK-4139 - Autoscaler is observed duplicate in Resources
7.TK-4158 - Search Backupplan dropdown shows no options when time range is Hour & Day - Listing of backup plans is not visible in the dropdown
8.TK-4160 - Edit transformation should not ask to update "Transform Name''
9.TK-4094 - Edit In Progress Backup Plan gives an error -"the object has been modified; please apply your changes to the latest version and try again"
2.5.3
Release Date
2021-11-01
What's New
1.No new features as part of this release.
Bugs Fixed
1.OCP issues with respect to web-backend pod restarting.
Known Issues/Limitations
1.TK-3843 - In Namespace and Application Summary Ingress shows twice
2.TK-3780 - UI: only GVK cannot be provided for excludeResources in Restore form [advanced configuration]
3.TK-3861 - Alignment issue for Restore Transformation Accordion, once transform component added
4.TK-3999 - 8 EB threshold capacity value shows "9223372036854775807" & dropdown is empty for edit NFS & AWS target
5.TK-4138 - gutter icon for navigation is visible in Backup metadata details
6.TK-4139 - Autoscaler is observed duplicate in Resources
7.TK-4158 - Search Backupplan dropdown shows no options when time range is Hour & Day - Listing of backupplans is not visible in the dropdown
8.TK-4160 - Edit transformation should not ask to update "Transform Name''
9.TK-4094 - Edit In Progress Backup Plan gives an error -"the object has been modified; please apply your changes to the latest version and try again"
2.5.2
Release Date
2021-10-05
What's New
1.No new features as part of this release.
Bugs Fixed
1.This release contains the fix to allow TVK to run behind the proxy server. TVK will be completely behind the proxy and perform operations in a secure way.
Known Issues/Limitations
1.TK-3843 - In Namespace and Application Summary Ingress shows twice
2.TK-3780 - UI: only GVK cannot be provided for excludeResources in Restore form [advanced configuration]
3.TK-3861 - Alignment issue for Restore Transformation Accordion, once transform component added
4.TK-3999 - 8 EB threshold capacity value shows "9223372036854775807" & dropdown is empty for edit NFS & AWS target
5.TK-4138 - gutter icon for navigation is visible in Backup metadata details
6.TK-4139 - Autoscaler is observed duplicate in Resources
7.TK-4158 - Search Backupplan dropdown shows no options when time range is Hour & Day - Listing of backupplans is not visible in the dropdown
8.TK-4160 - Edit transformation should not ask to update "Transform Name''
9.TK-4094 - Edit In Progress Backupplan gives an error -"the object has been modified; please apply your changes to the latest version and try again"
2.5.1
Release Date
2021-09-12
What's New
1.No new features as part of this release.
Bugs Fixed
1.S3 Targets that did not support object locking were failing upon creation.
Known Issues/Limitations
1.TK-3843 - In Namespace and Application Summary Ingress shows twice
2.TK-3780 - UI: only GVK cannot be provided for excludeResources in Restore form [advanced configuration]
3.TK-3861 - Alignment issue for Restore Transformation Accordion, once transform component added
4.TK-3999 - 8 EB threshold capacity value shows "9223372036854775807" & dropdown is empty for edit NFS & AWS target
5.TK-4138 - gutter icon for navigation is visible in Backup metadata details
6.TK-4139 - Autoscaler is observed duplicate in Resources
7.TK-4158 - Search Backupplan dropdown shows no options when time range is Hour & Day - Listing of backupplans is not visible in the dropdown
8.TK-4160 - Edit transformation should not ask to update "Transform Name''
9.TK-4094 - Edit In Progress Backupplan gives an error -"the object has been modified; please apply your changes to the latest version and try again"
2.5.0
Release Date
2021-09-08
What's New
1.Immutability: Trilio provides the ability to create immutable backups at the application level. Once the backup is taken and stored on an immutable target, it can not be altered (overwritten/deleted) until the retention period set through TVK is up.
2.Encryption/Decryption: Added support to encrypt backups to protect them from malicious users. TVK encrypts the backup data at the application level using an encryption key which can only be restored with the same encryption key. Even if an attacker gets holds of the backup data he can not see the actual data without a key.
3.Multi Namespace Backup/Restore: Earlier TVK used to protect only a single namespace with a single backup plan. Now, you can protect multiple namespaces using new CRDs - ClusterBackupPlan, ClusterBackup, and ClusterRestore.
4.NFS target without privilege: Earlier TVK requires NFS target to be mounted with privilege permissions, now for NFS target we have removed privileged access. This allows TVK to be run in an restricted environment without escalated permissions.
5.Inclusion/Exclusion: You can provide specific resource which needs to be included or excluded while doing backup. Resources can be specified either by GVKO or by the Kind directly.
6.LDAP & OIDC Support: TVK support 8 tested popular public OIDC providers including Google, Github, Azure, Okta, GitLab, LinkedIn, and ideally any OIDC provider will work.
7.OpenShift Authentication Support: This is enabled by default on OpenShift platform with the TVK operator. Trilio will auto-configure the management console based on authentication mechanisms available within OpenShift
8.Protect Restored Application: Recreate targets, policy, hooks, and backupplans to protect the restored application. Now, the application is protected no matter the Kubernetes cluster it is restored into.
9.Failed Restore Cleaner: Now restore allows you to specify via a flag to clean the resources created by the restore, if the restore fails.
10.Krew Plugin for target browser: TVK now has the kubectl plugin to get the backup information from the target using the kubectl CLI.
11.Target Credentials as Secrets: Earlier TVK used to have naked authentication information inside the target CR. Now, we support the target credentials to be saved as a secret and refer to the target CR for better security reasons.
12.Scheduling as a Policy: Now you can define the backup schedule policy as a different policy object and can use a policy in different backupplans.
13.Azure blob storage support: Added support to use the Azure blob storage as a target. We are using NFS3.0 to use the Azure blob storage.
14.S3 SSL Certificate: Now we support authenticating S3 targets using SSL certificates.
15.ReadOnlyRootFilesystem: All the containers that are running as backup and restore processes are running with a readOnlyRootFilesystem.
16.Sharing of Resources: To enable simplified management of Trilio resources in a multi-cluster environment, users can share/clone resources like targets, hooks, policies, etc. across namespaces in the same cluster or across clusters themselves.
Bugs Fixed
1.Multiple bugs with respect to the management console and backend APIs have been fixed
2.MinIO S3 targets are now supported.
Known Issues and Limitations
1.TK-3843 - In Namespace and Application Summary Ingress shows twice
2.TK-3780 - UI: only GVK cannot be provided for excludeResources in Restore form [advanced configuration]
3.TK-3861 - Alignment issue for Restore Transformation Accordion, once transform component added
4.TK-3999 - 8 EB threshold capacity value shows "9223372036854775807" & dropdown is empty for edit NFS & AWS target
5.TK-4138 - gutter icon for navigation is visible in Backup metadata details
6.TK-4139 - Autoscaler is observed duplicate in Resources
7.TK-4158 - Search Backupplan dropdown shows no options when time range is Hour & Day - Listing of backupplans is not visible in the dropdown
8.TK-4160 - Edit transformation should not ask to update "Transform Name''
9.TK-4094 - Edit In Progress Backupplan gives an error -"the object has been modified; please apply your changes to the latest version and try again"\
2.1.0
Release Date
2021-05-04
What's New
1.Architecture Change: Earlier TVK used to ship two different scope CustomResourceDefinitions (CRDs) : Cluster and Namespaced . Now, we only ship Namespaced Scope CRDs. However TVK still support both the "Cluster" & "Namespaced" installation mode as before.
2.Multi Cluster Management: TVK now supports managing multiple TVK clusters/installations through the UI.
3.Velero Integration: TVK now ships with velero integration. It will now allow you to list and see the details of your existing velero backups, restore & target in the TVK UI directly.
4.Analytics Controller: TVK now comes with an analytics controller which populates running stats in trilio resources providing extra information about individual resources.
5.Helm2 & v1alph1 CRD Deprecation: helm2 support is now deprecated from the TVK and you will not be able to backup/restore the helm2 applications. v1alpha1 version of the TVK CRD's is also deprecated.
6.Krew Plugins for preflight and log-collector: The shell based pre-flight checks and the go based log-collector tool have been migrated to Krew based plugins. Additional information around usage of these tools is available here​
7.Datamover Performance: This release includes performance improvement to the NFS based targets
8.Lightweight webhook & OLM bundle: TVK has simplified installation process by moving resource creation to it's Helm chart and the OLM bundle, making the webhook init process lightweight
9.View/Download YAML: Ability to view raw YAML files for Backup, Restore, Backupplan, Target, Hooks,Retention Policy.
10.DR Plan: Disaster Recovery Plan feature to support a plan via a single workflow to recover your cluster state in case of any disaster.
11.Tooltips for all UI forms
12.Performance and resource analysis via StormForge Experiments - purpose built solution to analyze the resource requirements for TVK pods.
Bugs Fixed
1.Multiple bugs with respect to the management console and backend APIs have been fixed.
Known Issues/Limitations
1.Multi-namespace backup in the same workflow not supported yet.
2.Custom certificates for on-premise S3 targets not supported.
3.MinIO targets are not supported as MinIO does not support empty folders. Will be fixed in the next release.
2.0.5
Release Date
2021-04-22
What's New
1.No new features as part of this release.
Bugs Fixed
1.This release includes a patch fix of taking clusterIP service backup and restore without using transformation on k8s 1.20+
Known Issues/Limitations
1.OLM Based Upgrade/Install
1.Clustered
1.The v2.0.4 version will be automatically upgraded to v2.0.5 via OLM if the subscription is set to automatic. If not, manually approve the subscription upgrade.
2.v1.1.1 or v2.0.0to v2.0.5 - either incrementally upgrade to the next version up to v2.0.3 or uninstall the current operator and reinstall the 2.0.4 operator from OperatorHub.
2.Namespaced
1.Install - Use a custom catalog source to install TVK at a namespace scope.
2.Upgrade - Uninstall the current operator and install the 2.0.5 operator via custom catalog source.
3.Clustered <-> namespaces
1.Same as before - full reinstall
2.In 2.1.0 (Early May) all clustered installations would have to go through full reinstalls as namespace to cluster and vice-versa upgrades will be supported.
3.Multi-namespace backup in the same workflow not supported yet.
4.Custom certificates for on-premise S3 targets not supported.
5.MinIO targets are not supported as MinIO does not support empty folders.\
2.0.4
Release Date
2021-04-01
What's New
1.No new features as part of this release.
Bugs Fixed
1.Issue related to cross-cluster migration and custom CRDs failing is now fixed.
2.504 Gateway timeout Error Toast Message on UI on Launch of Target Browser
3.There was a Red Hat OperatorHub issue where Trilio images were not loading for 2.0.3 which has been fixed with 2.04. As a result, 2.0.2 customers can upgrade to 2.0.4 via OLM.
Known Issues/Limitations
1.OLM Based Upgrade/Install
1.Clustered
1.The v2.0.2 version will be automatically upgraded to v2.0.4 via OLM if the subscription is set to automatic. If not, manually approve the subscription upgrade.
2.v1.1.1 or v2.0.0to v2.0.4 - either incrementally upgrade to the next version up to v2.0.3 or uninstall the current operator and reinstall the 2.0.4 operator from OperatorHub.
2.Namespaced
1.Install - Use a custom catalog source to install TVK at a namespace scope.
2.Upgrade - Uninstall the current operator and install the 2.0.4 operator via custom catalog source.
3.Clustered <-> namespaces
1.Same as before - full reinstall
2.In 2.1.0 (Early May) all clustered installations would have to go through full reinstalls as namespace to cluster and vice-versa upgrades will be supported.
3.Multi-namespace backup in the same workflow not supported yet.
4.Custom certificates for on-premise S3 targets not supported.
5.MinIO targets are not supported as MinIO does not support empty folders.
6.Kubernetes 1.20 adds a new field known as ClusterIPs for the service resource that is auto-populated from the clusterIP field. Trilio wipes out the clusterIP field from a service resource before a restore, but the ClusterIPs field cannot be non-empty with the clusterIP field. As a result, the restore validation fails. Trilio will fix this issue in a subsequent release, but until then restore transformations can be used to workaround this issue. A video explaining the transform can be found here\
2.0.3
Release Date
2021-03-08
What's New
1.No new features as part of this release.
Bugs Fixed
1.Issue related to cross-cluster migration and custom CRDs failing is now fixed.
2.504 Gateway timeout Error Toast Message on UI on Launch of Target Browser
Known Issues/Limitations
1.OLM Based Upgrade/Install
1.Clustered
1.The v2.0.2 version will be automatically upgraded to v2.0.3 via OLM if the subscription is set to automatic. If not, manually approve the subscription upgrade.
2.v1.1.1 or v2.0.0to v2.0.3 - either incrementally upgrade to the next version up to v2.0.3 or uninstall the current operator and reinstall the 2.0.3 operator from OperatorHub.
2.Namespaced
1.Install - Use a custom catalog source to install TVK at a namespace scope.
2.Upgrade - Uninstall the current operator and install the 2.0.3 operator via custom catalog source.
3.Clustered <-> namespaces
1.Same as before - full reinstall
2.In 2.1.0 (late March) all clustered installations would have to go through full reinstalls as namespace to cluster and vice-versa upgrades will be supported.
3.Multi-namespace backup in the same workflow not supported yet.
4.Custom certificates for on-premise S3 targets not supported.
5.MinIO targets are not supported as MinIO does not support empty folders.
6.Kubernetes 1.20 adds a new field known as ClusterIPs for the service resource that is auto-populated from the clusterIP field. Trilio wipes out the clusterIP field from a service resource before a restore, but the ClusterIPs field cannot be non-empty with the clusterIP field. As a result, the restore validation fails. Trilio will fix this issue in a subsequent release, but until then restore transformations can be used to workaround this issue. A video explaining the transform can be found here\
2.0.2
Release Date
2021-01-30
What's New
1.No new features as part of this release.
Bugs Fixed
1.OCP dynamic forms - inability to enter certain mandatory fields. All mandatory fields are supported now.
2.Restore by location from Target Browser not loading metadata for transformations and exclusions.
Known Issues/Limitations
1.OLM Based Upgrade/Install
1.Clustered
1.The v2.0.1 version will be automatically upgraded to v2.0.2 via OLM if the subscription is set to automatic. If not, manually approve the subscription upgrade.
2.v1.1.1 or v2.0.0to v2.0.2 - either incrementally upgrade to the next version up till to 2.0.2 or uninstall the current operator and reinstall the 2.0.2 operator from OperatorHub.
2.Namespaced
1.Install - Use a custom catalog source to install TVK at a namespace scope.
2.Upgrade - Uninstall current operator and install the 2.0.2 operator via custom catalog source.
3.Clustered <-> namespaces
1.Same as before - full reinstall
2.In 2.1.0 (late March) all clustered installations would have to go through full reinstalls as namespace to cluster and vice-versa upgrades will be supported.
3.Multi-namespace backup in the same workflow not supported yet.
4.Custom certificates for on-premise S3 targets not supported.
5.MinIO targets are not supported as MinIO does not support empty folders.