Symptoms


Provider reported that their marketplace is not upgrade to version 6, and from pods describe, the version 6 image was mounted, but the marketplace instance in production is still in the old version.

[root@osscore ~]# kubectl describe pods ux1-marketplace-connector-5b54994874-cw6ld
Name: ux1-marketplace-connector-5b54994874-cw6ld
Namespace: default
Node: kuber01.mp.advania.com/10.160.240.30
Start Time: Thu, 23 Sep 2021 07:00:54 +0000
Labels: app=ux1-marketplace
pod-template-hash=1610550430
release=ux1-marketplace
tier=connector
Annotations: <none>
Status: Running
IP: 10.244.0.169
Controlled By: ReplicaSet/ux1-marketplace-connector-5b54994874
Containers:
ux1-marketplace-connector:
Container ID: docker://78b7bd4e35256b34e729839502746a656426adf97031cb282fe2791c7cd17668
Image: odindevops-a8n-docker.jfrog.io/ux1-marketplace:6.0.952


Cause


The APS schema used in the latest UX1 MP (Version 6) upgrade referred to a APS Type schema that is only available from UX1 Marketplace 5.7x onwards. Due to both your production and lab have marketplace below 5.7, the upgrade will failed.

In this case the only way to recover is to do helm rollback (Revision number) in eg, it is 5. :

[root@osscore ~]# helm history ux1-marketplace
REVISION UPDATED STATUS CHART DESCRIPTION
1 Thu Mar 7 13:59:56 2019 SUPERSEDED ux1-marketplace-1.4.1-662 Install complete
2 Thu Mar 7 14:01:07 2019 SUPERSEDED ux1-marketplace-1.4.1-662 Upgrade complete
3 Fri Jun 5 03:05:57 2020 SUPERSEDED ux1-marketplace-4.0.0-1381 Upgrade complete
4 Fri Aug 28 17:40:38 2020 SUPERSEDED ux1-marketplace-4.1.3-1340 Upgrade complete
5 Thu Dec 10 22:07:24 2020 SUPERSEDED ux1-marketplace-5.1.235 Upgrade complete
6 Thu Sep 23 07:00:54 2021 DEPLOYED ux1-marketplace-6.0.952 Upgrade complete

[root@osscore ~]# helm rollback ux1-marketplace 5
Rollback was a success! Happy Helming!

[root@osscore ~]# helm history ux1-marketplace
REVISION UPDATED STATUS CHART DESCRIPTION
1 Thu Mar 7 13:59:56 2019 SUPERSEDED ux1-marketplace-1.4.1-662 Install complete
2 Thu Mar 7 14:01:07 2019 SUPERSEDED ux1-marketplace-1.4.1-662 Upgrade complete
3 Fri Jun 5 03:05:57 2020 SUPERSEDED ux1-marketplace-4.0.0-1381 Upgrade complete
4 Fri Aug 28 17:40:38 2020 SUPERSEDED ux1-marketplace-4.1.3-1340 Upgrade complete
5 Thu Dec 10 22:07:24 2020 SUPERSEDED ux1-marketplace-5.1.235 Upgrade complete
6 Thu Sep 23 07:00:54 2021 SUPERSEDED ux1-marketplace-6.0.952 Upgrade complete
7 Thu Sep 23 14:12:00 2021 DEPLOYED ux1-marketplace-5.1.235 Rollback to 5


After that, please start periodic task "UX1 Marketplace ... Plan indexer task" (Not incremental) in OA UI -> Task -> Periodic

Resolution


The workaround to upgrade to version 6 if the UX1 Marketplace version is below 5.7:

Upgrade to ux1-marketplace 5.7-852 first


In OA Management Node :


Follow the chart version, it's not using " - " for minor version at the back


helm upgrade ux1-marketplace a8n/ux1-marketplace --version 5.7.852


Wait until the aps instance upgrade is completed, check the status of ux1-marketplace-connector until it's Ready.


kubectl get apsinstance ux1-marketplace-connector


Then upgrade to the latest version (version 6)


helm upgrade ux1-marketplace a8n/ux1-marketplace

Run "UX1 Marketplace ... Plan indexer task" (not incremental) periodic task in OA UI -> Task -> Periodic after the upgrade is completed.


This issue has been logged as an internal issue CMP-9562 Post Upgrade MP from 5.1-235 to 6.0-952 is not executed in the APS.

Please contact your Technical Account Manager to check on the status and progress of the issue.