Symptoms

Provider uses OACI version 18.0 on OA version 8.2

Task with name Unprovisioning "PACIVPSHostingVPS" for APS application Cloud Infrastructure is failing with this output:

Server-side error

Following error is found in /var/log/pa/vps.aps.log on OCAI APS EndPoint:

2019-10-30 07:31:30,578 web_0c31e96e-4007-40ee-b3ae-0a380e845043_11499 INFO ImplicitAPSIdInjectorWebFilter [https-jsse-nio-9000-exec-7] - HTTP Request DELETE /api/ip_v6_addresses/1d851798-9f2f-4b79-b291-c7d9f5fd4628
..
* [PACI->APSC]
> GET https://192.168.30.19:6308/aps/2/resources/1d851798-9f2f-4b79-b291-c7d9f5fd4628
..
{
 "aps" : {
 "schema" : "/aps/2/types/139",
 "package" : {
 "id" : "ebe9e273-d75b-424a-9971-79eda24726e3",
 "href" : "/aps/2/packages/ebe9e273-d75b-424a-9971-79eda24726e3"
 },
 "modified" : "2018-11-29T16:03:37Z",
 "id" : "1d851798-9f2f-4b79-b291-c7d9f5fd4628",
 "subscription" : "ca173406-1da2-4b29-a984-8592fff6c353",
 "type" : "http://www.parallels.com/infrastructure/virtual-environment/ip-v6-address/1.0",
 "status" : "aps:unprovisioning",
 "revision" : 3
 },
 "address" : "*****",
 "type" : "IP_V_6",
 "netmask" : "65"
}
2019-10-30 07:31:30,622 web_0c31e96e-4007-40ee-b3ae-0a380e845043_11499 ERROR IaaSExceptionMapper [https-jsse-nio-9000-exec-7] - failure
java.lang.NullPointerException: null
 at com.parallels.paci.vps.rs.impl.PublicIpResourceImpl.delete(PublicIpResourceImpl.java:52)
 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
 at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
 at java.lang.reflect.Method.invoke(Method.java:498)
 at com.parallels.paci.vps.utils.ClassUtils.invokeDelegatedMethod(ClassUtils.java:117)
 at com.parallels.paci.vps.appstate.VPSProxyFactory.invokeAPSReady(VPSProxyFactory.java:130)
 at com.parallels.paci.vps.appstate.VPSProxyFactory.invokeTerminal(VPSProxyFactory.java:91)
 at com.parallels.paci.vps.appstate.VPSProxyFactory.privateInvoke(VPSProxyFactory.java:72)
 at com.sun.proxy.$Proxy100.delete(Unknown Source)

Note that in response from APS-controller resource of type http://www.parallels.com/infrastructure/virtual-environment/ip-v6-address/1.0 has no node "environment"

It is happening because resource of type http://www.parallels.com/infrastructure/virtual-environment/ was removed during first execution of the task. Extract from core.log on OSA Management Node:

# Firstly, request to remove "virtual-environment" is sent to EndPoint:
2019-10-29 13:11:45,044 DEBUG [task:23015498:88564 Thread-191645-(ActiveMQ-client-global-threads):633874 pau]: c.p.p.s.c.e.EndpointExecutorBean Begin request: 'DELETE https://192.168.1.8:9000/api/environments/2b4e3ded-2d5a-4966-ada0-4aa11cef82bf' TLSv1.2
..
2019-10-29 13:11:47,711 DEBUG [task:23015498:88564 Thread-191645-(ActiveMQ-client-global-threads):633874 pau]: c.p.p.s.c.e.EndpointExecutorBean End request: 'DELETE https://192.168.1.8:9000/api/environments/2b4e3ded-2d5a-4966-ada0-4aa11cef82bf' '200 OK'
..
# Secondly, request to remove IPv6 address is sent:
2019-10-29 13:11:47,880 DEBUG [task:23015498:88564 Thread-191645-(ActiveMQ-client-global-threads):633874 pau]: c.p.p.s.c.e.EndpointExecutorBean Begin request: 'DELETE https://192.168.1.8:9000/api/ip_v6_addresses/1d851798-9f2f-4b79-b291-c7d9f5fd4628' TLSv1.2
..
2019-10-29 13:11:48,043 DEBUG [task:23015498:88564 Thread-191645-(ActiveMQ-client-global-threads):633874 pau]: c.p.p.s.c.e.EndpointExecutorBean End request: 'DELETE https://192.168.1.8:9000/api/ip_v6_addresses/1d851798-9f2f-4b79-b291-c7d9f5fd4628' '500 Internal Server Error'

Incorrect order of resource deletion is the reason of task failure.

Cause

The issue is a result of this bug:

CCU-20539 Failed to delete subscription with IPv6

Resolution

Clarify status of the bug with your Technical Account Manager.

Contact CloudBlue Technical Support to apply internal workaround.

Internal content

Link on internal Article