Symptoms
Provider uses OACI version 18.0 on OA version 8.2
Task with name Unprovisioning "PACIVPSHostingVPS" for APS application Cloud Infrastructure is failing with this output:
Server-side error
Following error is found in /var/log/pa/vps.aps.log
on OCAI APS EndPoint:
2019-10-30 07:31:30,578 web_0c31e96e-4007-40ee-b3ae-0a380e845043_11499 INFO ImplicitAPSIdInjectorWebFilter [https-jsse-nio-9000-exec-7] - HTTP Request DELETE /api/ip_v6_addresses/1d851798-9f2f-4b79-b291-c7d9f5fd4628
..
* [PACI->APSC]
> GET https://192.168.30.19:6308/aps/2/resources/1d851798-9f2f-4b79-b291-c7d9f5fd4628
..
{
"aps" : {
"schema" : "/aps/2/types/139",
"package" : {
"id" : "ebe9e273-d75b-424a-9971-79eda24726e3",
"href" : "/aps/2/packages/ebe9e273-d75b-424a-9971-79eda24726e3"
},
"modified" : "2018-11-29T16:03:37Z",
"id" : "1d851798-9f2f-4b79-b291-c7d9f5fd4628",
"subscription" : "ca173406-1da2-4b29-a984-8592fff6c353",
"type" : "http://www.parallels.com/infrastructure/virtual-environment/ip-v6-address/1.0",
"status" : "aps:unprovisioning",
"revision" : 3
},
"address" : "*****",
"type" : "IP_V_6",
"netmask" : "65"
}
2019-10-30 07:31:30,622 web_0c31e96e-4007-40ee-b3ae-0a380e845043_11499 ERROR IaaSExceptionMapper [https-jsse-nio-9000-exec-7] - failure
java.lang.NullPointerException: null
at com.parallels.paci.vps.rs.impl.PublicIpResourceImpl.delete(PublicIpResourceImpl.java:52)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.parallels.paci.vps.utils.ClassUtils.invokeDelegatedMethod(ClassUtils.java:117)
at com.parallels.paci.vps.appstate.VPSProxyFactory.invokeAPSReady(VPSProxyFactory.java:130)
at com.parallels.paci.vps.appstate.VPSProxyFactory.invokeTerminal(VPSProxyFactory.java:91)
at com.parallels.paci.vps.appstate.VPSProxyFactory.privateInvoke(VPSProxyFactory.java:72)
at com.sun.proxy.$Proxy100.delete(Unknown Source)
Note that in response from APS-controller resource of type http://www.parallels.com/infrastructure/virtual-environment/ip-v6-address/1.0
has no node "environment"
It is happening because resource of type http://www.parallels.com/infrastructure/virtual-environment/
was removed during first execution of the task. Extract from core.log
on OSA Management Node:
# Firstly, request to remove "virtual-environment" is sent to EndPoint:
2019-10-29 13:11:45,044 DEBUG [task:23015498:88564 Thread-191645-(ActiveMQ-client-global-threads):633874 pau]: c.p.p.s.c.e.EndpointExecutorBean Begin request: 'DELETE https://192.168.1.8:9000/api/environments/2b4e3ded-2d5a-4966-ada0-4aa11cef82bf' TLSv1.2
..
2019-10-29 13:11:47,711 DEBUG [task:23015498:88564 Thread-191645-(ActiveMQ-client-global-threads):633874 pau]: c.p.p.s.c.e.EndpointExecutorBean End request: 'DELETE https://192.168.1.8:9000/api/environments/2b4e3ded-2d5a-4966-ada0-4aa11cef82bf' '200 OK'
..
# Secondly, request to remove IPv6 address is sent:
2019-10-29 13:11:47,880 DEBUG [task:23015498:88564 Thread-191645-(ActiveMQ-client-global-threads):633874 pau]: c.p.p.s.c.e.EndpointExecutorBean Begin request: 'DELETE https://192.168.1.8:9000/api/ip_v6_addresses/1d851798-9f2f-4b79-b291-c7d9f5fd4628' TLSv1.2
..
2019-10-29 13:11:48,043 DEBUG [task:23015498:88564 Thread-191645-(ActiveMQ-client-global-threads):633874 pau]: c.p.p.s.c.e.EndpointExecutorBean End request: 'DELETE https://192.168.1.8:9000/api/ip_v6_addresses/1d851798-9f2f-4b79-b291-c7d9f5fd4628' '500 Internal Server Error'
Incorrect order of resource deletion is the reason of task failure.
Cause
The issue is a result of this bug:
CCU-20539 Failed to delete subscription with IPv6
Resolution
Clarify status of the bug with your Technical Account Manager.
Contact CloudBlue Technical Support to apply internal workaround.