Dear DevConnect Team,

Here's the environment details:

AOD 7.2.1.0502
AEP 7.1.0.1.0004
MPP 7.1.0.1.0006
Windows based Tomcat Application Server (Tomcat 8.5.43)
Windows Server 2008 R2
Java version: JRE 1.8.0_181

Issue:
Application works fine in Simulation environment in AOD. However, when we attach the application on AEP applications page and try to call the DDI, it hits the application and fails at the beginning.

Is this any known issue or any workaround to get this work?

Another question - is there any limit to the number of items in Data node?

Description:
In simulation mode, the call covers all the logics within "AssignValues" data node and later move to welcome announcement. However, in actual call via AEP, the call is executed only till a certain point before disconnecting (as shown in attached screenshot of data node, the trace below red line is not executed at all, instead, we see application errors and call exits).

Additionally, we are getting these continuous HTTP 404 error in localhost access log file:

- - [12/Apr/2021:12:41:55 +0100] "POST /MnSGiftCard1/Greeting?___DDSESSIONID=641E7169038C8E7BD549A03F644D80E8%3A%2FMnSGiftCard1 HTTP/1.1" 404 1116
- - [12/Apr/2021:12:41:55 +0100] "GET /MnSGiftCard1/Error?___DDSESSIONID=641E7169038C8E7BD549A03F644D80E8%3A%2FMnSGiftCard1 HTTP/1.1" 404 1102
- - [12/Apr/2021:12:41:55 +0100] "GET /MnSGiftCard1/Error?___DDSESSIONID=641E7169038C8E7BD549A03F644D80E8%3A%2FMnSGiftCard1 HTTP/1.1" 404 1102
- - [12/Apr/2021:12:41:55 +0100] "GET /MnSGiftCard1/Error?___DDSESSIONID=641E7169038C8E7BD549A03F644D80E8%3A%2FMnSGiftCard1 HTTP/1.1" 404 1102

I will be happy to share / collect any additional log files/application details if required as this looks like a weird issue.

There are few other options more which I haven't tried yet - not sure whether this will help:
1. Restart MPP servers
2. Restart application server
3. Deploy the application in different environment (different application server and different MPP).

Appreciate any inputs on this,

Thanks for your support.

Warm regards,
Jaydeep Hatekar

You would need to provide some logs on the OD side. If you enable the the parameters on EPM (as shown in the attachment), you can get some useful logs in the app's trace.log file.

Thanks for your response Wilson. I had already enabled the application trace along with MPP logs to finest level to get more clues about the application error. However, we are getting blank as per below:

12/04/2021 12:41:55:934 ERROR - 641E7169038C8E7BD549A03F644D80E8:/MnSGiftCard1 : session id:MVSCCMMPPWM02-2021102114550-18 | MnSGiftCard1:Error | System Error has occurred for Call ID | CallID : 10001513021618227950
12/04/2021 12:41:55:934 INFO - 641E7169038C8E7BD549A03F644D80E8:/MnSGiftCard1 : session id:MVSCCMMPPWM02-2021102114550-18 | MnSGiftCard1:Error | Error Thrown: | ddLastException:errorcode :
12/04/2021 12:41:55:934 INFO - 641E7169038C8E7BD549A03F644D80E8:/MnSGiftCard1 : session id:MVSCCMMPPWM02-2021102114550-18 | MnSGiftCard1:Error | Error Message: | ddLastException:message :
12/04/2021 12:41:55:934 INFO - 641E7169038C8E7BD549A03F644D80E8:/MnSGiftCard1 : session id:MVSCCMMPPWM02-2021102114550-18 | MnSGiftCard1:Error | Error Type: | ddLastException:type :
12/04/2021 12:41:55:934 INFO - 641E7169038C8E7BD549A03F644D80E8:/MnSGiftCard1 : session id:MVSCCMMPPWM02-2021102114550-18 | MnSGiftCard1:Error | | session:lasterror :
12/04/2021 12:41:55:934 INFO - 641E7169038C8E7BD549A03F644D80E8:/MnSGiftCard1 : Using SCESession 641E7169038C8E7BD549A03F644D80E8:/MnSGiftCard1 servlet : End

There is no clue from any of the application trace or MPP logs.

Additionally, I am facing a weird issue that each time I do some changes to trace in AOD data node and regenerate the war file and deploy it freshly, each time the old version of the application is fetched instead of new application.

Is this faced / experienced before? Any workaround so that new war file is fetched instead of old application?

Appreciate any inputs on this regard,

Thanks for your support.

Warm regards,
Jaydeep Hatekar

It seems that the error (coming from mpp) get caught by the error handler in the app and the End node has been executed. The MPP log would give you more clue on what the error is.
The cleanest way to redeploy the app is removing the app folder and war file from the Tomcat/webapps directory and drop in the new war file. Never trust the Tomcat deployer.

Hi Wilson,

I did enable MPP logs to FINEST level; however, it only shows PAVB errors without any more details:

@2021-04-14 07:38:21,108||FINE|SessMgr|9578||CCall::Disconnected Call [228099] has disconnected (1, NearEndDisconnect : Application exited. [ERRORS]), endpoint 681841 destroyed|MVSCCMMPPLD02####
@2021-04-14 07:38:21,108||FINEST|SessMgr|9578||******** Leaving Call.cpp:1159:Disconnected|MVSCCMMPPLD02####
@2021-04-14 07:38:21,109|PSESM00070|ERROR|SessMgr|9578|FileName=SessionMgr.cpp,LineNumber=2082|Application errors occurred for application ProductionTestApp, Session ID MVSCCMMPPLD02-2021104063759-15, [vxml: PAVB_00191, vxml: PAVB_03064]|MVSCCMMPPLD02####
@2021-04-14 07:38:21,108||FINER|SessMgr|9578||Call object destroyed, CallID 228099 - MVSCCMMPPLD02-Session Managers-1-2021104063759|MVSCCMMPPLD02####
@2021-04-14 07:38:21,108||FINE|SessMgr|9578||Session::Run: No calls for session, setting termination timeout to 300000, Shutdown requested 1|MVSCCMMPPLD02####
@2021-04-14 07:38:21,108||FINER|SessMgr|9578||Check for exit conditions for session: [Call 0, CCXML 0, VXML 0, Preparing 0, Msg 1], wait time = 320 ms|MVSCCMMPPLD02####

And with reference to deploying new war file in tomcat instance, I always stop tomcat service and then delete both the war file and its folder from webapps folder and place the new war file and start tomcat service so that a new folder is created for the war.

I am still searching for more clues/ideas on how to get this going as this is simply weird that application runs in AOD simulator; however, the same nodes are not working similarly while making test calls.

Warm regards,
Jaydeep Hatekar

It doesn't even seem that the call lands on the app server. You definitely need to check the URL and see where the request is going to.

Hi Wilson,

I am still stuck at this point:

AOD Application works fine within AOD simulator. However, when I generate a war file and deploy it on AEP, it still picks up an old version of the application.

I did follow all the basic steps to deploy the war file:
- delete existing war files in war folder
- validate, generate project, generate fresh war file
- In the application server - webapps folder: stopped tomcat, then delete the war file as well as its associated folder, paste the new war file and restart tomcat service to generate a new folder structure

Yet, these steps are not helping. There is something new that I found today (see attached screenshot) - it's about Hot Code Replace failed - Delete method not implemented.

Is this something related to this issue which is avoiding getting a fresh war file generated for my application? What is the ideal action needs to be taken (Continue, Terminate or Restart)?

Appreciate any inputs on this topic.

Thanks for your support.

Warm regards,
Jaydeep Hatekar

This is the message box that shows up in Eclipse. You said you ran the app in deployed mode. Is the simulator(Eclipse) sharing the same Tomcat? I suppose you have a different Tomcat when running the app in deployment.

Hi Joseph, regarding the EP is still running the old version of the application even after you deleted war file, etc. I come across this quite often. The workaround is to regenerate the source codes by toggling the compiler compliance level. Please do the following:
OD Window > Preferences > Java > Compiler -> change the existing level I assume "1.8" to any other level other than your default 1.8 e.g. 1.5 click Apply then switch it back to 1.8 click Apply. This forces the OD the really clean out the remnants of the source code that are stuck in OD cache. Also close then reopen the project. Did you rename the project name? If you did, you want to check that the Tomcat Context name is exactly the same as the project name. Hope the above suggestions help. Let me know how it goes.

Hi Wilson,

Thanks for your response. The simulator eclipse tomcat is different than the application server tomcat.

Hi Jessica,

Thanks for your inputs as well. Although, I don't recollect if I did these steps to toggle the compiler compliance level; I managed to resolve this issue somehow; Followed these actions:
1. Deleting all the war files from local eclipse war folder
2. Deleting all xml files from eclipse tomcat -- conf -- Catalina -- localhost folder
3. Creating a new workspace and importing the project there
4. Freshly setting up Tomcat path (and may be I could have set the compiler level too... frankly speaking don't remember)
5. Generate the war file and deployed in windows application server

These steps picked the new call flow as designed/developed in the eclipse and verified it via application trace messages.

I would like to thank Wilson for his continuous efforts and quick responses/suggestions that encouraged me to keep on trying various options until I managed to reach till this point.

Thanks Jessica for your suggestions as well, this should definitely help our developers in future.

Warm regards,
Jaydeep Hatekar