2014-11-05 06:21:58,820 INFO [main] (enterprise.communications.util.prefs.PreferencesUpgrade)- {PreferencesUpgrade.upgrade-done}The preferences configuration [rhq.agent.configuration-schema-version] has been fully upgraded and is now at version [9] 2014-11-05 06:21:59,058 INFO [main] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.identify-version}Version=[RHQ 4.12.0.JON330CR01], Build Number=[6ac97ac], Build Date=[Oct 31, 2014 7:53 AM] 2014-11-05 06:21:59,154 INFO [main] (org.rhq.enterprise.communications.ServiceContainer)- {ServiceContainer.global-concurrency-limit-disabled}Global concurrency limit has been disabled - there is no limit to the number of incoming commands allowed 2014-11-05 06:21:59,573 INFO [main] (org.rhq.enterprise.communications.ServiceContainer)- {ServiceContainer.started}Service container started - ready to accept incoming commands 2014-11-05 06:21:59,573 INFO [main] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.no-auto-detect}Server auto-detection is not enabled - starting the poller immediately 2014-11-05 06:21:59,919 INFO [RHQ Server Polling Thread] (enterprise.communications.command.client.JBossRemotingRemoteCommunicator)- {JBossRemotingRemoteCommunicator.changing-endpoint}Communicator is changing endpoint from [InvokerLocator [servlet://10.16.23.123:7080/jboss-remoting-servlet-invoker/ServerInvokerServlet]] to [InvokerLocator [servlet://10.16.23.123:7080/jboss-remoting-servlet-invoker/ServerInvokerServlet]] 2014-11-05 06:21:59,939 WARN [RHQ Server Polling Thread] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.failover-failed}Failed to failover to another server. Cause: org.jboss.remoting.transport.http.WebServerError: JBoss Web/7.4.8.Final-redhat-4 - JBWEB000064: Error report

JBWEB000065: HTTP Status 404 - /jboss-remoting-servlet-invoker/ServerInvokerServlet


JBWEB000309: type JBWEB000067: Status report

JBWEB000068: message /jboss-remoting-servlet-invoker/ServerInvokerServlet

JBWEB000069: description JBWEB000124: The requested resource is not available.


JBoss Web/7.4.8.Final-redhat-4

2014-11-05 06:21:59,981 INFO [RHQ Server Polling Thread] (enterprise.communications.command.client.JBossRemotingRemoteCommunicator)- {JBossRemotingRemoteCommunicator.changing-endpoint}Communicator is changing endpoint from [InvokerLocator [servlet://10.16.23.123:7080/jboss-remoting-servlet-invoker/ServerInvokerServlet]] to [InvokerLocator [servlet://10.16.23.115:7080/jboss-remoting-servlet-invoker/ServerInvokerServlet]] 2014-11-05 06:21:59,998 WARN [RHQ Server Polling Thread] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.failover-failed}Failed to failover to another server. Cause: org.jboss.remoting.CannotConnectException: Can not connect http client invoker after 1 attempt(s) 2014-11-05 06:22:00,073 INFO [RHQ Server Polling Thread] (enterprise.communications.command.client.JBossRemotingRemoteCommunicator)- {JBossRemotingRemoteCommunicator.changing-endpoint}Communicator is changing endpoint from [InvokerLocator [servlet://10.16.23.115:7080/jboss-remoting-servlet-invoker/ServerInvokerServlet]] to [InvokerLocator [servlet://10.16.23.104:7080/jboss-remoting-servlet-invoker/ServerInvokerServlet]] 2014-11-05 06:22:00,083 WARN [RHQ Server Polling Thread] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.failover-failed}Failed to failover to another server. Cause: org.jboss.remoting.transport.http.WebServerError: JBoss Web/7.4.8.Final-redhat-4 - JBWEB000064: Error report

JBWEB000065: HTTP Status 404 - /jboss-remoting-servlet-invoker/ServerInvokerServlet


JBWEB000309: type JBWEB000067: Status report

JBWEB000068: message /jboss-remoting-servlet-invoker/ServerInvokerServlet

JBWEB000069: description JBWEB000124: The requested resource is not available.


JBoss Web/7.4.8.Final-redhat-4

2014-11-05 06:22:00,096 WARN [RHQ Server Polling Thread] (org.rhq.enterprise.agent.FailoverFailureCallback)- {AgentMain.too-many-failover-attempts}Too many failover attempts have been made [3]. Exception that triggered the failover: [org.jboss.remoting.transport.http.WebServerError: JBoss Web/7.4.8.Final-redhat-4 - JBWEB000064: Error report

JBWEB000065: HTTP Status 404 - /jboss-remoting-servlet-invoker/ServerInvokerServlet


JBWEB000309: type JBWEB000067: Status report

JBWEB000068: message /jboss-remoting-servlet-invoker/ServerInvokerServlet

JBWEB000069: description JBWEB000124: The requested resource is not available.


JBoss Web/7.4.8.Final-redhat-4

] 2014-11-05 06:22:00,101 ERROR [RHQ Server Polling Thread] (enterprise.communications.command.client.JBossRemotingRemoteCommunicator)- {JBossRemotingRemoteCommunicator.init-callback-failed}The initialize callback has failed. It will be tried again. Cause: org.jboss.remoting.transport.http.WebServerError:JBoss Web/7.4.8.Final-redhat-4 - JBWEB000064: Error report

JBWEB000065: HTTP Status 404 - /jboss-remoting-servlet-invoker/ServerInvokerServlet


JBWEB000309: type JBWEB000067: Status report

JBWEB000068: message /jboss-remoting-servlet-invoker/ServerInvokerServlet

JBWEB000069: description JBWEB000124: The requested resource is not available.


JBoss Web/7.4.8.Final-redhat-4

. Cause: org.jboss.remoting.transport.http.WebServerError: JBoss Web/7.4.8.Final-redhat-4 - JBWEB000064: Error report

JBWEB000065: HTTP Status 404 - /jboss-remoting-servlet-invoker/ServerInvokerServlet


JBWEB000309: type JBWEB000067: Status report

JBWEB000068: message /jboss-remoting-servlet-invoker/ServerInvokerServlet

JBWEB000069: description JBWEB000124: The requested resource is not available.


JBoss Web/7.4.8.Final-redhat-4

2014-11-05 06:22:59,725 INFO [main] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.waiting-for-plugins-with-dir}The agent is waiting for plugins to be downloaded to [plugins]... 2014-11-05 06:22:59,727 ERROR [main] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.plugin-update-failure}Failed to update the plugins.. Cause: java.lang.IllegalStateException: The sender object is currently not sending commands now. Command not sent: [Command: type=[remotepojo]; cmd-in-response=[false]; config=[{rhq.send-throttle=true}]; params=[{invocation=NameBasedInvocation[getLatestPlugins], targetInterfaceName=org.rhq.core.clientapi.server.core.CoreServerService}]] 2014-11-05 06:23:00,130 INFO [RHQ Server Polling Thread] (enterprise.communications.command.client.JBossRemotingRemoteCommunicator)- {JBossRemotingRemoteCommunicator.changing-endpoint}Communicator is changing endpoint from [InvokerLocator [servlet://10.16.23.104:7080/jboss-remoting-servlet-invoker/ServerInvokerServlet]] to [InvokerLocator [servlet://10.16.23.123:7080/jboss-remoting-servlet-invoker/ServerInvokerServlet]] 2014-11-05 06:23:00,167 WARN [RHQ Server Polling Thread] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.failover-failed}Failed to failover to another server. Cause: org.jboss.remoting.transport.http.WebServerError: JBoss Web/7.4.8.Final-redhat-4 - JBWEB000064: Error report

JBWEB000065: HTTP Status 503 - Server is not ready yet


JBWEB000309: type JBWEB000067: Status report

JBWEB000068: message Server is not ready yet

JBWEB000069: description JBWEB000148: The requested service is not currently available.


JBoss Web/7.4.8.Final-redhat-4

2014-11-05 06:23:00,179 INFO [RHQ Server Polling Thread] (enterprise.communications.command.client.JBossRemotingRemoteCommunicator)- {JBossRemotingRemoteCommunicator.changing-endpoint}Communicator is changing endpoint from [InvokerLocator [servlet://10.16.23.123:7080/jboss-remoting-servlet-invoker/ServerInvokerServlet]] to [InvokerLocator [servlet://10.16.23.115:7080/jboss-remoting-servlet-invoker/ServerInvokerServlet]] 2014-11-05 06:23:00,208 WARN [RHQ Server Polling Thread] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.failover-failed}Failed to failover to another server. Cause: org.jboss.remoting.transport.http.WebServerError: JBoss Web/7.4.8.Final-redhat-4 - JBWEB000064: Error report

JBWEB000065: HTTP Status 503 - Server is not ready yet


JBWEB000309: type JBWEB000067: Status report

JBWEB000068: message Server is not ready yet

JBWEB000069: description JBWEB000148: The requested service is not currently available.


JBoss Web/7.4.8.Final-redhat-4

2014-11-05 06:23:00,235 INFO [RHQ Server Polling Thread] (enterprise.communications.command.client.JBossRemotingRemoteCommunicator)- {JBossRemotingRemoteCommunicator.changing-endpoint}Communicator is changing endpoint from [InvokerLocator [servlet://10.16.23.115:7080/jboss-remoting-servlet-invoker/ServerInvokerServlet]] to [InvokerLocator [servlet://10.16.23.104:7080/jboss-remoting-servlet-invoker/ServerInvokerServlet]] 2014-11-05 06:23:00,251 WARN [RHQ Server Polling Thread] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.failover-failed}Failed to failover to another server. Cause: org.jboss.remoting.transport.http.WebServerError: JBoss Web/7.4.8.Final-redhat-4 - JBWEB000064: Error report

JBWEB000065: HTTP Status 503 - Server is not ready yet


JBWEB000309: type JBWEB000067: Status report

JBWEB000068: message Server is not ready yet

JBWEB000069: description JBWEB000148: The requested service is not currently available.


JBoss Web/7.4.8.Final-redhat-4

2014-11-05 06:23:00,258 WARN [RHQ Server Polling Thread] (org.rhq.enterprise.agent.FailoverFailureCallback)- {AgentMain.too-many-failover-attempts}Too many failover attempts have been made [3]. Exception that triggered the failover: [org.jboss.remoting.transport.http.WebServerError: JBoss Web/7.4.8.Final-redhat-4 - JBWEB000064: Error report

JBWEB000065: HTTP Status 503 - Server is not ready yet


JBWEB000309: type JBWEB000067: Status report

JBWEB000068: message Server is not ready yet

JBWEB000069: description JBWEB000148: The requested service is not currently available.


JBoss Web/7.4.8.Final-redhat-4

] 2014-11-05 06:23:00,258 ERROR [RHQ Server Polling Thread] (enterprise.communications.command.client.JBossRemotingRemoteCommunicator)- {JBossRemotingRemoteCommunicator.init-callback-failed}The initialize callback has failed. It will be tried again. Cause: org.jboss.remoting.transport.http.WebServerError:JBoss Web/7.4.8.Final-redhat-4 - JBWEB000064: Error report

JBWEB000065: HTTP Status 503 - Server is not ready yet


JBWEB000309: type JBWEB000067: Status report

JBWEB000068: message Server is not ready yet

JBWEB000069: description JBWEB000148: The requested service is not currently available.


JBoss Web/7.4.8.Final-redhat-4

. Cause: org.jboss.remoting.transport.http.WebServerError: JBoss Web/7.4.8.Final-redhat-4 - JBWEB000064: Error report

JBWEB000065: HTTP Status 503 - Server is not ready yet


JBWEB000309: type JBWEB000067: Status report

JBWEB000068: message Server is not ready yet

JBWEB000069: description JBWEB000148: The requested service is not currently available.


JBoss Web/7.4.8.Final-redhat-4

2014-11-05 06:23:29,728 ERROR [main] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.plugin-update-failure}Failed to update the plugins.. Cause: java.lang.IllegalStateException: The sender object is currently not sending commands now. Command not sent: [Command: type=[remotepojo]; cmd-in-response=[false]; config=[{rhq.send-throttle=true}]; params=[{invocation=NameBasedInvocation[getLatestPlugins], targetInterfaceName=org.rhq.core.clientapi.server.core.CoreServerService}]] 2014-11-05 06:23:59,729 ERROR [main] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.plugin-update-failure}Failed to update the plugins.. Cause: java.lang.IllegalStateException: The sender object is currently not sending commands now. Command not sent: [Command: type=[remotepojo]; cmd-in-response=[false]; config=[{rhq.send-throttle=true}]; params=[{invocation=NameBasedInvocation[getLatestPlugins], targetInterfaceName=org.rhq.core.clientapi.server.core.CoreServerService}]] 2014-11-05 06:24:00,272 INFO [RHQ Server Polling Thread] (enterprise.communications.command.client.JBossRemotingRemoteCommunicator)- {JBossRemotingRemoteCommunicator.changing-endpoint}Communicator is changing endpoint from [InvokerLocator [servlet://10.16.23.104:7080/jboss-remoting-servlet-invoker/ServerInvokerServlet]] to [InvokerLocator [servlet://10.16.23.123:7080/jboss-remoting-servlet-invoker/ServerInvokerServlet]] 2014-11-05 06:24:00,793 WARN [RHQ Server Polling Thread] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.server-thinks-agent-is-down}The server thinks this agent is down. Will notify the server of up-to-date information when possible. 2014-11-05 06:24:00,793 INFO [RHQ Server Polling Thread] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.failed-over-to-server}The agent has triggered its failover mechanism and switched to server [servlet://10.16.23.123:7080/jboss-remoting-servlet-invoker/ServerInvokerServlet] 2014-11-05 06:24:00,955 WARN [RHQ Server Polling Thread] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.server-thinks-agent-is-down}The server thinks this agent is down. Will notify the server of up-to-date information when possible. 2014-11-05 06:24:02,278 INFO [RHQ Agent Registration Thread] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.agent-registration-results}Agent has successfully registered with the server. The results are: [AgentRegistrationResults: [agent-token=xRAowwOH1641fshJvQUADVx1DmJsr0rpmdTDCtKLg6tHh5+GUW4pYFzNpdxPhu/Jipk=]] 2014-11-05 06:24:02,299 INFO [RHQ Server Polling Thread] (enterprise.communications.command.client.ServerPollingThread)- {ServerPollingThread.server-online}The server has come back online; client has been told to start sending commands again 2014-11-05 06:24:29,760 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading}Downloading the plugin [rhq-iis-plugin-4.12.0.JON330CR01.jar]... 2014-11-05 06:24:29,826 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading-complete}The plugin [IIS] has been updated at [rhq-iis-plugin-4.12.0.JON330CR01.jar]. 2014-11-05 06:24:29,826 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading}Downloading the plugin [rhq-agent-plugin-4.12.0.JON330CR01.jar]... 2014-11-05 06:24:29,878 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading-complete}The plugin [RHQAgent] has been updated at [rhq-agent-plugin-4.12.0.JON330CR01.jar]. 2014-11-05 06:24:29,878 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading}Downloading the plugin [servicemix3-plugin-7.3.1.redhat-379.jar]... 2014-11-05 06:24:32,979 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading-complete}The plugin [Servicemix3] has been updated at [servicemix3-plugin-7.3.1.redhat-379.jar]. 2014-11-05 06:24:32,980 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading}Downloading the plugin [drools-rhq-plugin-6.0.2-redhat-2.jar]... 2014-11-05 06:24:33,024 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading-complete}The plugin [KieRHQPlugin] has been updated at [drools-rhq-plugin-6.0.2-redhat-2.jar]. 2014-11-05 06:24:33,024 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading}Downloading the plugin [jopr-tomcat-plugin-4.12.0.JON330CR01.jar]... 2014-11-05 06:24:33,091 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading-complete}The plugin [Tomcat] has been updated at [jopr-tomcat-plugin-4.12.0.JON330CR01.jar]. 2014-11-05 06:24:33,092 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading}Downloading the plugin [teiid-rhq-plugin-1.0.0.Final-redhat-4.jar]... 2014-11-05 06:24:33,153 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading-complete}The plugin [Teiid] has been updated at [teiid-rhq-plugin-1.0.0.Final-redhat-4.jar]. 2014-11-05 06:24:33,153 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading}Downloading the plugin [rhq-switchyard-plugin-1.0.0-redhat-2.jar]... 2014-11-05 06:24:33,690 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading-complete}The plugin [SwitchYard] has been updated at [rhq-switchyard-plugin-1.0.0-redhat-2.jar]. 2014-11-05 06:24:33,690 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading}Downloading the plugin [rhq-rhqserver-plugin-4.9.0.JON320GA.jar]... 2014-11-05 06:24:34,109 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading-complete}The plugin [RHQServer] has been updated at [rhq-rhqserver-plugin-4.9.0.JON320GA.jar]. 2014-11-05 06:24:34,109 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading}Downloading the plugin [modeshape-rhq-plugin-3.3.6.GA-redhat-1.jar]... 2014-11-05 06:24:34,197 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading-complete}The plugin [ModeShape] has been updated at [modeshape-rhq-plugin-3.3.6.GA-redhat-1.jar]. 2014-11-05 06:24:34,197 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading}Downloading the plugin [jboss-datagrid-server-rhq-plugin-6.1.0.GA-redhat-1.jar]... 2014-11-05 06:24:34,222 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading-complete}The plugin [JDG] has been updated at [jboss-datagrid-server-rhq-plugin-6.1.0.GA-redhat-1.jar]. 2014-11-05 06:24:34,222 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading}Downloading the plugin [jopr-jboss-as-5-plugin-4.9.0.JON320GA.jar]... 2014-11-05 06:24:34,799 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading-complete}The plugin [JBossAS5] has been updated at [jopr-jboss-as-5-plugin-4.9.0.JON320GA.jar]. 2014-11-05 06:24:34,799 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading}Downloading the plugin [eds-p-5.3.0.GA-rhq-teiid-plugin.jar]... 2014-11-05 06:24:34,950 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading-complete}The plugin [TeiidPlugin] has been updated at [eds-p-5.3.0.GA-rhq-teiid-plugin.jar]. 2014-11-05 06:24:34,951 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading}Downloading the plugin [eds-p-5.3.0.GA-rhq-modeshape-plugin.jar]... 2014-11-05 06:24:35,007 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading-complete}The plugin [ModeShapePlugin] has been updated at [eds-p-5.3.0.GA-rhq-modeshape-plugin.jar]. 2014-11-05 06:24:35,008 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading}Downloading the plugin [soa-p-5.3.0.GA-rhq-jbossesb-plugin-as5.jar]... 2014-11-05 06:24:35,041 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading-complete}The plugin [JBossESB5] has been updated at [soa-p-5.3.0.GA-rhq-jbossesb-plugin-as5.jar]. 2014-11-05 06:24:35,042 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading}Downloading the plugin [jopr-jboss-cache-v3-plugin-4.9.0.JON320GA.jar]... 2014-11-05 06:24:35,065 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading-complete}The plugin [JBossCache3] has been updated at [jopr-jboss-cache-v3-plugin-4.9.0.JON320GA.jar]. 2014-11-05 06:24:35,066 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading}Downloading the plugin [jopr-jboss-as-plugin-4.9.0.JON320GA.jar]... 2014-11-05 06:24:35,405 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading-complete}The plugin [JBossAS] has been updated at [jopr-jboss-as-plugin-4.9.0.JON320GA.jar]. 2014-11-05 06:24:35,405 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading}Downloading the plugin [soa-p-5.3.0.GA-rhq-jbossesb-plugin-as4.jar]... 2014-11-05 06:24:35,426 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading-complete}The plugin [JBossESB] has been updated at [soa-p-5.3.0.GA-rhq-jbossesb-plugin-as4.jar]. 2014-11-05 06:24:35,426 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading}Downloading the plugin [jopr-jboss-cache-plugin-4.9.0.JON320GA.jar]... 2014-11-05 06:24:35,444 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading-complete}The plugin [JBossCache] has been updated at [jopr-jboss-cache-plugin-4.9.0.JON320GA.jar]. 2014-11-05 06:24:35,444 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading}Downloading the plugin [infinispan-rhq-plugin-5.2.4.Final-redhat-1.jar]... 2014-11-05 06:24:35,461 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading-complete}The plugin [Infinispan] has been updated at [infinispan-rhq-plugin-5.2.4.Final-redhat-1.jar]. 2014-11-05 06:24:35,462 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading}Downloading the plugin [rhq-jboss-as-7-plugin-4.12.0.JON330CR01.jar]... 2014-11-05 06:24:35,756 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading-complete}The plugin [JBossAS7] has been updated at [rhq-jboss-as-7-plugin-4.12.0.JON330CR01.jar]. 2014-11-05 06:24:35,756 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading}Downloading the plugin [hornetq-jopr-plugin-2.0.0.Final.jar]... 2014-11-05 06:24:35,784 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading-complete}The plugin [HornetQ] has been updated at [hornetq-jopr-plugin-2.0.0.Final.jar]. 2014-11-05 06:24:35,784 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading}Downloading the plugin [jopr-hibernate-plugin-4.9.0.JON320GA.jar]... 2014-11-05 06:24:35,802 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading-complete}The plugin [Hibernate] has been updated at [jopr-hibernate-plugin-4.9.0.JON320GA.jar]. 2014-11-05 06:24:35,802 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading}Downloading the plugin [gatein-as7-rhq-plugin-1.0.1.Final-redhat-1.jar]... 2014-11-05 06:24:35,819 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading-complete}The plugin [GateIn AS7] has been updated at [gatein-as7-rhq-plugin-1.0.1.Final-redhat-1.jar]. 2014-11-05 06:24:35,819 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading}Downloading the plugin [gatein-rhq-plugin-1.0.1.jar]... 2014-11-05 06:24:35,835 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading-complete}The plugin [GateIn] has been updated at [gatein-rhq-plugin-1.0.1.jar]. 2014-11-05 06:24:35,835 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading}Downloading the plugin [fabric-plugin-7.2.2.redhat-024.jar]... 2014-11-05 06:24:35,986 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading-complete}The plugin [Fabric] has been updated at [fabric-plugin-7.2.2.redhat-024.jar]. 2014-11-05 06:24:36,016 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading}Downloading the plugin [servicemix4-plugin-7.2.2.redhat-024.jar]... 2014-11-05 06:24:36,040 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading-complete}The plugin [Servicemix4] has been updated at [servicemix4-plugin-7.2.2.redhat-024.jar]. 2014-11-05 06:24:36,040 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading}Downloading the plugin [drools-rhq-plugin-6.0.0-redhat-3.jar]... 2014-11-05 06:24:36,072 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading-complete}The plugin [DroolsRHQPlugin] has been updated at [drools-rhq-plugin-6.0.0-redhat-3.jar]. 2014-11-05 06:24:36,072 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading}Downloading the plugin [jboss-fuse-plugin-7.3.1.redhat-379.jar]... 2014-11-05 06:24:36,117 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading-complete}The plugin [JBossFuse] has been updated at [jboss-fuse-plugin-7.3.1.redhat-379.jar]. 2014-11-05 06:24:36,118 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading}Downloading the plugin [rhq-ant-bundle-plugin-4.12.0.JON330CR01.jar]... 2014-11-05 06:24:36,528 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading-complete}The plugin [AntBundlePlugin] has been updated at [rhq-ant-bundle-plugin-4.12.0.JON330CR01.jar]. 2014-11-05 06:24:36,528 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading}Downloading the plugin [rhq-rhqstorage-plugin-4.12.0.JON330CR01.jar]... 2014-11-05 06:24:36,543 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading-complete}The plugin [RHQStorage] has been updated at [rhq-rhqstorage-plugin-4.12.0.JON330CR01.jar]. 2014-11-05 06:24:36,543 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading}Downloading the plugin [camel-plugin-7.2.2.redhat-024.jar]... 2014-11-05 06:24:36,561 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading-complete}The plugin [Camel] has been updated at [camel-plugin-7.2.2.redhat-024.jar]. 2014-11-05 06:24:36,561 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading}Downloading the plugin [cxf-plugin-7.2.2.redhat-024.jar]... 2014-11-05 06:24:36,576 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading-complete}The plugin [CXF] has been updated at [cxf-plugin-7.2.2.redhat-024.jar]. 2014-11-05 06:24:36,576 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading}Downloading the plugin [rhq-augeas-plugin-4.9.0.JON320GA.jar]... 2014-11-05 06:24:36,701 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading-complete}The plugin [Augeas] has been updated at [rhq-augeas-plugin-4.9.0.JON320GA.jar]. 2014-11-05 06:24:36,701 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading}Downloading the plugin [rhq-apache-plugin-4.9.0.JON320GA.jar]... 2014-11-05 06:24:36,777 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading-complete}The plugin [Apache] has been updated at [rhq-apache-plugin-4.9.0.JON320GA.jar]. 2014-11-05 06:24:36,777 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading}Downloading the plugin [activemq-plugin-7.2.2.redhat-024.jar]... 2014-11-05 06:24:36,792 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading-complete}The plugin [ActiveMQ] has been updated at [activemq-plugin-7.2.2.redhat-024.jar]. 2014-11-05 06:24:36,792 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading}Downloading the plugin [rhq-script-plugin-4.12.0.JON330CR01.jar]... 2014-11-05 06:24:36,806 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading-complete}The plugin [Script] has been updated at [rhq-script-plugin-4.12.0.JON330CR01.jar]. 2014-11-05 06:24:36,807 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading}Downloading the plugin [rhq-platform-plugin-4.12.0.JON330CR01.jar]... 2014-11-05 06:24:36,864 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading-complete}The plugin [Platforms] has been updated at [rhq-platform-plugin-4.12.0.JON330CR01.jar]. 2014-11-05 06:24:36,864 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading}Downloading the plugin [rhq-jmx-plugin-4.12.0.JON330CR01.jar]... 2014-11-05 06:24:36,971 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading-complete}The plugin [JMX] has been updated at [rhq-jmx-plugin-4.12.0.JON330CR01.jar]. 2014-11-05 06:24:36,971 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading}Downloading the plugin [rhq-postgres-plugin-4.12.0.JON330CR01.jar]... 2014-11-05 06:24:37,057 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading-complete}The plugin [Postgres] has been updated at [rhq-postgres-plugin-4.12.0.JON330CR01.jar]. 2014-11-05 06:24:37,057 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading}Downloading the plugin [rhq-database-plugin-4.12.0.JON330CR01.jar]... 2014-11-05 06:24:37,306 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading-complete}The plugin [Database] has been updated at [rhq-database-plugin-4.12.0.JON330CR01.jar]. 2014-11-05 06:24:37,306 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading}Downloading the plugin [rhq-cassandra-plugin-4.12.0.JON330CR01.jar]... 2014-11-05 06:24:37,350 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading-complete}The plugin [Cassandra] has been updated at [rhq-cassandra-plugin-4.12.0.JON330CR01.jar]. 2014-11-05 06:24:37,350 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.updating-complete}Completed updating the plugins to their latest versions. 2014-11-05 06:24:37,352 INFO [main] (org.rhq.core.pc.PluginContainer)- Initializing Plugin Container v4.12.0.JON330CR01... 2014-11-05 06:24:47,643 INFO [main] (rhq.core.pc.plugin.PluginManager)- Deployed plugins: [AgentPlugin [id=0, name=Script, md5=d74e60bbadd866dea49d040a44424f30], AgentPlugin [id=0, name=Platforms, md5=b9bff94567815680c74cdd1bfd9c9cb1], AgentPlugin [id=0, name=JMX, md5=e4d29e9daa3530ce6a1f7efbf7c2539a], AgentPlugin [id=0, name=Tomcat, md5=f63756196675b1195a91f53dfd5f214d], AgentPlugin [id=0, name=Servicemix3, md5=96b25393461a8915bb8298760b7aea63], AgentPlugin [id=0, name=RHQAgent, md5=7e64c3497bf6ebc5c3fdf23babf7ccb0], AgentPlugin [id=0, name=KieRHQPlugin, md5=bb6ca21b4d4676da59b02d7c20a7b25b], AgentPlugin [id=0, name=JBossFuse, md5=8a22d4ef90c4e255aab4eded35c0a1b2], AgentPlugin [id=0, name=JBossAS7, md5=ea18eed6efcfaca84bf5550816f9d06f], AgentPlugin [id=0, name=Teiid, md5=e5be9b61fc73d68d57cc425849e92e70], AgentPlugin [id=0, name=SwitchYard, md5=6d055c2c1a2ab3b4ab4ecfa9209d54ab], AgentPlugin [id=0, name=RHQServer, md5=618c7262321a52a84393b311ae0a1134], AgentPlugin [id=0, name=ModeShape, md5=c77e4ffe00dfde5d3e7d35bbed016753], AgentPlugin [id=0, name=JDG, md5=bc3bb1cc5800b67bf516fa1cb95ccdb4], AgentPlugin [id=0, name=JBossAS5, md5=be941d167046f9aef2825eb882e96ec2], AgentPlugin [id=0, name=TeiidPlugin, md5=4808b650b96f13a979442ebd685ccfc4], AgentPlugin [id=0, name=ModeShapePlugin, md5=6368c26b5dc966339ccc72be1b6c22c3], AgentPlugin [id=0, name=JBossESB5, md5=bbf99d35814c4c894b3f4c5da2cdf9aa], AgentPlugin [id=0, name=JBossCache3, md5=d542282486db366102ed35744661a7dd], AgentPlugin [id=0, name=JBossAS, md5=ebaf78d978ffcbd2ce71dfaa0d453959], AgentPlugin [id=0, name=JBossESB, md5=5966cbe51a1deeb05088dd923769d97b], AgentPlugin [id=0, name=JBossCache, md5=cd70eb81cf5cbd3e911abf2a6f9db680], AgentPlugin [id=0, name=Infinispan, md5=83999fc7432241953580f19bc7cef5a8], AgentPlugin [id=0, name=IIS, md5=5b3e3e5fc69b8f27d610c1c20d6c31ce], AgentPlugin [id=0, name=HornetQ, md5=d351425c4e2ddf8ad23ac42646a61065], AgentPlugin [id=0, name=Hibernate, md5=d9b54b7bde13c70854ecc353dfbec20e], AgentPlugin [id=0, name=GateIn AS7, md5=f6dd483e4c3696e4ab56f9381e33eb31], AgentPlugin [id=0, name=GateIn, md5=4dc187d1103c3bfc0d48c8da73d205b5], AgentPlugin [id=0, name=Fabric, md5=bff4f53726e814e0dd02940dd7305434], AgentPlugin [id=0, name=Servicemix4, md5=2ea28f85fd26cfaa63dd364e0d3746d8], AgentPlugin [id=0, name=DroolsRHQPlugin, md5=c0b520b98cce29dd10b619fcdfef5b24], AgentPlugin [id=0, name=Database, md5=4a8c94c7cc7696e379be8e63ee96f52a], AgentPlugin [id=0, name=Postgres, md5=0370805f58a5cc8b134c9e4e1c57b11f], AgentPlugin [id=0, name=Cassandra, md5=0d77f9e3782b977842b5835b4a837ac0], AgentPlugin [id=0, name=RHQStorage, md5=140bda404e86d5a4b8b4f1c19957c7bf], AgentPlugin [id=0, name=Camel, md5=a4efbd0c7b6c67a150c80d756617ff76], AgentPlugin [id=0, name=CXF, md5=b8da1b49d28db1636f93307168673298], AgentPlugin [id=0, name=Augeas, md5=59d91ec1b355dbcb75764caf62355e64], AgentPlugin [id=0, name=Apache, md5=5dde36883f503d7d52bd53f2646ede67], AgentPlugin [id=0, name=AntBundlePlugin, md5=f51b589e9a42a233fda032b9ab314c1b], AgentPlugin [id=0, name=ActiveMQ, md5=d803c0c42dce8429400b0fb61e8d55e2]] 2014-11-05 06:24:47,683 INFO [main] (rhq.core.pc.inventory.InventoryManager)- Initializing Inventory Manager... 2014-11-05 06:24:47,709 INFO [main] (rhq.core.pc.inventory.InventoryManager)- Detected new Platform [Resource[id=0, uuid=27ac4353-8d3e-4f55-8d04-aafef6244d3b, type={Platforms}Linux, key=fbr-ha-3.bc.jonqe.lab.eng.bos.redhat.com, name=fbr-ha-3.bc.jonqe.lab.eng.bos.redhat.com, parent=, version=Linux 2.6.32-504.el6.x86_64]] - adding to local inventory... 2014-11-05 06:24:47,711 INFO [main] (rhq.core.pc.inventory.InventoryManager)- Starting resource activation and upgrade. 2014-11-05 06:24:47,711 INFO [main] (rhq.core.pc.inventory.InventoryManager)- Executing the initial inventory synchronization before upgrade. 2014-11-05 06:24:47,711 INFO [main] (rhq.core.pc.inventory.InventoryManager)- Sending [server] inventory report to Server... 2014-11-05 06:24:47,845 INFO [main] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Platform [10111] 2014-11-05 06:24:47,845 INFO [main] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Platform Top level services [10111] 2014-11-05 06:24:47,954 INFO [main] (rhq.core.pc.inventory.InventoryManager)- Got unknown resource: 10111 2014-11-05 06:24:48,059 INFO [main] (core.pc.drift.sync.DriftSyncManager)- Starting server sync for drift definitions... 2014-11-05 06:24:48,086 INFO [main] (core.pc.drift.sync.DriftSyncManager)- Finished server sync for drift definitions. 0 added and 0 deleted in 25 ms 2014-11-05 06:24:48,086 INFO [main] (core.pc.drift.sync.DriftSyncManager)- Starting drift content sync... 2014-11-05 06:24:48,086 INFO [main] (core.pc.drift.sync.DriftSyncManager)- Finished drift content sync in 0 ms 2014-11-05 06:24:48,086 INFO [main] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Platform Top level services [10111] Local inventory changed: [true] 2014-11-05 06:24:48,109 INFO [main] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [10113] 2014-11-05 06:24:48,774 INFO [main] (rhq.core.pc.inventory.InventoryManager)- Got unknown resource: 10113 2014-11-05 06:24:49,054 INFO [main] (core.pc.drift.sync.DriftSyncManager)- Starting server sync for drift definitions... 2014-11-05 06:24:49,057 INFO [main] (core.pc.drift.sync.DriftSyncManager)- Finished server sync for drift definitions. 0 added and 0 deleted in 3 ms 2014-11-05 06:24:49,057 INFO [main] (core.pc.drift.sync.DriftSyncManager)- Starting drift content sync... 2014-11-05 06:24:49,057 INFO [main] (core.pc.drift.sync.DriftSyncManager)- Finished drift content sync in 0 ms 2014-11-05 06:24:49,057 INFO [main] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [10113] Local inventory changed: [true] 2014-11-05 06:24:49,868 INFO [main] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [10112] 2014-11-05 06:24:49,965 INFO [main] (rhq.core.pc.inventory.InventoryManager)- Got unknown resource: 10112 2014-11-05 06:24:50,037 INFO [main] (core.pc.drift.sync.DriftSyncManager)- Starting server sync for drift definitions... 2014-11-05 06:24:50,039 INFO [main] (core.pc.drift.sync.DriftSyncManager)- Finished server sync for drift definitions. 0 added and 0 deleted in 2 ms 2014-11-05 06:24:50,040 INFO [main] (core.pc.drift.sync.DriftSyncManager)- Starting drift content sync... 2014-11-05 06:24:50,040 INFO [main] (core.pc.drift.sync.DriftSyncManager)- Finished drift content sync in 0 ms 2014-11-05 06:24:50,040 INFO [main] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [10112] Local inventory changed: [true] 2014-11-05 06:24:50,864 INFO [main] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [10114] 2014-11-05 06:24:52,242 INFO [main] (rhq.core.pc.inventory.InventoryManager)- Got unknown resource: 10114 2014-11-05 06:24:53,015 INFO [main] (core.pc.drift.sync.DriftSyncManager)- Starting server sync for drift definitions... 2014-11-05 06:24:53,034 INFO [main] (core.pc.drift.sync.DriftSyncManager)- Finished server sync for drift definitions. 0 added and 0 deleted in 19 ms 2014-11-05 06:24:53,034 INFO [main] (core.pc.drift.sync.DriftSyncManager)- Starting drift content sync... 2014-11-05 06:24:53,034 INFO [main] (core.pc.drift.sync.DriftSyncManager)- Finished drift content sync in 0 ms 2014-11-05 06:24:53,034 INFO [main] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [10114] Local inventory changed: [true] 2014-11-05 06:24:53,836 INFO [main] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Platform [10111]. 2014-11-05 06:24:53,836 INFO [main] (rhq.core.pc.inventory.InventoryManager)- Starting to activate (and upgrade) resources. 2014-11-05 06:24:53,854 INFO [ResourceContainer.invoker.daemon-1] (org.rhq.plugins.platform.LinuxPlatformComponent)- Internal yum server is disabled. 2014-11-05 06:24:55,146 INFO [ResourceContainer.invoker.daemon-1] (ems.impl.jmx.connection.DConnection)- Querying MBeanServer for all MBeans... 2014-11-05 06:24:55,225 INFO [ResourceContainer.invoker.daemon-1] (ems.impl.jmx.connection.DConnection)- Found 937 MBeans - starting load... 2014-11-05 06:24:55,440 INFO [ResourceContainer.invoker.daemon-1] (ems.impl.jmx.connection.DConnection)- Querying MBeanServer for all MBeans... 2014-11-05 06:24:55,441 INFO [ResourceContainer.invoker.daemon-1] (ems.impl.jmx.connection.DConnection)- Found 29 MBeans - starting load... 2014-11-05 06:24:55,519 INFO [ResourceContainer.invoker.daemon-1] (ems.impl.jmx.connection.DConnection)- Querying MBeanServer for all MBeans... 2014-11-05 06:24:55,519 INFO [ResourceContainer.invoker.daemon-1] (ems.impl.jmx.connection.DConnection)- Found 29 MBeans - starting load... 2014-11-05 06:24:56,309 INFO [ResourceContainer.invoker.daemon-1] (org.rhq.plugins.server.JBossAS7JMXComponent)- Loading AS7 connection [service:jmx:remoting-jmx://127.0.0.1:6999] with install path [null]... 2014-11-05 06:24:56,359 INFO [ResourceContainer.invoker.daemon-1] (org.xnio)- XNIO Version 3.0.7.GA-redhat-1 2014-11-05 06:24:56,385 INFO [ResourceContainer.invoker.daemon-1] (org.xnio.nio)- XNIO NIO Implementation Version 3.0.7.GA-redhat-1 2014-11-05 06:24:56,409 INFO [ResourceContainer.invoker.daemon-1] (org.jboss.remoting)- JBoss Remoting version 3.2.16.GA-redhat-1 2014-11-05 06:24:57,387 INFO [main] (rhq.core.pc.inventory.InventoryManager)- Inventory activated and upgrade requests gathered in 9676ms. 2014-11-05 06:24:57,387 INFO [main] (rhq.core.pc.inventory.InventoryManager)- Sending the upgrade requests to the server. 2014-11-05 06:24:57,709 INFO [main] (rhq.core.pc.inventory.InventoryManager)- Resource [Resource[id=10113, uuid=2508154c-518b-457f-a8f7-1e9e58fa727c, type={RHQStorage}RHQ Storage Node, key=RHQ Storage Node(fbr-ha-3.bc.jonqe.lab.eng.bos.redhat.com), name=RHQ Storage Node(fbr-ha-3.bc.jonqe.lab.eng.bos.redhat.com), parent=fbr-ha-3.bc.jonqe.lab.eng.bos.redhat.com, version=4.9.0.JON320GA]] upgraded [pluginConfiguration,] to become [Resource[id=10113, uuid=2508154c-518b-457f-a8f7-1e9e58fa727c, type={RHQStorage}RHQ Storage Node, key=RHQ Storage Node(fbr-ha-3.bc.jonqe.lab.eng.bos.redhat.com), name=RHQ Storage Node(fbr-ha-3.bc.jonqe.lab.eng.bos.redhat.com), parent=fbr-ha-3.bc.jonqe.lab.eng.bos.redhat.com, version=4.9.0.JON320GA]] 2014-11-05 06:24:57,709 INFO [main] (rhq.core.pc.inventory.InventoryManager)- Resource [Resource[id=10112, uuid=0bdc5e04-02e1-4ed9-8635-baa5781ea774, type={RHQAgent}RHQ Agent, key=fbr-ha-3.bc.jonqe.lab.eng.bos.redhat.com RHQ Agent, name=RHQ Agent, parent=fbr-ha-3.bc.jonqe.lab.eng.bos.redhat.com, version=4.9.0.JON320GA]] upgraded [resourceKey,] to become [Resource[id=10112, uuid=0bdc5e04-02e1-4ed9-8635-baa5781ea774, type={RHQAgent}RHQ Agent, key=RHQ Agent, name=RHQ Agent, parent=fbr-ha-3.bc.jonqe.lab.eng.bos.redhat.com, version=4.9.0.JON320GA]] 2014-11-05 06:24:57,709 INFO [main] (rhq.core.pc.inventory.InventoryManager)- Resource [Resource[id=10114, uuid=a77ded3d-b857-4de2-ab15-b52797463bfe, type={JBossAS7}JBossAS7 Standalone Server, key=hostConfig: /home/hudson/jon-server-3.2.0.GA/jbossas/standalone/configuration/standalone-full.xml, name=EAP (127.0.0.1:6990) RHQ Server, parent=fbr-ha-3.bc.jonqe.lab.eng.bos.redhat.com, version=EAP 6.1.1.GA]] upgraded [pluginConfiguration,] to become [Resource[id=10114, uuid=a77ded3d-b857-4de2-ab15-b52797463bfe, type={JBossAS7}JBossAS7 Standalone Server, key=hostConfig: /home/hudson/jon-server-3.2.0.GA/jbossas/standalone/configuration/standalone-full.xml, name=EAP (127.0.0.1:6990) RHQ Server, parent=fbr-ha-3.bc.jonqe.lab.eng.bos.redhat.com, version=EAP 6.1.1.GA]] 2014-11-05 06:24:57,709 INFO [main] (rhq.core.pc.inventory.InventoryManager)- Resource [Resource[id=10135, uuid=d35a88a2-60ea-4043-8704-8f6f7f22af94, type={RHQStorage}Cassandra Server JVM, key=JVM, name=Cassandra Server JVM, parent=RHQ Storage Node(fbr-ha-3.bc.jonqe.lab.eng.bos.redhat.com), version=1.7.0_65]] upgraded [name, description,] to become [Resource[id=10135, uuid=d35a88a2-60ea-4043-8704-8f6f7f22af94, type={RHQStorage}Cassandra Server JVM, key=JVM, name=JVM, parent=RHQ Storage Node(fbr-ha-3.bc.jonqe.lab.eng.bos.redhat.com), version=1.7.0_65]] 2014-11-05 06:24:57,712 INFO [ResourceContainer.invoker.daemon-1] (ems.impl.jmx.connection.DConnection)- Querying MBeanServer for all MBeans... 2014-11-05 06:24:57,713 INFO [ResourceContainer.invoker.daemon-1] (ems.impl.jmx.connection.DConnection)- Found 30 MBeans - starting load... 2014-11-05 06:24:57,738 INFO [ResourceContainer.invoker.daemon-1] (ems.impl.jmx.connection.DConnection)- Querying MBeanServer for all MBeans... 2014-11-05 06:24:57,801 INFO [ResourceContainer.invoker.daemon-1] (ems.impl.jmx.connection.DConnection)- Found 937 MBeans - starting load... 2014-11-05 06:24:57,886 INFO [ResourceContainer.invoker.daemon-2] (ems.impl.jmx.connection.DConnection)- Querying MBeanServer for all MBeans... 2014-11-05 06:24:57,963 INFO [ResourceContainer.invoker.daemon-2] (ems.impl.jmx.connection.DConnection)- Found 937 MBeans - starting load... 2014-11-05 06:24:57,975 INFO [main] (rhq.core.pc.inventory.InventoryManager)- Resource activation and upgrade finished. 2014-11-05 06:24:57,975 INFO [main] (rhq.core.pc.inventory.InventoryManager)- Inventory Manager initialized. 2014-11-05 06:24:57,975 INFO [main] (rhq.core.pc.event.EventManager)- Initializing Event Manager... 2014-11-05 06:24:57,977 INFO [main] (rhq.core.pc.event.EventManager)- Event Manager initialized. 2014-11-05 06:24:57,977 INFO [main] (rhq.core.pc.measurement.MeasurementManager)- Initializing Measurement Manager... 2014-11-05 06:24:58,087 INFO [main] (rhq.core.pc.measurement.MeasurementManager)- Measurement Manager initialized. 2014-11-05 06:24:58,087 INFO [main] (rhq.core.pc.content.ContentManager)- Initializing Content Manager... 2014-11-05 06:24:58,087 INFO [main] (rhq.core.pc.content.ContentManager)- Initializing scheduled content discovery... 2014-11-05 06:24:58,093 INFO [main] (rhq.core.pc.content.ContentManager)- Content Manager initialized... 2014-11-05 06:24:58,135 INFO [main] (rhq.core.pc.drift.DriftManager)- Finished initializing drift detection schedules in 7 ms 2014-11-05 06:24:58,135 INFO [main] (rhq.core.pc.drift.DriftManager)- Scanning for change set content to resend... 2014-11-05 06:24:58,135 INFO [main] (rhq.core.pc.drift.DriftManager)- Checking for deleted drift definitions 2014-11-05 06:24:58,135 INFO [main] (rhq.core.pc.drift.DriftManager)- Finished initialization in 11 ms 2014-11-05 06:24:58,136 INFO [main] (org.rhq.core.pc.PluginContainer)- Plugin Container initialized. 2014-11-05 06:24:58,137 INFO [RHQ Agent Ping Thread-1] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.ping-executor.stop-polling-resume-ping}Stopping polling and resuming pinging 2014-11-05 06:24:58,142 INFO [RHQ Primary Server Switchover Thread] (org.rhq.enterprise.agent.AgentMain)- {PrimaryServerSwitchoverThread.started}The primary server switchover thread has started. 2014-11-05 06:24:58,163 WARN [RHQ Agent Ping Thread-1] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.server-thinks-agent-is-down}The server thinks this agent is down. Will notify the server of up-to-date information when possible. 2014-11-05 06:25:07,975 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.AutoDiscoveryExecutor)- Executing server discovery scan... 2014-11-05 06:25:08,176 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Version of [Resource[id=10112, uuid=0bdc5e04-02e1-4ed9-8635-baa5781ea774, type={RHQAgent}RHQ Agent, key=RHQ Agent, name=RHQ Agent, parent=fbr-ha-3.bc.jonqe.lab.eng.bos.redhat.com, version=4.12.0.JON330CR01]] changed from [4.9.0.JON320GA] to [4.12.0.JON330CR01] 2014-11-05 06:25:08,177 INFO [ResourceContainer.invoker.daemon-2] (ems.impl.jmx.connection.DConnection)- Querying MBeanServer for all MBeans... 2014-11-05 06:25:08,177 INFO [ResourceContainer.invoker.daemon-2] (ems.impl.jmx.connection.DConnection)- Found 31 MBeans - starting load... 2014-11-05 06:25:08,579 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Detected new Server [Resource[id=0, uuid=268d06af-957e-4094-928e-1296aaf4de6a, type={JBossAS7}JBossAS7 Standalone Server, key=hostConfig: /home/hudson/jon-server-3.3.0.CR01/jbossas/standalone/configuration/standalone-full.xml, name=EAP (127.0.0.1:6990) RHQ Server, parent=, version=EAP 6.3.0.GA]] - adding to local inventory... 2014-11-05 06:25:08,867 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Version of [Resource[id=10113, uuid=2508154c-518b-457f-a8f7-1e9e58fa727c, type={RHQStorage}RHQ Storage Node, key=RHQ Storage Node(fbr-ha-3.bc.jonqe.lab.eng.bos.redhat.com), name=RHQ Storage Node(fbr-ha-3.bc.jonqe.lab.eng.bos.redhat.com), parent=fbr-ha-3.bc.jonqe.lab.eng.bos.redhat.com, version=4.12.0.JON330CR01]] changed from [4.9.0.JON320GA] to [4.12.0.JON330CR01] 2014-11-05 06:25:08,886 INFO [ResourceContainer.invoker.daemon-2] (ems.impl.jmx.connection.DConnection)- Querying MBeanServer for all MBeans... 2014-11-05 06:25:08,943 INFO [ResourceContainer.invoker.daemon-2] (ems.impl.jmx.connection.DConnection)- Found 937 MBeans - starting load... 2014-11-05 06:25:09,039 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.AutoDiscoveryExecutor)- Discovered new platform with 12 child server(s). 2014-11-05 06:25:09,039 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sending [server] inventory report to Server... 2014-11-05 06:25:13,093 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Platform [10111] 2014-11-05 06:25:13,093 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Platform Top level services [10111] 2014-11-05 06:25:13,093 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Platform Top level services [10111] Local inventory changed: [false] 2014-11-05 06:25:13,103 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [10113] 2014-11-05 06:25:13,172 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [10113] Local inventory changed: [false] 2014-11-05 06:25:13,981 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [10112] 2014-11-05 06:25:13,982 INFO [ResourceContainer.invoker.daemon-1] (ems.impl.jmx.connection.DConnection)- Querying MBeanServer for all MBeans... 2014-11-05 06:25:13,982 INFO [ResourceContainer.invoker.daemon-1] (ems.impl.jmx.connection.DConnection)- Found 31 MBeans - starting load... 2014-11-05 06:25:13,986 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [10112] Local inventory changed: [false] 2014-11-05 06:25:14,807 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [10114] 2014-11-05 06:25:14,819 WARN [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Cannot start component for Resource[id=10356, uuid=10cad0bc-84d2-46f9-aace-777ae1dd6055, type={JBossAS7}Deployment, key=deployment=rhq.ear, name=rhq.ear, parent=EAP (127.0.0.1:6990) RHQ Server] from synchronized merge due to invalid plugin config: Failed to start component for Resource[id=10356, uuid=10cad0bc-84d2-46f9-aace-777ae1dd6055, type={JBossAS7}Deployment, key=deployment=rhq.ear, name=rhq.ear, parent=EAP (127.0.0.1:6990) RHQ Server] - Credentials for plugin to connect to AS7 management interface are invalid - update Connection Settings with valid credentials. 2014-11-05 06:25:14,865 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [10114] Local inventory changed: [false] 2014-11-05 06:25:15,673 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [12951] 2014-11-05 06:25:15,673 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [12951] Local inventory changed: [true] 2014-11-05 06:25:16,476 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Platform [10111]. 2014-11-05 06:25:16,476 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync changes detected, requesting full availability report and service discovery: Platform [10111] 2014-11-05 06:25:17,976 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.RuntimeDiscoveryExecutor)- Executing runtime discovery scan rooted at [platform]... 2014-11-05 06:25:18,036 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Version of [Resource[id=10122, uuid=22f5d657-fda3-4f5c-9235-35c859cde681, type={AntBundlePlugin}Ant Bundle Handler, key=ant-bundle, name=Bundle Handler - Ant, parent=fbr-ha-3.bc.jonqe.lab.eng.bos.redhat.com, version=4.12.0.JON330CR01]] changed from [4.9.0.JON320GA] to [4.12.0.JON330CR01] 2014-11-05 06:25:18,050 INFO [ResourceDiscoveryComponent.invoker.daemon-1] (ems.impl.jmx.connection.DConnection)- Querying MBeanServer for all MBeans... 2014-11-05 06:25:18,430 INFO [ResourceDiscoveryComponent.invoker.daemon-3] (org.rhq.plugins.agent.AgentEnvironmentScriptDiscoveryComponent)- Discovering RHQ Agent's environment setup script... 2014-11-05 06:25:18,512 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Version of [Resource[id=10293, uuid=fa3ac2be-7fb2-4d9d-ad02-cad5999e170f, type={RHQAgent}Environment Setup Script, key=environment-setup-script, name=rhq-agent-env.sh, parent=RHQ Agent, version=4.12.0.JON330CR01]] changed from [4.9.0.JON320GA] to [4.12.0.JON330CR01] 2014-11-05 06:25:18,513 INFO [ResourceDiscoveryComponent.invoker.daemon-3] (org.rhq.plugins.agent.AgentLauncherScriptDiscoveryComponent)- Discovering RHQ Agent's launcher script service... 2014-11-05 06:25:18,587 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Version of [Resource[id=10296, uuid=14f7a148-4131-4a00-a64f-cc54173f74d8, type={RHQAgent}Launcher Script, key=launcherscript, name=RHQ Agent Launcher Script, parent=RHQ Agent, version=4.12.0.JON330CR01]] changed from [4.9.0.JON320GA] to [4.12.0.JON330CR01] 2014-11-05 06:25:18,590 INFO [ResourceDiscoveryComponent.invoker.daemon-3] (org.rhq.plugins.agent.AgentJavaServiceWrapperDiscoveryComponent)- Discovering RHQ Agent's JSW service... 2014-11-05 06:25:18,603 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.RuntimeDiscoveryExecutor)- Scanned platform and 1 server(s) and discovered 692 new descendant Resource(s). 2014-11-05 06:25:18,603 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sending [runtime] inventory report to Server... 2014-11-05 06:25:22,159 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Platform [10111] 2014-11-05 06:25:22,159 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Platform Top level services [10111] 2014-11-05 06:25:22,258 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Platform Top level services [10111] Local inventory changed: [true] 2014-11-05 06:25:22,280 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [10113] 2014-11-05 06:25:22,331 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [10113] Local inventory changed: [true] 2014-11-05 06:25:23,156 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [10112] 2014-11-05 06:25:23,156 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [10112] Local inventory changed: [false] 2014-11-05 06:25:23,986 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [10114] 2014-11-05 06:25:23,992 WARN [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Cannot start component for Resource[id=10356, uuid=10cad0bc-84d2-46f9-aace-777ae1dd6055, type={JBossAS7}Deployment, key=deployment=rhq.ear, name=rhq.ear, parent=EAP (127.0.0.1:6990) RHQ Server] from synchronized merge due to invalid plugin config: Failed to start component for Resource[id=10356, uuid=10cad0bc-84d2-46f9-aace-777ae1dd6055, type={JBossAS7}Deployment, key=deployment=rhq.ear, name=rhq.ear, parent=EAP (127.0.0.1:6990) RHQ Server] - Credentials for plugin to connect to AS7 management interface are invalid - update Connection Settings with valid credentials. 2014-11-05 06:25:24,025 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [10114] Local inventory changed: [false] 2014-11-05 06:25:24,832 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [12951] 2014-11-05 06:25:24,833 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [12951] Local inventory changed: [false] 2014-11-05 06:25:25,634 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Platform [10111]. 2014-11-05 06:25:25,634 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync changes detected, requesting full availability report and service discovery: Platform [10111] 2014-11-05 06:25:25,634 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Canceled in-progress service scan in favor of starting new scan. Partial scan will still be processed. 2014-11-05 06:25:28,672 WARN [MeasurementManager.collector-1] (rhq.core.pc.measurement.MeasurementCollectorRunner)- Failure to collect measurement data for Resource[id=10448, uuid=50c85be9-b040-4b9e-8259-c3daa1d0876f, type={RHQStorage}ConfigurableInternalServerMetrics, key=org.apache.cassandra.internal:type=AntiEntropySessions, name=Anti Entropy Sessions, parent=RHQ Storage Node(fbr-ha-3.bc.jonqe.lab.eng.bos.redhat.com)] - cause: java.lang.IllegalStateException:EMS bean was null for Resource with type [ResourceType[id=0, name=ConfigurableInternalServerMetrics, plugin=RHQStorage, category=Service]] and key [org.apache.cassandra.internal:type=AntiEntropySessions]. 2014-11-05 06:25:29,094 WARN [MeasurementManager.collector-1] (rhq.core.pc.measurement.MeasurementCollectorRunner)- Failure to collect measurement data for Resource[id=10801, uuid=97c7c025-af86-4f47-8dd5-f900cee244ae, type={RHQStorage}ColumnFamily, key=six_hour_metrics, name=six_hour_metrics, parent=rhq] - cause: java.lang.IllegalStateException:EMS bean was null for Resource with type [ResourceType[id=0, name=ColumnFamily, plugin=RHQStorage, category=Service]] and key [six_hour_metrics]. 2014-11-05 06:25:29,096 WARN [MeasurementManager.collector-1] (rhq.core.pc.measurement.MeasurementCollectorRunner)- Failure to collect measurement data for Resource[id=10658, uuid=15330b3f-88d0-473a-9c7a-d34bd4e22b9d, type={RHQStorage}ColumnFamily, key=twenty_four_hour_metrics, name=twenty_four_hour_metrics, parent=rhq] - cause: java.lang.IllegalStateException:EMS bean was null for Resource with type [ResourceType[id=0, name=ColumnFamily, plugin=RHQStorage, category=Service]] and key [twenty_four_hour_metrics]. 2014-11-05 06:25:29,145 WARN [MeasurementManager.collector-1] (rhq.core.pc.measurement.MeasurementCollectorRunner)- Failure to collect measurement data for Resource[id=10659, uuid=8eb71194-c180-458d-8612-5cf695615708, type={RHQStorage}ColumnFamily, key=one_hour_metrics, name=one_hour_metrics, parent=rhq] - cause: java.lang.IllegalStateException:EMS bean was null for Resource with type [ResourceType[id=0, name=ColumnFamily, plugin=RHQStorage, category=Service]] and key [one_hour_metrics]. 2014-11-05 06:25:29,160 WARN [MeasurementManager.collector-1] (rhq.core.pc.measurement.MeasurementCollectorRunner)- Failure to collect measurement data for Resource[id=10803, uuid=81c5bd71-716f-42b2-a451-5871e3d7ad42, type={RHQStorage}ColumnFamily, key=metrics_index, name=metrics_index, parent=rhq] - cause: java.lang.IllegalStateException:EMS bean was null for Resource with type [ResourceType[id=0, name=ColumnFamily, plugin=RHQStorage, category=Service]] and key [metrics_index]. 2014-11-05 06:25:29,239 WARN [MeasurementManager.collector-1] (rhq.core.pc.measurement.MeasurementCollectorRunner)- Failure to collect measurement data for Resource[id=10114, uuid=a77ded3d-b857-4de2-ab15-b52797463bfe, type={JBossAS7}JBossAS7 Standalone Server, key=hostConfig: /home/hudson/jon-server-3.2.0.GA/jbossas/standalone/configuration/standalone-full.xml, name=EAP (127.0.0.1:6990) RHQ Server, parent=fbr-ha-3.bc.jonqe.lab.eng.bos.redhat.com, version=EAP 6.1.1.GA] - cause: org.rhq.core.pluginapi.inventory.InvalidPluginConfigurationException:Credentials for plugin to connect to AS7 management interface are invalid - update Connection Settings with valid credentials. 2014-11-05 06:25:29,244 WARN [MeasurementManager.collector-1] (rhq.core.pc.measurement.MeasurementCollectorRunner)- Failure to collect measurement data for Resource[id=10523, uuid=42ebc8de-4fa5-41f7-95e7-338d260c895e, type={JBossAS7}Memory, key=core-service=platform-mbean,type=memory, name=memory, parent=platform-mbean] - cause: org.rhq.core.pluginapi.inventory.InvalidPluginConfigurationException:Credentials for plugin to connect to AS7 management interface are invalid - update Connection Settings with valid credentials. 2014-11-05 06:25:29,272 WARN [MeasurementManager.collector-1] (rhq.core.pc.measurement.MeasurementCollectorRunner)- Failure to collect measurement data for Resource[id=10260, uuid=10042033-0dc7-4f8e-aafa-6a773eb4449b, type={JBossAS7}Transactions Subsystem (Standalone), key=subsystem=transactions, name=transactions, parent=EAP (127.0.0.1:6990) RHQ Server] - cause: org.rhq.core.pluginapi.inventory.InvalidPluginConfigurationException:Credentials for plugin to connect to AS7 management interface are invalid - update Connection Settings with valid credentials. 2014-11-05 06:25:29,276 WARN [MeasurementManager.collector-1] (rhq.core.pc.measurement.MeasurementCollectorRunner)- Failure to collect measurement data for Resource[id=10449, uuid=b2b634e1-32a1-4c3c-9940-bd3cf34e0563, type={JBossAS7}XADataSource (Standalone), key=subsystem=datasources,xa-data-source=RHQDS, name=RHQDS, parent=datasources] - cause: org.rhq.core.pluginapi.inventory.InvalidPluginConfigurationException:Credentials for plugin to connect to AS7 management interface are invalid - update Connection Settings with valid credentials. 2014-11-05 06:25:29,330 WARN [MeasurementManager.collector-1] (rhq.core.pc.measurement.MeasurementCollectorRunner)- Failure to collect measurement data for Resource[id=10450, uuid=f15b8652-8522-4811-94d9-b99997651769, type={JBossAS7}DataSource (Standalone), key=subsystem=datasources,data-source=NoTxRHQDS, name=NoTxRHQDS, parent=datasources] - cause: org.rhq.core.pluginapi.inventory.InvalidPluginConfigurationException:Credentials for plugin to connect to AS7 management interface are invalid - update Connection Settings with valid credentials. 2014-11-05 06:25:29,464 WARN [MeasurementManager.collector-1] (rhq.core.pc.measurement.MeasurementCollectorRunner)- Failure to collect measurement data for Resource[id=10277, uuid=269b50a5-46d9-46e4-b27e-d53d5454bf04, type={JBossAS7}Connector, key=subsystem=web,connector=https, name=https, parent=web] - cause: org.rhq.core.pluginapi.inventory.InvalidPluginConfigurationException:Credentials for plugin to connect to AS7 management interface are invalid - update Connection Settings with valid credentials. 2014-11-05 06:25:29,469 WARN [MeasurementManager.collector-1] (rhq.core.pc.measurement.MeasurementCollectorRunner)- Failure to collect measurement data for Resource[id=10278, uuid=75406069-4c9d-47bc-a067-f420618dc4d8, type={JBossAS7}VHost, key=subsystem=web,virtual-server=default-host, name=default-host, parent=web] - cause: org.rhq.core.pluginapi.inventory.InvalidPluginConfigurationException:Credentials for plugin to connect to AS7 management interface are invalid - update Connection Settings with valid credentials. 2014-11-05 06:25:29,472 WARN [MeasurementManager.collector-1] (rhq.core.pc.measurement.MeasurementCollectorRunner)- Failure to collect measurement data for Resource[id=10279, uuid=2e054d3a-1435-405b-ba32-ccf4f1810a38, type={JBossAS7}Connector, key=subsystem=web,connector=http, name=http, parent=web] - cause: org.rhq.core.pluginapi.inventory.InvalidPluginConfigurationException:Credentials for plugin to connect to AS7 management interface are invalid - update Connection Settings with valid credentials. 2014-11-05 06:25:30,635 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.RuntimeDiscoveryExecutor)- Executing runtime discovery scan rooted at [platform]... 2014-11-05 06:25:30,650 INFO [ResourceDiscoveryComponent.invoker.daemon-3] (ems.impl.jmx.connection.DConnection)- Querying MBeanServer for all MBeans... 2014-11-05 06:25:30,821 INFO [ResourceDiscoveryComponent.invoker.daemon-2] (org.rhq.plugins.agent.AgentEnvironmentScriptDiscoveryComponent)- Discovering RHQ Agent's environment setup script... 2014-11-05 06:25:30,822 INFO [ResourceDiscoveryComponent.invoker.daemon-2] (org.rhq.plugins.agent.AgentLauncherScriptDiscoveryComponent)- Discovering RHQ Agent's launcher script service... 2014-11-05 06:25:30,823 INFO [ResourceDiscoveryComponent.invoker.daemon-2] (org.rhq.plugins.agent.AgentJavaServiceWrapperDiscoveryComponent)- Discovering RHQ Agent's JSW service... 2014-11-05 06:25:30,834 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.RuntimeDiscoveryExecutor)- Scanned platform and 0 server(s) and discovered 0 new descendant Resource(s). 2014-11-05 06:25:30,834 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.RuntimeDiscoveryExecutor)- Not sending inventory report because no new descendent resources were discovered. 2014-11-05 06:25:33,117 INFO [InventoryManager.availability-1] (rhq.core.pc.inventory.InventoryManager)- Sending availability report to Server... 2014-11-05 06:26:06,004 INFO [InventoryManager.availability-1] (rhq.core.pc.inventory.InventoryManager)- Sending availability report to Server... 2014-11-05 06:26:36,544 INFO [InventoryManager.availability-1] (rhq.core.pc.inventory.InventoryManager)- Sending availability report to Server... 2014-11-05 06:27:07,028 INFO [InventoryManager.availability-1] (rhq.core.pc.inventory.InventoryManager)- Sending availability report to Server... 2014-11-05 06:27:37,608 INFO [InventoryManager.availability-1] (rhq.core.pc.inventory.InventoryManager)- Sending availability report to Server... 2014-11-05 06:28:08,098 INFO [InventoryManager.availability-1] (rhq.core.pc.inventory.InventoryManager)- Sending availability report to Server... 2014-11-05 06:28:38,711 INFO [InventoryManager.availability-1] (rhq.core.pc.inventory.InventoryManager)- Sending availability report to Server... 2014-11-05 06:29:09,178 INFO [InventoryManager.availability-1] (rhq.core.pc.inventory.InventoryManager)- Sending availability report to Server... 2014-11-05 06:29:39,667 INFO [InventoryManager.availability-1] (rhq.core.pc.inventory.InventoryManager)- Sending availability report to Server... 2014-11-05 06:29:58,125 INFO [ResourceContainer.invoker.daemon-2] (org.rhq.plugins.jmx.MBeanResourceComponent)- Configuration management is currently disabled for the ResourceType[id=0, name=java.util.logging, plugin=RHQAgent, category=Service] Resource with key [java.util.logging:type=Logging] - it can be enabled in the Resource's Inventory > Connection tab. 2014-11-05 06:29:58,309 INFO [ResourceContainer.invoker.daemon-3] (org.rhq.plugins.jmx.MBeanResourceComponent)- Configuration management is currently disabled for the ResourceType[id=0, name=java.util.logging, plugin=RHQStorage, category=Service] Resource with key [java.util.logging:type=Logging] - it can be enabled in the Resource's Inventory > Connection tab. 2014-11-05 06:30:10,107 INFO [InventoryManager.availability-1] (rhq.core.pc.inventory.InventoryManager)- Sending availability report to Server... 2014-11-05 06:30:40,679 INFO [InventoryManager.availability-1] (rhq.core.pc.inventory.InventoryManager)- Sending availability report to Server... 2014-11-05 06:31:11,170 INFO [InventoryManager.availability-1] (rhq.core.pc.inventory.InventoryManager)- Sending availability report to Server... 2014-11-05 06:31:41,613 INFO [InventoryManager.availability-1] (rhq.core.pc.inventory.InventoryManager)- Sending availability report to Server... 2014-11-05 06:32:12,086 INFO [InventoryManager.availability-1] (rhq.core.pc.inventory.InventoryManager)- Sending availability report to Server... 2014-11-05 06:32:37,059 INFO [WorkerThread#0[10.16.23.104:51365]] (rhq.core.pc.inventory.InventoryManager)- Deleted resource #[10114] - this will trigger a server scan now 2014-11-05 06:32:37,059 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.AutoDiscoveryExecutor)- Executing server discovery scan... 2014-11-05 06:32:37,239 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.AutoDiscoveryExecutor)- Discovered 1 new server(s). 2014-11-05 06:32:37,239 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sending [server] inventory report to Server... 2014-11-05 06:32:37,425 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Platform [10111] 2014-11-05 06:32:37,425 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Platform Top level services [10111] 2014-11-05 06:32:37,426 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Platform Top level services [10111] Local inventory changed: [false] 2014-11-05 06:32:37,445 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [10113] 2014-11-05 06:32:38,239 INFO [InventoryManager.discovery-1] (core.pc.drift.sync.DriftSyncManager)- Starting server sync for drift definitions... 2014-11-05 06:32:38,272 INFO [InventoryManager.discovery-1] (core.pc.drift.sync.DriftSyncManager)- Finished server sync for drift definitions. 0 added and 0 deleted in 28 ms 2014-11-05 06:32:38,273 INFO [InventoryManager.discovery-1] (core.pc.drift.sync.DriftSyncManager)- Starting drift content sync... 2014-11-05 06:32:38,273 INFO [InventoryManager.discovery-1] (rhq.core.pc.drift.DriftManager)- Scanning for change set content to resend... 2014-11-05 06:32:38,273 INFO [InventoryManager.discovery-1] (core.pc.drift.sync.DriftSyncManager)- Finished drift content sync in 0 ms 2014-11-05 06:32:38,281 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [10113] Local inventory changed: [true] 2014-11-05 06:32:39,121 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [10112] 2014-11-05 06:32:39,121 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [10112] Local inventory changed: [false] 2014-11-05 06:32:39,929 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [12951] 2014-11-05 06:32:39,929 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [12951] Local inventory changed: [false] 2014-11-05 06:32:40,730 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Platform [10111]. 2014-11-05 06:32:40,730 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync changes detected, requesting full availability report and service discovery: Platform [10111] 2014-11-05 06:32:42,571 INFO [InventoryManager.availability-1] (rhq.core.pc.inventory.InventoryManager)- Sending availability report to Server... 2014-11-05 06:32:45,730 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.RuntimeDiscoveryExecutor)- Executing runtime discovery scan rooted at [platform]... 2014-11-05 06:32:45,743 INFO [ResourceDiscoveryComponent.invoker.daemon-5] (ems.impl.jmx.connection.DConnection)- Querying MBeanServer for all MBeans... 2014-11-05 06:32:45,860 INFO [ResourceDiscoveryComponent.invoker.daemon-5] (org.rhq.plugins.agent.AgentEnvironmentScriptDiscoveryComponent)- Discovering RHQ Agent's environment setup script... 2014-11-05 06:32:45,861 INFO [ResourceDiscoveryComponent.invoker.daemon-5] (org.rhq.plugins.agent.AgentLauncherScriptDiscoveryComponent)- Discovering RHQ Agent's launcher script service... 2014-11-05 06:32:45,861 INFO [ResourceDiscoveryComponent.invoker.daemon-5] (org.rhq.plugins.agent.AgentJavaServiceWrapperDiscoveryComponent)- Discovering RHQ Agent's JSW service... 2014-11-05 06:32:45,866 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.RuntimeDiscoveryExecutor)- Scanned platform and 0 server(s) and discovered 0 new descendant Resource(s). 2014-11-05 06:32:45,866 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.RuntimeDiscoveryExecutor)- Not sending inventory report because no new descendent resources were discovered. 2014-11-05 06:32:50,105 INFO [WorkerThread#0[10.16.23.104:51365]] (rhq.core.pc.inventory.InventoryManager)- Synchronizing local inventory with Server inventory for Resource [12951] and its descendants... 2014-11-05 06:32:50,176 INFO [WorkerThread#0[10.16.23.104:51365]] (core.pc.drift.sync.DriftSyncManager)- Starting server sync for drift definitions... 2014-11-05 06:32:50,190 INFO [WorkerThread#0[10.16.23.104:51365]] (core.pc.drift.sync.DriftSyncManager)- Finished server sync for drift definitions. 0 added and 0 deleted in 14 ms 2014-11-05 06:32:50,190 INFO [WorkerThread#0[10.16.23.104:51365]] (core.pc.drift.sync.DriftSyncManager)- Starting drift content sync... 2014-11-05 06:32:50,190 INFO [WorkerThread#0[10.16.23.104:51365]] (rhq.core.pc.drift.DriftManager)- Scanning for change set content to resend... 2014-11-05 06:32:50,190 INFO [WorkerThread#0[10.16.23.104:51365]] (core.pc.drift.sync.DriftSyncManager)- Finished drift content sync in 0 ms 2014-11-05 06:32:50,575 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.RuntimeDiscoveryExecutor)- Executing runtime discovery scan rooted at [Resource[id=12951, uuid=268d06af-957e-4094-928e-1296aaf4de6a, type={JBossAS7}JBossAS7 Standalone Server, key=hostConfig: /home/hudson/jon-server-3.3.0.CR01/jbossas/standalone/configuration/standalone-full.xml, name=EAP (127.0.0.1:6990) RHQ Server, parent=fbr-ha-3.bc.jonqe.lab.eng.bos.redhat.com, version=EAP 6.3.0.GA]]... 2014-11-05 06:32:52,280 ERROR [ResourceDiscoveryComponent.invoker.daemon-4] (org.modeshape.rhq.ModeShapePlugin)- No ModeShape Engine discovered 2014-11-05 06:32:52,369 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.RuntimeDiscoveryExecutor)- Scanned Resource[id=12951, uuid=268d06af-957e-4094-928e-1296aaf4de6a, type={JBossAS7}JBossAS7 Standalone Server, key=hostConfig: /home/hudson/jon-server-3.3.0.CR01/jbossas/standalone/configuration/standalone-full.xml, name=EAP (127.0.0.1:6990) RHQ Server, parent=fbr-ha-3.bc.jonqe.lab.eng.bos.redhat.com, version=EAP 6.3.0.GA] and 1 server(s) and discovered 30 new descendant Resource(s). 2014-11-05 06:32:52,369 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sending [runtime] inventory report to Server... 2014-11-05 06:32:53,410 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Platform [10111] 2014-11-05 06:32:53,410 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Platform Top level services [10111] 2014-11-05 06:32:53,410 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Platform Top level services [10111] Local inventory changed: [false] 2014-11-05 06:32:53,418 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [10113] 2014-11-05 06:32:53,418 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [10113] Local inventory changed: [false] 2014-11-05 06:32:54,228 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [10112] 2014-11-05 06:32:54,228 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [10112] Local inventory changed: [false] 2014-11-05 06:32:55,037 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [12951] 2014-11-05 06:32:55,060 INFO [ResourceContainer.invoker.daemon-3] (org.rhq.plugins.server.JBossAS7JMXComponent)- Loading AS7 connection [service:jmx:remoting-jmx://127.0.0.1:6999] with install path [null]... 2014-11-05 06:32:55,088 INFO [ResourceContainer.invoker.daemon-3] (org.xnio)- XNIO Version 3.0.10.GA-redhat-1 2014-11-05 06:32:55,104 INFO [ResourceContainer.invoker.daemon-3] (org.xnio.nio)- XNIO NIO Implementation Version 3.0.10.GA-redhat-1 2014-11-05 06:32:55,194 INFO [ResourceContainer.invoker.daemon-3] (org.jboss.remoting)- JBoss Remoting version (unknown) 2014-11-05 06:32:55,304 ERROR [Remoting "endpoint" read-1] (org.xnio.listener)- A channel event listener threw an exception java.lang.NoClassDefFoundError: org/jboss/logging/Logger at org.jboss.sasl.digest.AbstractSaslImpl.(AbstractSaslImpl.java:46) at org.jboss.sasl.digest.DigestMD5ClientFactory.createSaslClient(DigestMD5ClientFactory.java:41) at org.jboss.remoting3.remote.ClientConnectionOpenListener$Capabilities$1.run(ClientConnectionOpenListener.java:428) at org.jboss.remoting3.remote.ClientConnectionOpenListener$Capabilities$1.run(ClientConnectionOpenListener.java:426) at java.security.AccessController.doPrivileged(Native Method) at org.jboss.remoting3.remote.ClientConnectionOpenListener$Capabilities.handleEvent(ClientConnectionOpenListener.java:426) at org.jboss.remoting3.remote.ClientConnectionOpenListener$Capabilities.handleEvent(ClientConnectionOpenListener.java:242) at org.xnio.ChannelListeners.invokeChannelListener(ChannelListeners.java:72) at org.xnio.channels.TranslatingSuspendableChannel.handleReadable(TranslatingSuspendableChannel.java:189) at org.xnio.channels.TranslatingSuspendableChannel$1.handleEvent(TranslatingSuspendableChannel.java:103) at org.xnio.ChannelListeners.invokeChannelListener(ChannelListeners.java:72) at org.xnio.channels.TranslatingSuspendableChannel.handleReadable(TranslatingSuspendableChannel.java:189) at org.xnio.ssl.JsseConnectedSslStreamChannel.handleReadable(JsseConnectedSslStreamChannel.java:180) at org.xnio.channels.TranslatingSuspendableChannel$1.handleEvent(TranslatingSuspendableChannel.java:103) at org.xnio.ChannelListeners.invokeChannelListener(ChannelListeners.java:72) at org.xnio.nio.NioHandle.run(NioHandle.java:90) at org.xnio.nio.WorkerThread.run(WorkerThread.java:198) Caused by: java.lang.ClassNotFoundException: org.jboss.logging.Logger at java.net.URLClassLoader$1.run(URLClassLoader.java:366) at java.net.URLClassLoader$1.run(URLClassLoader.java:355) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:354) at java.lang.ClassLoader.loadClass(ClassLoader.java:425) at org.rhq.core.pc.plugin.PluginClassLoader.loadClass(PluginClassLoader.java:63) at java.lang.ClassLoader.loadClass(ClassLoader.java:358) ... 17 more 2014-11-05 06:33:00,288 WARN [ResourceContainer.invoker.daemon-3] (org.rhq.plugins.server.JBossAS7JMXComponent)- Could not establish connection to the JBoss AS instance [1] times for resource [RHQServerSubsystems] org.mc4j.ems.connection.EmsConnectException: Could not connect [service:jmx:remoting-jmx://127.0.0.1:6999] java.lang.RuntimeException: Operation failed with status WAITING at org.mc4j.ems.impl.jmx.connection.support.providers.AbstractConnectionProvider.connect(AbstractConnectionProvider.java:106) at org.rhq.plugins.server.JBossAS7JMXComponent.loadConnection(JBossAS7JMXComponent.java:148) at org.rhq.plugins.server.JBossAS7JMXComponent.start(JBossAS7JMXComponent.java:98) at sun.reflect.GeneratedMethodAccessor45.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.rhq.core.pc.inventory.ResourceContainer$ComponentInvocation.call(ResourceContainer.java:759) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Caused by: java.lang.RuntimeException: Operation failed with status WAITING at org.jboss.remotingjmx.RemotingConnector.internalRemotingConnect(RemotingConnector.java:235) at org.jboss.remotingjmx.RemotingConnector.internalConnect(RemotingConnector.java:148) at org.jboss.remotingjmx.RemotingConnector.connect(RemotingConnector.java:99) at javax.management.remote.JMXConnectorFactory.connect(JMXConnectorFactory.java:268) at org.mc4j.ems.impl.jmx.connection.support.providers.JMXRemotingConnectionProvider.doConnect(JMXRemotingConnectionProvider.java:143) at org.mc4j.ems.impl.jmx.connection.support.providers.AbstractConnectionProvider.connect(AbstractConnectionProvider.java:101) ... 10 more 2014-11-05 06:33:00,290 WARN [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Cannot start component for Resource[id=13055, uuid=61bdf394-cb61-43ae-b47a-d041451cc225, type={RHQServer}RHQ Server Subsystem Services, key=RHQServerSubsystems, name=RHQ Server Subsystems, parent=EAP (127.0.0.1:6990) RHQ Server, version=EAP 6.3.0.GA] from synchronized merge due to invalid plugin config: Failed to start component for Resource[id=13055, uuid=61bdf394-cb61-43ae-b47a-d041451cc225, type={RHQServer}RHQ Server Subsystem Services, key=RHQServerSubsystems, name=RHQ Server Subsystems, parent=EAP (127.0.0.1:6990) RHQ Server, version=EAP 6.3.0.GA] - Could not connect [service:jmx:remoting-jmx://127.0.0.1:6999] java.lang.RuntimeException: Operation failed with status WAITING - Cause: org.mc4j.ems.connection.EmsConnectException: Operation failed with status WAITING 2014-11-05 06:33:00,523 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [12951] Local inventory changed: [true] 2014-11-05 06:33:01,324 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Platform [10111]. 2014-11-05 06:33:01,324 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync changes detected, requesting full availability report and service discovery: Platform [10111] 2014-11-05 06:33:06,324 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.RuntimeDiscoveryExecutor)- Executing runtime discovery scan rooted at [platform]... 2014-11-05 06:33:06,344 INFO [ResourceDiscoveryComponent.invoker.daemon-4] (ems.impl.jmx.connection.DConnection)- Querying MBeanServer for all MBeans... 2014-11-05 06:33:06,476 INFO [ResourceDiscoveryComponent.invoker.daemon-4] (org.rhq.plugins.agent.AgentEnvironmentScriptDiscoveryComponent)- Discovering RHQ Agent's environment setup script... 2014-11-05 06:33:06,476 INFO [ResourceDiscoveryComponent.invoker.daemon-4] (org.rhq.plugins.agent.AgentLauncherScriptDiscoveryComponent)- Discovering RHQ Agent's launcher script service... 2014-11-05 06:33:06,477 INFO [ResourceDiscoveryComponent.invoker.daemon-4] (org.rhq.plugins.agent.AgentJavaServiceWrapperDiscoveryComponent)- Discovering RHQ Agent's JSW service... 2014-11-05 06:33:08,128 ERROR [ResourceDiscoveryComponent.invoker.daemon-4] (org.modeshape.rhq.ModeShapePlugin)- No ModeShape Engine discovered 2014-11-05 06:33:11,679 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.RuntimeDiscoveryExecutor)- Scanned platform and 14 server(s) and discovered 61 new descendant Resource(s). 2014-11-05 06:33:11,679 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sending [runtime] inventory report to Server... 2014-11-05 06:33:12,866 INFO [ResourceContainer.invoker.daemon-4] (org.rhq.plugins.server.JBossAS7JMXComponent)- Loading AS7 connection [service:jmx:remoting-jmx://127.0.0.1:6999] with install path [null]... 2014-11-05 06:33:12,883 ERROR [Remoting "endpoint" read-1] (org.xnio.listener)- A channel event listener threw an exception java.lang.NoClassDefFoundError: Could not initialize class org.jboss.sasl.digest.DigestMD5Client at org.jboss.sasl.digest.DigestMD5ClientFactory.createSaslClient(DigestMD5ClientFactory.java:41) at org.jboss.remoting3.remote.ClientConnectionOpenListener$Capabilities$1.run(ClientConnectionOpenListener.java:428) at org.jboss.remoting3.remote.ClientConnectionOpenListener$Capabilities$1.run(ClientConnectionOpenListener.java:426) at java.security.AccessController.doPrivileged(Native Method) at org.jboss.remoting3.remote.ClientConnectionOpenListener$Capabilities.handleEvent(ClientConnectionOpenListener.java:426) at org.jboss.remoting3.remote.ClientConnectionOpenListener$Capabilities.handleEvent(ClientConnectionOpenListener.java:242) at org.xnio.ChannelListeners.invokeChannelListener(ChannelListeners.java:72) at org.xnio.channels.TranslatingSuspendableChannel.handleReadable(TranslatingSuspendableChannel.java:189) at org.xnio.channels.TranslatingSuspendableChannel$1.handleEvent(TranslatingSuspendableChannel.java:103) at org.xnio.ChannelListeners.invokeChannelListener(ChannelListeners.java:72) at org.xnio.channels.TranslatingSuspendableChannel.handleReadable(TranslatingSuspendableChannel.java:189) at org.xnio.ssl.JsseConnectedSslStreamChannel.handleReadable(JsseConnectedSslStreamChannel.java:180) at org.xnio.channels.TranslatingSuspendableChannel$1.handleEvent(TranslatingSuspendableChannel.java:103) at org.xnio.ChannelListeners.invokeChannelListener(ChannelListeners.java:72) at org.xnio.nio.NioHandle.run(NioHandle.java:90) at org.xnio.nio.WorkerThread.run(WorkerThread.java:198) 2014-11-05 06:33:13,923 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Platform [10111] 2014-11-05 06:33:13,923 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Platform Top level services [10111] 2014-11-05 06:33:13,923 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Platform Top level services [10111] Local inventory changed: [false] 2014-11-05 06:33:13,942 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [10113] 2014-11-05 06:33:13,943 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [10113] Local inventory changed: [false] 2014-11-05 06:33:14,768 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [10112] 2014-11-05 06:33:14,768 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [10112] Local inventory changed: [false] 2014-11-05 06:33:15,577 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [12951] 2014-11-05 06:33:15,882 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [12951] Local inventory changed: [true] 2014-11-05 06:33:16,682 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Platform [10111]. 2014-11-05 06:33:16,683 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync changes detected, requesting full availability report and service discovery: Platform [10111] 2014-11-05 06:33:16,683 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Canceled in-progress service scan in favor of starting new scan. Partial scan will still be processed. 2014-11-05 06:33:17,883 WARN [InventoryManager.availability-1] (rhq.core.pc.inventory.AvailabilityExecutor)- Availability collection failed with exception on Resource[id=13055, uuid=61bdf394-cb61-43ae-b47a-d041451cc225, type={RHQServer}RHQ Server Subsystem Services, key=RHQServerSubsystems, name=RHQ Server Subsystems, parent=EAP (127.0.0.1:6990) RHQ Server, version=EAP 6.3.0.GA], availability will be reported as DOWN, reason=Failed to start component for Resource[id=13055, uuid=61bdf394-cb61-43ae-b47a-d041451cc225, type={RHQServer}RHQ Server Subsystem Services, key=RHQServerSubsystems, name=RHQ Server Subsystems, parent=EAP (127.0.0.1:6990) RHQ Server, version=EAP 6.3.0.GA] - Could not connect [service:jmx:remoting-jmx://127.0.0.1:6999] java.lang.RuntimeException: Operation failed with status WAITING - Cause: org.mc4j.ems.connection.EmsConnectException: Operation failed with status WAITING 2014-11-05 06:33:17,883 INFO [InventoryManager.availability-1] (rhq.core.pc.inventory.InventoryManager)- Sending availability report to Server... 2014-11-05 06:33:21,683 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.RuntimeDiscoveryExecutor)- Executing runtime discovery scan rooted at [platform]... 2014-11-05 06:33:21,694 INFO [ResourceDiscoveryComponent.invoker.daemon-4] (ems.impl.jmx.connection.DConnection)- Querying MBeanServer for all MBeans... 2014-11-05 06:33:21,811 INFO [ResourceDiscoveryComponent.invoker.daemon-5] (org.rhq.plugins.agent.AgentEnvironmentScriptDiscoveryComponent)- Discovering RHQ Agent's environment setup script... 2014-11-05 06:33:21,812 INFO [ResourceDiscoveryComponent.invoker.daemon-5] (org.rhq.plugins.agent.AgentLauncherScriptDiscoveryComponent)- Discovering RHQ Agent's launcher script service... 2014-11-05 06:33:21,812 INFO [ResourceDiscoveryComponent.invoker.daemon-5] (org.rhq.plugins.agent.AgentJavaServiceWrapperDiscoveryComponent)- Discovering RHQ Agent's JSW service... 2014-11-05 06:33:23,396 ERROR [ResourceDiscoveryComponent.invoker.daemon-6] (org.modeshape.rhq.ModeShapePlugin)- No ModeShape Engine discovered 2014-11-05 06:33:36,980 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.RuntimeDiscoveryExecutor)- Scanned platform and 28 server(s) and discovered 66 new descendant Resource(s). 2014-11-05 06:33:36,980 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sending [runtime] inventory report to Server... 2014-11-05 06:33:40,624 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Platform [10111] 2014-11-05 06:33:40,624 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Platform Top level services [10111] 2014-11-05 06:33:40,624 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Platform Top level services [10111] Local inventory changed: [false] 2014-11-05 06:33:40,633 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [10113] 2014-11-05 06:33:40,634 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [10113] Local inventory changed: [false] 2014-11-05 06:33:41,633 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [10112] 2014-11-05 06:33:41,633 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [10112] Local inventory changed: [false] 2014-11-05 06:33:42,446 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [12951] 2014-11-05 06:33:42,446 INFO [ResourceContainer.invoker.daemon-5] (org.rhq.plugins.server.JBossAS7JMXComponent)- Loading AS7 connection [service:jmx:remoting-jmx://127.0.0.1:6999] with install path [null]... 2014-11-05 06:33:42,455 ERROR [Remoting "endpoint" read-1] (org.xnio.listener)- A channel event listener threw an exception java.lang.NoClassDefFoundError: Could not initialize class org.jboss.sasl.digest.DigestMD5Client at org.jboss.sasl.digest.DigestMD5ClientFactory.createSaslClient(DigestMD5ClientFactory.java:41) at org.jboss.remoting3.remote.ClientConnectionOpenListener$Capabilities$1.run(ClientConnectionOpenListener.java:428) at org.jboss.remoting3.remote.ClientConnectionOpenListener$Capabilities$1.run(ClientConnectionOpenListener.java:426) at java.security.AccessController.doPrivileged(Native Method) at org.jboss.remoting3.remote.ClientConnectionOpenListener$Capabilities.handleEvent(ClientConnectionOpenListener.java:426) at org.jboss.remoting3.remote.ClientConnectionOpenListener$Capabilities.handleEvent(ClientConnectionOpenListener.java:242) at org.xnio.ChannelListeners.invokeChannelListener(ChannelListeners.java:72) at org.xnio.channels.TranslatingSuspendableChannel.handleReadable(TranslatingSuspendableChannel.java:189) at org.xnio.channels.TranslatingSuspendableChannel$1.handleEvent(TranslatingSuspendableChannel.java:103) at org.xnio.ChannelListeners.invokeChannelListener(ChannelListeners.java:72) at org.xnio.channels.TranslatingSuspendableChannel.handleReadable(TranslatingSuspendableChannel.java:189) at org.xnio.ssl.JsseConnectedSslStreamChannel.handleReadable(JsseConnectedSslStreamChannel.java:180) at org.xnio.channels.TranslatingSuspendableChannel$1.handleEvent(TranslatingSuspendableChannel.java:103) at org.xnio.ChannelListeners.invokeChannelListener(ChannelListeners.java:72) at org.xnio.nio.NioHandle.run(NioHandle.java:90) at org.xnio.nio.WorkerThread.run(WorkerThread.java:198) 2014-11-05 06:33:47,454 ERROR [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Failed to start component for Resource[id=13055, uuid=61bdf394-cb61-43ae-b47a-d041451cc225, type={RHQServer}RHQ Server Subsystem Services, key=RHQServerSubsystems, name=RHQ Server Subsystems, parent=EAP (127.0.0.1:6990) RHQ Server, version=EAP 6.3.0.GA] from synchronized merge. org.rhq.core.clientapi.agent.PluginContainerException: Failed to start component for Resource[id=13055, uuid=61bdf394-cb61-43ae-b47a-d041451cc225, type={RHQServer}RHQ Server Subsystem Services, key=RHQServerSubsystems, name=RHQ Server Subsystems, parent=EAP (127.0.0.1:6990) RHQ Server, version=EAP 6.3.0.GA] - Could not connect [service:jmx:remoting-jmx://127.0.0.1:6999] java.lang.RuntimeException: Operation failed with status WAITING - Cause: org.mc4j.ems.connection.EmsConnectException: Operation failed with status WAITING at org.rhq.core.pc.inventory.InventoryManager.activateResource(InventoryManager.java:2283) at org.rhq.core.pc.inventory.InventoryManager.refreshResourceComponentState(InventoryManager.java:3663) at org.rhq.core.pc.inventory.InventoryManager.processSyncInfo(InventoryManager.java:3201) at org.rhq.core.pc.inventory.InventoryManager.syncResources(InventoryManager.java:1435) at org.rhq.core.pc.inventory.InventoryManager.syncPlatform(InventoryManager.java:1365) at org.rhq.core.pc.inventory.InventoryManager.handleReport(InventoryManager.java:1316) at org.rhq.core.pc.inventory.RuntimeDiscoveryExecutor.call(RuntimeDiscoveryExecutor.java:127) at org.rhq.core.pc.inventory.RuntimeDiscoveryExecutor.run(RuntimeDiscoveryExecutor.java:92) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) 2014-11-05 06:33:48,393 INFO [ResourceContainer.invoker.daemon-3] (org.rhq.plugins.server.JBossAS7JMXComponent)- Loading AS7 connection [service:jmx:remoting-jmx://127.0.0.1:6999] with install path [null]... 2014-11-05 06:33:48,402 ERROR [Remoting "endpoint" read-1] (org.xnio.listener)- A channel event listener threw an exception java.lang.NoClassDefFoundError: Could not initialize class org.jboss.sasl.digest.DigestMD5Client at org.jboss.sasl.digest.DigestMD5ClientFactory.createSaslClient(DigestMD5ClientFactory.java:41) at org.jboss.remoting3.remote.ClientConnectionOpenListener$Capabilities$1.run(ClientConnectionOpenListener.java:428) at org.jboss.remoting3.remote.ClientConnectionOpenListener$Capabilities$1.run(ClientConnectionOpenListener.java:426) at java.security.AccessController.doPrivileged(Native Method) at org.jboss.remoting3.remote.ClientConnectionOpenListener$Capabilities.handleEvent(ClientConnectionOpenListener.java:426) at org.jboss.remoting3.remote.ClientConnectionOpenListener$Capabilities.handleEvent(ClientConnectionOpenListener.java:242) at org.xnio.ChannelListeners.invokeChannelListener(ChannelListeners.java:72) at org.xnio.channels.TranslatingSuspendableChannel.handleReadable(TranslatingSuspendableChannel.java:189) at org.xnio.channels.TranslatingSuspendableChannel$1.handleEvent(TranslatingSuspendableChannel.java:103) at org.xnio.ChannelListeners.invokeChannelListener(ChannelListeners.java:72) at org.xnio.channels.TranslatingSuspendableChannel.handleReadable(TranslatingSuspendableChannel.java:189) at org.xnio.ssl.JsseConnectedSslStreamChannel.handleReadable(JsseConnectedSslStreamChannel.java:180) at org.xnio.channels.TranslatingSuspendableChannel$1.handleEvent(TranslatingSuspendableChannel.java:103) at org.xnio.ChannelListeners.invokeChannelListener(ChannelListeners.java:72) at org.xnio.nio.NioHandle.run(NioHandle.java:90) at org.xnio.nio.WorkerThread.run(WorkerThread.java:198) 2014-11-05 06:33:48,596 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [12951] Local inventory changed: [true] 2014-11-05 06:33:49,396 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Platform [10111]. 2014-11-05 06:33:49,396 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync changes detected, requesting full availability report and service discovery: Platform [10111] 2014-11-05 06:33:49,396 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Canceled in-progress service scan in favor of starting new scan. Partial scan will still be processed. 2014-11-05 06:33:53,400 WARN [InventoryManager.availability-1] (rhq.core.pc.inventory.AvailabilityExecutor)- Availability collection failed with exception on Resource[id=13055, uuid=61bdf394-cb61-43ae-b47a-d041451cc225, type={RHQServer}RHQ Server Subsystem Services, key=RHQServerSubsystems, name=RHQ Server Subsystems, parent=EAP (127.0.0.1:6990) RHQ Server, version=EAP 6.3.0.GA], availability will be reported as DOWN, reason=Failed to start component for Resource[id=13055, uuid=61bdf394-cb61-43ae-b47a-d041451cc225, type={RHQServer}RHQ Server Subsystem Services, key=RHQServerSubsystems, name=RHQ Server Subsystems, parent=EAP (127.0.0.1:6990) RHQ Server, version=EAP 6.3.0.GA] - Could not connect [service:jmx:remoting-jmx://127.0.0.1:6999] java.lang.RuntimeException: Operation failed with status WAITING - Cause: org.mc4j.ems.connection.EmsConnectException: Operation failed with status WAITING 2014-11-05 06:33:53,401 INFO [InventoryManager.availability-1] (rhq.core.pc.inventory.InventoryManager)- Sending availability report to Server... 2014-11-05 06:33:54,397 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.RuntimeDiscoveryExecutor)- Executing runtime discovery scan rooted at [platform]... 2014-11-05 06:33:54,409 INFO [ResourceDiscoveryComponent.invoker.daemon-6] (ems.impl.jmx.connection.DConnection)- Querying MBeanServer for all MBeans... 2014-11-05 06:33:54,530 INFO [ResourceDiscoveryComponent.invoker.daemon-6] (org.rhq.plugins.agent.AgentEnvironmentScriptDiscoveryComponent)- Discovering RHQ Agent's environment setup script... 2014-11-05 06:33:54,531 INFO [ResourceDiscoveryComponent.invoker.daemon-4] (org.rhq.plugins.agent.AgentLauncherScriptDiscoveryComponent)- Discovering RHQ Agent's launcher script service... 2014-11-05 06:33:54,531 INFO [ResourceDiscoveryComponent.invoker.daemon-4] (org.rhq.plugins.agent.AgentJavaServiceWrapperDiscoveryComponent)- Discovering RHQ Agent's JSW service... 2014-11-05 06:33:56,066 ERROR [ResourceDiscoveryComponent.invoker.daemon-6] (org.modeshape.rhq.ModeShapePlugin)- No ModeShape Engine discovered 2014-11-05 06:34:11,554 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.RuntimeDiscoveryExecutor)- Scanned platform and 13 server(s) and discovered 149 new descendant Resource(s). 2014-11-05 06:34:11,555 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sending [runtime] inventory report to Server... 2014-11-05 06:34:18,978 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Platform [10111] 2014-11-05 06:34:18,979 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Platform Top level services [10111] 2014-11-05 06:34:18,979 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Platform Top level services [10111] Local inventory changed: [false] 2014-11-05 06:34:18,987 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [10113] 2014-11-05 06:34:18,988 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [10113] Local inventory changed: [false] 2014-11-05 06:34:19,797 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [10112] 2014-11-05 06:34:19,797 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [10112] Local inventory changed: [false] 2014-11-05 06:34:20,612 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [12951] 2014-11-05 06:34:20,612 INFO [ResourceContainer.invoker.daemon-3] (org.rhq.plugins.server.JBossAS7JMXComponent)- Loading AS7 connection [service:jmx:remoting-jmx://127.0.0.1:6999] with install path [null]... 2014-11-05 06:34:20,621 ERROR [Remoting "endpoint" read-1] (org.xnio.listener)- A channel event listener threw an exception java.lang.NoClassDefFoundError: Could not initialize class org.jboss.sasl.digest.DigestMD5Client at org.jboss.sasl.digest.DigestMD5ClientFactory.createSaslClient(DigestMD5ClientFactory.java:41) at org.jboss.remoting3.remote.ClientConnectionOpenListener$Capabilities$1.run(ClientConnectionOpenListener.java:428) at org.jboss.remoting3.remote.ClientConnectionOpenListener$Capabilities$1.run(ClientConnectionOpenListener.java:426) at java.security.AccessController.doPrivileged(Native Method) at org.jboss.remoting3.remote.ClientConnectionOpenListener$Capabilities.handleEvent(ClientConnectionOpenListener.java:426) at org.jboss.remoting3.remote.ClientConnectionOpenListener$Capabilities.handleEvent(ClientConnectionOpenListener.java:242) at org.xnio.ChannelListeners.invokeChannelListener(ChannelListeners.java:72) at org.xnio.channels.TranslatingSuspendableChannel.handleReadable(TranslatingSuspendableChannel.java:189) at org.xnio.channels.TranslatingSuspendableChannel$1.handleEvent(TranslatingSuspendableChannel.java:103) at org.xnio.ChannelListeners.invokeChannelListener(ChannelListeners.java:72) at org.xnio.channels.TranslatingSuspendableChannel.handleReadable(TranslatingSuspendableChannel.java:189) at org.xnio.ssl.JsseConnectedSslStreamChannel.handleReadable(JsseConnectedSslStreamChannel.java:180) at org.xnio.channels.TranslatingSuspendableChannel$1.handleEvent(TranslatingSuspendableChannel.java:103) at org.xnio.ChannelListeners.invokeChannelListener(ChannelListeners.java:72) at org.xnio.nio.NioHandle.run(NioHandle.java:90) at org.xnio.nio.WorkerThread.run(WorkerThread.java:198) 2014-11-05 06:34:25,619 ERROR [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Failed to start component for Resource[id=13055, uuid=61bdf394-cb61-43ae-b47a-d041451cc225, type={RHQServer}RHQ Server Subsystem Services, key=RHQServerSubsystems, name=RHQ Server Subsystems, parent=EAP (127.0.0.1:6990) RHQ Server, version=EAP 6.3.0.GA] from synchronized merge. org.rhq.core.clientapi.agent.PluginContainerException: Failed to start component for Resource[id=13055, uuid=61bdf394-cb61-43ae-b47a-d041451cc225, type={RHQServer}RHQ Server Subsystem Services, key=RHQServerSubsystems, name=RHQ Server Subsystems, parent=EAP (127.0.0.1:6990) RHQ Server, version=EAP 6.3.0.GA] - Could not connect [service:jmx:remoting-jmx://127.0.0.1:6999] java.lang.RuntimeException: Operation failed with status WAITING - Cause: org.mc4j.ems.connection.EmsConnectException: Operation failed with status WAITING at org.rhq.core.pc.inventory.InventoryManager.activateResource(InventoryManager.java:2283) at org.rhq.core.pc.inventory.InventoryManager.refreshResourceComponentState(InventoryManager.java:3663) at org.rhq.core.pc.inventory.InventoryManager.processSyncInfo(InventoryManager.java:3201) at org.rhq.core.pc.inventory.InventoryManager.syncResources(InventoryManager.java:1435) at org.rhq.core.pc.inventory.InventoryManager.syncPlatform(InventoryManager.java:1365) at org.rhq.core.pc.inventory.InventoryManager.handleReport(InventoryManager.java:1316) at org.rhq.core.pc.inventory.RuntimeDiscoveryExecutor.call(RuntimeDiscoveryExecutor.java:127) at org.rhq.core.pc.inventory.RuntimeDiscoveryExecutor.run(RuntimeDiscoveryExecutor.java:92) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) 2014-11-05 06:34:27,790 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [12951] Local inventory changed: [true] 2014-11-05 06:34:28,591 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Platform [10111]. 2014-11-05 06:34:28,591 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync changes detected, requesting full availability report and service discovery: Platform [10111] 2014-11-05 06:34:28,591 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Canceled in-progress service scan in favor of starting new scan. Partial scan will still be processed. 2014-11-05 06:34:33,591 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.RuntimeDiscoveryExecutor)- Executing runtime discovery scan rooted at [platform]... 2014-11-05 06:34:33,609 INFO [ResourceDiscoveryComponent.invoker.daemon-6] (ems.impl.jmx.connection.DConnection)- Querying MBeanServer for all MBeans... 2014-11-05 06:34:33,730 INFO [ResourceDiscoveryComponent.invoker.daemon-4] (org.rhq.plugins.agent.AgentEnvironmentScriptDiscoveryComponent)- Discovering RHQ Agent's environment setup script... 2014-11-05 06:34:33,730 INFO [ResourceDiscoveryComponent.invoker.daemon-4] (org.rhq.plugins.agent.AgentLauncherScriptDiscoveryComponent)- Discovering RHQ Agent's launcher script service... 2014-11-05 06:34:33,731 INFO [ResourceDiscoveryComponent.invoker.daemon-4] (org.rhq.plugins.agent.AgentJavaServiceWrapperDiscoveryComponent)- Discovering RHQ Agent's JSW service... 2014-11-05 06:34:35,204 ERROR [ResourceDiscoveryComponent.invoker.daemon-6] (org.modeshape.rhq.ModeShapePlugin)- No ModeShape Engine discovered 2014-11-05 06:34:37,254 INFO [ResourceContainer.invoker.daemon-3] (org.rhq.plugins.server.JBossAS7JMXComponent)- Loading AS7 connection [service:jmx:remoting-jmx://127.0.0.1:6999] with install path [null]... 2014-11-05 06:34:37,262 ERROR [Remoting "endpoint" read-1] (org.xnio.listener)- A channel event listener threw an exception java.lang.NoClassDefFoundError: Could not initialize class org.jboss.sasl.digest.DigestMD5Client at org.jboss.sasl.digest.DigestMD5ClientFactory.createSaslClient(DigestMD5ClientFactory.java:41) at org.jboss.remoting3.remote.ClientConnectionOpenListener$Capabilities$1.run(ClientConnectionOpenListener.java:428) at org.jboss.remoting3.remote.ClientConnectionOpenListener$Capabilities$1.run(ClientConnectionOpenListener.java:426) at java.security.AccessController.doPrivileged(Native Method) at org.jboss.remoting3.remote.ClientConnectionOpenListener$Capabilities.handleEvent(ClientConnectionOpenListener.java:426) at org.jboss.remoting3.remote.ClientConnectionOpenListener$Capabilities.handleEvent(ClientConnectionOpenListener.java:242) at org.xnio.ChannelListeners.invokeChannelListener(ChannelListeners.java:72) at org.xnio.channels.TranslatingSuspendableChannel.handleReadable(TranslatingSuspendableChannel.java:189) at org.xnio.channels.TranslatingSuspendableChannel$1.handleEvent(TranslatingSuspendableChannel.java:103) at org.xnio.ChannelListeners.invokeChannelListener(ChannelListeners.java:72) at org.xnio.channels.TranslatingSuspendableChannel.handleReadable(TranslatingSuspendableChannel.java:189) at org.xnio.ssl.JsseConnectedSslStreamChannel.handleReadable(JsseConnectedSslStreamChannel.java:180) at org.xnio.channels.TranslatingSuspendableChannel$1.handleEvent(TranslatingSuspendableChannel.java:103) at org.xnio.ChannelListeners.invokeChannelListener(ChannelListeners.java:72) at org.xnio.nio.NioHandle.run(NioHandle.java:90) at org.xnio.nio.WorkerThread.run(WorkerThread.java:198) 2014-11-05 06:34:42,261 WARN [InventoryManager.availability-1] (rhq.core.pc.inventory.AvailabilityExecutor)- Availability collection failed with exception on Resource[id=13055, uuid=61bdf394-cb61-43ae-b47a-d041451cc225, type={RHQServer}RHQ Server Subsystem Services, key=RHQServerSubsystems, name=RHQ Server Subsystems, parent=EAP (127.0.0.1:6990) RHQ Server, version=EAP 6.3.0.GA], availability will be reported as DOWN, reason=Failed to start component for Resource[id=13055, uuid=61bdf394-cb61-43ae-b47a-d041451cc225, type={RHQServer}RHQ Server Subsystem Services, key=RHQServerSubsystems, name=RHQ Server Subsystems, parent=EAP (127.0.0.1:6990) RHQ Server, version=EAP 6.3.0.GA] - Could not connect [service:jmx:remoting-jmx://127.0.0.1:6999] java.lang.RuntimeException: Operation failed with status WAITING - Cause: org.mc4j.ems.connection.EmsConnectException: Operation failed with status WAITING 2014-11-05 06:34:42,261 INFO [InventoryManager.availability-1] (rhq.core.pc.inventory.InventoryManager)- Sending availability report to Server... 2014-11-05 06:34:48,559 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.RuntimeDiscoveryExecutor)- Scanned platform and 11 server(s) and discovered 290 new descendant Resource(s). 2014-11-05 06:34:48,560 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sending [runtime] inventory report to Server... 2014-11-05 06:34:58,053 INFO [ResourceContainer.invoker.daemon-3] (rhq.modules.plugins.jbossas7.BaseComponent)- Resource[id=12951, uuid=268d06af-957e-4094-928e-1296aaf4de6a, type={JBossAS7}JBossAS7 Standalone Server, key=hostConfig: /home/hudson/jon-server-3.3.0.CR01/jbossas/standalone/configuration/standalone-full.xml, name=EAP (127.0.0.1:6990) RHQ Server, parent=fbr-ha-3.bc.jonqe.lab.eng.bos.redhat.com, version=EAP 6.3.0.GA] Global EJB3 statistics is now enabled, because there is a request to collect EJB Calltime metrics. 2014-11-05 06:35:03,876 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Platform [10111] 2014-11-05 06:35:03,877 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Platform Top level services [10111] 2014-11-05 06:35:03,877 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Platform Top level services [10111] Local inventory changed: [false] 2014-11-05 06:35:03,886 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [10113] 2014-11-05 06:35:03,887 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [10113] Local inventory changed: [false] 2014-11-05 06:35:04,695 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [10112] 2014-11-05 06:35:04,695 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [10112] Local inventory changed: [false] 2014-11-05 06:35:05,516 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [12951] 2014-11-05 06:35:05,516 INFO [ResourceContainer.invoker.daemon-6] (org.rhq.plugins.server.JBossAS7JMXComponent)- Loading AS7 connection [service:jmx:remoting-jmx://127.0.0.1:6999] with install path [null]... 2014-11-05 06:35:05,524 ERROR [Remoting "endpoint" read-1] (org.xnio.listener)- A channel event listener threw an exception java.lang.NoClassDefFoundError: Could not initialize class org.jboss.sasl.digest.DigestMD5Client at org.jboss.sasl.digest.DigestMD5ClientFactory.createSaslClient(DigestMD5ClientFactory.java:41) at org.jboss.remoting3.remote.ClientConnectionOpenListener$Capabilities$1.run(ClientConnectionOpenListener.java:428) at org.jboss.remoting3.remote.ClientConnectionOpenListener$Capabilities$1.run(ClientConnectionOpenListener.java:426) at java.security.AccessController.doPrivileged(Native Method) at org.jboss.remoting3.remote.ClientConnectionOpenListener$Capabilities.handleEvent(ClientConnectionOpenListener.java:426) at org.jboss.remoting3.remote.ClientConnectionOpenListener$Capabilities.handleEvent(ClientConnectionOpenListener.java:242) at org.xnio.ChannelListeners.invokeChannelListener(ChannelListeners.java:72) at org.xnio.channels.TranslatingSuspendableChannel.handleReadable(TranslatingSuspendableChannel.java:189) at org.xnio.channels.TranslatingSuspendableChannel$1.handleEvent(TranslatingSuspendableChannel.java:103) at org.xnio.ChannelListeners.invokeChannelListener(ChannelListeners.java:72) at org.xnio.channels.TranslatingSuspendableChannel.handleReadable(TranslatingSuspendableChannel.java:189) at org.xnio.ssl.JsseConnectedSslStreamChannel.handleReadable(JsseConnectedSslStreamChannel.java:180) at org.xnio.channels.TranslatingSuspendableChannel$1.handleEvent(TranslatingSuspendableChannel.java:103) at org.xnio.ChannelListeners.invokeChannelListener(ChannelListeners.java:72) at org.xnio.nio.NioHandle.run(NioHandle.java:90) at org.xnio.nio.WorkerThread.run(WorkerThread.java:198) 2014-11-05 06:35:10,525 ERROR [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Failed to start component for Resource[id=13055, uuid=61bdf394-cb61-43ae-b47a-d041451cc225, type={RHQServer}RHQ Server Subsystem Services, key=RHQServerSubsystems, name=RHQ Server Subsystems, parent=EAP (127.0.0.1:6990) RHQ Server, version=EAP 6.3.0.GA] from synchronized merge. org.rhq.core.clientapi.agent.PluginContainerException: Failed to start component for Resource[id=13055, uuid=61bdf394-cb61-43ae-b47a-d041451cc225, type={RHQServer}RHQ Server Subsystem Services, key=RHQServerSubsystems, name=RHQ Server Subsystems, parent=EAP (127.0.0.1:6990) RHQ Server, version=EAP 6.3.0.GA] - Could not connect [service:jmx:remoting-jmx://127.0.0.1:6999] java.lang.RuntimeException: Operation failed with status WAITING - Cause: org.mc4j.ems.connection.EmsConnectException: Operation failed with status WAITING at org.rhq.core.pc.inventory.InventoryManager.activateResource(InventoryManager.java:2283) at org.rhq.core.pc.inventory.InventoryManager.refreshResourceComponentState(InventoryManager.java:3663) at org.rhq.core.pc.inventory.InventoryManager.processSyncInfo(InventoryManager.java:3201) at org.rhq.core.pc.inventory.InventoryManager.syncResources(InventoryManager.java:1435) at org.rhq.core.pc.inventory.InventoryManager.syncPlatform(InventoryManager.java:1365) at org.rhq.core.pc.inventory.InventoryManager.handleReport(InventoryManager.java:1316) at org.rhq.core.pc.inventory.RuntimeDiscoveryExecutor.call(RuntimeDiscoveryExecutor.java:127) at org.rhq.core.pc.inventory.RuntimeDiscoveryExecutor.run(RuntimeDiscoveryExecutor.java:92) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) 2014-11-05 06:35:11,945 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [12951] Local inventory changed: [true] 2014-11-05 06:35:12,746 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Platform [10111]. 2014-11-05 06:35:12,746 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync changes detected, requesting full availability report and service discovery: Platform [10111] 2014-11-05 06:35:12,746 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Canceled in-progress service scan in favor of starting new scan. Partial scan will still be processed. 2014-11-05 06:35:14,810 INFO [ResourceContainer.invoker.daemon-6] (org.rhq.plugins.server.JBossAS7JMXComponent)- Loading AS7 connection [service:jmx:remoting-jmx://127.0.0.1:6999] with install path [null]... 2014-11-05 06:35:14,818 ERROR [Remoting "endpoint" read-1] (org.xnio.listener)- A channel event listener threw an exception java.lang.NoClassDefFoundError: Could not initialize class org.jboss.sasl.digest.DigestMD5Client at org.jboss.sasl.digest.DigestMD5ClientFactory.createSaslClient(DigestMD5ClientFactory.java:41) at org.jboss.remoting3.remote.ClientConnectionOpenListener$Capabilities$1.run(ClientConnectionOpenListener.java:428) at org.jboss.remoting3.remote.ClientConnectionOpenListener$Capabilities$1.run(ClientConnectionOpenListener.java:426) at java.security.AccessController.doPrivileged(Native Method) at org.jboss.remoting3.remote.ClientConnectionOpenListener$Capabilities.handleEvent(ClientConnectionOpenListener.java:426) at org.jboss.remoting3.remote.ClientConnectionOpenListener$Capabilities.handleEvent(ClientConnectionOpenListener.java:242) at org.xnio.ChannelListeners.invokeChannelListener(ChannelListeners.java:72) at org.xnio.channels.TranslatingSuspendableChannel.handleReadable(TranslatingSuspendableChannel.java:189) at org.xnio.channels.TranslatingSuspendableChannel$1.handleEvent(TranslatingSuspendableChannel.java:103) at org.xnio.ChannelListeners.invokeChannelListener(ChannelListeners.java:72) at org.xnio.channels.TranslatingSuspendableChannel.handleReadable(TranslatingSuspendableChannel.java:189) at org.xnio.ssl.JsseConnectedSslStreamChannel.handleReadable(JsseConnectedSslStreamChannel.java:180) at org.xnio.channels.TranslatingSuspendableChannel$1.handleEvent(TranslatingSuspendableChannel.java:103) at org.xnio.ChannelListeners.invokeChannelListener(ChannelListeners.java:72) at org.xnio.nio.NioHandle.run(NioHandle.java:90) at org.xnio.nio.WorkerThread.run(WorkerThread.java:198) 2014-11-05 06:35:17,747 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.RuntimeDiscoveryExecutor)- Executing runtime discovery scan rooted at [platform]... 2014-11-05 06:35:17,760 INFO [ResourceDiscoveryComponent.invoker.daemon-6] (ems.impl.jmx.connection.DConnection)- Querying MBeanServer for all MBeans... 2014-11-05 06:35:17,848 INFO [ResourceDiscoveryComponent.invoker.daemon-6] (org.rhq.plugins.agent.AgentEnvironmentScriptDiscoveryComponent)- Discovering RHQ Agent's environment setup script... 2014-11-05 06:35:17,849 INFO [ResourceDiscoveryComponent.invoker.daemon-6] (org.rhq.plugins.agent.AgentLauncherScriptDiscoveryComponent)- Discovering RHQ Agent's launcher script service... 2014-11-05 06:35:17,849 INFO [ResourceDiscoveryComponent.invoker.daemon-6] (org.rhq.plugins.agent.AgentJavaServiceWrapperDiscoveryComponent)- Discovering RHQ Agent's JSW service... 2014-11-05 06:35:19,346 ERROR [ResourceDiscoveryComponent.invoker.daemon-6] (org.modeshape.rhq.ModeShapePlugin)- No ModeShape Engine discovered 2014-11-05 06:35:19,818 WARN [InventoryManager.availability-1] (rhq.core.pc.inventory.AvailabilityExecutor)- Availability collection failed with exception on Resource[id=13055, uuid=61bdf394-cb61-43ae-b47a-d041451cc225, type={RHQServer}RHQ Server Subsystem Services, key=RHQServerSubsystems, name=RHQ Server Subsystems, parent=EAP (127.0.0.1:6990) RHQ Server, version=EAP 6.3.0.GA], availability will be reported as DOWN, reason=Failed to start component for Resource[id=13055, uuid=61bdf394-cb61-43ae-b47a-d041451cc225, type={RHQServer}RHQ Server Subsystem Services, key=RHQServerSubsystems, name=RHQ Server Subsystems, parent=EAP (127.0.0.1:6990) RHQ Server, version=EAP 6.3.0.GA] - Could not connect [service:jmx:remoting-jmx://127.0.0.1:6999] java.lang.RuntimeException: Operation failed with status WAITING - Cause: org.mc4j.ems.connection.EmsConnectException: Operation failed with status WAITING 2014-11-05 06:35:19,818 INFO [InventoryManager.availability-1] (rhq.core.pc.inventory.InventoryManager)- Sending availability report to Server... 2014-11-05 06:35:32,633 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.RuntimeDiscoveryExecutor)- Scanned platform and 0 server(s) and discovered 0 new descendant Resource(s). 2014-11-05 06:35:32,633 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.RuntimeDiscoveryExecutor)- Not sending inventory report because no new descendent resources were discovered. 2014-11-05 06:35:33,267 INFO [Thread-9] (org.rhq.enterprise.agent.AgentShutdownHook)- {AgentShutdownHook.exit.shutting-down}Shutting down... 2014-11-05 06:35:33,281 INFO [Thread-9] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.shutting-down}Agent is being shut down... 2014-11-05 06:35:33,289 INFO [RHQ Primary Server Switchover Thread] (org.rhq.enterprise.agent.AgentMain)- {PrimaryServerSwitchoverThread.stopped}The primary server switchover thread has stopped. 2014-11-05 06:35:33,288 INFO [Thread-9] (org.rhq.core.pc.PluginContainer)- Plugin container is being shutdown... 2014-11-05 06:35:33,292 INFO [Thread-9] (org.rhq.core.pc.PluginContainer)- Plugin container shutdown will wait up to 300 seconds for shut down background threads to terminate. 2014-11-05 06:35:33,299 INFO [Thread-9] (rhq.core.pc.content.ContentManager)- Shutting down Content Manager... 2014-11-05 06:35:33,322 INFO [MeasurementManager.collector-1] (rhq.core.pc.measurement.MeasurementManager)- Shutting down measurement collection... 2014-11-05 06:35:33,953 INFO [Thread-9] (org.rhq.core.pc.PluginContainer)- All shut down background threads have terminated (less than 1 second elapsed). 2014-11-05 06:35:33,953 INFO [Thread-9] (org.rhq.core.pc.PluginContainer)- Plugin container is now shutdown. 2014-11-05 06:35:34,234 INFO [Thread-9] (org.rhq.enterprise.communications.ServiceContainer)- {ServiceContainer.shutting-down}Service container shutting down... 2014-11-05 06:35:34,240 INFO [Thread-9] (org.rhq.enterprise.communications.ServiceContainer)- {ServiceContainer.shutdown}Service container shut down - no longer accepting incoming commands 2014-11-05 06:35:34,240 INFO [Thread-9] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.shut-down}Agent has been shut down 2014-11-05 06:35:34,241 INFO [Thread-9] (org.rhq.enterprise.agent.AgentShutdownHook)- {AgentShutdownHook.wait}The agent will wait for [0] threads to die 2014-11-05 06:35:34,242 INFO [Thread-9] (org.rhq.enterprise.agent.AgentShutdownHook)- {AgentShutdownHook.exit.shutdown-complete}Shutdown complete - agent will now exit. 2014-11-05 06:39:17,683 INFO [main] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.identify-version}Version=[RHQ 4.12.0.JON330CR01], Build Number=[6ac97ac], Build Date=[Oct 31, 2014 7:53 AM] 2014-11-05 06:39:17,873 INFO [main] (org.rhq.enterprise.communications.ServiceContainer)- {ServiceContainer.global-concurrency-limit-disabled}Global concurrency limit has been disabled - there is no limit to the number of incoming commands allowed 2014-11-05 06:39:18,606 INFO [main] (org.rhq.enterprise.communications.ServiceContainer)- {ServiceContainer.started}Service container started - ready to accept incoming commands 2014-11-05 06:39:18,607 INFO [main] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.no-auto-detect}Server auto-detection is not enabled - starting the poller immediately 2014-11-05 06:39:19,141 INFO [RHQ Server Polling Thread] (enterprise.communications.command.client.JBossRemotingRemoteCommunicator)- {JBossRemotingRemoteCommunicator.changing-endpoint}Communicator is changing endpoint from [InvokerLocator [servlet://10.16.23.123:7080/jboss-remoting-servlet-invoker/ServerInvokerServlet]] to [InvokerLocator [servlet://10.16.23.123:7080/jboss-remoting-servlet-invoker/ServerInvokerServlet]] 2014-11-05 06:39:19,218 WARN [RHQ Server Polling Thread] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.failover-failed}Failed to failover to another server. Cause: org.jboss.remoting.transport.http.WebServerError: JBoss Web/7.4.8.Final-redhat-4 - JBWEB000064: Error report

JBWEB000065: HTTP Status 404 - /jboss-remoting-servlet-invoker/ServerInvokerServlet


JBWEB000309: type JBWEB000067: Status report

JBWEB000068: message /jboss-remoting-servlet-invoker/ServerInvokerServlet

JBWEB000069: description JBWEB000124: The requested resource is not available.


JBoss Web/7.4.8.Final-redhat-4

2014-11-05 06:39:19,255 INFO [RHQ Server Polling Thread] (enterprise.communications.command.client.JBossRemotingRemoteCommunicator)- {JBossRemotingRemoteCommunicator.changing-endpoint}Communicator is changing endpoint from [InvokerLocator [servlet://10.16.23.123:7080/jboss-remoting-servlet-invoker/ServerInvokerServlet]] to [InvokerLocator [servlet://10.16.23.115:7080/jboss-remoting-servlet-invoker/ServerInvokerServlet]] 2014-11-05 06:39:19,275 WARN [RHQ Server Polling Thread] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.failover-failed}Failed to failover to another server. Cause: org.jboss.remoting.CannotConnectException: Can not connect http client invoker after 1 attempt(s) 2014-11-05 06:39:19,330 INFO [RHQ Server Polling Thread] (enterprise.communications.command.client.JBossRemotingRemoteCommunicator)- {JBossRemotingRemoteCommunicator.changing-endpoint}Communicator is changing endpoint from [InvokerLocator [servlet://10.16.23.115:7080/jboss-remoting-servlet-invoker/ServerInvokerServlet]] to [InvokerLocator [servlet://10.16.23.104:7080/jboss-remoting-servlet-invoker/ServerInvokerServlet]] 2014-11-05 06:39:19,571 WARN [RHQ Server Polling Thread] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.server-thinks-agent-is-down}The server thinks this agent is down. Will notify the server of up-to-date information when possible. 2014-11-05 06:39:19,593 INFO [RHQ Server Polling Thread] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.failed-over-to-server}The agent has triggered its failover mechanism and switched to server [servlet://10.16.23.104:7080/jboss-remoting-servlet-invoker/ServerInvokerServlet] 2014-11-05 06:39:19,793 WARN [RHQ Server Polling Thread] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.server-thinks-agent-is-down}The server thinks this agent is down. Will notify the server of up-to-date information when possible. 2014-11-05 06:39:21,071 WARN [RHQ Agent Registration Thread] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.failover-list-unreachable-host}Failover list has an unreachable host [10.16.23.115] (tested ports [7080] and [7443]). Cause: java.net.ConnectException:Connection refused 2014-11-05 06:39:21,159 INFO [RHQ Agent Registration Thread] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.agent-registration-results}Agent has successfully registered with the server. The results are: [AgentRegistrationResults: [agent-token=xRAowwOH1641fshJvQUADVx1DmJsr0rpmdTDCtKLg6tHh5+GUW4pYFzNpdxPhu/Jipk=]] 2014-11-05 06:39:21,175 INFO [RHQ Server Polling Thread] (enterprise.communications.command.client.ServerPollingThread)- {ServerPollingThread.server-online}The server has come back online; client has been told to start sending commands again 2014-11-05 06:39:21,308 INFO [main] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.waiting-for-plugins-with-dir}The agent is waiting for plugins to be downloaded to [plugins]... 2014-11-05 06:39:21,750 WARN [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.plugin-not-on-server}The plugin [plugins/jboss-datagrid-server-rhq-plugin-6.1.0.GA-redhat-1.jar] does not exist on the Server - renaming it to [jboss-datagrid-server-rhq-plugin-6.1.0.GA-redhat-1.jar.REJECTED] so it will not get deployed by the Plugin Container. 2014-11-05 06:39:21,751 WARN [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.plugin-not-on-server}The plugin [plugins/gatein-as7-rhq-plugin-1.0.1.Final-redhat-1.jar] does not exist on the Server - renaming it to [gatein-as7-rhq-plugin-1.0.1.Final-redhat-1.jar.REJECTED] so it will not get deployed by the Plugin Container. 2014-11-05 06:39:21,751 WARN [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.plugin-not-on-server}The plugin [plugins/drools-rhq-plugin-6.0.0-redhat-3.jar] does not exist on the Server - renaming it to [drools-rhq-plugin-6.0.0-redhat-3.jar.REJECTED] so it will not get deployed by the Plugin Container. 2014-11-05 06:39:21,751 WARN [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.plugin-not-on-server}The plugin [plugins/jopr-jboss-as-5-plugin-4.9.0.JON320GA.jar] does not exist on the Server - renaming it to [jopr-jboss-as-5-plugin-4.9.0.JON320GA.jar.REJECTED] so it will not get deployed by the Plugin Container. 2014-11-05 06:39:21,751 WARN [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.plugin-not-on-server}The plugin [plugins/jopr-jboss-cache-plugin-4.9.0.JON320GA.jar] does not exist on the Server - renaming it to [jopr-jboss-cache-plugin-4.9.0.JON320GA.jar.REJECTED] so it will not get deployed by the Plugin Container. 2014-11-05 06:39:21,752 WARN [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.plugin-not-on-server}The plugin [plugins/rhq-rhqserver-plugin-4.9.0.JON320GA.jar] does not exist on the Server - renaming it to [rhq-rhqserver-plugin-4.9.0.JON320GA.jar.REJECTED] so it will not get deployed by the Plugin Container. 2014-11-05 06:39:21,752 WARN [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.plugin-not-on-server}The plugin [plugins/modeshape-rhq-plugin-3.3.6.GA-redhat-1.jar] does not exist on the Server - renaming it to [modeshape-rhq-plugin-3.3.6.GA-redhat-1.jar.REJECTED] so it will not get deployed by the Plugin Container. 2014-11-05 06:39:21,756 WARN [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.plugin-not-on-server}The plugin [plugins/jopr-jboss-cache-v3-plugin-4.9.0.JON320GA.jar] does not exist on the Server - renaming it to [jopr-jboss-cache-v3-plugin-4.9.0.JON320GA.jar.REJECTED] so it will not get deployed by the Plugin Container. 2014-11-05 06:39:21,756 WARN [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.plugin-not-on-server}The plugin [plugins/camel-plugin-7.2.2.redhat-024.jar] does not exist on the Server - renaming it to [camel-plugin-7.2.2.redhat-024.jar.REJECTED] so it will not get deployed by the Plugin Container. 2014-11-05 06:39:21,757 WARN [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.plugin-not-on-server}The plugin [plugins/soa-p-5.3.0.GA-rhq-jbossesb-plugin-as4.jar] does not exist on the Server - renaming it to [soa-p-5.3.0.GA-rhq-jbossesb-plugin-as4.jar.REJECTED] so it will not get deployed by the Plugin Container. 2014-11-05 06:39:21,757 WARN [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.plugin-not-on-server}The plugin [plugins/rhq-augeas-plugin-4.9.0.JON320GA.jar] does not exist on the Server - renaming it to [rhq-augeas-plugin-4.9.0.JON320GA.jar.REJECTED] so it will not get deployed by the Plugin Container. 2014-11-05 06:39:21,757 WARN [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.plugin-not-on-server}The plugin [plugins/fabric-plugin-7.2.2.redhat-024.jar] does not exist on the Server - renaming it to [fabric-plugin-7.2.2.redhat-024.jar.REJECTED] so it will not get deployed by the Plugin Container. 2014-11-05 06:39:21,757 WARN [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.plugin-not-on-server}The plugin [plugins/servicemix4-plugin-7.2.2.redhat-024.jar] does not exist on the Server - renaming it to [servicemix4-plugin-7.2.2.redhat-024.jar.REJECTED] so it will not get deployed by the Plugin Container. 2014-11-05 06:39:21,758 WARN [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.plugin-not-on-server}The plugin [plugins/cxf-plugin-7.2.2.redhat-024.jar] does not exist on the Server - renaming it to [cxf-plugin-7.2.2.redhat-024.jar.REJECTED] so it will not get deployed by the Plugin Container. 2014-11-05 06:39:21,758 WARN [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.plugin-not-on-server}The plugin [plugins/rhq-apache-plugin-4.9.0.JON320GA.jar] does not exist on the Server - renaming it to [rhq-apache-plugin-4.9.0.JON320GA.jar.REJECTED] so it will not get deployed by the Plugin Container. 2014-11-05 06:39:21,758 WARN [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.plugin-not-on-server}The plugin [plugins/infinispan-rhq-plugin-5.2.4.Final-redhat-1.jar] does not exist on the Server - renaming it to [infinispan-rhq-plugin-5.2.4.Final-redhat-1.jar.REJECTED] so it will not get deployed by the Plugin Container. 2014-11-05 06:39:21,758 WARN [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.plugin-not-on-server}The plugin [plugins/jopr-hibernate-plugin-4.9.0.JON320GA.jar] does not exist on the Server - renaming it to [jopr-hibernate-plugin-4.9.0.JON320GA.jar.REJECTED] so it will not get deployed by the Plugin Container. 2014-11-05 06:39:21,759 WARN [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.plugin-not-on-server}The plugin [plugins/jopr-jboss-as-plugin-4.9.0.JON320GA.jar] does not exist on the Server - renaming it to [jopr-jboss-as-plugin-4.9.0.JON320GA.jar.REJECTED] so it will not get deployed by the Plugin Container. 2014-11-05 06:39:21,759 WARN [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.plugin-not-on-server}The plugin [plugins/soa-p-5.3.0.GA-rhq-jbossesb-plugin-as5.jar] does not exist on the Server - renaming it to [soa-p-5.3.0.GA-rhq-jbossesb-plugin-as5.jar.REJECTED] so it will not get deployed by the Plugin Container. 2014-11-05 06:39:21,759 WARN [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.plugin-not-on-server}The plugin [plugins/activemq-plugin-7.2.2.redhat-024.jar] does not exist on the Server - renaming it to [activemq-plugin-7.2.2.redhat-024.jar.REJECTED] so it will not get deployed by the Plugin Container. 2014-11-05 06:39:21,759 WARN [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.plugin-not-on-server}The plugin [plugins/teiid-rhq-plugin-1.0.0.Final-redhat-4.jar] does not exist on the Server - renaming it to [teiid-rhq-plugin-1.0.0.Final-redhat-4.jar.REJECTED] so it will not get deployed by the Plugin Container. 2014-11-05 06:39:21,764 WARN [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.plugin-not-on-server}The plugin [plugins/rhq-switchyard-plugin-1.0.0-redhat-2.jar] does not exist on the Server - renaming it to [rhq-switchyard-plugin-1.0.0-redhat-2.jar.REJECTED] so it will not get deployed by the Plugin Container. 2014-11-05 06:39:21,777 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading}Downloading the plugin [teiid-rhq-plugin-2.1.0.redhat-2.jar]... 2014-11-05 06:39:21,960 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading-complete}The plugin [Teiid] has been updated at [teiid-rhq-plugin-2.1.0.redhat-2.jar]. 2014-11-05 06:39:21,960 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading}Downloading the plugin [switchyard-rhq-plugin-1.1.1-p5-redhat-1.jar]... 2014-11-05 06:39:23,031 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading-complete}The plugin [SwitchYard] has been updated at [switchyard-rhq-plugin-1.1.1-p5-redhat-1.jar]. 2014-11-05 06:39:23,031 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading}Downloading the plugin [rhq-rhqserver-plugin-4.12.0.JON330CR01.jar]... 2014-11-05 06:39:23,834 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading-complete}The plugin [RHQServer] has been updated at [rhq-rhqserver-plugin-4.12.0.JON330CR01.jar]. 2014-11-05 06:39:23,834 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading}Downloading the plugin [modeshape-rhq-plugin-3.8.1.GA-redhat-1.jar]... 2014-11-05 06:39:23,975 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading-complete}The plugin [ModeShape] has been updated at [modeshape-rhq-plugin-3.8.1.GA-redhat-1.jar]. 2014-11-05 06:39:23,975 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading}Downloading the plugin [infinispan-server-rhq-plugin-6.1.0.Final-redhat-3.jar]... 2014-11-05 06:39:24,047 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading-complete}The plugin [JDG] has been updated at [infinispan-server-rhq-plugin-6.1.0.Final-redhat-3.jar]. 2014-11-05 06:39:24,047 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading}Downloading the plugin [jopr-jboss-as-5-plugin-4.12.0.JON330CR01.jar]... 2014-11-05 06:39:25,162 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading-complete}The plugin [JBossAS5] has been updated at [jopr-jboss-as-5-plugin-4.12.0.JON330CR01.jar]. 2014-11-05 06:39:25,162 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading}Downloading the plugin [soa-p-5.3.1.GA_6-rhq-jbossesb-plugin-as5.jar]... 2014-11-05 06:39:25,214 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading-complete}The plugin [JBossESB5] has been updated at [soa-p-5.3.1.GA_6-rhq-jbossesb-plugin-as5.jar]. 2014-11-05 06:39:25,214 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading}Downloading the plugin [jopr-jboss-cache-v3-plugin-4.12.0.JON330CR01.jar]... 2014-11-05 06:39:25,248 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading-complete}The plugin [JBossCache3] has been updated at [jopr-jboss-cache-v3-plugin-4.12.0.JON330CR01.jar]. 2014-11-05 06:39:25,248 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading}Downloading the plugin [jopr-jboss-as-plugin-4.12.0.JON330CR01.jar]... 2014-11-05 06:39:26,468 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading-complete}The plugin [JBossAS] has been updated at [jopr-jboss-as-plugin-4.12.0.JON330CR01.jar]. 2014-11-05 06:39:26,469 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading}Downloading the plugin [soa-p-5.3.1.GA_6-rhq-jbossesb-plugin-as4.jar]... 2014-11-05 06:39:26,494 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading-complete}The plugin [JBossESB] has been updated at [soa-p-5.3.1.GA_6-rhq-jbossesb-plugin-as4.jar]. 2014-11-05 06:39:26,494 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading}Downloading the plugin [jopr-jboss-cache-plugin-4.12.0.JON330CR01.jar]... 2014-11-05 06:39:26,559 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading-complete}The plugin [JBossCache] has been updated at [jopr-jboss-cache-plugin-4.12.0.JON330CR01.jar]. 2014-11-05 06:39:26,559 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading}Downloading the plugin [infinispan-rhq-plugin-6.1.0.Final-redhat-3.jar]... 2014-11-05 06:39:26,607 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading-complete}The plugin [Infinispan] has been updated at [infinispan-rhq-plugin-6.1.0.Final-redhat-3.jar]. 2014-11-05 06:39:26,607 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading}Downloading the plugin [rhq-augeas-plugin-4.12.0.JON330CR01.jar]... 2014-11-05 06:39:26,914 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading-complete}The plugin [Augeas] has been updated at [rhq-augeas-plugin-4.12.0.JON330CR01.jar]. 2014-11-05 06:39:26,914 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading}Downloading the plugin [fabric-plugin-7.3.1.redhat-379.jar]... 2014-11-05 06:39:26,956 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading-complete}The plugin [Fabric] has been updated at [fabric-plugin-7.3.1.redhat-379.jar]. 2014-11-05 06:39:26,956 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading}Downloading the plugin [rhq-apache-plugin-4.12.0.JON330CR01.jar]... 2014-11-05 06:39:27,125 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading-complete}The plugin [Apache] has been updated at [rhq-apache-plugin-4.12.0.JON330CR01.jar]. 2014-11-05 06:39:27,125 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading}Downloading the plugin [activemq-plugin-7.3.1.redhat-379.jar]... 2014-11-05 06:39:27,149 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading-complete}The plugin [ActiveMQ] has been updated at [activemq-plugin-7.3.1.redhat-379.jar]. 2014-11-05 06:39:27,149 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading}Downloading the plugin [servicemix4-plugin-7.3.1.redhat-379.jar]... 2014-11-05 06:39:27,174 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading-complete}The plugin [Servicemix4] has been updated at [servicemix4-plugin-7.3.1.redhat-379.jar]. 2014-11-05 06:39:27,174 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading}Downloading the plugin [drools-rhq-plugin-6.0.0-redhat-9.jar]... 2014-11-05 06:39:27,193 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading-complete}The plugin [DroolsRHQPlugin] has been updated at [drools-rhq-plugin-6.0.0-redhat-9.jar]. 2014-11-05 06:39:27,193 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading}Downloading the plugin [camel-plugin-7.3.1.redhat-379.jar]... 2014-11-05 06:39:27,235 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading-complete}The plugin [Camel] has been updated at [camel-plugin-7.3.1.redhat-379.jar]. 2014-11-05 06:39:27,235 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading}Downloading the plugin [cxf-plugin-7.3.1.redhat-379.jar]... 2014-11-05 06:39:27,275 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading-complete}The plugin [CXF] has been updated at [cxf-plugin-7.3.1.redhat-379.jar]. 2014-11-05 06:39:27,275 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading}Downloading the plugin [jopr-hibernate-plugin-4.12.0.JON330CR01.jar]... 2014-11-05 06:39:27,315 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading-complete}The plugin [Hibernate] has been updated at [jopr-hibernate-plugin-4.12.0.JON330CR01.jar]. 2014-11-05 06:39:27,315 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading}Downloading the plugin [gatein-as7-rhq-plugin-1.1.1.Final-redhat-1.jar]... 2014-11-05 06:39:27,333 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.downloading-complete}The plugin [GateIn AS7] has been updated at [gatein-as7-rhq-plugin-1.1.1.Final-redhat-1.jar]. 2014-11-05 06:39:27,333 INFO [main] (org.rhq.enterprise.agent.PluginUpdate)- {PluginUpdate.updating-complete}Completed updating the plugins to their latest versions. 2014-11-05 06:39:27,335 INFO [main] (org.rhq.core.pc.PluginContainer)- Initializing Plugin Container v4.12.0.JON330CR01... 2014-11-05 06:39:45,552 INFO [main] (rhq.core.pc.plugin.PluginManager)- Deployed plugins: [AgentPlugin [id=0, name=Script, md5=d74e60bbadd866dea49d040a44424f30], AgentPlugin [id=0, name=Platforms, md5=b9bff94567815680c74cdd1bfd9c9cb1], AgentPlugin [id=0, name=JMX, md5=e4d29e9daa3530ce6a1f7efbf7c2539a], AgentPlugin [id=0, name=Tomcat, md5=f63756196675b1195a91f53dfd5f214d], AgentPlugin [id=0, name=Servicemix3, md5=96b25393461a8915bb8298760b7aea63], AgentPlugin [id=0, name=RHQAgent, md5=7e64c3497bf6ebc5c3fdf23babf7ccb0], AgentPlugin [id=0, name=KieRHQPlugin, md5=bb6ca21b4d4676da59b02d7c20a7b25b], AgentPlugin [id=0, name=JBossFuse, md5=8a22d4ef90c4e255aab4eded35c0a1b2], AgentPlugin [id=0, name=JBossAS7, md5=ea18eed6efcfaca84bf5550816f9d06f], AgentPlugin [id=0, name=Teiid, md5=23a1930b58ea80535636f960b3c03a6c], AgentPlugin [id=0, name=SwitchYard, md5=399539c83987f122f7c22a1f2862a39e], AgentPlugin [id=0, name=RHQServer, md5=d6ea0ff947b742fa776f283f232451c9], AgentPlugin [id=0, name=ModeShape, md5=11a389f7eb305f3901de5e02f38b3b7b], AgentPlugin [id=0, name=JDG, md5=e8a7d1dbb7cba623f1283d846ce00a0c], AgentPlugin [id=0, name=JBossAS5, md5=384e9605976c0c5caa8fc896fd358f15], AgentPlugin [id=0, name=TeiidPlugin, md5=4808b650b96f13a979442ebd685ccfc4], AgentPlugin [id=0, name=ModeShapePlugin, md5=6368c26b5dc966339ccc72be1b6c22c3], AgentPlugin [id=0, name=JBossESB5, md5=c9d02785e0c6c484342fcec1318316d3], AgentPlugin [id=0, name=JBossCache3, md5=b636def6fb9956b1aa8ec6ac22218ff7], AgentPlugin [id=0, name=JBossAS, md5=2b82f1137dd45a33418b868a7f3235b0], AgentPlugin [id=0, name=JBossESB, md5=897d66dddc64e6a6f2f80417fd397a75], AgentPlugin [id=0, name=JBossCache, md5=0a06ae8f86acbd8be16d2b7ccf57b76c], AgentPlugin [id=0, name=Infinispan, md5=eb195098872be54a5667f9023fd4f539], AgentPlugin [id=0, name=IIS, md5=5b3e3e5fc69b8f27d610c1c20d6c31ce], AgentPlugin [id=0, name=HornetQ, md5=d351425c4e2ddf8ad23ac42646a61065], AgentPlugin [id=0, name=Hibernate, md5=a9390759c41d0a0ab8ff493d0ef6c852], AgentPlugin [id=0, name=GateIn AS7, md5=3454aa2648d44c8b98703092cb4104cd], AgentPlugin [id=0, name=GateIn, md5=4dc187d1103c3bfc0d48c8da73d205b5], AgentPlugin [id=0, name=Fabric, md5=88d713f213ef51519367e8d710eac8a8], AgentPlugin [id=0, name=Servicemix4, md5=ac2a5ffb617cdacd8caea0423672134f], AgentPlugin [id=0, name=DroolsRHQPlugin, md5=c07f68cdf5eccaf55467452abe117f63], AgentPlugin [id=0, name=Database, md5=4a8c94c7cc7696e379be8e63ee96f52a], AgentPlugin [id=0, name=Postgres, md5=0370805f58a5cc8b134c9e4e1c57b11f], AgentPlugin [id=0, name=Cassandra, md5=0d77f9e3782b977842b5835b4a837ac0], AgentPlugin [id=0, name=RHQStorage, md5=140bda404e86d5a4b8b4f1c19957c7bf], AgentPlugin [id=0, name=Camel, md5=146e1839412ec340ccae445a4d9606f6], AgentPlugin [id=0, name=CXF, md5=aa9e644e0cb6967dce38d4c8503d939c], AgentPlugin [id=0, name=Augeas, md5=dd17da0401836c109ac9e7463b095ae3], AgentPlugin [id=0, name=Apache, md5=f513cafe6e411bbe22e6a2fe7a9abc0b], AgentPlugin [id=0, name=AntBundlePlugin, md5=f51b589e9a42a233fda032b9ab314c1b], AgentPlugin [id=0, name=ActiveMQ, md5=70ff967b09b777ae2807249114d28d7f]] 2014-11-05 06:39:45,642 INFO [main] (rhq.core.pc.inventory.InventoryManager)- Initializing Inventory Manager... 2014-11-05 06:39:45,642 INFO [main] (rhq.core.pc.inventory.InventoryManager)- Loading inventory from data file [data/inventory.dat]... 2014-11-05 06:39:47,575 INFO [main] (rhq.core.pc.inventory.InventoryManager)- Inventory with size [706] loaded from data file in [1933ms] 2014-11-05 06:39:47,591 INFO [main] (rhq.core.pc.inventory.InventoryManager)- Starting resource activation and upgrade. 2014-11-05 06:39:47,591 INFO [main] (rhq.core.pc.inventory.InventoryManager)- Executing the initial inventory synchronization before upgrade. 2014-11-05 06:39:47,591 INFO [main] (rhq.core.pc.inventory.InventoryManager)- Sending [server] inventory report to Server... 2014-11-05 06:39:47,785 INFO [main] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Platform [10111] 2014-11-05 06:39:47,785 INFO [main] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Platform Top level services [10111] 2014-11-05 06:39:47,791 INFO [main] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Platform Top level services [10111] Local inventory changed: [false] 2014-11-05 06:39:47,822 INFO [main] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [10113] 2014-11-05 06:39:47,844 INFO [main] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [10113] Local inventory changed: [false] 2014-11-05 06:39:48,660 INFO [main] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [10112] 2014-11-05 06:39:48,666 INFO [main] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [10112] Local inventory changed: [false] 2014-11-05 06:39:49,613 INFO [main] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [12951] 2014-11-05 06:39:49,700 INFO [main] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [12951] Local inventory changed: [false] 2014-11-05 06:39:50,503 INFO [main] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Platform [10111]. 2014-11-05 06:39:50,503 INFO [main] (rhq.core.pc.inventory.InventoryManager)- Starting to activate (and upgrade) resources. 2014-11-05 06:39:50,529 INFO [ResourceContainer.invoker.daemon-1] (org.rhq.plugins.platform.LinuxPlatformComponent)- Internal yum server is disabled. 2014-11-05 06:39:53,038 INFO [ResourceContainer.invoker.daemon-2] (ems.impl.jmx.connection.DConnection)- Querying MBeanServer for all MBeans... 2014-11-05 06:39:53,170 INFO [ResourceContainer.invoker.daemon-2] (ems.impl.jmx.connection.DConnection)- Found 937 MBeans - starting load... 2014-11-05 06:39:53,478 INFO [ResourceContainer.invoker.daemon-1] (ems.impl.jmx.connection.DConnection)- Querying MBeanServer for all MBeans... 2014-11-05 06:39:53,479 INFO [ResourceContainer.invoker.daemon-1] (ems.impl.jmx.connection.DConnection)- Found 29 MBeans - starting load... 2014-11-05 06:39:53,576 INFO [ResourceContainer.invoker.daemon-1] (ems.impl.jmx.connection.DConnection)- Querying MBeanServer for all MBeans... 2014-11-05 06:39:53,576 INFO [ResourceContainer.invoker.daemon-1] (ems.impl.jmx.connection.DConnection)- Found 29 MBeans - starting load... 2014-11-05 06:39:55,852 WARN [ResourceContainer.invoker.daemon-1] (rhq.modules.plugins.jbossas7.BaseComponent)- Could not determine the location of the deployment - the content descriptor wasn't found for deploymentAddress{path: deployment=rhq.ear}. 2014-11-05 06:39:56,677 INFO [ResourceContainer.invoker.daemon-1] (org.mc4j.ems.connection.ConnectionFactory)- Discovered libraries in 7 ms 2014-11-05 06:39:56,677 INFO [ResourceContainer.invoker.daemon-1] (org.rhq.plugins.server.JBossAS7JMXComponent)- Loading AS7 connection [service:jmx:remoting-jmx://127.0.0.1:6999] with install path [/home/hudson/jon-server-3.3.0.CR01/jbossas/bin/client]... 2014-11-05 06:39:56,741 INFO [ResourceContainer.invoker.daemon-1] (org.xnio)- XNIO Version 3.0.10.GA-redhat-1 2014-11-05 06:39:56,775 INFO [ResourceContainer.invoker.daemon-1] (org.xnio.nio)- XNIO NIO Implementation Version 3.0.10.GA-redhat-1 2014-11-05 06:39:56,892 INFO [ResourceContainer.invoker.daemon-1] (org.jboss.remoting)- JBoss Remoting version (unknown) 2014-11-05 06:39:57,920 INFO [main] (rhq.core.pc.inventory.InventoryManager)- Inventory activated and upgrade requests gathered in 10329ms. 2014-11-05 06:39:57,920 INFO [main] (rhq.core.pc.inventory.InventoryManager)- Sending the upgrade requests to the server. 2014-11-05 06:39:57,920 INFO [main] (rhq.core.pc.inventory.InventoryManager)- Resource activation and upgrade finished. 2014-11-05 06:39:57,935 INFO [main] (rhq.core.pc.inventory.InventoryManager)- Inventory Manager initialized. 2014-11-05 06:39:57,935 INFO [main] (rhq.core.pc.event.EventManager)- Initializing Event Manager... 2014-11-05 06:39:57,940 INFO [main] (rhq.core.pc.event.EventManager)- Event Manager initialized. 2014-11-05 06:39:57,940 INFO [main] (rhq.core.pc.measurement.MeasurementManager)- Initializing Measurement Manager... 2014-11-05 06:39:58,125 INFO [main] (rhq.core.pc.measurement.MeasurementManager)- Measurement Manager initialized. 2014-11-05 06:39:58,125 INFO [main] (rhq.core.pc.content.ContentManager)- Initializing Content Manager... 2014-11-05 06:39:58,126 INFO [main] (rhq.core.pc.content.ContentManager)- Initializing scheduled content discovery... 2014-11-05 06:39:58,171 INFO [main] (rhq.core.pc.content.ContentManager)- Content Manager initialized... 2014-11-05 06:39:58,299 INFO [main] (rhq.core.pc.drift.DriftManager)- Finished initializing drift detection schedules in 22 ms 2014-11-05 06:39:58,300 INFO [main] (rhq.core.pc.drift.DriftManager)- Scanning for change set content to resend... 2014-11-05 06:39:58,300 INFO [main] (rhq.core.pc.drift.DriftManager)- Checking for deleted drift definitions 2014-11-05 06:39:58,303 INFO [main] (rhq.core.pc.drift.DriftManager)- Finished initialization in 48 ms 2014-11-05 06:39:58,304 INFO [main] (org.rhq.core.pc.PluginContainer)- Plugin Container initialized. 2014-11-05 06:39:58,343 INFO [RHQ Agent Ping Thread-1] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.ping-executor.stop-polling-resume-ping}Stopping polling and resuming pinging 2014-11-05 06:39:58,353 INFO [RHQ Primary Server Switchover Thread] (org.rhq.enterprise.agent.AgentMain)- {PrimaryServerSwitchoverThread.started}The primary server switchover thread has started. 2014-11-05 06:39:58,380 INFO [RHQ Primary Server Switchover Thread] (org.rhq.enterprise.agent.AgentMain)- {PrimaryServerSwitchoverThread.not-talking-to-primary}The agent is not talking to its primary server [10.16.23.123:7080] - it is talking to [10.16.23.104:7080] 2014-11-05 06:39:58,383 WARN [RHQ Agent Ping Thread-1] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.server-thinks-agent-is-down}The server thinks this agent is down. Will notify the server of up-to-date information when possible. 2014-11-05 06:39:58,385 INFO [RHQ Primary Server Switchover Thread] (org.rhq.enterprise.agent.AgentMain)- {PrimaryServerSwitchoverThread.primary-still-down}Primary server at [10.16.23.123:7080] is still down - cannot switch back to it yet 2014-11-05 06:40:03,886 INFO [InventoryManager.availability-1] (rhq.core.pc.inventory.InventoryManager)- Sending availability report to Server... 2014-11-05 06:40:07,930 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.AutoDiscoveryExecutor)- Executing server discovery scan... 2014-11-05 06:40:08,264 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.AutoDiscoveryExecutor)- Discovered 0 new server(s). 2014-11-05 06:40:08,264 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sending [server] inventory report to Server... 2014-11-05 06:40:08,383 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Platform [10111] 2014-11-05 06:40:08,383 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Platform Top level services [10111] 2014-11-05 06:40:08,383 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Platform Top level services [10111] Local inventory changed: [false] 2014-11-05 06:40:08,401 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [10113] 2014-11-05 06:40:08,402 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [10113] Local inventory changed: [false] 2014-11-05 06:40:09,214 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [10112] 2014-11-05 06:40:09,214 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [10112] Local inventory changed: [false] 2014-11-05 06:40:10,056 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [12951] 2014-11-05 06:40:10,059 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [12951] Local inventory changed: [false] 2014-11-05 06:40:10,886 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Platform [10111]. 2014-11-05 06:40:17,935 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.RuntimeDiscoveryExecutor)- Executing runtime discovery scan rooted at [platform]... 2014-11-05 06:40:17,960 INFO [ResourceDiscoveryComponent.invoker.daemon-1] (ems.impl.jmx.connection.DConnection)- Querying MBeanServer for all MBeans... 2014-11-05 06:40:18,244 INFO [ResourceDiscoveryComponent.invoker.daemon-2] (org.rhq.plugins.agent.AgentEnvironmentScriptDiscoveryComponent)- Discovering RHQ Agent's environment setup script... 2014-11-05 06:40:18,248 INFO [ResourceDiscoveryComponent.invoker.daemon-2] (org.rhq.plugins.agent.AgentLauncherScriptDiscoveryComponent)- Discovering RHQ Agent's launcher script service... 2014-11-05 06:40:18,250 INFO [ResourceDiscoveryComponent.invoker.daemon-2] (org.rhq.plugins.agent.AgentJavaServiceWrapperDiscoveryComponent)- Discovering RHQ Agent's JSW service... 2014-11-05 06:40:28,499 WARN [MeasurementManager.collector-1] (rhq.core.pc.measurement.MeasurementCollectorRunner)- Failure to collect measurement data for Resource[id=10448, uuid=50c85be9-b040-4b9e-8259-c3daa1d0876f, type={RHQStorage}ConfigurableInternalServerMetrics, key=org.apache.cassandra.internal:type=AntiEntropySessions, name=Anti Entropy Sessions, parent=RHQ Storage Node(fbr-ha-3.bc.jonqe.lab.eng.bos.redhat.com)] - cause: java.lang.IllegalStateException:EMS bean was null for Resource with type [ResourceType[id=0, name=ConfigurableInternalServerMetrics, plugin=RHQStorage, category=Service]] and key [org.apache.cassandra.internal:type=AntiEntropySessions]. 2014-11-05 06:40:37,553 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.RuntimeDiscoveryExecutor)- Scanned platform and 1 server(s) and discovered 6 new descendant Resource(s). 2014-11-05 06:40:37,553 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sending [runtime] inventory report to Server... 2014-11-05 06:40:38,735 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Platform [10111] 2014-11-05 06:40:38,736 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Platform Top level services [10111] 2014-11-05 06:40:38,736 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Platform Top level services [10111] Local inventory changed: [false] 2014-11-05 06:40:38,747 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [10113] 2014-11-05 06:40:38,748 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [10113] Local inventory changed: [false] 2014-11-05 06:40:39,559 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [10112] 2014-11-05 06:40:39,559 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [10112] Local inventory changed: [false] 2014-11-05 06:40:40,420 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [12951] 2014-11-05 06:40:40,726 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [12951] Local inventory changed: [true] 2014-11-05 06:40:41,528 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Platform [10111]. 2014-11-05 06:40:41,528 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync changes detected, requesting full availability report and service discovery: Platform [10111] 2014-11-05 06:40:46,528 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.RuntimeDiscoveryExecutor)- Executing runtime discovery scan rooted at [platform]... 2014-11-05 06:40:46,562 INFO [ResourceDiscoveryComponent.invoker.daemon-1] (ems.impl.jmx.connection.DConnection)- Querying MBeanServer for all MBeans... 2014-11-05 06:40:46,731 INFO [ResourceDiscoveryComponent.invoker.daemon-3] (org.rhq.plugins.agent.AgentEnvironmentScriptDiscoveryComponent)- Discovering RHQ Agent's environment setup script... 2014-11-05 06:40:46,732 INFO [ResourceDiscoveryComponent.invoker.daemon-3] (org.rhq.plugins.agent.AgentLauncherScriptDiscoveryComponent)- Discovering RHQ Agent's launcher script service... 2014-11-05 06:40:46,732 INFO [ResourceDiscoveryComponent.invoker.daemon-3] (org.rhq.plugins.agent.AgentJavaServiceWrapperDiscoveryComponent)- Discovering RHQ Agent's JSW service... 2014-11-05 06:41:05,222 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.RuntimeDiscoveryExecutor)- Scanned platform and 1 server(s) and discovered 7 new descendant Resource(s). 2014-11-05 06:41:05,222 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sending [runtime] inventory report to Server... 2014-11-05 06:41:05,674 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Platform [10111] 2014-11-05 06:41:05,675 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Platform Top level services [10111] 2014-11-05 06:41:05,675 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Platform Top level services [10111] Local inventory changed: [false] 2014-11-05 06:41:05,688 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [10113] 2014-11-05 06:41:05,689 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [10113] Local inventory changed: [false] 2014-11-05 06:41:06,500 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [10112] 2014-11-05 06:41:06,501 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [10112] Local inventory changed: [false] 2014-11-05 06:41:07,349 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [12951] 2014-11-05 06:41:07,387 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [12951] Local inventory changed: [true] 2014-11-05 06:41:08,189 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Platform [10111]. 2014-11-05 06:41:08,189 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync changes detected, requesting full availability report and service discovery: Platform [10111] 2014-11-05 06:41:08,189 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Canceled in-progress service scan in favor of starting new scan. Partial scan will still be processed. 2014-11-05 06:41:13,189 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.RuntimeDiscoveryExecutor)- Executing runtime discovery scan rooted at [platform]... 2014-11-05 06:41:13,211 INFO [ResourceDiscoveryComponent.invoker.daemon-1] (ems.impl.jmx.connection.DConnection)- Querying MBeanServer for all MBeans... 2014-11-05 06:41:13,343 INFO [ResourceDiscoveryComponent.invoker.daemon-3] (org.rhq.plugins.agent.AgentEnvironmentScriptDiscoveryComponent)- Discovering RHQ Agent's environment setup script... 2014-11-05 06:41:13,344 INFO [ResourceDiscoveryComponent.invoker.daemon-1] (org.rhq.plugins.agent.AgentLauncherScriptDiscoveryComponent)- Discovering RHQ Agent's launcher script service... 2014-11-05 06:41:13,344 INFO [ResourceDiscoveryComponent.invoker.daemon-3] (org.rhq.plugins.agent.AgentJavaServiceWrapperDiscoveryComponent)- Discovering RHQ Agent's JSW service... 2014-11-05 06:41:30,422 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.RuntimeDiscoveryExecutor)- Scanned platform and 0 server(s) and discovered 0 new descendant Resource(s). 2014-11-05 06:41:30,422 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.RuntimeDiscoveryExecutor)- Not sending inventory report because no new descendent resources were discovered. 2014-11-05 06:41:31,387 INFO [InventoryManager.availability-1] (rhq.core.pc.inventory.InventoryManager)- Sending availability report to Server... 2014-11-05 06:42:05,423 INFO [InventoryManager.availability-1] (rhq.core.pc.inventory.InventoryManager)- Sending availability report to Server... 2014-11-05 06:44:58,214 INFO [ResourceContainer.invoker.daemon-2] (org.rhq.plugins.jmx.MBeanResourceComponent)- Configuration management is currently disabled for the ResourceType[id=0, name=java.util.logging, plugin=RHQAgent, category=Service] Resource with key [java.util.logging:type=Logging] - it can be enabled in the Resource's Inventory > Connection tab. 2014-11-05 06:44:58,443 INFO [ResourceContainer.invoker.daemon-3] (org.rhq.plugins.jmx.MBeanResourceComponent)- Configuration management is currently disabled for the ResourceType[id=0, name=java.util.logging, plugin=RHQStorage, category=Service] Resource with key [java.util.logging:type=Logging] - it can be enabled in the Resource's Inventory > Connection tab. 2014-11-05 06:51:27,949 INFO [ClientCommandSenderTask Timer Thread #14] (enterprise.communications.command.client.JBossRemotingRemoteCommunicator)- {JBossRemotingRemoteCommunicator.changing-endpoint}Communicator is changing endpoint from [InvokerLocator [servlet://10.16.23.104:7080/jboss-remoting-servlet-invoker/ServerInvokerServlet]] to [InvokerLocator [servlet://10.16.23.123:7080/jboss-remoting-servlet-invoker/ServerInvokerServlet]] 2014-11-05 06:51:28,158 INFO [ClientCommandSenderTask Timer Thread #14] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.failed-over-to-server}The agent has triggered its failover mechanism and switched to server [servlet://10.16.23.123:7080/jboss-remoting-servlet-invoker/ServerInvokerServlet] 2014-11-05 06:51:57,941 INFO [ClientCommandSenderTask Timer Thread #14] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.not-sending-dup-connect}Not sending another connect message since one was recently sent: [servlet://10.16.23.123:7080/jboss-remoting-servlet-invoker/ServerInvokerServlet@Wed Nov 05 06:51:28 EST 2014] 2014-11-05 06:55:10,887 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.AutoDiscoveryExecutor)- Executing server discovery scan... 2014-11-05 06:55:11,119 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.AutoDiscoveryExecutor)- Discovered 0 new server(s). 2014-11-05 06:55:11,119 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sending [server] inventory report to Server... 2014-11-05 06:55:11,315 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Platform [10111] 2014-11-05 06:55:11,315 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Platform Top level services [10111] 2014-11-05 06:55:11,315 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Platform Top level services [10111] Local inventory changed: [false] 2014-11-05 06:55:11,339 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [10113] 2014-11-05 06:55:11,340 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [10113] Local inventory changed: [false] 2014-11-05 06:55:12,152 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [10112] 2014-11-05 06:55:12,153 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [10112] Local inventory changed: [false] 2014-11-05 06:55:12,992 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [12951] 2014-11-05 06:55:12,995 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [12951] Local inventory changed: [false] 2014-11-05 06:55:13,831 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Platform [10111]. 2014-11-05 07:00:27,969 WARN [MeasurementManager.collector-1] (rhq.core.pc.measurement.MeasurementCollectorRunner)- Failure to collect measurement data for Resource[id=10448, uuid=50c85be9-b040-4b9e-8259-c3daa1d0876f, type={RHQStorage}ConfigurableInternalServerMetrics, key=org.apache.cassandra.internal:type=AntiEntropySessions, name=Anti Entropy Sessions, parent=RHQ Storage Node(fbr-ha-3.bc.jonqe.lab.eng.bos.redhat.com)] - cause: java.lang.IllegalStateException:EMS bean was null for Resource with type [ResourceType[id=0, name=ConfigurableInternalServerMetrics, plugin=RHQStorage, category=Service]] and key [org.apache.cassandra.internal:type=AntiEntropySessions]. 2014-11-05 07:10:13,831 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.AutoDiscoveryExecutor)- Executing server discovery scan... 2014-11-05 07:10:14,059 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.AutoDiscoveryExecutor)- Discovered 0 new server(s). 2014-11-05 07:10:14,060 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sending [server] inventory report to Server... 2014-11-05 07:10:14,166 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Platform [10111] 2014-11-05 07:10:14,166 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Platform Top level services [10111] 2014-11-05 07:10:14,166 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Platform Top level services [10111] Local inventory changed: [false] 2014-11-05 07:10:14,176 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [10113] 2014-11-05 07:10:14,177 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [10113] Local inventory changed: [false] 2014-11-05 07:10:14,987 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [10112] 2014-11-05 07:10:14,987 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [10112] Local inventory changed: [false] 2014-11-05 07:10:15,863 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [12951] 2014-11-05 07:10:15,866 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [12951] Local inventory changed: [false] 2014-11-05 07:10:16,668 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Platform [10111]. 2014-11-05 07:20:27,967 WARN [MeasurementManager.collector-1] (rhq.core.pc.measurement.MeasurementCollectorRunner)- Failure to collect measurement data for Resource[id=10448, uuid=50c85be9-b040-4b9e-8259-c3daa1d0876f, type={RHQStorage}ConfigurableInternalServerMetrics, key=org.apache.cassandra.internal:type=AntiEntropySessions, name=Anti Entropy Sessions, parent=RHQ Storage Node(fbr-ha-3.bc.jonqe.lab.eng.bos.redhat.com)] - cause: java.lang.IllegalStateException:EMS bean was null for Resource with type [ResourceType[id=0, name=ConfigurableInternalServerMetrics, plugin=RHQStorage, category=Service]] and key [org.apache.cassandra.internal:type=AntiEntropySessions]. 2014-11-05 07:25:16,668 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.AutoDiscoveryExecutor)- Executing server discovery scan... 2014-11-05 07:25:16,822 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.AutoDiscoveryExecutor)- Discovered 0 new server(s). 2014-11-05 07:25:16,822 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sending [server] inventory report to Server... 2014-11-05 07:25:16,921 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Platform [10111] 2014-11-05 07:25:16,922 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Platform Top level services [10111] 2014-11-05 07:25:16,922 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Platform Top level services [10111] Local inventory changed: [false] 2014-11-05 07:25:16,931 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [10113] 2014-11-05 07:25:16,932 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [10113] Local inventory changed: [false] 2014-11-05 07:25:17,742 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [10112] 2014-11-05 07:25:17,742 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [10112] Local inventory changed: [false] 2014-11-05 07:25:18,566 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [12951] 2014-11-05 07:25:18,569 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [12951] Local inventory changed: [false] 2014-11-05 07:25:19,370 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Platform [10111]. 2014-11-05 07:40:19,371 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.AutoDiscoveryExecutor)- Executing server discovery scan... 2014-11-05 07:40:19,524 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.AutoDiscoveryExecutor)- Discovered 0 new server(s). 2014-11-05 07:40:19,524 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sending [server] inventory report to Server... 2014-11-05 07:40:19,628 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Platform [10111] 2014-11-05 07:40:19,628 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Platform Top level services [10111] 2014-11-05 07:40:19,628 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Platform Top level services [10111] Local inventory changed: [false] 2014-11-05 07:40:19,637 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [10113] 2014-11-05 07:40:19,637 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [10113] Local inventory changed: [false] 2014-11-05 07:40:20,445 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [10112] 2014-11-05 07:40:20,445 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [10112] Local inventory changed: [false] 2014-11-05 07:40:21,272 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [12951] 2014-11-05 07:40:21,275 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [12951] Local inventory changed: [false] 2014-11-05 07:40:22,076 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Platform [10111]. 2014-11-05 07:40:27,974 WARN [MeasurementManager.collector-1] (rhq.core.pc.measurement.MeasurementCollectorRunner)- Failure to collect measurement data for Resource[id=10448, uuid=50c85be9-b040-4b9e-8259-c3daa1d0876f, type={RHQStorage}ConfigurableInternalServerMetrics, key=org.apache.cassandra.internal:type=AntiEntropySessions, name=Anti Entropy Sessions, parent=RHQ Storage Node(fbr-ha-3.bc.jonqe.lab.eng.bos.redhat.com)] - cause: java.lang.IllegalStateException:EMS bean was null for Resource with type [ResourceType[id=0, name=ConfigurableInternalServerMetrics, plugin=RHQStorage, category=Service]] and key [org.apache.cassandra.internal:type=AntiEntropySessions]. 2014-11-05 07:46:57,958 INFO [ClientCommandSenderTask Timer Thread #14] (enterprise.communications.command.client.JBossRemotingRemoteCommunicator)- {JBossRemotingRemoteCommunicator.changing-endpoint}Communicator is changing endpoint from [InvokerLocator [servlet://10.16.23.123:7080/jboss-remoting-servlet-invoker/ServerInvokerServlet]] to [InvokerLocator [servlet://10.16.23.123:7080/jboss-remoting-servlet-invoker/ServerInvokerServlet]] 2014-11-05 07:46:57,959 WARN [ClientCommandSenderTask Timer Thread #14] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.failover-failed}Failed to failover to another server. Cause: org.jboss.remoting.CannotConnectException: Can not connect http client invoker after 1 attempt(s) 2014-11-05 07:46:57,975 INFO [ClientCommandSenderTask Timer Thread #14] (enterprise.communications.command.client.JBossRemotingRemoteCommunicator)- {JBossRemotingRemoteCommunicator.changing-endpoint}Communicator is changing endpoint from [InvokerLocator [servlet://10.16.23.123:7080/jboss-remoting-servlet-invoker/ServerInvokerServlet]] to [InvokerLocator [servlet://10.16.23.115:7080/jboss-remoting-servlet-invoker/ServerInvokerServlet]] 2014-11-05 07:46:57,977 WARN [ClientCommandSenderTask Timer Thread #14] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.failover-failed}Failed to failover to another server. Cause: org.jboss.remoting.CannotConnectException: Can not connect http client invoker after 1 attempt(s) 2014-11-05 07:46:57,993 INFO [ClientCommandSenderTask Timer Thread #14] (enterprise.communications.command.client.JBossRemotingRemoteCommunicator)- {JBossRemotingRemoteCommunicator.changing-endpoint}Communicator is changing endpoint from [InvokerLocator [servlet://10.16.23.115:7080/jboss-remoting-servlet-invoker/ServerInvokerServlet]] to [InvokerLocator [servlet://10.16.23.104:7080/jboss-remoting-servlet-invoker/ServerInvokerServlet]] 2014-11-05 07:46:58,003 WARN [ClientCommandSenderTask Timer Thread #14] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.failover-failed}Failed to failover to another server. Cause: org.jboss.remoting.transport.http.WebServerError: JBoss Web/7.4.8.Final-redhat-4 - JBWEB000064: Error report

JBWEB000065: HTTP Status 404 - /jboss-remoting-servlet-invoker/ServerInvokerServlet


JBWEB000309: type JBWEB000067: Status report

JBWEB000068: message /jboss-remoting-servlet-invoker/ServerInvokerServlet

JBWEB000069: description JBWEB000124: The requested resource is not available.


JBoss Web/7.4.8.Final-redhat-4

2014-11-05 07:46:58,006 WARN [ClientCommandSenderTask Timer Thread #14] (org.rhq.enterprise.agent.FailoverFailureCallback)- {AgentMain.too-many-failover-attempts}Too many failover attempts have been made [3]. Exception that triggered the failover: [org.jboss.remoting.transport.http.WebServerError: JBoss Web/7.4.8.Final-redhat-4 - JBWEB000064: Error report

JBWEB000065: HTTP Status 404 - /jboss-remoting-servlet-invoker/ServerInvokerServlet


JBWEB000309: type JBWEB000067: Status report

JBWEB000068: message /jboss-remoting-servlet-invoker/ServerInvokerServlet

JBWEB000069: description JBWEB000124: The requested resource is not available.


JBoss Web/7.4.8.Final-redhat-4

] 2014-11-05 07:46:58,007 ERROR [ClientCommandSenderTask Thread #3] (enterprise.communications.command.client.ClientCommandSenderTask)- {ClientCommandSenderTask.send-failed}Failed to send command [Command: type=[remotepojo]; cmd-in-response=[false]; config=[{rhq.agent-name=fbr-ha-3.bc.jonqe.lab.eng.bos.redhat.com, rhq.externalizable-strategy=AGENT, rhq.security-token=xRAowwOH1641fshJvQUADVx1DmJsr0rpmdTDCtKLg6tHh5+GUW4pYFzNpdxPhu/Jipk=, rhq.guaranteed-delivery=true, rhq.send-throttle=true}]; params=[{invocation=NameBasedInvocation[mergeMeasurementReport], targetInterfaceName=org.rhq.core.clientapi.server.measurement.MeasurementServerService}]]. Cause: org.jboss.remoting.transport.http.WebServerError:JBoss Web/7.4.8.Final-redhat-4 - JBWEB000064: Error report

JBWEB000065: HTTP Status 404 - /jboss-remoting-servlet-invoker/ServerInvokerServlet


JBWEB000309: type JBWEB000067: Status report

JBWEB000068: message /jboss-remoting-servlet-invoker/ServerInvokerServlet

JBWEB000069: description JBWEB000124: The requested resource is not available.


JBoss Web/7.4.8.Final-redhat-4

. Cause: org.jboss.remoting.transport.http.WebServerError: JBoss Web/7.4.8.Final-redhat-4 - JBWEB000064: Error report

JBWEB000065: HTTP Status 404 - /jboss-remoting-servlet-invoker/ServerInvokerServlet


JBWEB000309: type JBWEB000067: Status report

JBWEB000068: message /jboss-remoting-servlet-invoker/ServerInvokerServlet

JBWEB000069: description JBWEB000124: The requested resource is not available.


JBoss Web/7.4.8.Final-redhat-4

2014-11-05 07:46:58,009 WARN [ClientCommandSenderTask Thread #3] (enterprise.communications.command.client.ClientCommandSenderTask)- {ClientCommandSenderTask.queuing-failed-command}The command that failed has its guaranteed-delivery flag set so it is being queued again 2014-11-05 07:46:58,206 INFO [ResourceContainer.invoker.daemon-14] (org.rhq.plugins.jmx.MBeanResourceComponent)- Configuration management is currently disabled for the ResourceType[id=0, name=java.util.logging, plugin=RHQAgent, category=Service] Resource with key [java.util.logging:type=Logging] - it can be enabled in the Resource's Inventory > Connection tab. 2014-11-05 07:46:58,430 INFO [ClientCommandSenderTask Timer Thread #14] (enterprise.communications.command.client.JBossRemotingRemoteCommunicator)- {JBossRemotingRemoteCommunicator.changing-endpoint}Communicator is changing endpoint from [InvokerLocator [servlet://10.16.23.104:7080/jboss-remoting-servlet-invoker/ServerInvokerServlet]] to [InvokerLocator [servlet://10.16.23.123:7080/jboss-remoting-servlet-invoker/ServerInvokerServlet]] 2014-11-05 07:46:58,434 WARN [ClientCommandSenderTask Timer Thread #14] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.failover-failed}Failed to failover to another server. Cause: org.jboss.remoting.CannotConnectException: Can not connect http client invoker after 1 attempt(s) 2014-11-05 07:46:58,442 INFO [ClientCommandSenderTask Timer Thread #14] (enterprise.communications.command.client.JBossRemotingRemoteCommunicator)- {JBossRemotingRemoteCommunicator.changing-endpoint}Communicator is changing endpoint from [InvokerLocator [servlet://10.16.23.123:7080/jboss-remoting-servlet-invoker/ServerInvokerServlet]] to [InvokerLocator [servlet://10.16.23.115:7080/jboss-remoting-servlet-invoker/ServerInvokerServlet]] 2014-11-05 07:46:58,445 WARN [ClientCommandSenderTask Timer Thread #14] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.failover-failed}Failed to failover to another server. Cause: org.jboss.remoting.CannotConnectException: Can not connect http client invoker after 1 attempt(s) 2014-11-05 07:46:58,460 INFO [ClientCommandSenderTask Timer Thread #14] (enterprise.communications.command.client.JBossRemotingRemoteCommunicator)- {JBossRemotingRemoteCommunicator.changing-endpoint}Communicator is changing endpoint from [InvokerLocator [servlet://10.16.23.115:7080/jboss-remoting-servlet-invoker/ServerInvokerServlet]] to [InvokerLocator [servlet://10.16.23.104:7080/jboss-remoting-servlet-invoker/ServerInvokerServlet]] 2014-11-05 07:46:58,466 WARN [ClientCommandSenderTask Timer Thread #14] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.failover-failed}Failed to failover to another server. Cause: org.jboss.remoting.transport.http.WebServerError: JBoss Web/7.4.8.Final-redhat-4 - JBWEB000064: Error report

JBWEB000065: HTTP Status 404 - /jboss-remoting-servlet-invoker/ServerInvokerServlet


JBWEB000309: type JBWEB000067: Status report

JBWEB000068: message /jboss-remoting-servlet-invoker/ServerInvokerServlet

JBWEB000069: description JBWEB000124: The requested resource is not available.


JBoss Web/7.4.8.Final-redhat-4

2014-11-05 07:46:58,468 WARN [ClientCommandSenderTask Timer Thread #14] (org.rhq.enterprise.agent.FailoverFailureCallback)- {AgentMain.too-many-failover-attempts}Too many failover attempts have been made [3]. Exception that triggered the failover: [org.jboss.remoting.transport.http.WebServerError: JBoss Web/7.4.8.Final-redhat-4 - JBWEB000064: Error report

JBWEB000065: HTTP Status 404 - /jboss-remoting-servlet-invoker/ServerInvokerServlet


JBWEB000309: type JBWEB000067: Status report

JBWEB000068: message /jboss-remoting-servlet-invoker/ServerInvokerServlet

JBWEB000069: description JBWEB000124: The requested resource is not available.


JBoss Web/7.4.8.Final-redhat-4

] 2014-11-05 07:46:58,468 ERROR [ClientCommandSenderTask Timer Thread #14] (enterprise.communications.command.client.JBossRemotingRemoteCommunicator)- {JBossRemotingRemoteCommunicator.init-callback-failed}The initialize callback has failed. It will be tried again. Cause: org.jboss.remoting.transport.http.WebServerError:JBoss Web/7.4.8.Final-redhat-4 - JBWEB000064: Error report

JBWEB000065: HTTP Status 404 - /jboss-remoting-servlet-invoker/ServerInvokerServlet


JBWEB000309: type JBWEB000067: Status report

JBWEB000068: message /jboss-remoting-servlet-invoker/ServerInvokerServlet

JBWEB000069: description JBWEB000124: The requested resource is not available.


JBoss Web/7.4.8.Final-redhat-4

. Cause: org.jboss.remoting.transport.http.WebServerError: JBoss Web/7.4.8.Final-redhat-4 - JBWEB000064: Error report

JBWEB000065: HTTP Status 404 - /jboss-remoting-servlet-invoker/ServerInvokerServlet


JBWEB000309: type JBWEB000067: Status report

JBWEB000068: message /jboss-remoting-servlet-invoker/ServerInvokerServlet

JBWEB000069: description JBWEB000124: The requested resource is not available.


JBoss Web/7.4.8.Final-redhat-4

2014-11-05 07:46:58,539 INFO [ResourceContainer.invoker.daemon-12] (org.rhq.plugins.jmx.MBeanResourceComponent)- Configuration management is currently disabled for the ResourceType[id=0, name=java.util.logging, plugin=RHQStorage, category=Service] Resource with key [java.util.logging:type=Logging] - it can be enabled in the Resource's Inventory > Connection tab. 2014-11-05 07:46:58,699 INFO [ClientCommandSenderTask Timer Thread #14] (enterprise.communications.command.client.JBossRemotingRemoteCommunicator)- {JBossRemotingRemoteCommunicator.changing-endpoint}Communicator is changing endpoint from [InvokerLocator [servlet://10.16.23.104:7080/jboss-remoting-servlet-invoker/ServerInvokerServlet]] to [InvokerLocator [servlet://10.16.23.123:7080/jboss-remoting-servlet-invoker/ServerInvokerServlet]] 2014-11-05 07:46:58,703 WARN [ClientCommandSenderTask Timer Thread #14] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.failover-failed}Failed to failover to another server. Cause: org.jboss.remoting.CannotConnectException: Can not connect http client invoker after 1 attempt(s) 2014-11-05 07:46:58,720 INFO [ClientCommandSenderTask Timer Thread #14] (enterprise.communications.command.client.JBossRemotingRemoteCommunicator)- {JBossRemotingRemoteCommunicator.changing-endpoint}Communicator is changing endpoint from [InvokerLocator [servlet://10.16.23.123:7080/jboss-remoting-servlet-invoker/ServerInvokerServlet]] to [InvokerLocator [servlet://10.16.23.115:7080/jboss-remoting-servlet-invoker/ServerInvokerServlet]] 2014-11-05 07:46:58,735 WARN [ClientCommandSenderTask Timer Thread #14] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.failover-failed}Failed to failover to another server. Cause: org.jboss.remoting.CannotConnectException: Can not connect http client invoker after 1 attempt(s) 2014-11-05 07:46:58,745 INFO [ClientCommandSenderTask Timer Thread #14] (enterprise.communications.command.client.JBossRemotingRemoteCommunicator)- {JBossRemotingRemoteCommunicator.changing-endpoint}Communicator is changing endpoint from [InvokerLocator [servlet://10.16.23.115:7080/jboss-remoting-servlet-invoker/ServerInvokerServlet]] to [InvokerLocator [servlet://10.16.23.104:7080/jboss-remoting-servlet-invoker/ServerInvokerServlet]] 2014-11-05 07:46:58,748 WARN [ClientCommandSenderTask Timer Thread #14] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.failover-failed}Failed to failover to another server. Cause: org.jboss.remoting.transport.http.WebServerError: JBoss Web/7.4.8.Final-redhat-4 - JBWEB000064: Error report

JBWEB000065: HTTP Status 404 - /jboss-remoting-servlet-invoker/ServerInvokerServlet


JBWEB000309: type JBWEB000067: Status report

JBWEB000068: message /jboss-remoting-servlet-invoker/ServerInvokerServlet

JBWEB000069: description JBWEB000124: The requested resource is not available.


JBoss Web/7.4.8.Final-redhat-4

2014-11-05 07:46:58,804 WARN [ClientCommandSenderTask Timer Thread #14] (org.rhq.enterprise.agent.FailoverFailureCallback)- {AgentMain.too-many-failover-attempts}Too many failover attempts have been made [3]. Exception that triggered the failover: [org.jboss.remoting.transport.http.WebServerError: JBoss Web/7.4.8.Final-redhat-4 - JBWEB000064: Error report

JBWEB000065: HTTP Status 404 - /jboss-remoting-servlet-invoker/ServerInvokerServlet


JBWEB000309: type JBWEB000067: Status report

JBWEB000068: message /jboss-remoting-servlet-invoker/ServerInvokerServlet

JBWEB000069: description JBWEB000124: The requested resource is not available.


JBoss Web/7.4.8.Final-redhat-4

] 2014-11-05 07:46:58,804 ERROR [ClientCommandSenderTask Timer Thread #14] (enterprise.communications.command.client.JBossRemotingRemoteCommunicator)- {JBossRemotingRemoteCommunicator.init-callback-failed}The initialize callback has failed. It will be tried again. Cause: org.jboss.remoting.transport.http.WebServerError:JBoss Web/7.4.8.Final-redhat-4 - JBWEB000064: Error report

JBWEB000065: HTTP Status 404 - /jboss-remoting-servlet-invoker/ServerInvokerServlet


JBWEB000309: type JBWEB000067: Status report

JBWEB000068: message /jboss-remoting-servlet-invoker/ServerInvokerServlet

JBWEB000069: description JBWEB000124: The requested resource is not available.


JBoss Web/7.4.8.Final-redhat-4

. Cause: org.jboss.remoting.transport.http.WebServerError: JBoss Web/7.4.8.Final-redhat-4 - JBWEB000064: Error report

JBWEB000065: HTTP Status 404 - /jboss-remoting-servlet-invoker/ServerInvokerServlet


JBWEB000309: type JBWEB000067: Status report

JBWEB000068: message /jboss-remoting-servlet-invoker/ServerInvokerServlet

JBWEB000069: description JBWEB000124: The requested resource is not available.


JBoss Web/7.4.8.Final-redhat-4

2014-11-05 07:46:58,817 INFO [ClientCommandSenderTask Timer Thread #17] (enterprise.communications.command.client.JBossRemotingRemoteCommunicator)- {JBossRemotingRemoteCommunicator.changing-endpoint}Communicator is changing endpoint from [InvokerLocator [servlet://10.16.23.104:7080/jboss-remoting-servlet-invoker/ServerInvokerServlet]] to [InvokerLocator [servlet://10.16.23.123:7080/jboss-remoting-servlet-invoker/ServerInvokerServlet]] 2014-11-05 07:46:58,819 WARN [ClientCommandSenderTask Timer Thread #17] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.failover-failed}Failed to failover to another server. Cause: org.jboss.remoting.CannotConnectException: Can not connect http client invoker after 1 attempt(s) 2014-11-05 07:46:58,836 INFO [ClientCommandSenderTask Timer Thread #17] (enterprise.communications.command.client.JBossRemotingRemoteCommunicator)- {JBossRemotingRemoteCommunicator.changing-endpoint}Communicator is changing endpoint from [InvokerLocator [servlet://10.16.23.123:7080/jboss-remoting-servlet-invoker/ServerInvokerServlet]] to [InvokerLocator [servlet://10.16.23.115:7080/jboss-remoting-servlet-invoker/ServerInvokerServlet]] 2014-11-05 07:46:58,838 WARN [ClientCommandSenderTask Timer Thread #17] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.failover-failed}Failed to failover to another server. Cause: org.jboss.remoting.CannotConnectException: Can not connect http client invoker after 1 attempt(s) 2014-11-05 07:46:58,849 INFO [ClientCommandSenderTask Timer Thread #17] (enterprise.communications.command.client.JBossRemotingRemoteCommunicator)- {JBossRemotingRemoteCommunicator.changing-endpoint}Communicator is changing endpoint from [InvokerLocator [servlet://10.16.23.115:7080/jboss-remoting-servlet-invoker/ServerInvokerServlet]] to [InvokerLocator [servlet://10.16.23.104:7080/jboss-remoting-servlet-invoker/ServerInvokerServlet]] 2014-11-05 07:46:58,854 WARN [ClientCommandSenderTask Timer Thread #17] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.failover-failed}Failed to failover to another server. Cause: org.jboss.remoting.transport.http.WebServerError: JBoss Web/7.4.8.Final-redhat-4 - JBWEB000064: Error report

JBWEB000065: HTTP Status 404 - /jboss-remoting-servlet-invoker/ServerInvokerServlet


JBWEB000309: type JBWEB000067: Status report

JBWEB000068: message /jboss-remoting-servlet-invoker/ServerInvokerServlet

JBWEB000069: description JBWEB000124: The requested resource is not available.


JBoss Web/7.4.8.Final-redhat-4

2014-11-05 07:46:58,858 WARN [ClientCommandSenderTask Timer Thread #17] (org.rhq.enterprise.agent.FailoverFailureCallback)- {AgentMain.too-many-failover-attempts}Too many failover attempts have been made [3]. Exception that triggered the failover: [org.jboss.remoting.transport.http.WebServerError: JBoss Web/7.4.8.Final-redhat-4 - JBWEB000064: Error report

JBWEB000065: HTTP Status 404 - /jboss-remoting-servlet-invoker/ServerInvokerServlet


JBWEB000309: type JBWEB000067: Status report

JBWEB000068: message /jboss-remoting-servlet-invoker/ServerInvokerServlet

JBWEB000069: description JBWEB000124: The requested resource is not available.


JBoss Web/7.4.8.Final-redhat-4

] 2014-11-05 07:46:58,858 ERROR [ClientCommandSenderTask Timer Thread #17] (enterprise.communications.command.client.JBossRemotingRemoteCommunicator)- {JBossRemotingRemoteCommunicator.init-callback-failed}The initialize callback has failed. It will be tried again. Cause: org.jboss.remoting.transport.http.WebServerError:JBoss Web/7.4.8.Final-redhat-4 - JBWEB000064: Error report

JBWEB000065: HTTP Status 404 - /jboss-remoting-servlet-invoker/ServerInvokerServlet


JBWEB000309: type JBWEB000067: Status report

JBWEB000068: message /jboss-remoting-servlet-invoker/ServerInvokerServlet

JBWEB000069: description JBWEB000124: The requested resource is not available.


JBoss Web/7.4.8.Final-redhat-4

. Cause: org.jboss.remoting.transport.http.WebServerError: JBoss Web/7.4.8.Final-redhat-4 - JBWEB000064: Error report

JBWEB000065: HTTP Status 404 - /jboss-remoting-servlet-invoker/ServerInvokerServlet


JBWEB000309: type JBWEB000067: Status report

JBWEB000068: message /jboss-remoting-servlet-invoker/ServerInvokerServlet

JBWEB000069: description JBWEB000124: The requested resource is not available.


JBoss Web/7.4.8.Final-redhat-4

2014-11-05 07:46:59,526 INFO [ClientCommandSenderTask Timer Thread #17] (enterprise.communications.command.client.JBossRemotingRemoteCommunicator)- {JBossRemotingRemoteCommunicator.changing-endpoint}Communicator is changing endpoint from [InvokerLocator [servlet://10.16.23.104:7080/jboss-remoting-servlet-invoker/ServerInvokerServlet]] to [InvokerLocator [servlet://10.16.23.123:7080/jboss-remoting-servlet-invoker/ServerInvokerServlet]] 2014-11-05 07:46:59,527 WARN [ClientCommandSenderTask Timer Thread #17] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.failover-failed}Failed to failover to another server. Cause: org.jboss.remoting.CannotConnectException: Can not connect http client invoker after 1 attempt(s) 2014-11-05 07:46:59,548 INFO [ClientCommandSenderTask Timer Thread #17] (enterprise.communications.command.client.JBossRemotingRemoteCommunicator)- {JBossRemotingRemoteCommunicator.changing-endpoint}Communicator is changing endpoint from [InvokerLocator [servlet://10.16.23.123:7080/jboss-remoting-servlet-invoker/ServerInvokerServlet]] to [InvokerLocator [servlet://10.16.23.115:7080/jboss-remoting-servlet-invoker/ServerInvokerServlet]] 2014-11-05 07:46:59,550 WARN [ClientCommandSenderTask Timer Thread #17] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.failover-failed}Failed to failover to another server. Cause: org.jboss.remoting.CannotConnectException: Can not connect http client invoker after 1 attempt(s) 2014-11-05 07:46:59,571 INFO [ClientCommandSenderTask Timer Thread #17] (enterprise.communications.command.client.JBossRemotingRemoteCommunicator)- {JBossRemotingRemoteCommunicator.changing-endpoint}Communicator is changing endpoint from [InvokerLocator [servlet://10.16.23.115:7080/jboss-remoting-servlet-invoker/ServerInvokerServlet]] to [InvokerLocator [servlet://10.16.23.104:7080/jboss-remoting-servlet-invoker/ServerInvokerServlet]] 2014-11-05 07:46:59,577 WARN [ClientCommandSenderTask Timer Thread #17] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.failover-failed}Failed to failover to another server. Cause: org.jboss.remoting.transport.http.WebServerError: JBoss Web/7.4.8.Final-redhat-4 - JBWEB000064: Error report

JBWEB000065: HTTP Status 404 - /jboss-remoting-servlet-invoker/ServerInvokerServlet


JBWEB000309: type JBWEB000067: Status report

JBWEB000068: message /jboss-remoting-servlet-invoker/ServerInvokerServlet

JBWEB000069: description JBWEB000124: The requested resource is not available.


JBoss Web/7.4.8.Final-redhat-4

2014-11-05 07:46:59,579 WARN [ClientCommandSenderTask Timer Thread #17] (org.rhq.enterprise.agent.FailoverFailureCallback)- {AgentMain.too-many-failover-attempts}Too many failover attempts have been made [3]. Exception that triggered the failover: [org.jboss.remoting.transport.http.WebServerError: JBoss Web/7.4.8.Final-redhat-4 - JBWEB000064: Error report

JBWEB000065: HTTP Status 404 - /jboss-remoting-servlet-invoker/ServerInvokerServlet


JBWEB000309: type JBWEB000067: Status report

JBWEB000068: message /jboss-remoting-servlet-invoker/ServerInvokerServlet

JBWEB000069: description JBWEB000124: The requested resource is not available.


JBoss Web/7.4.8.Final-redhat-4

] 2014-11-05 07:46:59,579 ERROR [ClientCommandSenderTask Timer Thread #17] (enterprise.communications.command.client.JBossRemotingRemoteCommunicator)- {JBossRemotingRemoteCommunicator.init-callback-failed}The initialize callback has failed. It will be tried again. Cause: org.jboss.remoting.transport.http.WebServerError:JBoss Web/7.4.8.Final-redhat-4 - JBWEB000064: Error report

JBWEB000065: HTTP Status 404 - /jboss-remoting-servlet-invoker/ServerInvokerServlet


JBWEB000309: type JBWEB000067: Status report

JBWEB000068: message /jboss-remoting-servlet-invoker/ServerInvokerServlet

JBWEB000069: description JBWEB000124: The requested resource is not available.


JBoss Web/7.4.8.Final-redhat-4

. Cause: org.jboss.remoting.transport.http.WebServerError: JBoss Web/7.4.8.Final-redhat-4 - JBWEB000064: Error report

JBWEB000065: HTTP Status 404 - /jboss-remoting-servlet-invoker/ServerInvokerServlet


JBWEB000309: type JBWEB000067: Status report

JBWEB000068: message /jboss-remoting-servlet-invoker/ServerInvokerServlet

JBWEB000069: description JBWEB000124: The requested resource is not available.


JBoss Web/7.4.8.Final-redhat-4

2014-11-05 07:46:59,580 INFO [RHQ Agent Ping Thread-1] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.ping-executor.start-polling-after-exception}Starting polling to determine sender status (server ping failed) 2014-11-05 07:46:59,588 INFO [RHQ Server Polling Thread] (enterprise.communications.command.client.JBossRemotingRemoteCommunicator)- {JBossRemotingRemoteCommunicator.changing-endpoint}Communicator is changing endpoint from [InvokerLocator [servlet://10.16.23.104:7080/jboss-remoting-servlet-invoker/ServerInvokerServlet]] to [InvokerLocator [servlet://10.16.23.123:7080/jboss-remoting-servlet-invoker/ServerInvokerServlet]] 2014-11-05 07:46:59,589 WARN [RHQ Server Polling Thread] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.failover-failed}Failed to failover to another server. Cause: org.jboss.remoting.CannotConnectException: Can not connect http client invoker after 1 attempt(s) 2014-11-05 07:46:59,601 INFO [RHQ Server Polling Thread] (enterprise.communications.command.client.JBossRemotingRemoteCommunicator)- {JBossRemotingRemoteCommunicator.changing-endpoint}Communicator is changing endpoint from [InvokerLocator [servlet://10.16.23.123:7080/jboss-remoting-servlet-invoker/ServerInvokerServlet]] to [InvokerLocator [servlet://10.16.23.115:7080/jboss-remoting-servlet-invoker/ServerInvokerServlet]] 2014-11-05 07:46:59,607 WARN [RHQ Server Polling Thread] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.failover-failed}Failed to failover to another server. Cause: org.jboss.remoting.CannotConnectException: Can not connect http client invoker after 1 attempt(s) 2014-11-05 07:46:59,616 INFO [RHQ Server Polling Thread] (enterprise.communications.command.client.JBossRemotingRemoteCommunicator)- {JBossRemotingRemoteCommunicator.changing-endpoint}Communicator is changing endpoint from [InvokerLocator [servlet://10.16.23.115:7080/jboss-remoting-servlet-invoker/ServerInvokerServlet]] to [InvokerLocator [servlet://10.16.23.104:7080/jboss-remoting-servlet-invoker/ServerInvokerServlet]] 2014-11-05 07:46:59,618 WARN [RHQ Server Polling Thread] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.failover-failed}Failed to failover to another server. Cause: org.jboss.remoting.transport.http.WebServerError: JBoss Web/7.4.8.Final-redhat-4 - JBWEB000064: Error report

JBWEB000065: HTTP Status 404 - /jboss-remoting-servlet-invoker/ServerInvokerServlet


JBWEB000309: type JBWEB000067: Status report

JBWEB000068: message /jboss-remoting-servlet-invoker/ServerInvokerServlet

JBWEB000069: description JBWEB000124: The requested resource is not available.


JBoss Web/7.4.8.Final-redhat-4

2014-11-05 07:46:59,623 WARN [RHQ Server Polling Thread] (org.rhq.enterprise.agent.FailoverFailureCallback)- {AgentMain.too-many-failover-attempts}Too many failover attempts have been made [3]. Exception that triggered the failover: [org.jboss.remoting.transport.http.WebServerError: JBoss Web/7.4.8.Final-redhat-4 - JBWEB000064: Error report

JBWEB000065: HTTP Status 404 - /jboss-remoting-servlet-invoker/ServerInvokerServlet


JBWEB000309: type JBWEB000067: Status report

JBWEB000068: message /jboss-remoting-servlet-invoker/ServerInvokerServlet

JBWEB000069: description JBWEB000124: The requested resource is not available.


JBoss Web/7.4.8.Final-redhat-4

] 2014-11-05 07:46:59,623 ERROR [RHQ Server Polling Thread] (enterprise.communications.command.client.JBossRemotingRemoteCommunicator)- {JBossRemotingRemoteCommunicator.init-callback-failed}The initialize callback has failed. It will be tried again. Cause: org.jboss.remoting.transport.http.WebServerError:JBoss Web/7.4.8.Final-redhat-4 - JBWEB000064: Error report

JBWEB000065: HTTP Status 404 - /jboss-remoting-servlet-invoker/ServerInvokerServlet


JBWEB000309: type JBWEB000067: Status report

JBWEB000068: message /jboss-remoting-servlet-invoker/ServerInvokerServlet

JBWEB000069: description JBWEB000124: The requested resource is not available.


JBoss Web/7.4.8.Final-redhat-4

. Cause: org.jboss.remoting.transport.http.WebServerError: JBoss Web/7.4.8.Final-redhat-4 - JBWEB000064: Error report

JBWEB000065: HTTP Status 404 - /jboss-remoting-servlet-invoker/ServerInvokerServlet


JBWEB000309: type JBWEB000067: Status report

JBWEB000068: message /jboss-remoting-servlet-invoker/ServerInvokerServlet

JBWEB000069: description JBWEB000124: The requested resource is not available.


JBoss Web/7.4.8.Final-redhat-4

2014-11-05 07:47:10,718 WARN [MeasurementManager.collector-1] (rhq.core.pc.measurement.MeasurementCollectorRunner)- Failure to collect measurement data for Resource[id=15033, uuid=e0567145-a407-4a0a-82d8-2acb6516f1ad, type={RHQServer}RHQ Server Storage Client Subsystem, key=rhq:service=StorageClientManager, name=Storage Client Subsystem, parent=RHQ Server Subsystems] - cause: java.lang.RuntimeException:Unable to load attributes on bean [rhq:service=StorageClientManager] null -> java.lang.reflect.UndeclaredThrowableException:null -> org.jboss.remoting3.NotOpenException:Writes closed 2014-11-05 07:47:11,525 INFO [InventoryManager.availability-1] (rhq.core.pc.inventory.InventoryManager)- Sending availability report to Server... 2014-11-05 07:47:11,549 INFO [ClientCommandSenderTask Timer Thread #17] (enterprise.communications.command.client.JBossRemotingRemoteCommunicator)- {JBossRemotingRemoteCommunicator.changing-endpoint}Communicator is changing endpoint from [InvokerLocator [servlet://10.16.23.104:7080/jboss-remoting-servlet-invoker/ServerInvokerServlet]] to [InvokerLocator [servlet://10.16.23.123:7080/jboss-remoting-servlet-invoker/ServerInvokerServlet]] 2014-11-05 07:47:11,592 WARN [ClientCommandSenderTask Timer Thread #17] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.failover-failed}Failed to failover to another server. Cause: org.jboss.remoting.transport.http.WebServerError: JBoss Web/7.4.8.Final-redhat-4 - JBWEB000064: Error report

JBWEB000065: HTTP Status 404 - /jboss-remoting-servlet-invoker/ServerInvokerServlet


JBWEB000309: type JBWEB000067: Status report

JBWEB000068: message /jboss-remoting-servlet-invoker/ServerInvokerServlet

JBWEB000069: description JBWEB000124: The requested resource is not available.


JBoss Web/7.4.8.Final-redhat-4

2014-11-05 07:47:11,598 INFO [ClientCommandSenderTask Timer Thread #17] (enterprise.communications.command.client.JBossRemotingRemoteCommunicator)- {JBossRemotingRemoteCommunicator.changing-endpoint}Communicator is changing endpoint from [InvokerLocator [servlet://10.16.23.123:7080/jboss-remoting-servlet-invoker/ServerInvokerServlet]] to [InvokerLocator [servlet://10.16.23.115:7080/jboss-remoting-servlet-invoker/ServerInvokerServlet]] 2014-11-05 07:47:11,642 WARN [ClientCommandSenderTask Timer Thread #17] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.failover-failed}Failed to failover to another server. Cause: org.jboss.remoting.transport.http.WebServerError: JBoss Web/7.4.8.Final-redhat-4 - JBWEB000064: Error report

JBWEB000065: HTTP Status 404 - /jboss-remoting-servlet-invoker/ServerInvokerServlet


JBWEB000309: type JBWEB000067: Status report

JBWEB000068: message /jboss-remoting-servlet-invoker/ServerInvokerServlet

JBWEB000069: description JBWEB000124: The requested resource is not available.


JBoss Web/7.4.8.Final-redhat-4

2014-11-05 07:47:11,660 INFO [ClientCommandSenderTask Timer Thread #17] (enterprise.communications.command.client.JBossRemotingRemoteCommunicator)- {JBossRemotingRemoteCommunicator.changing-endpoint}Communicator is changing endpoint from [InvokerLocator [servlet://10.16.23.115:7080/jboss-remoting-servlet-invoker/ServerInvokerServlet]] to [InvokerLocator [servlet://10.16.23.104:7080/jboss-remoting-servlet-invoker/ServerInvokerServlet]] 2014-11-05 07:47:11,662 WARN [ClientCommandSenderTask Timer Thread #17] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.failover-failed}Failed to failover to another server. Cause: org.jboss.remoting.transport.http.WebServerError: JBoss Web/7.4.8.Final-redhat-4 - JBWEB000064: Error report

JBWEB000065: HTTP Status 404 - /jboss-remoting-servlet-invoker/ServerInvokerServlet


JBWEB000309: type JBWEB000067: Status report

JBWEB000068: message /jboss-remoting-servlet-invoker/ServerInvokerServlet

JBWEB000069: description JBWEB000124: The requested resource is not available.


JBoss Web/7.4.8.Final-redhat-4

2014-11-05 07:47:11,664 WARN [ClientCommandSenderTask Timer Thread #17] (org.rhq.enterprise.agent.FailoverFailureCallback)- {AgentMain.too-many-failover-attempts}Too many failover attempts have been made [3]. Exception that triggered the failover: [org.jboss.remoting.transport.http.WebServerError: JBoss Web/7.4.8.Final-redhat-4 - JBWEB000064: Error report

JBWEB000065: HTTP Status 404 - /jboss-remoting-servlet-invoker/ServerInvokerServlet


JBWEB000309: type JBWEB000067: Status report

JBWEB000068: message /jboss-remoting-servlet-invoker/ServerInvokerServlet

JBWEB000069: description JBWEB000124: The requested resource is not available.


JBoss Web/7.4.8.Final-redhat-4

] 2014-11-05 07:47:11,664 ERROR [ClientCommandSenderTask Timer Thread #17] (enterprise.communications.command.client.JBossRemotingRemoteCommunicator)- {JBossRemotingRemoteCommunicator.init-callback-failed}The initialize callback has failed. It will be tried again. Cause: org.jboss.remoting.transport.http.WebServerError:JBoss Web/7.4.8.Final-redhat-4 - JBWEB000064: Error report

JBWEB000065: HTTP Status 404 - /jboss-remoting-servlet-invoker/ServerInvokerServlet


JBWEB000309: type JBWEB000067: Status report

JBWEB000068: message /jboss-remoting-servlet-invoker/ServerInvokerServlet

JBWEB000069: description JBWEB000124: The requested resource is not available.


JBoss Web/7.4.8.Final-redhat-4

. Cause: org.jboss.remoting.transport.http.WebServerError: JBoss Web/7.4.8.Final-redhat-4 - JBWEB000064: Error report

JBWEB000065: HTTP Status 404 - /jboss-remoting-servlet-invoker/ServerInvokerServlet


JBWEB000309: type JBWEB000067: Status report

JBWEB000068: message /jboss-remoting-servlet-invoker/ServerInvokerServlet

JBWEB000069: description JBWEB000124: The requested resource is not available.


JBoss Web/7.4.8.Final-redhat-4

2014-11-05 07:47:11,665 WARN [InventoryManager.availability-1] (rhq.core.pc.inventory.InventoryManager)- Could not transmit availability report to server java.lang.reflect.UndeclaredThrowableException at com.sun.proxy.$Proxy5.mergeAvailabilityReport(Unknown Source) at org.rhq.core.pc.inventory.InventoryManager.handleReport(InventoryManager.java:1223) at org.rhq.core.pc.inventory.AvailabilityExecutor.run(AvailabilityExecutor.java:90) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Caused by: org.jboss.remoting.transport.http.WebServerError: JBoss Web/7.4.8.Final-redhat-4 - JBWEB000064: Error report

JBWEB000065: HTTP Status 404 - /jboss-remoting-servlet-invoker/ServerInvokerServlet


JBWEB000309: type JBWEB000067: Status report

JBWEB000068: message /jboss-remoting-servlet-invoker/ServerInvokerServlet

JBWEB000069: description JBWEB000124: The requested resource is not available.


JBoss Web/7.4.8.Final-redhat-4

at org.jboss.remoting.transport.http.HTTPClientInvoker.useHttpURLConnection(HTTPClientInvoker.java:497) at org.jboss.remoting.transport.http.HTTPClientInvoker.makeInvocation(HTTPClientInvoker.java:253) at org.jboss.remoting.transport.http.HTTPClientInvoker.transport(HTTPClientInvoker.java:176) at org.jboss.remoting.MicroRemoteClientInvoker.invoke(MicroRemoteClientInvoker.java:169) at org.jboss.remoting.Client.invoke(Client.java:2084) at org.jboss.remoting.Client.invoke(Client.java:879) at org.jboss.remoting.Client.invoke(Client.java:867) at org.rhq.enterprise.communications.command.client.JBossRemotingRemoteCommunicator.invoke(JBossRemotingRemoteCommunicator.java:501) at org.rhq.enterprise.communications.command.client.JBossRemotingRemoteCommunicator.rawSend(JBossRemotingRemoteCommunicator.java:346) at org.rhq.enterprise.communications.command.client.JBossRemotingRemoteCommunicator.sendWithoutCallbacks(JBossRemotingRemoteCommunicator.java:288) at org.rhq.enterprise.communications.command.client.JBossRemotingRemoteCommunicator.sendWithoutInitializeCallback(JBossRemotingRemoteCommunicator.java:307) at org.rhq.enterprise.agent.AgentMain.sendConnectRequestToServer(AgentMain.java:2269) at org.rhq.enterprise.agent.ConnectAgentInitializeCallback.sendingInitialCommand(ConnectAgentInitializeCallback.java:43) at org.rhq.enterprise.communications.command.client.JBossRemotingRemoteCommunicator.invokeInitializeCallbackIfNeeded(JBossRemotingRemoteCommunicator.java:411) at org.rhq.enterprise.communications.command.client.JBossRemotingRemoteCommunicator.send(JBossRemotingRemoteCommunicator.java:323) at org.rhq.enterprise.communications.command.client.AbstractCommandClient.invoke(AbstractCommandClient.java:143) at org.rhq.enterprise.communications.command.client.ClientCommandSender.send(ClientCommandSender.java:1084) at org.rhq.enterprise.communications.command.client.ClientCommandSenderTask.send(ClientCommandSenderTask.java:229) at org.rhq.enterprise.communications.command.client.ClientCommandSenderTask.call(ClientCommandSenderTask.java:107) at org.rhq.enterprise.communications.command.client.ClientCommandSenderTask.call(ClientCommandSenderTask.java:55) at java.util.concurrent.FutureTask.run(FutureTask.java:262) ... 3 more 2014-11-05 07:47:13,010 ERROR [ClientCommandSenderTask Thread #0] (enterprise.communications.command.client.ClientCommandSenderTask)- {ClientCommandSenderTask.send-failed}Failed to send command [Command: type=[remotepojo]; cmd-in-response=[false]; config=[{rhq.agent-name=fbr-ha-3.bc.jonqe.lab.eng.bos.redhat.com, rhq.externalizable-strategy=AGENT, rhq.security-token=xRAowwOH1641fshJvQUADVx1DmJsr0rpmdTDCtKLg6tHh5+GUW4pYFzNpdxPhu/Jipk=, rhq.retry=1, rhq.guaranteed-delivery=true, rhq.send-throttle=true}]; params=[{invocation=NameBasedInvocation[mergeMeasurementReport], targetInterfaceName=org.rhq.core.clientapi.server.measurement.MeasurementServerService}]]. Cause: java.lang.InterruptedException:null. Cause: java.lang.InterruptedException 2014-11-05 07:47:13,011 WARN [ClientCommandSenderTask Thread #0] (enterprise.communications.command.client.ClientCommandSenderTask)- {ClientCommandSenderTask.queuing-failed-command}The command that failed has its guaranteed-delivery flag set so it is being queued again 2014-11-05 07:47:13,013 WARN [RHQ Server Polling Thread] (enterprise.communications.command.client.ServerPollingThread)- {ServerPollingThread.server-offline}The server has gone offline; client has been told to stop sending commands 2014-11-05 07:47:41,682 INFO [InventoryManager.availability-1] (rhq.core.pc.inventory.InventoryManager)- Sending availability report to Server... 2014-11-05 07:47:41,683 WARN [InventoryManager.availability-1] (rhq.core.pc.inventory.InventoryManager)- Could not transmit availability report to server java.lang.IllegalStateException: The sender object is currently not sending commands now. Command not sent: [Command: type=[remotepojo]; cmd-in-response=[false]; config=[{rhq.send-throttle=true}]; params=[{invocation=NameBasedInvocation[mergeAvailabilityReport], targetInterfaceName=org.rhq.core.clientapi.server.discovery.DiscoveryServerService}]] at org.rhq.enterprise.communications.command.client.ClientCommandSender.sendSynch(ClientCommandSender.java:623) at org.rhq.enterprise.communications.command.client.ClientRemotePojoFactory$RemotePojoProxyHandler.invoke(ClientRemotePojoFactory.java:418) at com.sun.proxy.$Proxy5.mergeAvailabilityReport(Unknown Source) at org.rhq.core.pc.inventory.InventoryManager.handleReport(InventoryManager.java:1223) at org.rhq.core.pc.inventory.AvailabilityExecutor.run(AvailabilityExecutor.java:90) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) 2014-11-05 07:48:13,476 INFO [RHQ Server Polling Thread] (enterprise.communications.command.client.ServerPollingThread)- {ServerPollingThread.server-online}The server has come back online; client has been told to start sending commands again 2014-11-05 07:48:37,685 INFO [InventoryManager.availability-1] (rhq.core.pc.inventory.InventoryManager)- Sending availability report to Server... 2014-11-05 07:48:59,581 INFO [RHQ Agent Ping Thread-1] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.ping-executor.stop-polling-resume-ping}Stopping polling and resuming pinging 2014-11-05 07:51:20,703 INFO [ResourceContainer.invoker.availCheck.daemon-38] (org.mc4j.ems.connection.ConnectionFactory)- Discovered libraries in 0 ms 2014-11-05 07:51:20,704 INFO [ResourceContainer.invoker.availCheck.daemon-38] (org.rhq.plugins.server.JBossAS7JMXComponent)- Loading AS7 connection [service:jmx:remoting-jmx://127.0.0.1:6999] with install path [/home/hudson/jon-server-3.3.0.CR01/jbossas/bin/client]... 2014-11-05 07:51:20,905 INFO [InventoryManager.availability-1] (rhq.core.pc.inventory.InventoryManager)- Sending availability report to Server... 2014-11-05 07:55:22,077 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.AutoDiscoveryExecutor)- Executing server discovery scan... 2014-11-05 07:55:22,258 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.AutoDiscoveryExecutor)- Discovered 0 new server(s). 2014-11-05 07:55:22,258 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sending [server] inventory report to Server... 2014-11-05 07:55:22,373 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Platform [10111] 2014-11-05 07:55:22,373 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Platform Top level services [10111] 2014-11-05 07:55:22,373 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Platform Top level services [10111] Local inventory changed: [false] 2014-11-05 07:55:22,398 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [10113] 2014-11-05 07:55:22,399 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [10113] Local inventory changed: [false] 2014-11-05 07:55:23,217 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [10112] 2014-11-05 07:55:23,217 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [10112] Local inventory changed: [false] 2014-11-05 07:55:24,307 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [12951] 2014-11-05 07:55:24,309 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [12951] Local inventory changed: [false] 2014-11-05 07:55:25,111 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Platform [10111]. 2014-11-05 08:00:27,966 WARN [MeasurementManager.collector-1] (rhq.core.pc.measurement.MeasurementCollectorRunner)- Failure to collect measurement data for Resource[id=10448, uuid=50c85be9-b040-4b9e-8259-c3daa1d0876f, type={RHQStorage}ConfigurableInternalServerMetrics, key=org.apache.cassandra.internal:type=AntiEntropySessions, name=Anti Entropy Sessions, parent=RHQ Storage Node(fbr-ha-3.bc.jonqe.lab.eng.bos.redhat.com)] - cause: java.lang.IllegalStateException:EMS bean was null for Resource with type [ResourceType[id=0, name=ConfigurableInternalServerMetrics, plugin=RHQStorage, category=Service]] and key [org.apache.cassandra.internal:type=AntiEntropySessions]. 2014-11-05 08:10:25,112 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.AutoDiscoveryExecutor)- Executing server discovery scan... 2014-11-05 08:10:25,248 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.AutoDiscoveryExecutor)- Discovered 0 new server(s). 2014-11-05 08:10:25,249 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sending [server] inventory report to Server... 2014-11-05 08:10:25,352 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Platform [10111] 2014-11-05 08:10:25,352 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Platform Top level services [10111] 2014-11-05 08:10:25,353 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Platform Top level services [10111] Local inventory changed: [false] 2014-11-05 08:10:25,371 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [10113] 2014-11-05 08:10:25,372 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [10113] Local inventory changed: [false] 2014-11-05 08:10:26,187 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [10112] 2014-11-05 08:10:26,187 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [10112] Local inventory changed: [false] 2014-11-05 08:10:27,060 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [12951] 2014-11-05 08:10:27,064 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [12951] Local inventory changed: [false] 2014-11-05 08:10:27,865 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Platform [10111]. 2014-11-05 08:20:27,967 WARN [MeasurementManager.collector-1] (rhq.core.pc.measurement.MeasurementCollectorRunner)- Failure to collect measurement data for Resource[id=10448, uuid=50c85be9-b040-4b9e-8259-c3daa1d0876f, type={RHQStorage}ConfigurableInternalServerMetrics, key=org.apache.cassandra.internal:type=AntiEntropySessions, name=Anti Entropy Sessions, parent=RHQ Storage Node(fbr-ha-3.bc.jonqe.lab.eng.bos.redhat.com)] - cause: java.lang.IllegalStateException:EMS bean was null for Resource with type [ResourceType[id=0, name=ConfigurableInternalServerMetrics, plugin=RHQStorage, category=Service]] and key [org.apache.cassandra.internal:type=AntiEntropySessions]. 2014-11-05 08:25:27,865 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.AutoDiscoveryExecutor)- Executing server discovery scan... 2014-11-05 08:25:28,067 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.AutoDiscoveryExecutor)- Discovered 0 new server(s). 2014-11-05 08:25:28,067 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sending [server] inventory report to Server... 2014-11-05 08:25:28,181 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Platform [10111] 2014-11-05 08:25:28,181 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Platform Top level services [10111] 2014-11-05 08:25:28,181 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Platform Top level services [10111] Local inventory changed: [false] 2014-11-05 08:25:28,199 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [10113] 2014-11-05 08:25:28,200 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [10113] Local inventory changed: [false] 2014-11-05 08:25:29,015 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [10112] 2014-11-05 08:25:29,015 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [10112] Local inventory changed: [false] 2014-11-05 08:25:29,873 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [12951] 2014-11-05 08:25:29,877 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [12951] Local inventory changed: [false] 2014-11-05 08:25:30,678 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Platform [10111]. 2014-11-05 08:39:58,425 INFO [RHQ Primary Server Switchover Thread] (org.rhq.enterprise.agent.AgentMain)- {PrimaryServerSwitchoverThread.not-talking-to-primary}The agent is not talking to its primary server [10.16.23.123:7080] - it is talking to [10.16.23.104:7080] 2014-11-05 08:39:58,438 INFO [RHQ Primary Server Switchover Thread] (org.rhq.enterprise.agent.AgentMain)- {PrimaryServerSwitchoverThread.primary-up}Primary server appears to be back online at [10.16.23.123:7080] - attempting to switch back to it 2014-11-05 08:39:58,447 INFO [RHQ Primary Server Switchover Thread] (enterprise.communications.command.client.JBossRemotingRemoteCommunicator)- {JBossRemotingRemoteCommunicator.changing-endpoint}Communicator is changing endpoint from [InvokerLocator [servlet://10.16.23.104:7080/jboss-remoting-servlet-invoker/ServerInvokerServlet]] to [InvokerLocator [servlet://10.16.23.123:7080/jboss-remoting-servlet-invoker/ServerInvokerServlet]] 2014-11-05 08:39:58,564 INFO [RHQ Primary Server Switchover Thread] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.failed-over-to-server}The agent has triggered its failover mechanism and switched to server [servlet://10.16.23.123:7080/jboss-remoting-servlet-invoker/ServerInvokerServlet] 2014-11-05 08:40:00,192 INFO [ClientCommandSenderTask Timer Thread #18] (org.rhq.enterprise.agent.AgentMain)- {AgentMain.not-sending-dup-connect}Not sending another connect message since one was recently sent: [servlet://10.16.23.123:7080/jboss-remoting-servlet-invoker/ServerInvokerServlet@Wed Nov 05 08:39:58 EST 2014] 2014-11-05 08:40:27,973 WARN [MeasurementManager.collector-1] (rhq.core.pc.measurement.MeasurementCollectorRunner)- Failure to collect measurement data for Resource[id=10448, uuid=50c85be9-b040-4b9e-8259-c3daa1d0876f, type={RHQStorage}ConfigurableInternalServerMetrics, key=org.apache.cassandra.internal:type=AntiEntropySessions, name=Anti Entropy Sessions, parent=RHQ Storage Node(fbr-ha-3.bc.jonqe.lab.eng.bos.redhat.com)] - cause: java.lang.IllegalStateException:EMS bean was null for Resource with type [ResourceType[id=0, name=ConfigurableInternalServerMetrics, plugin=RHQStorage, category=Service]] and key [org.apache.cassandra.internal:type=AntiEntropySessions]. 2014-11-05 08:40:30,678 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.AutoDiscoveryExecutor)- Executing server discovery scan... 2014-11-05 08:40:30,864 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.AutoDiscoveryExecutor)- Discovered 0 new server(s). 2014-11-05 08:40:30,864 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sending [server] inventory report to Server... 2014-11-05 08:40:30,951 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Platform [10111] 2014-11-05 08:40:30,951 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Platform Top level services [10111] 2014-11-05 08:40:30,951 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Platform Top level services [10111] Local inventory changed: [false] 2014-11-05 08:40:30,960 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [10113] 2014-11-05 08:40:30,960 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [10113] Local inventory changed: [false] 2014-11-05 08:40:31,771 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [10112] 2014-11-05 08:40:31,771 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [10112] Local inventory changed: [false] 2014-11-05 08:40:32,596 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [12951] 2014-11-05 08:40:32,599 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [12951] Local inventory changed: [false] 2014-11-05 08:40:33,401 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Platform [10111]. 2014-11-05 08:48:58,211 INFO [ResourceContainer.invoker.daemon-28] (org.rhq.plugins.jmx.MBeanResourceComponent)- Configuration management is currently disabled for the ResourceType[id=0, name=java.util.logging, plugin=RHQAgent, category=Service] Resource with key [java.util.logging:type=Logging] - it can be enabled in the Resource's Inventory > Connection tab. 2014-11-05 08:48:58,414 INFO [ResourceContainer.invoker.daemon-28] (org.rhq.plugins.jmx.MBeanResourceComponent)- Configuration management is currently disabled for the ResourceType[id=0, name=java.util.logging, plugin=RHQStorage, category=Service] Resource with key [java.util.logging:type=Logging] - it can be enabled in the Resource's Inventory > Connection tab. 2014-11-05 08:55:33,401 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.AutoDiscoveryExecutor)- Executing server discovery scan... 2014-11-05 08:55:33,566 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.AutoDiscoveryExecutor)- Discovered 0 new server(s). 2014-11-05 08:55:33,566 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sending [server] inventory report to Server... 2014-11-05 08:55:33,648 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Platform [10111] 2014-11-05 08:55:33,648 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Platform Top level services [10111] 2014-11-05 08:55:33,648 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Platform Top level services [10111] Local inventory changed: [false] 2014-11-05 08:55:33,658 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [10113] 2014-11-05 08:55:33,659 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [10113] Local inventory changed: [false] 2014-11-05 08:55:34,658 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [10112] 2014-11-05 08:55:34,658 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [10112] Local inventory changed: [false] 2014-11-05 08:55:35,481 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [12951] 2014-11-05 08:55:35,484 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [12951] Local inventory changed: [false] 2014-11-05 08:55:36,286 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Platform [10111]. 2014-11-05 09:00:27,966 WARN [MeasurementManager.collector-1] (rhq.core.pc.measurement.MeasurementCollectorRunner)- Failure to collect measurement data for Resource[id=10448, uuid=50c85be9-b040-4b9e-8259-c3daa1d0876f, type={RHQStorage}ConfigurableInternalServerMetrics, key=org.apache.cassandra.internal:type=AntiEntropySessions, name=Anti Entropy Sessions, parent=RHQ Storage Node(fbr-ha-3.bc.jonqe.lab.eng.bos.redhat.com)] - cause: java.lang.IllegalStateException:EMS bean was null for Resource with type [ResourceType[id=0, name=ConfigurableInternalServerMetrics, plugin=RHQStorage, category=Service]] and key [org.apache.cassandra.internal:type=AntiEntropySessions]. 2014-11-05 09:10:36,286 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.AutoDiscoveryExecutor)- Executing server discovery scan... 2014-11-05 09:10:36,428 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.AutoDiscoveryExecutor)- Discovered 0 new server(s). 2014-11-05 09:10:36,428 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sending [server] inventory report to Server... 2014-11-05 09:10:36,507 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Platform [10111] 2014-11-05 09:10:36,507 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Platform Top level services [10111] 2014-11-05 09:10:36,507 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Platform Top level services [10111] Local inventory changed: [false] 2014-11-05 09:10:36,516 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [10113] 2014-11-05 09:10:36,517 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [10113] Local inventory changed: [false] 2014-11-05 09:10:37,325 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [10112] 2014-11-05 09:10:37,325 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [10112] Local inventory changed: [false] 2014-11-05 09:10:38,149 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [12951] 2014-11-05 09:10:38,152 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [12951] Local inventory changed: [false] 2014-11-05 09:10:38,953 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Platform [10111]. 2014-11-05 09:20:27,970 WARN [MeasurementManager.collector-1] (rhq.core.pc.measurement.MeasurementCollectorRunner)- Failure to collect measurement data for Resource[id=10448, uuid=50c85be9-b040-4b9e-8259-c3daa1d0876f, type={RHQStorage}ConfigurableInternalServerMetrics, key=org.apache.cassandra.internal:type=AntiEntropySessions, name=Anti Entropy Sessions, parent=RHQ Storage Node(fbr-ha-3.bc.jonqe.lab.eng.bos.redhat.com)] - cause: java.lang.IllegalStateException:EMS bean was null for Resource with type [ResourceType[id=0, name=ConfigurableInternalServerMetrics, plugin=RHQStorage, category=Service]] and key [org.apache.cassandra.internal:type=AntiEntropySessions]. 2014-11-05 09:25:38,953 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.AutoDiscoveryExecutor)- Executing server discovery scan... 2014-11-05 09:25:39,130 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.AutoDiscoveryExecutor)- Discovered 0 new server(s). 2014-11-05 09:25:39,130 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sending [server] inventory report to Server... 2014-11-05 09:25:39,217 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Platform [10111] 2014-11-05 09:25:39,218 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Platform Top level services [10111] 2014-11-05 09:25:39,218 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Platform Top level services [10111] Local inventory changed: [false] 2014-11-05 09:25:39,227 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [10113] 2014-11-05 09:25:39,228 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [10113] Local inventory changed: [false] 2014-11-05 09:25:40,043 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [10112] 2014-11-05 09:25:40,043 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [10112] Local inventory changed: [false] 2014-11-05 09:25:40,886 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [12951] 2014-11-05 09:25:40,888 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [12951] Local inventory changed: [false] 2014-11-05 09:25:41,689 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Platform [10111]. 2014-11-05 09:40:27,966 WARN [MeasurementManager.collector-1] (rhq.core.pc.measurement.MeasurementCollectorRunner)- Failure to collect measurement data for Resource[id=10448, uuid=50c85be9-b040-4b9e-8259-c3daa1d0876f, type={RHQStorage}ConfigurableInternalServerMetrics, key=org.apache.cassandra.internal:type=AntiEntropySessions, name=Anti Entropy Sessions, parent=RHQ Storage Node(fbr-ha-3.bc.jonqe.lab.eng.bos.redhat.com)] - cause: java.lang.IllegalStateException:EMS bean was null for Resource with type [ResourceType[id=0, name=ConfigurableInternalServerMetrics, plugin=RHQStorage, category=Service]] and key [org.apache.cassandra.internal:type=AntiEntropySessions]. 2014-11-05 09:40:41,690 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.AutoDiscoveryExecutor)- Executing server discovery scan... 2014-11-05 09:40:41,841 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.AutoDiscoveryExecutor)- Discovered 0 new server(s). 2014-11-05 09:40:41,841 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sending [server] inventory report to Server... 2014-11-05 09:40:41,928 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Platform [10111] 2014-11-05 09:40:41,928 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Platform Top level services [10111] 2014-11-05 09:40:41,929 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Platform Top level services [10111] Local inventory changed: [false] 2014-11-05 09:40:41,938 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [10113] 2014-11-05 09:40:41,938 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [10113] Local inventory changed: [false] 2014-11-05 09:40:42,746 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [10112] 2014-11-05 09:40:42,746 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [10112] Local inventory changed: [false] 2014-11-05 09:40:43,569 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [12951] 2014-11-05 09:40:43,571 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [12951] Local inventory changed: [false] 2014-11-05 09:40:44,374 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Platform [10111]. 2014-11-05 09:50:58,207 INFO [ResourceContainer.invoker.daemon-48] (org.rhq.plugins.jmx.MBeanResourceComponent)- Configuration management is currently disabled for the ResourceType[id=0, name=java.util.logging, plugin=RHQAgent, category=Service] Resource with key [java.util.logging:type=Logging] - it can be enabled in the Resource's Inventory > Connection tab. 2014-11-05 09:50:58,332 INFO [ResourceContainer.invoker.daemon-47] (org.rhq.plugins.jmx.MBeanResourceComponent)- Configuration management is currently disabled for the ResourceType[id=0, name=java.util.logging, plugin=RHQStorage, category=Service] Resource with key [java.util.logging:type=Logging] - it can be enabled in the Resource's Inventory > Connection tab. 2014-11-05 09:55:44,374 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.AutoDiscoveryExecutor)- Executing server discovery scan... 2014-11-05 09:55:44,517 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.AutoDiscoveryExecutor)- Discovered 0 new server(s). 2014-11-05 09:55:44,517 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sending [server] inventory report to Server... 2014-11-05 09:55:44,601 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Platform [10111] 2014-11-05 09:55:44,601 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Platform Top level services [10111] 2014-11-05 09:55:44,601 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Platform Top level services [10111] Local inventory changed: [false] 2014-11-05 09:55:44,610 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [10113] 2014-11-05 09:55:44,610 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [10113] Local inventory changed: [false] 2014-11-05 09:55:45,609 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [10112] 2014-11-05 09:55:45,609 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [10112] Local inventory changed: [false] 2014-11-05 09:55:46,431 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [12951] 2014-11-05 09:55:46,433 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [12951] Local inventory changed: [false] 2014-11-05 09:55:47,235 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Platform [10111]. 2014-11-05 10:00:27,965 WARN [MeasurementManager.collector-1] (rhq.core.pc.measurement.MeasurementCollectorRunner)- Failure to collect measurement data for Resource[id=10448, uuid=50c85be9-b040-4b9e-8259-c3daa1d0876f, type={RHQStorage}ConfigurableInternalServerMetrics, key=org.apache.cassandra.internal:type=AntiEntropySessions, name=Anti Entropy Sessions, parent=RHQ Storage Node(fbr-ha-3.bc.jonqe.lab.eng.bos.redhat.com)] - cause: java.lang.IllegalStateException:EMS bean was null for Resource with type [ResourceType[id=0, name=ConfigurableInternalServerMetrics, plugin=RHQStorage, category=Service]] and key [org.apache.cassandra.internal:type=AntiEntropySessions]. 2014-11-05 10:10:47,235 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.AutoDiscoveryExecutor)- Executing server discovery scan... 2014-11-05 10:10:47,388 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.AutoDiscoveryExecutor)- Discovered 0 new server(s). 2014-11-05 10:10:47,388 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sending [server] inventory report to Server... 2014-11-05 10:10:47,470 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Platform [10111] 2014-11-05 10:10:47,470 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Platform Top level services [10111] 2014-11-05 10:10:47,470 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Platform Top level services [10111] Local inventory changed: [false] 2014-11-05 10:10:47,478 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [10113] 2014-11-05 10:10:47,479 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [10113] Local inventory changed: [false] 2014-11-05 10:10:48,288 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [10112] 2014-11-05 10:10:48,288 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [10112] Local inventory changed: [false] 2014-11-05 10:10:49,113 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Starting: Top Level Server [12951] 2014-11-05 10:10:49,115 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Top Level Server [12951] Local inventory changed: [false] 2014-11-05 10:10:49,917 INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.InventoryManager)- Sync Complete: Platform [10111].