HP Operations Manager for Windows

Troubleshooting


Errors

The following errors, if reported after an operation, can indicate the reason of the error:

Cannot connect to RPC service at system 'ncadg_ip_udp:15.136.120.88[22222]'. Local port configuration has been consulted - rpcd/llbd on remote system not queried. (OpC20-186)

Communication errors always contain this form of message, when a local port configuration is used by an RPC client to connect the server. If this text is NOT part of the error message, a regular endpoint mapper lookup has been performed. The stated RPC binding contains the used protocol sequence (TCP or UDP) as well as the destination IP address and the port where the RPC server had been expected.

Cannot find port for RPC service 'opcctla' at '15.136.120.88' in local configuration. (OpC20-187)

No port configuration was found for the specified service (either in the server port specification file, opcinfo or anywhere else) and OPC_COMM_LOOKUP_RPC_SRV is false, that is NO endpoint mapper lookup is performed.

The port configuration file /xxxx contains an invalid entry: '... some syntax error ...'. (OpC20-174)

The file /xxxx contains bad entries. The value of OPC_COMM_LOOKUP_RPC_SRV is irrelevant and NO endpoint mapper lookup has been performed.

If no local port configuration for a destination service is found and OPC_COMM_LOOKUP_RPC_SRV is true (default), the traditional behavior of looking up the destination RPC server at the endpoint mapper applies. Then use tracing for further troubleshooting.

NoteNOTE:
It may now take much longer for RPC calls to time out if the called RPC server is not listening - especially over UDP. The RPC client must now attempt to find a server, whereas before, the endpoint mapper was usually running and immediately returned the information about the requested RPC server and whether it was registered or not.


Tracing On Managed Nodes

The new and modified functionality contains trace and debug statements. Particularly the DEBUG areas CONF and COMM are of interest since they cover the evaluation of configurable variables and the DCE communication. The DEBUG area FILE might be interesting to track the detection of a modified server port specification file.

To enable tracing for these areas, set the following variables in the opcinfo file:

OPC_TRACE TRUE

OPC_TRACE_AREA ALL,DEBUG

OPC_DBG_AREA CONF,COMM

It is also recommended that you restrict the trace to certain processes by using the OPC_TRC_PROCS and OPC_DBG_PROCS variables and the process names, such as:

OPC_TRC_PROCS opcmsga

OPC_DBG_PROCS opcmsga

NoteNOTE:
opcrpccp show mapping does not show RPC servers for which the OPC_COMM_REGISTER_RPC_SRV setting is FALSE. In addition, this program will fail altogether if the rpcd/dced is not running on the destination node.


RPC Servers log the following type of information, if endpoint mapper registration is enabled:

... opcctla(...)[DEBUG]: COMM: Register manager
... opcctla(...)[DEBUG]: CONF: Returning value 'TRUE' for key 'OPC_COMM_REGISTER_RPC_SRV'
... opcctla(...)[DEBUG]: COMM: Checking hostname '' for replacement
... opcctla(...)[INIT]: Regarding the setting of OPC_IP_ADDRESS
... opcctla(...)[DEBUG]: CONF: No value found for key 'OPC_IP_ADDRESS'
... opcctla(...)[DEBUG]: COMM: Using '15.139.88.156' as local address
... opcctla(...)[DEBUG]: COMM: Returning '15.139.88.156'
... opcctla(...)[DEBUG]: COMM: Lookup Srv
... opcctla(...)[DEBUG]: COMM: Server lookup using rpcd interface
... opcctla(...)[DEBUG]: COMM: Element lookup initialized
... opcctla(...)[DEBUG]: CONF: Returning value '13' for key 'OPC_MAX_PORT_RETRIES'
... opcctla(...)[DEBUG]: COMM: Got another element
... opcctla(...)[DEBUG]: COMM: Srv lookup using rpcd done. NumSrv = 0. rc = 0.
... opcctla(...)[DEBUG]: COMM: Register manager
... opcctla(...)[DEBUG]: COMM: rpc_ep_register for binding '0' successful
... opcctla(...)[DEBUG]: COMM: rpc_ep_register for binding '1' successful
[...]
... opcctla(...)[INT]: Entering RPC server loop ...

RPC Servers log the following type of information, if endpoint mapper registration is disabled:

... opcctla(...)[DEBUG]: COMM: Register manager
... opcctla(...)[DEBUG]: CONF: Returning value 'FALSE' for key 'OPC_COMM_REGISTER_RPC_SRV'
... opcctla(...)[DEBUG]: COMM: Register manager
... opcctla(...)[DEBUG]: COMM: Register manager
... opcctla(...)[DEBUG]: CONF: Returning value 'FALSE' for key 'OPC_COMM_REGISTER_RPC_SRV'
[...] ... opcctla(...)[DEBUG]: COMM: Entering RPC main loop ...

RPC clients on the managed node log the following type of information:

... opcmsga(...)[INIT]: Connecting message receiver on 260790428 ...
... opcmsga(...)[DEBUG]: COMM: Connecting with address: 15.139.88.156
... opcmsga(...)[DEBUG]: COMM: Getting server port for: opcmsgrd on host: '15.139.88.156'
... opcmsga(...)[DEBUG]: CONF: Returning value '/tmp/ports.tge' for key 'OPC_COMM_RPC_PORT_FILE'
... opcmsga(...)[DEBUG]: COMM: Examining external client port file /tmp/ports.tge ...
... opcmsga(...)[DEBUG]: COMM: Re-loading external client port file ...
... opcmsga(...)[DEBUG]: COMM: Activating external client port file. 0 entries
... opcmsga(...)[DEBUG]: COMM: Searching server port for: opcmsgrd at '15.139.88.156'
... opcmsga(...)[DEBUG]: CONF: Returning value '51528' for key 'OPC_COMM_PORT_MSGR'
... opcmsga(...)[DEBUG]: COMM: Got opcmsgrd server port from opc/nodeinfo[OPC_COMM_PORT_MSGR]: 51528
... opcmsga(...)[DEBUG]: COMM: Checking hostname '15.139.88.156' for replacement
... opcmsga(...)[DEBUG]: COMM: Returning '15.139.88.156'
... opcmsga(...)[DEBUG]: COMM: Connection to non-local node. Using long timeout
... opcmsga(...)[DEBUG]: COMM: Checking server. Mgr type: 0x0
... opcmsga(...)[DEBUG]: COMM: Binding: ncadg_ip_udp:15.139.88.156[51528]
... opcmsga(...)[DEBUG]: CONF: Returning value '13' for key 'OPC_MAX_PORT_RETRIES'
... opcmsga(...)[DEBUG]: COMM: Checking whether server is listening ...
... opcmsga(...)[DEBUG]: COMM: Checking server: succeeded. st=0 rpc_rc=1

Related Topics: