Hi, Victor.
ICMP ping for status polling is not disabled and netxmsd runs from root and successfully sends echo requests when nxagent on some node goes down.
C
cyril
@cyril
Posts
-
Netxms claims a node down when it can't understand SNMP response -
Netxms claims a node down when it can't understand SNMP responseHi! We noticed that NetXMS generates SYS_NODE_DOWN event followed by SYS_NODE_UP with 1 min delay from time to time polling our equipment, in particular Juniper switches and Ubiquiti access points.
Further inspection revealed a common pattern.
For Ubiquiti AP the pattern is:
Events:"ID","Time","Source","DCI","Event","Severity","Message","User tag","Root ID" "2127109","13.10.2017 10:28:39","wifi-ap","0","SYS_NODE_NORMAL","Normal","Node status changed to NORMAL","","0" "2127104","13.10.2017 10:28:39","wifi-ap","0","SYS_IF_UP","Normal","Interface ""wifi0"" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 5)","","0" "2127107","13.10.2017 10:28:39","wifi-ap","0","SYS_IF_UP","Normal","Interface ""br0"" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 2)","","0" "2127106","13.10.2017 10:28:39","wifi-ap","0","SYS_IF_UP","Normal","Interface ""ath0"" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 6)","","0" "2127108","13.10.2017 10:28:39","wifi-ap","0","SYS_NODE_UP","Normal","Node up","","0" "2127105","13.10.2017 10:28:39","wifi-ap","0","SYS_IF_UP","Normal","Interface ""br0.9"" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 8)","","0" "2127103","13.10.2017 10:28:38","wifi-ap","0","SYS_IF_UP","Normal","Interface ""eth0.9"" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 7)","","0" "2127102","13.10.2017 10:28:38","wifi-ap","0","SYS_IF_UP","Normal","Interface ""eth0"" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 3)","","0" "2127100","13.10.2017 10:28:38","wifi-ap","0","SYS_IF_UP","Normal","Interface ""lo"" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 1)","","0" "2127101","13.10.2017 10:28:38","wifi-ap","0","SYS_IF_DISABLED","Normal","Interface ""eth1"" disabled (IP Addr: UNSPEC/0, IfIndex: 4)","","0" "2127099","13.10.2017 10:28:37","wifi-ap","0","SYS_SNMP_OK","Normal","Connectivity with SNMP agent restored","","0" "2127097","13.10.2017 10:27:32","wifi-ap","0","SYS_NODE_CRITICAL","Critical","Node status changed to CRITICAL","","0" "2127095","13.10.2017 10:27:32","wifi-ap","0","SYS_NODE_DOWN","Critical","Node down","","0" "2127096","13.10.2017 10:27:32","wifi-ap","0","SYS_NODE_UNKNOWN","Normal","Node status changed to UNKNOWN","","0"Network:
"No.","Time","Source","Destination","Protocol","Length","Info" "1","2017-10-13 10:24:07.407391","NETXMS_IP","UBIQUITI_IP","SNMP","93","get-next-request 1.3.6.1.2.1.4.21.1.1" "2","2017-10-13 10:24:07.612367","UBIQUITI_IP","NETXMS_IP","SNMP","95","get-response 1.3.6.1.2.1.11.1.0" "3","2017-10-13 10:27:32.882671","NETXMS_IP","UBIQUITI_IP","SNMP","96","get-next-request 1.3.6.1.2.1.17.7.1.4.3.1.1" "4","2017-10-13 10:27:33.229215","UBIQUITI_IP","NETXMS_IP","SNMP","100","get-response 1.3.6.1.4.1.10002.1.1.1.1.1.0" "5","2017-10-13 10:27:33.229282","NETXMS_IP","UBIQUITI_IP","SNMP","96","get-next-request 1.3.6.1.2.1.17.7.1.4.2.1.4" "6","2017-10-13 10:27:33.361641","UBIQUITI_IP","NETXMS_IP","SNMP","100","get-response 1.3.6.1.4.1.10002.1.1.1.1.1.0" "7","2017-10-13 10:27:33.361698","NETXMS_IP","UBIQUITI_IP","SNMP","96","get-next-request 1.3.6.1.2.1.17.7.1.4.3.1.2" "8","2017-10-13 10:27:33.504172","UBIQUITI_IP","NETXMS_IP","SNMP","100","get-response 1.3.6.1.4.1.10002.1.1.1.1.1.0" "9","2017-10-13 10:27:33.504390","NETXMS_IP","UBIQUITI_IP","SNMP","97","get-next-request 1.3.6.1.4.1.14988.1.1.1.2.1.3" "10","2017-10-13 10:27:33.797663","UBIQUITI_IP","NETXMS_IP","SNMP","104","get-response 1.3.6.1.4.1.41112.1.6.1.1.1.2.0" "11","2017-10-13 10:28:37.498911","NETXMS_IP","UBIQUITI_IP","SNMP","92","get-request 1.3.6.1.2.1.1.2.0" "12","2017-10-13 10:28:37.631093","UBIQUITI_IP","NETXMS_IP","SNMP","100","get-response 1.3.6.1.2.1.1.2.0"Every response has error-status: noError. We were capturing icmp too, but it seems that NetXMS did not fall back to icmp ping.
For juniper:
"ID","Time","Source","DCI","Event","Severity","Message","User tag","Root ID" "2127333","13.10.2017 11:29:56","jun-switch","0","SYS_NODE_UP","Normal","Node up","","0" "2127331","13.10.2017 11:29:56","jun-switch","0","SYS_IF_UP","Normal","Interface ""pime"" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 10)","","0" "2127330","13.10.2017 11:29:56","jun-switch","0","SYS_IF_UP","Normal","Interface ""tap"" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 7)","","0" "2127332","13.10.2017 11:29:56","jun-switch","0","SYS_IF_UP","Normal","Interface ""ge-0/0/1 "" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 503)","","0" "2127334","13.10.2017 11:29:56","jun-switch","0","SYS_NODE_NORMAL","Normal","Node status changed to NORMAL","","0" "2127328","13.10.2017 11:29:55","jun-switch","0","SYS_IF_UP","Normal","Interface ""ge-0/0/23 "" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 533)","","0" "2127326","13.10.2017 11:29:55","jun-switch","0","SYS_IF_UP","Normal","Interface ""ge-0/0/14.0"" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 514)","","0" "2127329","13.10.2017 11:29:55","jun-switch","0","SYS_IF_UP","Normal","Interface ""ge-0/0/8.0"" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 546)","","0" "2127327","13.10.2017 11:29:55","jun-switch","0","SYS_IF_UP","Normal","Interface ""ge-0/0/19 "" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 523)","","0" "2127325","13.10.2017 11:29:54","jun-switch","0","SYS_IF_UP","Normal","Interface ""ge-0/0/22 "" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 531)","","0" "2127324","13.10.2017 11:29:54","jun-switch","0","SYS_IF_UP","Normal","Interface ""lo0"" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 6)","","0" "2127323","13.10.2017 11:29:54","jun-switch","0","SYS_IF_UP","Normal","Interface ""bme0.32768"" changed state to UP (IP Addr: 128.0.0.1/2, IfIndex: 38)","","0" "2127321","13.10.2017 11:29:53","jun-switch","0","SYS_IF_UP","Normal","Interface ""pimd"" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 11)","","0" "2127322","13.10.2017 11:29:53","jun-switch","0","SYS_IF_UP","Normal","Interface ""ipip"" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 9)","","0" "2127319","13.10.2017 11:29:53","jun-switch","0","SYS_IF_UP","Normal","Interface ""vlan.6"" changed state to UP (IP Addr: 10.201.6.2/24, IfIndex: 551)","","0" "2127320","13.10.2017 11:29:53","jun-switch","0","SYS_IF_UP","Normal","Interface ""bme0"" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 37)","","0" "2127318","13.10.2017 11:29:52","jun-switch","0","SYS_IF_UP","Normal","Interface ""mtun"" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 12)","","0" "2127316","13.10.2017 11:29:52","jun-switch","0","SYS_IF_UP","Normal","Interface ""ge-0/0/23.0"" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 534)","","0" "2127317","13.10.2017 11:29:52","jun-switch","0","SYS_IF_UP","Normal","Interface ""gre"" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 8)","","0" "2127315","13.10.2017 11:29:52","jun-switch","0","SYS_IF_UP","Normal","Interface ""ge-0/0/20 "" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 527)","","0" "2127312","13.10.2017 11:29:51","jun-switch","0","SYS_IF_UP","Normal","Interface ""ge-0/0/20.0"" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 528)","","0" "2127313","13.10.2017 11:29:51","jun-switch","0","SYS_IF_UP","Normal","Interface ""ge-0/0/21.0"" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 530)","","0" "2127314","13.10.2017 11:29:51","jun-switch","0","SYS_IF_UP","Normal","Interface ""ge-0/0/5.0"" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 540)","","0" "2127308","13.10.2017 11:29:50","jun-switch","0","SYS_IF_UP","Normal","Interface ""vlan"" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 549)","","0" "2127309","13.10.2017 11:29:50","jun-switch","0","SYS_IF_UP","Normal","Interface ""lsi"" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 4)","","0" "2127310","13.10.2017 11:29:50","jun-switch","0","SYS_IF_UP","Normal","Interface ""dsc"" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 5)","","0" "2127311","13.10.2017 11:29:50","jun-switch","0","SYS_IF_UP","Normal","Interface ""ge-0/0/21 "" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 529)","","0" "2127305","13.10.2017 11:29:49","jun-switch","0","SYS_IF_UP","Normal","Interface ""ge-0/0/2"" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 525)","","0" "2127306","13.10.2017 11:29:49","jun-switch","0","SYS_IF_UP","Normal","Interface ""ge-0/0/8"" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 545)","","0" "2127304","13.10.2017 11:29:49","jun-switch","0","SYS_IF_UP","Normal","Interface ""ge-0/0/0"" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 501)","","0" "2127307","13.10.2017 11:29:49","jun-switch","0","SYS_IF_UP","Normal","Interface ""ge-0/0/1.0"" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 504)","","0" "2127300","13.10.2017 11:29:48","jun-switch","0","SYS_IF_UP","Normal","Interface ""ge-0/0/22.0"" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 532)","","0" "2127302","13.10.2017 11:29:48","jun-switch","0","SYS_IF_UP","Normal","Interface ""ge-0/0/19.0"" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 524)","","0" "2127303","13.10.2017 11:29:48","jun-switch","0","SYS_IF_UP","Normal","Interface ""lo0.16384"" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 21)","","0" "2127301","13.10.2017 11:29:48","jun-switch","0","SYS_IF_UP","Normal","Interface ""ge-0/0/5"" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 539)","","0" "2127297","13.10.2017 11:29:47","jun-switch","0","SYS_IF_UP","Normal","Interface ""ge-0/0/17.0 "" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 520)","","0" "2127299","13.10.2017 11:29:47","jun-switch","0","SYS_IF_UP","Normal","Interface ""ge-0/0/16 "" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 517)","","0" "2127298","13.10.2017 11:29:47","jun-switch","0","SYS_IF_UP","Normal","Interface ""ge-0/0/14 "" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 513)","","0" "2127296","13.10.2017 11:29:46","jun-switch","0","SYS_IF_UP","Normal","Interface ""ge-0/0/17"" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 519)","","0" "2127293","13.10.2017 11:29:46","jun-switch","0","SYS_IF_UP","Normal","Interface ""ge-0/0/0.0"" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 502)","","0" "2127294","13.10.2017 11:29:46","jun-switch","0","SYS_IF_UP","Normal","Interface ""ge-0/0/18.0"" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 522)","","0" "2127295","13.10.2017 11:29:46","jun-switch","0","SYS_IF_UP","Normal","Interface ""ge-0/0/2.0"" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 526)","","0" "2127291","13.10.2017 11:29:45","jun-switch","0","SYS_IF_UP","Normal","Interface ""ge-0/0/18 "" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 521)","","0" "2127292","13.10.2017 11:29:45","jun-switch","0","SYS_IF_UP","Normal","Interface ""ge-0/0/16.0"" changed state to UP (IP Addr: UNSPEC/0, IfIndex: 518)","","0" "2127290","13.10.2017 11:29:45","jun-switch","0","SYS_SNMP_OK","Normal","Connectivity with SNMP agent restored","","0" "2127285","13.10.2017 11:28:41","jun-switch","0","SYS_NODE_CRITICAL","Critical","Node status changed to CRITICAL","","0" "2127284","13.10.2017 11:28:41","jun-switch","0","SYS_NODE_DOWN","Critical","Node down","","0"Network:
"No.","Time","Source","Destination","Protocol","Length","Info" "1","2017-10-13 11:23:54.816540","netxms_ip","jun_ip","SNMP","93","get-next-request 1.3.6.1.2.1.4.21.1.1" "2","2017-10-13 11:23:54.953011","jun_ip","netxms_ip","SNMP","100","get-response 1.3.6.1.2.1.4.22.1.1.38.128.0.0.1" "3","2017-10-13 11:28:41.391314","netxms_ip","jun_ip","SNMP","98","get-next-request 1.3.6.1.4.1.2636.3.40.1.5.1.5.1" "4","2017-10-13 11:28:41.544835","jun_ip","netxms_ip","SNMP","114","get-response 1.3.6.1.4.1.2636.3.40.1.5.1.5.1.2.2" "5","2017-10-13 11:28:41.545043","netxms_ip","jun_ip","SNMP","100","get-next-request 1.3.6.1.4.1.2636.3.40.1.5.1.5.1.2.2" "6","2017-10-13 11:28:41.681306","jun_ip","netxms_ip","SNMP","114","get-response 1.3.6.1.4.1.2636.3.40.1.5.1.5.1.2.3" "7","2017-10-13 11:28:41.681604","netxms_ip","jun_ip","SNMP","100","get-next-request 1.3.6.1.4.1.2636.3.40.1.5.1.5.1.2.3" "8","2017-10-13 11:28:41.824843","jun_ip","netxms_ip","SNMP","108","get-response 1.3.6.1.4.1.2636.3.40.1.5.1.5.1.2.4" "9","2017-10-13 11:28:41.824936","netxms_ip","jun_ip","SNMP","100","get-next-request 1.3.6.1.4.1.2636.3.40.1.5.1.5.1.2.4" "10","2017-10-13 11:28:41.962373","jun_ip","netxms_ip","SNMP","112","get-response 1.3.6.1.4.1.2636.3.40.1.5.1.5.1.2.5" "11","2017-10-13 11:28:41.962455","netxms_ip","jun_ip","SNMP","100","get-next-request 1.3.6.1.4.1.2636.3.40.1.5.1.5.1.2.5" "12","2017-10-13 11:28:42.098320","jun_ip","netxms_ip","SNMP","111","get-response 1.3.6.1.4.1.2636.3.40.1.5.1.5.1.2.6" "13","2017-10-13 11:28:42.098420","netxms_ip","jun_ip","SNMP","100","get-next-request 1.3.6.1.4.1.2636.3.40.1.5.1.5.1.2.6" "14","2017-10-13 11:28:42.235346","jun_ip","netxms_ip","SNMP","107","get-response 1.3.6.1.4.1.2636.3.40.1.5.1.5.1.2.8" "15","2017-10-13 11:28:42.235420","netxms_ip","jun_ip","SNMP","100","get-next-request 1.3.6.1.4.1.2636.3.40.1.5.1.5.1.2.8" "16","2017-10-13 11:28:42.379286","jun_ip","netxms_ip","SNMP","101","get-response 1.3.6.1.4.1.2636.3.40.1.5.1.5.1.3.2" "17","2017-10-13 11:28:42.379498","netxms_ip","jun_ip","SNMP","100","get-next-request 1.3.6.1.4.1.2636.3.40.1.5.1.5.1.3.2" ... "387","2017-10-13 11:29:07.878230","netxms_ip","jun_ip","SNMP","102","get-next-request 1.3.6.1.4.1.2636.3.40.1.5.1.7.1.5.6.531" "388","2017-10-13 11:29:08.014139","jun_ip","netxms_ip","SNMP","103","get-response 1.3.6.1.4.1.2636.3.40.1.5.1.7.1.5.6.532" "389","2017-10-13 11:29:08.014320","netxms_ip","jun_ip","SNMP","102","get-next-request 1.3.6.1.4.1.2636.3.40.1.5.1.7.1.5.6.532" "390","2017-10-13 11:29:08.150575","jun_ip","netxms_ip","SNMP","103","get-response 1.3.6.1.4.1.2636.3.40.1.5.1.7.1.5.6.533" "391","2017-10-13 11:29:08.150677","netxms_ip","jun_ip","SNMP","102","get-next-request 1.3.6.1.4.1.2636.3.40.1.5.1.7.1.5.6.533" "392","2017-10-13 11:29:08.305570","jun_ip","netxms_ip","SNMP","103","get-response 1.3.6.1.4.1.2636.3.40.1.5.1.7.1.5.6.534" "393","2017-10-13 11:29:08.305660","netxms_ip","jun_ip","SNMP","102","get-next-request 1.3.6.1.4.1.2636.3.40.1.5.1.7.1.5.6.534" "394","2017-10-13 11:29:08.443077","jun_ip","netxms_ip","SNMP","103","get-response 1.3.6.1.4.1.2636.3.40.1.5.1.7.1.5.6.535" "395","2017-10-13 11:29:08.443153","netxms_ip","jun_ip","SNMP","102","get-next-request 1.3.6.1.4.1.2636.3.40.1.5.1.7.1.5.6.535" "396","2017-10-13 11:29:08.580558","jun_ip","netxms_ip","SNMP","103","get-response 1.3.6.1.4.1.2636.3.40.1.5.1.7.1.5.6.536" "397","2017-10-13 11:29:08.580629","netxms_ip","jun_ip","SNMP","102","get-next-request 1.3.6.1.4.1.2636.3.40.1.5.1.7.1.5.6.536" "398","2017-10-13 11:29:08.725585","jun_ip","netxms_ip","SNMP","101","get-response 1.3.6.1.4.1.2636.3.40.1.7.1.1.1.1.0" "399","2017-10-13 11:29:45.176593","netxms_ip","jun_ip","SNMP","92","get-request 1.3.6.1.2.1.1.2.0" "400","2017-10-13 11:29:45.306845","jun_ip","netxms_ip","SNMP","104","get-response 1.3.6.1.2.1.1.2.0"Every response has error-status: noError. We were capturing icmp too, but it seems that NetXMS did not fall back to icmp ping.
It seems that NetXMS believes that node is down when it gets unexpected snmp response.
-
Netxms server segfaulted during configuration pollGreat! Many thanks
-
Netxms server segfaulted during configuration poll@victor said in Netxms server segfaulted during configuration poll:
Could you please provide output of command
nxget -T node_ip_here System.InstalledProducts
?It prints installed packages like this (output exceeds max message lenght)
| NAME | VERSION | VENDOR | DATE | URL | DESCRIPTION | | acpi | 1.6-1 | | | http://sourceforge.net/projects/acpiclient | displays information on ACPI devices | | acpi-support-base | 0.140-5+deb7u3 | | | | scripts for handling base ACPI events such as the power button | | acpid | 1:2.0.16-1+deb7u1 | | | http://www.tedfelix.com/linux/acpid-netlink.html | Advanced Configuration and Power Interface event daemon | | adduser | 3.113+nmu3 | | | http://alioth.debian.org/projects/adduser/ | add and remove users and groups | | apache2-mpm-prefork | 2.2.22-13+deb7u6 | | | http://httpd.apache.org/ | Apache HTTP Server - traditional non-threaded model | | apache2-utils | 2.2.22-13+deb7u6 | | | http://httpd.apache.org/ | utility programs for webservers | | apache2.2-bin | 2.2.22-13+deb7u6 | | | http://httpd.apache.org/ | Apache HTTP Server common binary files | | apache2.2-common | 2.2.22-13+deb7u6 | | | http://httpd.apache.org/ | Apache HTTP Server common files | | apt | 0.9.7.9+deb7u7 | | | | commandline package manager | | apt-utils | 0.9.7.9+deb7u7 | | | | package managment related utility programs | | aptitude | 0.6.8.2-1 | | | http://aptitude.alioth.debian.org/ | terminal-based package manager | | aptitude-common | 0.6.8.2-1 | | | http://aptitude.alioth.debian.org/ | architecture indepedent files for the aptitude package manager | | asterisk | 1:11.13.1~dfsg-2~bpo70+1 | | | http://www.asterisk.org/ | Open Source Private Branch Exchange (PBX) | | asterisk-config | 1:11.13.1~dfsg-2~bpo70+1 | | | http://www.asterisk.org/ | Configuration files for Asterisk | | asterisk-core-sounds-en | 1.4.22-1 | | | http://www.asterisk.org/ | asterisk PBX sound files - US English | | asterisk-core-sounds-en-gsm | 1.4.22-1 | | | http://www.asterisk.org/ | asterisk PBX sound files - en-us/gsm | | asterisk-modules | 1:11.13.1~dfsg-2~bpo70+1 | | | http://www.asterisk.org/ | loadable modules for the Asterisk PBX | | asterisk-moh-opsound-gsm | 2.03-1 | | | http://www.asterisk.org/ | asterisk extra sound files - English/gsm | | asterisk-mp3 | 1:11.13.1~dfsg-2~bpo70+1 | | | http://www.asterisk.org/ | MP3 playback support for the Asterisk PBX | | asterisk-mysql | 1:11.13.1~dfsg-2~bpo70+1 | | | http://www.asterisk.org/ | MySQL database protocol support for the Asterisk PBX | | asterisk-voicemail | 1:11.13.1~dfsg-2~bpo70+1 | | | http://www.asterisk.org/ | simple voicemail support for the Asterisk PBX | | autopoint | 0.18.1.1-9 | | | http://www.gnu.org/software/gettext/ | The autopoint program from GNU gettext | | bareos-common | 15.2.0.git.1438969517.7e23e6f-1142.1 | | | http://www.bareos.org/ | Backup Archiving Recovery Open Sourced - common files | | bareos-filedaemon | 15.2.0.git.1438969517.7e23e6f-1142.1 | | | http://www.bareos.org/ | Backup Archiving Recovery Open Sourced - file daemon | | base-files | 7.1wheezy9 | | | | Debian base system miscellaneous files | | base-passwd | 3.5.26 | | | | Debian base system master password and group files | | bash | 4.2+dfsg-0.1+deb7u3 | | | http://tiswww.case.edu/php/chet/bash/bashtop.html | GNU Bourne Again SHell | | binutils | 2.22-8+deb7u2 | | | | GNU assembler, linker and binary utilities | | bsdmainutils | 9.0.3 | | | | collection of more utilities from FreeBSD | | bsdutils | 1:2.20.1-5.3 | | | http://userweb.kernel.org/~kzak/util-linux/ | Basic utilities from 4.4BSD-Lite | | build-essential | 11.5 | | | | Informational list of build-essential packages | | busybox | 1:1.20.0-7 | | | http://www.busybox.net | Tiny utilities for small and embedded systems | | bzip2 | 1.0.6-4 | | | http://www.bzip.org/ | high-quality block-sorting file compressor - utilities | | ca-certificates | 20130119+deb7u1 | | | | Common CA certificates | | console-setup | 1.88 | | | | console font and keymap setup program | | console-setup-linux | 1.88 | | | | Linux specific part of console-setup | | coreutils | 8.13-3.5 | | | http://gnu.org/software/coreutils | GNU core utilities |We have had another segfault during a poll from another node with agent version 2.0.7. Nxget worked correctly with it too. Here is backtrace:
#0 wcscmp () at ../sysdeps/x86_64/wcscmp.S:424 #1 0x00007f12bbd3edb1 in msort_with_tmp (p=0x7f1220e09d20, b=0x7f11f63d24e0, n=2) at msort.c:83 #2 0x00007f12bbd3eb02 in msort_with_tmp (n=2, b=0x7f11f63d24e0, p=0x7f1220e09d20) at msort.c:45 #3 msort_with_tmp (p=0x7f1220e09d20, b=0x7f11f63d24e0, n=4) at msort.c:53 #4 0x00007f12bbd3eb02 in msort_with_tmp (n=4, b=0x7f11f63d24e0, p=0x7f1220e09d20) at msort.c:45 #5 msort_with_tmp (p=0x7f1220e09d20, b=0x7f11f63d24e0, n=8) at msort.c:53 #6 0x00007f12bbd3eb02 in msort_with_tmp (n=8, b=0x7f11f63d24e0, p=0x7f1220e09d20) at msort.c:45 #7 msort_with_tmp (p=0x7f1220e09d20, b=0x7f11f63d24e0, n=17) at msort.c:53 #8 0x00007f12bbd3eb02 in msort_with_tmp (n=17, b=0x7f11f63d24e0, p=0x7f1220e09d20) at msort.c:45 #9 msort_with_tmp (p=0x7f1220e09d20, b=0x7f11f63d24e0, n=35) at msort.c:53 #10 0x00007f12bbd3eb02 in msort_with_tmp (n=35, b=0x7f11f63d24e0, p=0x7f1220e09d20) at msort.c:45 #11 msort_with_tmp (p=0x7f1220e09d20, b=0x7f11f63d24e0, n=70) at msort.c:53 #12 0x00007f12bbd3eb02 in msort_with_tmp (n=70, b=0x7f11f63d24e0, p=0x7f1220e09d20) at msort.c:45 #13 msort_with_tmp (p=0x7f1220e09d20, b=0x7f11f63d24e0, n=141) at msort.c:53 #14 0x00007f12bbd3eb02 in msort_with_tmp (n=141, b=0x7f11f63d24e0, p=0x7f1220e09d20) at msort.c:45 #15 msort_with_tmp (p=0x7f1220e09d20, b=0x7f11f63d24e0, n=282) at msort.c:53 #16 0x00007f12bbd3f05c in msort_with_tmp (n=282, b=0x7f11f63d24e0, p=0x7f1220e09d20) at msort.c:45 #17 __GI_qsort_r (b=0x7f11f63d24e0, n=282, s=8, cmp=0x7f12bf2bae20 <PackageNameComparator(SoftwarePackage const**, SoftwarePackage const**)>, arg=<optimized out>) at msort.c:297 #18 0x00007f12bf2cc4fa in sort (cb=<optimized out>, this=<optimized out>) at ../../../include/nms_util.h:726 #19 Node::updateSoftwarePackages (this=0x7ffc4e0, poller=0x11a, requestId=0) at node.cpp:2214 #20 0x00007f12bf2d07d5 in Node::configurationPoll (this=0x7ffc4e0, pSession=0x0, dwRqId=0, poller=0x7f127c389dc0, maskBits=0) at node.cpp:2428 #21 0x00007f12bf2d0ec3 in Node::configurationPoll (this=0x7ffc4e0, poller=0x7f127c389dc0) at node.cpp:2275 #22 0x00007f12bf268781 in __ThreadPoolExecute_Wrapper<Node, PollerInfo*> (arg=0x7f127c38a040) at ../../../include/nms_threads.h:970 #23 0x00007f12be2e53b6 in WorkerThread (arg=0x7f127c1aba10) at tp.cpp:127 #24 0x00007f12bcf3a064 in start_thread (arg=0x7f1220e0e700) at pthread_create.c:309 #25 0x00007f12bbdf062d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 -
Netxms server segfaulted during configuration pollHi. Our netxms sever crushed because of segmentation fault. Here is back trace:
Core was generated by `/usr/bin/netxmsd -d'. Program terminated with signal SIGSEGV, Segmentation fault. #0 wcscmp () at ../sysdeps/x86_64/wcscmp.S:424 424 ../sysdeps/x86_64/wcscmp.S: No such file or directory. (gdb) set print pretty on (gdb) set height 0 (gdb) bt full #0 wcscmp () at ../sysdeps/x86_64/wcscmp.S:424 No locals. #1 0x00007fca7b446db1 in msort_with_tmp (p=0x7fc9c31b3d20, b=0x11788288, n=2) at msort.c:83 b1 = 0x11788288 "\200B\271\022" b2 = 0x11788290 "\300Ag\017" n1 = 1 n2 = 1 tmp = 0xfa7c210 "\240;\254\016" s = 8 cmp = 0x7fca7e9c2e20 <PackageNameComparator(SoftwarePackage const**, SoftwarePackage const**)> arg = 0x0 #2 0x00007fca7b446b18 in msort_with_tmp (n=2, b=0x11788288, p=0x7fc9c31b3d20) at msort.c:45 No locals. #3 msort_with_tmp (p=0x7fc9c31b3d20, b=0x11788280, n=3) at msort.c:54 b1 = 0x11788280 "\220\242\276\021" b2 = 0x11788288 "\200B\271\022" n1 = 1 n2 = 2 tmp = <optimized out> s = <optimized out> cmp = <optimized out> arg = <optimized out> #4 0x00007fca7b446b02 in msort_with_tmp (n=3, b=0x11788280, p=0x7fc9c31b3d20) at msort.c:45 No locals. #5 msort_with_tmp (p=0x7fc9c31b3d20, b=0x11788280, n=6) at msort.c:53 b1 = 0x11788280 "\220\242\276\021" b2 = 0x11788298 "\200d\376\017" n1 = 3 n2 = 3 tmp = <optimized out> s = <optimized out> cmp = <optimized out> arg = <optimized out> #6 0x00007fca7b446b02 in msort_with_tmp (n=6, b=0x11788280, p=0x7fc9c31b3d20) at msort.c:45 No locals. #7 msort_with_tmp (p=0x7fc9c31b3d20, b=0x11788280, n=13) at msort.c:53 b1 = 0x11788280 "\220\242\276\021" b2 = 0x117882b0 "P\321\r\023" n1 = 6 n2 = 7 tmp = <optimized out> s = <optimized out> cmp = <optimized out> arg = <optimized out> #8 0x00007fca7b446b02 in msort_with_tmp (n=13, b=0x11788280, p=0x7fc9c31b3d20) at msort.c:45 No locals. #9 msort_with_tmp (p=0x7fc9c31b3d20, b=0x11788280, n=26) at msort.c:53 b1 = 0x11788280 "\220\242\276\021" b2 = 0x117882e8 "@\353t\020" n1 = 13 n2 = 13 tmp = <optimized out> s = <optimized out> cmp = <optimized out> arg = <optimized out> #10 0x00007fca7b446b02 in msort_with_tmp (n=26, b=0x11788280, p=0x7fc9c31b3d20) at msort.c:45 No locals. #11 msort_with_tmp (p=0x7fc9c31b3d20, b=0x11788280, n=53) at msort.c:53 b1 = 0x11788280 "\220\242\276\021" b2 = 0x11788350 "\300\002J\024" n1 = 26 n2 = 27 tmp = <optimized out> s = <optimized out> cmp = <optimized out> arg = <optimized out> #12 0x00007fca7b446b02 in msort_with_tmp (n=53, b=0x11788280, p=0x7fc9c31b3d20) at msort.c:45 No locals. #13 msort_with_tmp (p=0x7fc9c31b3d20, b=0x11788280, n=107) at msort.c:53 b1 = 0x11788280 "\220\242\276\021" b2 = 0x11788428 "\340\201?\025" n1 = 53 n2 = 54 tmp = <optimized out> s = <optimized out> cmp = <optimized out> arg = <optimized out> #14 0x00007fca7b446b02 in msort_with_tmp (n=107, b=0x11788280, p=0x7fc9c31b3d20) at msort.c:45 No locals. #15 msort_with_tmp (p=0x7fc9c31b3d20, b=0x11788280, n=215) at msort.c:53 b1 = 0x11788280 "\220\242\276\021" b2 = 0x117885d8 "\260\277\300\020" n1 = 107 n2 = 108 tmp = <optimized out> s = <optimized out> cmp = <optimized out> arg = <optimized out> #16 0x00007fca7b446b02 in msort_with_tmp (n=215, b=0x11788280, p=0x7fc9c31b3d20) at msort.c:45 No locals. #17 msort_with_tmp (p=0x7fc9c31b3d20, b=0x11788280, n=430) at msort.c:53 b1 = 0x11788280 "\220\242\276\021" b2 = 0x11788938 "\200\227\337\024" n1 = 215 n2 = 215 tmp = <optimized out> s = <optimized out> cmp = <optimized out> arg = <optimized out> #18 0x00007fca7b44705c in msort_with_tmp (n=430, b=0x11788280, p=0x7fc9c31b3d20) at msort.c:45 No locals. #19 __GI_qsort_r (b=0x11788280, n=430, s=8, cmp=0x7fca7e9c2e20 <PackageNameComparator(SoftwarePackage const**, SoftwarePackage const**)>, arg=<optimized out>) at msort.c:297 size = <optimized out> tmp = 0xfa7c210 "\240;\254\016" p = { s = 8, var = 1, cmp = 0x7fca7e9c2e20 <PackageNameComparator(SoftwarePackage const**, SoftwarePackage const**)>, arg = 0x0, t = 0xfa7c210 "\240;\254\016" } #20 0x00007fca7e9d44fa in sort (cb=<optimized out>, this=<optimized out>) at ../../../include/nms_util.h:726 No locals. #21 Node::updateSoftwarePackages (this=0x7443860, poller=0x1ae, requestId=0) at node.cpp:2214 table = 0x10830150 packages = 0x11bea250 #22 0x00007fca7e9d87d5 in Node::configurationPoll (this=0x7443860, pSession=0x0, dwRqId=0, poller=0x7fca4d0b4bd0, maskBits=0) at node.cpp:2428 type = NODE_TYPE_UNKNOWN szBuffer = L'\000' <repeats 3678 times>... hasChanges = true #23 0x00007fca7e9d8ec3 in Node::configurationPoll (this=0x7443860, poller=0x7fca4d0b4bd0) at node.cpp:2275 No locals. #24 0x00007fca7e970781 in __ThreadPoolExecute_Wrapper<Node, PollerInfo*> (arg=0x7fca4c4423b0) at ../../../include/nms_threads.h:970 wd = 0x7fca4c4423b0 #25 0x00007fca7d9ed3b6 in WorkerThread (arg=0x7fca4c2cd240) at tp.cpp:127 rq = 0x7fca4c2fbf90 p = 0x7fca4c0fd2b0 q = 0x7fca4c0fd380 #26 0x00007fca7c642064 in start_thread (arg=0x7fc9c31b8700) at pthread_create.c:309 __res = <optimized out> pd = 0x7fc9c31b8700 now = <optimized out> unwind_buf = { cancel_jmp_buf = {{ jmp_buf = {140504538515200, 8965125287727607267, 0, 263873856, 17, 140504538515200, -8937107837346107933, -8935566916459024925}, mask_was_saved = 0 }}, priv = { pad = {0x0, 0x0, 0x0, 0x0}, data = { prev = 0x0, cleanup = 0x0, canceltype = 0 } } } not_first_call = <optimized out> pagesize_m1 = <optimized out> sp = <optimized out> freesize = <optimized out> __PRETTY_FUNCTION__ = "start_thread" #27 0x00007fca7b4f862d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 No locals. (gdb)It seems that the problem is in "software inventory" feature. Error occurred during poll from agent of version 2.0.7. Is it possible to temporary disable this feature?
-
Performance issues with netxmsThanks, increasing of data collectors mostly solved the issue. But there is one left. We have netxms agent proxy which handles many custom ExternalParameter actions and it lags too. Is there any way to tune it?
-
Performance issues with netxmsHi! We have been experiencing performance issues with netxms lately. There were no particular point at which netxms started to lag but for now we have these problems:
- 'Force DCI poll' button does not work
- Large delays in DCI polling. e.g. 10 minutes between polls where 60 second poll is configured
info:
nxadm -c 'sh stat' Total number of objects: 3924 Number of monitored nodes: 394 Number of collectable DCIs: 12063 nxadm -c 'sh q' Data collector : 6921 (floats around 3-7K) DCI cache loader : 0 Database writer : 0 Database writer (IData) : 0 Database writer (raw DCI values) : 0 Event processor : 0 Node poller : 0 Syslog processing : 0 Syslog writer : 0 Number of DCI collectors: 200 (increasing this number from 25 did not give much effect) Average time to queue DCI for polling for last minute: 4 load average: 0.97, 0.93, 0.92 2 CPUs free -h total used free shared buffers cached Mem: 2.0G 1.9G 106M 540M 138M 716M -/+ buffers/cache: 1.0G 961M Swap: 2.0G 330M 1.6G iostat 60 5 Linux 3.16.0-4-amd64 (netxms) 08/03/2017 _x86_64_ (2 CPU) avg-cpu: %user %nice %system %iowait %steal %idle 18.28 0.01 5.13 2.92 0.00 73.67 Device: tps kB_read/s kB_wrtn/s kB_read kB_wrtn sda 66.76 140.82 562.47 685000987 2735994668 avg-cpu: %user %nice %system %iowait %steal %idle 14.50 0.00 3.95 2.40 0.00 79.14 Device: tps kB_read/s kB_wrtn/s kB_read kB_wrtn sda 45.10 141.40 346.67 8484 20800 avg-cpu: %user %nice %system %iowait %steal %idle 33.37 0.00 10.06 2.58 0.00 54.00 Device: tps kB_read/s kB_wrtn/s kB_read kB_wrtn sda 150.00 22.33 1707.20 1340 102432 avg-cpu: %user %nice %system %iowait %steal %idle 8.64 0.00 2.47 0.29 0.00 88.60 Device: tps kB_read/s kB_wrtn/s kB_read kB_wrtn sda 26.60 1.33 289.00 80 17340 avg-cpu: %user %nice %system %iowait %steal %idle 27.19 0.00 7.45 1.59 0.00 63.77 Device: tps kB_read/s kB_wrtn/s kB_read kB_wrtn sda 58.25 9.47 583.13 568 34988 -
Netxms Java WebAPI build problem on Debian Jessie with jdk 7@sviests said in Netxms Java WebAPI build problem on Debian Jessie with jdk 7:
Try navigating to netxms/src/java/client and running package.sh
If it finishes without errors, try building the WebAPI again.Thanks, this has helped me.
-
Netxms Java WebAPI build problem on Debian Jessie with jdk 7Hi! I have tried to build Netxms WebAPI on Debian Jessie with openjdk 7.
I have followed these steps to encountered such a problem:
On master (commit ecabd44ec20f8e7e1dfceba428490a42a184a72c) mvn install threw this error:root@netxms:/opt/netxms/src/server/nxapisrv/java# mvn install [INFO] Scanning for projects... [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netxms:netxms-websvc:war:2.1-RC1 [WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-compiler-plugin is missing. @ line 77, column 18 [WARNING] [WARNING] It is highly recommended to fix these problems because they threaten the stability of your build. [WARNING] [WARNING] For this reason, future Maven versions might no longer support building such malformed projects. [WARNING] [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetXMS REST API Server 2.1-RC1 [INFO] ------------------------------------------------------------------------ [WARNING] The POM for org.netxms:netxms-base:jar:2.1-RC1 is missing, no dependency information available [WARNING] The POM for org.netxms:netxms-client:jar:2.1-RC1 is missing, no dependency information available [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 2.438s [INFO] Finished at: Mon May 22 10:14:32 UTC 2017 [INFO] Final Memory: 5M/30M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal on project netxms-websvc: Could not resolve dependencies for project org.netxms:netxms-websvc:war:2.1-RC1: The following artifacts could not be resolved: org.netxms:netxms-base:jar:2.1-RC1, org.netxms:netxms-client:jar:2.1-RC1: Failure to find org.netxms:netxms-base:jar:2.1-RC1 in http://maven.restlet.com was cached in the local repository, resolution will not be reattempted until the update interval of maven-restlet has elapsed or updates are forced -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionExceptionThen I tried to do the same on tag 2.1-M3 and mvn install threw this:
root@netxms:/opt/netxms/src/server/nxapisrv/java# mvn install [INFO] Scanning for projects... [WARNING] [WARNING] Some problems were encountered while building the effective model for org.netxms:netxms-websvc:war:2.1-M2 [WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-compiler-plugin is missing. @ line 77, column 18 [WARNING] [WARNING] It is highly recommended to fix these problems because they threaten the stability of your build. [WARNING] [WARNING] For this reason, future Maven versions might no longer support building such malformed projects. [WARNING] [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building NetXMS REST API Server 2.1-M2 [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-resources-plugin:2.3:resources (default-resources) @ netxms-websvc --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 1 resource [INFO] [INFO] --- maven-compiler-plugin:2.5.1:compile (default-compile) @ netxms-websvc --- [INFO] Compiling 17 source files to /opt/netxms/src/server/nxapisrv/java/target/classes [INFO] ------------------------------------------------------------- [ERROR] COMPILATION ERROR : [INFO] ------------------------------------------------------------- [ERROR] /opt/netxms/src/server/nxapisrv/java/src/main/java/org/netxms/websvc/json/JsonTools.java:[26,34] error: package org.netxms.base.annotations does not exist [ERROR] /opt/netxms/src/server/nxapisrv/java/src/main/java/org/netxms/websvc/handlers/Objects.java:[51,58] error: incompatible types [ERROR] /opt/netxms/src/server/nxapisrv/java/src/main/java/org/netxms/websvc/handlers/Objects.java:[133,38] error: cannot find symbol [ERROR] symbol: method isWithinArea(double,double,double,double) location: class GeoLocation /opt/netxms/src/server/nxapisrv/java/src/main/java/org/netxms/websvc/handlers/GrafanaDataCollection.java:[51,42] error: incompatible types [ERROR] /opt/netxms/src/server/nxapisrv/java/src/main/java/org/netxms/websvc/json/JsonTools.java:[70,35] error: cannot find symbol [ERROR] symbol: class Internal /opt/netxms/src/server/nxapisrv/java/src/main/java/org/netxms/websvc/json/JsonTools.java:[76,41] error: cannot find symbol [INFO] 6 errors [INFO] ------------------------------------------------------------- [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 11.300s [INFO] Finished at: Mon May 22 10:05:03 UTC 2017 [INFO] Final Memory: 11M/30M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:2.5.1:compile (default-compile) on project netxms-websvc: Compilation failure: Compilation failure: [ERROR] /opt/netxms/src/server/nxapisrv/java/src/main/java/org/netxms/websvc/json/JsonTools.java:[26,34] error: package org.netxms.base.annotations does not exist [ERROR] /opt/netxms/src/server/nxapisrv/java/src/main/java/org/netxms/websvc/handlers/Objects.java:[51,58] error: incompatible types [ERROR] /opt/netxms/src/server/nxapisrv/java/src/main/java/org/netxms/websvc/handlers/Objects.java:[133,38] error: cannot find symbol [ERROR] symbol: method isWithinArea(double,double,double,double) [ERROR] location: class GeoLocation [ERROR] /opt/netxms/src/server/nxapisrv/java/src/main/java/org/netxms/websvc/handlers/GrafanaDataCollection.java:[51,42] error: incompatible types [ERROR] /opt/netxms/src/server/nxapisrv/java/src/main/java/org/netxms/websvc/json/JsonTools.java:[70,35] error: cannot find symbol [ERROR] symbol: class Internal [ERROR] /opt/netxms/src/server/nxapisrv/java/src/main/java/org/netxms/websvc/json/JsonTools.java:[76,41] error: cannot find symbol [ERROR] -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureExceptionCan you point what's wrong with it? Or will pre-built package of WebAPI available soon?
-
How to create DCI using NetXMS Java API version 2.1-M3Thank you, Victor!
-
How to create DCI using NetXMS Java API version 2.1-M3Prior 2.1-M3, It was possible to create Data Collection Item in nxshell like this:
template_id = session.findObjectByName("Some_template").getObjectId() config = session.openDataCollectionConfiguration(template_id) DCIid = config.createItem() DCI = template_config.findItem(DCIid)Now, createItem method requires DataCollectionObject instance. Moreover, DataCollectionObject constructor is protected and requires an id parameter.
How can I create DCI using this method or what is the right way to create DCI in template using nxshell? -
Как пользоваться методом toJson() для Event'a в nxsl скриптах?спасибо, получилось
-
Как пользоваться методом toJson() для Event'a в nxsl скриптах?Согласно этим постам
https://www.netxms.org/forum/e-eoe-o-koaot-netxms/to_json-eta/
https://www.netxms.org/forum/announcements/netxms-2-0-5-released/
появился метод toJson() для класса Event, но как им пользоваться в nxsl скриптах?
Мне нужно отладить какой аларм терминируется пришедшим ивентом, и было бы удобно увидеть в логе все параметры пришедшего ивента.
Напрмер, в EventProcessingPolicy для правила на ивент SYS_ALARM_TIMEOUT добавить в Filtering Script такое:trace(3,toJson($event));