DCI last values don't store history data

xelander

Here they are.

nxmc-metadata-windows7.zip

nxmc-metadata-centos8.tgz

Filipp Sudanov

Did you try to open the dci graph / history during the duration of that log?

xelander

Yes, of course.

Filipp Sudanov

Let's try to get historical data from java API using nxshell - this way we could see if the issue is with the server or the GUI.

You will need to recompile to get nxshell, for that please run

export JAVA_HOME=/usr/lib/jvm/java-11-openjdk-amd64

add then run your ./configure command with the following keys added:

--with-jdk=/usr/lib/jvm/java-11-openjdk-amd64 --with-client

make & make install should produce nxshell executable in your bin folder.

Then make a file, say collected_data.py

from java.util import Date
data = s.getCollectedData(200, 2000, Date(Date().time - 60 * 60 * 1000), Date(), 100, HistoricalDataType.valueOf('PROCESSED'))
print data
for v in data.values:
    print v.timestamp.toString() + " = " + str(v.value)

replace 200 with a node ID and 2000 with a DCI ID.

Then run the following (-u username, same as in management console and -P is the password):

nxshell -H 127.0.0.1 -u admin -P ""  collected_data.py

and share the output. This script script should return datapoints for a give DCI for last hour.

xelander

Hi, here they are.
Node 2069, DCI 682

nxshell -H 127.0.0.1 -u admin -P XXXX collected_data.py
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.python.core.PySystemState (file:/usr/local/lib/netxms/nxshell.jar) to method java.io.Console.encoding()
WARNING: Please consider reporting this to the maintainers of org.python.core.PySystemState
WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
WARNING: All illegal access operations will be denied in a future release
DciData [nodeId=2069, dciId=682, dataType=INT32, valuesSize=0]

Node 2069, DCI 683

nxshell -H 127.0.0.1 -u admin -P XXXX collected_data.py
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.python.core.PySystemState (file:/usr/local/lib/netxms/nxshell.jar) to method java.io.Console.encoding()
WARNING: Please consider reporting this to the maintainers of org.python.core.PySystemState
WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
WARNING: All illegal access operations will be denied in a future release
DciData [nodeId=2069, dciId=683, dataType=INT32, valuesSize=0]

It seems nxshell doesn't get any data too

collected_data.py

Filipp Sudanov

Can we possible get remote access to your netxms server? If yes, please send a message to [email protected]

If no, please collect server log at debuglevel = 8. Start console during the log and open the graph and history of a DCI.
You can change debut level on the fly:
nxadm -c "debug 8"
will change it

nxadm -c "debug"
will print current debug level

xelander

Yes, I can set up a remote access for you, thank you very much.
I have to setup some port forwarding on our firewall: do you only need SSH or also port 4701 for the console?
Can you tell me the public IP address you will be using to connect?

In the meanwhile, I changed the debug level and opened the history and graph of DCI 682 and 683 of node 2069, see attached log.I think they are at line 5744, timestamp 2020.08.11 11:21:55.828

netxmsd.zip

Filipp Sudanov

Sent you a PM.

Meanwhile - it's recommended to check netxms log for *E* and *W* messages - there is one SQL query error, which is not related to issue discussed here, we will have a look. And there's also a warning about autobind script.

xelander

The SQL errors are related to two new groups I was creating (see screenshot), perhaps I made something wrong.
About the autobind script, I don't know, I'm new to NetXMS and I'm still exploring all its features.
I remember opening the script library, perhaps I unvoluntarily tampered with the scripts.

Filipp Sudanov

There was one thing we missed - after recompiling --with-mariadb --with-mariadb-compat-headers, database driver in netxmsd.conf should have been updated, but mysql.ddr was left there.
The correct configuration is:

DBDriver = mariadb.ddr

P.S. pls disable system user in netxms - it's currently enabled.

xelander

Oh! I'm really sorry, I completely missed this step :-[ .
Thank you very, very much for your support and for your time.
P.S. I disabled the system user, thank you.

logic_sam

BIG HUG FOR Filipp Sudanov

NetXMS on CentOS 8
MariaDB

Data was not written in the history.
I was able to see "last values" but no history, no graphs.
netxms data collection was not working (i add this for google searches)

Thanks to Filipp :

i learned to look for datas in "idata_xxx" tables
i recompiled with mariadb options
i changed netxmsd.conf to "DBDriver = mariadb.ddr"

God bless you Filipp !

for the records :

./configure --with-server --with-mariadb --with-mariadb-compat-headers --with-agent
/usr/local/etc/netxmsd.conf
DBDriver = mariadb.ddr

NetXMS Forum

DCI last values don't store history data