DCI last values don't store history data

xelander

Hello,
I enabled query logging on the DB and the query seems to be correct, and it returns valid data (see attachements):

SELECT idata_timestamp,idata_value,raw_value FROM idata_2069 WHERE item_id=682 ORDER BY idata_timestamp DESC LIMIT 4096

I'll try the new version as soon as possible, and I'll let you know.

Thanks,
Alessandro

xelander

Hi,
I upgraded to version 3.4.284, both the server and the management console, but unfortunately nothing changed.

The query is the same:

SELECT idata_timestamp,idata_value,raw_value FROM idata_2069 WHERE item_id=682 ORDER BY idata_timestamp DESC LIMIT 4096

but still no data is displayed in the History view or in the Charts view, and I cannot find any error in MariaDB nor Netxms logs.

Is there anything alse I can try to debug the problem?

Thanks,
Alessandro

Victor Kirhenshtein

Try to change DCI data type to "String" and request history - will it show something?

Best regards,
Victor

xelander

Nothing changed, sorry

Filipp Sudanov

How did you compile netxms - can you show config.log file? Can you show the output of yum list installed

xelander

Hi,I followed the directions on the "NetXMS Administrator Guide, Release 3.4.178", chapter "3.6 Installing from sources", that is:

# ./configure --with-server --with-mysql --with-agent
# make
# make install

I'm attaching the config.log and the output of yum list installed.If you need anything else, please let me know.

Thank you,Alessandro

logs.zip

Filipp Sudanov

As an experiment - can you try to a different configure command:

./configure prefix=/opt/netxms-master --with-server --with-mariadb --with-mariadb-compat-headers --with-agent

xelander

I tried (see attached config.log), but the issue is still present.
The query is the same as before:

200806 15:54:06    266 Prepare  SELECT idata_timestamp,idata_value,raw_value FROM idata_2069 WHERE item_id=? ORDER BY idata_timestamp DESC LIMIT 4096
                   266 Execute  SELECT idata_timestamp,idata_value,raw_value FROM idata_2069 WHERE item_id=683 ORDER BY idata_timestamp DESC LIMIT 4096
                   266 Close stmt

I was wondering if it could be a client issue, instead of a server one.
After all, if the server had a problem SELECT'ing data from the DB, almost nothing would work...

config.zip

Filipp Sudanov

What's the operating system where the client is running? What's client version? Is it downloaded from netxms web site?
For testing - may be you could try the client on another machine, preferrably on a different OS.

xelander

I tried the Windows client (nxmc-3.4.284-win32-x64.zip) both on Windows 7 and on Windows 10, but I also tried the web interface (nxmc-3.4.284.war), everything downloaded from the netxms website, so it seems the issue doesn't depend on the client OS.
I still have to try on Linux...

xelander

Today I also tried on Linux CentOS 8, (nxmc-3.4.284-linux-gtk-x64.tar.gz) but nothing changed: no historical data.This is so strange that now I wonder if I'm doing something wrong...

Filipp Sudanov

Does it happen that there are no historical data for all DCIs in system, or just for some DCIs?

xelander

I've not configured many DCIs yet, but it seems no DCI shows historical data.
I've added a couple of other DCI on a different switch (3Com vs CISCO), but still no historical data in the GUI.

Even default DCIs for the NetXMS server itself show no historical data (see attachments).
The only strange thing I'm noticing now, is the <<ERROR>> value for the only DCI coming from the NetXMS agent on the server.

Filipp Sudanov

One more thing to have a look at - console writes it's own log file in user's home folder in \.nxmc\data\.metadata
Can you share what you have there?

xelander

Here they are.

nxmc-metadata-windows7.zip

nxmc-metadata-centos8.tgz

Filipp Sudanov

Did you try to open the dci graph / history during the duration of that log?

xelander

Yes, of course.

Filipp Sudanov

Let's try to get historical data from java API using nxshell - this way we could see if the issue is with the server or the GUI.

You will need to recompile to get nxshell, for that please run

export JAVA_HOME=/usr/lib/jvm/java-11-openjdk-amd64

add then run your ./configure command with the following keys added:

--with-jdk=/usr/lib/jvm/java-11-openjdk-amd64 --with-client

make & make install should produce nxshell executable in your bin folder.

Then make a file, say collected_data.py

from java.util import Date
data = s.getCollectedData(200, 2000, Date(Date().time - 60 * 60 * 1000), Date(), 100, HistoricalDataType.valueOf('PROCESSED'))
print data
for v in data.values:
    print v.timestamp.toString() + " = " + str(v.value)

replace 200 with a node ID and 2000 with a DCI ID.

Then run the following (-u username, same as in management console and -P is the password):

nxshell -H 127.0.0.1 -u admin -P ""  collected_data.py

and share the output. This script script should return datapoints for a give DCI for last hour.

xelander

Hi, here they are.
Node 2069, DCI 682

nxshell -H 127.0.0.1 -u admin -P XXXX collected_data.py
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.python.core.PySystemState (file:/usr/local/lib/netxms/nxshell.jar) to method java.io.Console.encoding()
WARNING: Please consider reporting this to the maintainers of org.python.core.PySystemState
WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
WARNING: All illegal access operations will be denied in a future release
DciData [nodeId=2069, dciId=682, dataType=INT32, valuesSize=0]

Node 2069, DCI 683

nxshell -H 127.0.0.1 -u admin -P XXXX collected_data.py
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.python.core.PySystemState (file:/usr/local/lib/netxms/nxshell.jar) to method java.io.Console.encoding()
WARNING: Please consider reporting this to the maintainers of org.python.core.PySystemState
WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
WARNING: All illegal access operations will be denied in a future release
DciData [nodeId=2069, dciId=683, dataType=INT32, valuesSize=0]

It seems nxshell doesn't get any data too

collected_data.py

Filipp Sudanov

Can we possible get remote access to your netxms server? If yes, please send a message to [email protected]

If no, please collect server log at debuglevel = 8. Start console during the log and open the graph and history of a DCI.
You can change debut level on the fly:
nxadm -c "debug 8"
will change it

nxadm -c "debug"
will print current debug level

NetXMS Forum

DCI last values don't store history data