SOTI Directory Service stopped working

Solved Locked
BW
Benjamin, Wilts
Taneri Consulting GmbH (TCG Global)

Hi,

one our customers has the problem that the Directory Service stopped working.


Please find the following log details:

[2020-04-15T11:41:39,759][INFO ][o.e.c.r.a.DiskThresholdMonitor] [VISSOTI01] low disk watermark [1gb] exceeded on [iGAZJBXKQt6NcEwKIvwDdg][VISSOTI01][C:\Program Files\SOTI\MobiControl\Search\data\nodes\0] free: 929.3mb[2.3%], replicas will not be assigned to this node
[2020-04-15T11:42:09,768][INFO ][o.e.c.r.a.DiskThresholdMonitor] [VISSOTI01] low disk watermark [1gb] exceeded on [iGAZJBXKQt6NcEwKIvwDdg][VISSOTI01][C:\Program Files\SOTI\MobiControl\Search\data\nodes\0] free: 531.7mb[1.3%], replicas will not be assigned to this node
[2020-04-15T11:42:39,782][INFO ][o.e.c.r.a.DiskThresholdMonitor] [VISSOTI01] low disk watermark [1gb] exceeded on [iGAZJBXKQt6NcEwKIvwDdg][VISSOTI01][C:\Program Files\SOTI\MobiControl\Search\data\nodes\0] free: 515.3mb[1.2%], replicas will not be assigned to this node
[2020-04-15T11:43:09,806][INFO ][o.e.c.r.a.DiskThresholdMonitor] [VISSOTI01] low disk watermark [1gb] exceeded on [iGAZJBXKQt6NcEwKIvwDdg][VISSOTI01][C:\Program Files\SOTI\MobiControl\Search\data\nodes\0] free: 515.3mb[1.2%], replicas will not be assigned to this node
[2020-04-15T11:43:39,847][INFO ][o.e.c.r.a.DiskThresholdMonitor] [VISSOTI01] low disk watermark [1gb] exceeded on [iGAZJBXKQt6NcEwKIvwDdg][VISSOTI01][C:\Program Files\SOTI\MobiControl\Search\data\nodes\0] free: 513.9mb[1.2%], replicas will not be assigned to this node
[2020-04-15T11:44:09,865][INFO ][o.e.c.r.a.DiskThresholdMonitor] [VISSOTI01] low disk watermark [1gb] exceeded on [iGAZJBXKQt6NcEwKIvwDdg][VISSOTI01][C:\Program Files\SOTI\MobiControl\Search\data\nodes\0] free: 513mb[1.2%], replicas will not be assigned to this node
[2020-04-15T11:44:39,895][INFO ][o.e.c.r.a.DiskThresholdMonitor] [VISSOTI01] low disk watermark [1gb] exceeded on [iGAZJBXKQt6NcEwKIvwDdg][VISSOTI01][C:\Program Files\SOTI\MobiControl\Search\data\nodes\0] free: 512.6mb[1.2%], replicas will not be assigned to this node
[2020-04-15T11:45:09,926][WARN ][o.e.c.r.a.DiskThresholdMonitor] [VISSOTI01] flood stage disk watermark [512mb] exceeded on [iGAZJBXKQt6NcEwKIvwDdg][VISSOTI01][C:\Program Files\SOTI\MobiControl\Search\data\nodes\0] free: 510.6mb[1.2%], all indices on this node will be marked read-only
[2020-04-15T11:45:39,951][WARN ][o.e.c.r.a.DiskThresholdMonitor] [VISSOTI01] flood stage disk watermark [512mb] exceeded on [iGAZJBXKQt6NcEwKIvwDdg][VISSOTI01][C:\Program Files\SOTI\MobiControl\Search\data\nodes\0] free: 510.6mb[1.2%], all indices on this node will be marked read-only
[2020-04-15T11:46:09,962][WARN ][o.e.c.r.a.DiskThresholdMonitor] [VISSOTI01] flood stage disk watermark [512mb] exceeded on [iGAZJBXKQt6NcEwKIvwDdg][VISSOTI01][C:\Program Files\SOTI\MobiControl\Search\data\nodes\0] free: 510.1mb[1.2%], all indices on this node will be marked read-only
[2020-04-15T11:46:39,972][WARN ][o.e.c.r.a.DiskThresholdMonitor] [VISSOTI01] flood stage disk watermark [512mb] exceeded on [iGAZJBXKQt6NcEwKIvwDdg][VISSOTI01][C:\Program Files\SOTI\MobiControl\Search\data\nodes\0] free: 509.3mb[1.2%], all indices on this node will be marked read-only
[2020-04-15T11:47:09,984][WARN ][o.e.c.r.a.DiskThresholdMonitor] [VISSOTI01] flood stage disk watermark [512mb] exceeded on [iGAZJBXKQt6NcEwKIvwDdg][VISSOTI01][C:\Program Files\SOTI\MobiControl\Search\data\nodes\0] free: 508.9mb[1.2%], all indices on this node will be marked read-only
[2020-04-15T11:47:39,993][INFO ][o.e.c.r.a.DiskThresholdMonitor] [VISSOTI01] low disk watermark [1gb] exceeded on [iGAZJBXKQt6NcEwKIvwDdg][VISSOTI01][C:\Program Files\SOTI\MobiControl\Search\data\nodes\0] free: 521.9mb[1.2%], replicas will not be assigned to this node
[2020-04-15T11:48:10,005][INFO ][o.e.c.r.a.DiskThresholdMonitor] [VISSOTI01] low disk watermark [1gb] exceeded on [iGAZJBXKQt6NcEwKIvwDdg][VISSOTI01][C:\Program Files\SOTI\MobiControl\Search\data\nodes\0] free: 521.5mb[1.2%], replicas will not be assigned to this node
[2020-04-15T11:48:40,017][INFO ][o.e.c.r.a.DiskThresholdMonitor] [VISSOTI01] low disk watermark [1gb] exceeded on [iGAZJBXKQt6NcEwKIvwDdg][VISSOTI01][C:\Program Files\SOTI\MobiControl\Search\data\nodes\0] free: 520.7mb[1.2%], replicas will not be assigned to this node
[2020-04-15T11:49:10,031][INFO ][o.e.c.r.a.DiskThresholdMonitor] [VISSOTI01] low disk watermark [1gb] exceeded on [iGAZJBXKQt6NcEwKIvwDdg][VISSOTI01][C:\Program Files\SOTI\MobiControl\Search\data\nodes\0] free: 530.4mb[1.3%], replicas will not be assigned to this node
[2020-04-15T11:49:40,048][INFO ][o.e.c.r.a.DiskThresholdMonitor] [VISSOTI01] low disk watermark [1gb] exceeded on [iGAZJBXKQt6NcEwKIvwDdg][VISSOTI01][C:\Program Files\SOTI\MobiControl\Search\data\nodes\0] free: 529.9mb[1.3%], replicas will not be assigned to this node
[2020-04-15T11:50:10,065][INFO ][o.e.c.r.a.DiskThresholdMonitor] [VISSOTI01] low disk watermark [1gb] exceeded on [iGAZJBXKQt6NcEwKIvwDdg][VISSOTI01][C:\Program Files\SOTI\MobiControl\Search\data\nodes\0] free: 545.8mb[1.3%], replicas will not be assigned to this node
[2020-04-15T11:50:40,094][INFO ][o.e.c.r.a.DiskThresholdMonitor] [VISSOTI01] rerouting shards: [one or more nodes has gone under the high or low watermark]
[2020-04-15T12:10:41,083][INFO ][o.e.c.r.a.DiskThresholdMonitor] [VISSOTI01] low disk watermark [1gb] exceeded on [iGAZJBXKQt6NcEwKIvwDdg][VISSOTI01][C:\Program Files\SOTI\MobiControl\Search\data\nodes\0] free: 964.7mb[2.3%], replicas will not be assigned to this node
[2020-04-15T12:11:11,087][INFO ][o.e.c.r.a.DiskThresholdMonitor] [VISSOTI01] low disk watermark [1gb] exceeded on [iGAZJBXKQt6NcEwKIvwDdg][VISSOTI01][C:\Program Files\SOTI\MobiControl\Search\data\nodes\0] free: 552.1mb[1.3%], replicas will not be assigned to this node
[2020-04-15T12:11:41,098][INFO ][o.e.c.r.a.DiskThresholdMonitor] [VISSOTI01] low disk watermark [1gb] exceeded on [iGAZJBXKQt6NcEwKIvwDdg][VISSOTI01][C:\Program Files\SOTI\MobiControl\Search\data\nodes\0] free: 551.9mb[1.3%], replicas will not be assigned to this node
[2020-04-15T12:12:11,108][INFO ][o.e.c.r.a.DiskThresholdMonitor] [VISSOTI01] low disk watermark [1gb] exceeded on [iGAZJBXKQt6NcEwKIvwDdg][VISSOTI01][C:\Program Files\SOTI\MobiControl\Search\data\nodes\0] free: 551.9mb[1.3%], replicas will not be assigned to this node
[2020-04-15T12:12:41,120][INFO ][o.e.c.r.a.DiskThresholdMonitor] [VISSOTI01] low disk watermark [1gb] exceeded on [iGAZJBXKQt6NcEwKIvwDdg][VISSOTI01][C:\Program Files\SOTI\MobiControl\Search\data\nodes\0] free: 561.8mb[1.3%], replicas will not be assigned to this node
[2020-04-15T12:13:11,127][INFO ][o.e.c.r.a.DiskThresholdMonitor] [VISSOTI01] low disk watermark [1gb] exceeded on [iGAZJBXKQt6NcEwKIvwDdg][VISSOTI01][C:\Program Files\SOTI\MobiControl\Search\data\nodes\0] free: 561.3mb[1.3%], replicas will not be assigned to this node
[2020-04-15T12:13:41,140][INFO ][o.e.c.r.a.DiskThresholdMonitor] [VISSOTI01] low disk watermark [1gb] exceeded on [iGAZJBXKQt6NcEwKIvwDdg][VISSOTI01][C:\Program Files\SOTI\MobiControl\Search\data\nodes\0] free: 559.9mb[1.3%], replicas will not be assigned to this node
[2020-04-15T12:14:11,153][INFO ][o.e.c.r.a.DiskThresholdMonitor] [VISSOTI01] low disk watermark [1gb] exceeded on [iGAZJBXKQt6NcEwKIvwDdg][VISSOTI01][C:\Program Files\SOTI\MobiControl\Search\data\nodes\0] free: 558.7mb[1.3%], replicas will not be assigned to this node
[2020-04-15T12:14:41,162][INFO ][o.e.c.r.a.DiskThresholdMonitor] [VISSOTI01] low disk watermark [1gb] exceeded on [iGAZJBXKQt6NcEwKIvwDdg][VISSOTI01][C:\Program Files\SOTI\MobiControl\Search\data\nodes\0] free: 558.6mb[1.3%], replicas will not be assigned to this node
[2020-04-15T12:15:11,167][INFO ][o.e.c.r.a.DiskThresholdMonitor] [VISSOTI01] low disk watermark [1gb] exceeded on [iGAZJBXKQt6NcEwKIvwDdg][VISSOTI01][C:\Program Files\SOTI\MobiControl\Search\data\nodes\0] free: 558.5mb[1.3%], replicas will not be assigned to this node
[2020-04-15T12:15:41,170][INFO ][o.e.c.r.a.DiskThresholdMonitor] [VISSOTI01] low disk watermark [1gb] exceeded on [iGAZJBXKQt6NcEwKIvwDdg][VISSOTI01][C:\Program Files\SOTI\MobiControl\Search\data\nodes\0] free: 558.6mb[1.3%], replicas will not be assigned to this node
[2020-04-15T12:16:11,174][INFO ][o.e.c.r.a.DiskThresholdMonitor] [VISSOTI01] low disk watermark [1gb] exceeded on [iGAZJBXKQt6NcEwKIvwDdg][VISSOTI01][C:\Program Files\SOTI\MobiControl\Search\data\nodes\0] free: 558.3mb[1.3%], replicas will not be assigned to this node
[2020-04-15T12:16:41,186][INFO ][o.e.c.r.a.DiskThresholdMonitor] [VISSOTI01] low disk watermark [1gb] exceeded on [iGAZJBXKQt6NcEwKIvwDdg][VISSOTI01][C:\Program Files\SOTI\MobiControl\Search\data\nodes\0] free: 558mb[1.3%], replicas will not be assigned to this node
[2020-04-15T12:17:11,195][INFO ][o.e.c.r.a.DiskThresholdMonitor] [VISSOTI01] low disk watermark [1gb] exceeded on [iGAZJBXKQt6NcEwKIvwDdg][VISSOTI01][C:\Program Files\SOTI\MobiControl\Search\data\nodes\0] free: 556.1mb[1.3%], replicas will not be assigned to this node
[2020-04-15T12:17:41,209][INFO ][o.e.c.r.a.DiskThresholdMonitor] [VISSOTI01] low disk watermark [1gb] exceeded on [iGAZJBXKQt6NcEwKIvwDdg][VISSOTI01][C:\Program Files\SOTI\MobiControl\Search\data\nodes\0] free: 564.6mb[1.4%], replicas will not be assigned to this node
[2020-04-15T12:18:11,223][INFO ][o.e.c.r.a.DiskThresholdMonitor] [VISSOTI01] low disk watermark [1gb] exceeded on [iGAZJBXKQt6NcEwKIvwDdg][VISSOTI01][C:\Program Files\SOTI\MobiControl\Search\data\nodes\0] free: 564.2mb[1.3%], replicas will not be assigned to this node
[2020-04-15T12:18:41,237][INFO ][o.e.c.r.a.DiskThresholdMonitor] [VISSOTI01] low disk watermark [1gb] exceeded on [iGAZJBXKQt6NcEwKIvwDdg][VISSOTI01][C:\Program Files\SOTI\MobiControl\Search\data\nodes\0] free: 563.7mb[1.3%], replicas will not be assigned to this node
[2020-04-15T12:19:11,251][INFO ][o.e.c.r.a.DiskThresholdMonitor] [VISSOTI01] low disk watermark [1gb] exceeded on [iGAZJBXKQt6NcEwKIvwDdg][VISSOTI01][C:\Program Files\SOTI\MobiControl\Search\data\nodes\0] free: 563.4mb[1.3%], replicas will not be assigned to this node
[2020-04-15T12:19:41,260][INFO ][o.e.c.r.a.DiskThresholdMonitor] [VISSOTI01] rerouting shards: [one or more nodes has gone under the high or low watermark]
[2020-04-15T13:44:59,546][INFO ][o.e.n.Node               ] [VISSOTI01] stopping ...
[2020-04-15T13:44:59,737][INFO ][o.e.n.Node               ] [VISSOTI01] stopped
[2020-04-15T13:44:59,737][INFO ][o.e.n.Node               ] [VISSOTI01] closing ...
[2020-04-15T13:44:59,759][INFO ][o.e.n.Node               ] [VISSOTI01] closed
[2020-04-15T13:45:38,090][INFO ][o.e.n.Node               ] [VISSOTI01] initializing ..."

In addition to that on several devices remote control and/or scripts aren't working anymore. The devices are online, but they are not shown with the possibility to use remote control.

If a log of one of the devices is necessary please let me know. I will post it then.

Thanks for your ideas,

Regards,

Benny

Edited 5 years ago
SOTI MobiControl
ANSWERS
JD
John Doe
5 years ago (edited 5 years ago)
Solution
D
DDMOD@SOTI
5 years ago

Hi Benjamin,

Thanks for the interesting post!

Can you please raise a support case(click here) or call SOTI Support team(+1 905.624.9828) as we need to troubleshoot further to get this working?

 

Regards,

BW
Benjamin, Wilts
5 years ago

Thanks,

I just opened a case.

SB
Simon Breuer
5 years ago (edited 5 years ago)

Maybe your disk is running out of free space? This is what I can see in your log.