Skip navigation
1 2 3 4 Previous Next 42334 Views 45 Replies Latest reply: Aug 24, 2010 1:09 PM by Adrian Bool RSS Go to original post
  • s_aldinger Rank: White Belt 9 posts since
    Aug 4, 2010
    Currently Being Moderated
    15. Aug 5, 2010 11:23 AM (in response to Ian McCracken)
    Re: Devices "missing in action"?

    Ok, I too did a full reinstall, but I have the same problem still. Slightly different numbers though, out of 19 devices only 4 remained visable, after  running

     

    zencatalog run --createcatalog --forceindex

    2010-08-05 07:53:19,322 INFO zen.Catalog: Reindexing your system. This may take some time.
    ................................................................................................................

     

    only 1 device is visable now.

     

    ummm I seem to have a discrepency, as zencatalog.log is nowhere to be found.

     

    # /usr/local/zenoss/
    common  ctlscript.sh  extras  licenses  mysql  python  scripts  zenconsole  zenoss

     

    #ls /usr/local/zenoss/zenoss/etc/
    hubpasswd  snmpd.conf       zenbackup.conf   zendisc.conf      zenjobs.conf     zenmodeler.conf  zenperfsnmp.conf  zenrender.conf  zentrap.conf        zenxevent.conf  zope.conf       zope.conf.in.prev
    my.cnf     sudoers          zencatalog.conf  zeneventlog.conf  zenmib.conf      zenoss.conf.in   zenping.conf      zenstatus.conf  zenwin.conf         zeo.conf        zope.conf.back
    site.zcml  zenactions.conf  zencommand.conf  zenhub.conf       zenmigrate.conf  zenpack.conf     zenprocess.conf   zensyslog.conf  zenwinmodeler.conf  zeo.zdsock      zope.conf.in

     

    # ls /usr/local/zenoss/zenoss/log/
    event.log   Z2.log          zencommand.log   zenhub.log   zenmigrate.log  zenperfsnmp.log  zenprocess.log  zensyslog.log  zenwin.log
    README.txt  zenactions.log  zeneventlog.log  zenjobs.log  zenmodeler.log  zenping.log      zenstatus.log   zentrap.log    zeo.log

     

    # mlocate zencatalog
    /usr/local/zenoss/zenoss/Products/ZenUtils/zencatalog.py
    /usr/local/zenoss/zenoss/bin/zencatalog
    /usr/local/zenoss/zenoss/etc/zencatalog.conf

  • Ian McCracken ZenossEmployee 257 posts since
    Feb 26, 2007
    Currently Being Moderated
    16. Aug 10, 2010 12:50 AM (in response to s_aldinger)
    Re: Devices "missing in action"?

    Okay, sorry, my fault... Run  zencatalog start --forceindex --createcatalog --logseverity 10  That'll create the log file and give debug output. Sounds like your indexing is being interrupted before it can complete.

  • s_aldinger Rank: White Belt 9 posts since
    Aug 4, 2010
    Currently Being Moderated
    17. Aug 10, 2010 2:40 AM (in response to Ian McCracken)
    Re: Devices "missing in action"?

    Well... that's a rather large log file.

    Hope you see something more interesting in it then I do.

    Attachments:
  • s_aldinger Rank: White Belt 9 posts since
    Aug 4, 2010
    Currently Being Moderated
    18. Aug 12, 2010 12:03 AM (in response to s_aldinger)
    Re: Devices "missing in action"?

    I tried updating to 3.0.1 ontop of the broken install. To no surprise, it still doesn't list any devices.

    However I did notice a note in the change log that there is a bug requiring 4GB of ram for zenoss to run... I didn't have that.

     

    I am going to clone this current install, remove, and reinstall with more ram... I don't expect much, but eh, why not try.

  • the_jack Rank: White Belt 28 posts since
    Jun 24, 2010
    Currently Being Moderated
    19. Aug 12, 2010 11:20 AM (in response to s_aldinger)
    Re: Devices "missing in action"?

    It would be great if someone from Zenoss would take a look at these posts.  There is obviously a bug in 3.0/3.0.1 or its installation that causes the Device classes and/or index thereof to be messed up.

     

    http://community.zenoss.org/thread/14179?tstart=0

    http://community.zenoss.org/thread/14075?tstart=0

    http://community.zenoss.org/thread/14043?tstart=0

     

    These posts represent users who have Devices and/or Devices Classes that are missing in the UI.  In most cases, the user shows "Device Classes (0)".  These Devices and Device Classes still exist and are being monitored and alerted, but are missing in navigation and as such cannot be managed.   According to zencatalog.log, these devices and classes are indexed and zencatalog "marks the database index complete".

     

    Your attention would be appreciated.  Given that there are 3 posts, I would assume this issue is actually affecting a larger number of users.

     

    Jack

  • Ian McCracken ZenossEmployee 257 posts since
    Feb 26, 2007
    Currently Being Moderated
    20. Aug 13, 2010 11:01 AM (in response to s_aldinger)
    Re: Devices "missing in action"?

    s_aldinger: No, the RAM thing isn't related to this. Sorry for the delay, I wasn't getting emails from the community site for some reason.

     

    I scanned your log file, and you're right, there's nothing interesting there. It is successfully indexing everything. Okay, so the problem is further up the chain somewhere.

     

    Let's try searching for devices, raw. Try:

     

    $ zendmd
    >>> from Products.Zuul.interfaces import ICatalogTool
    >>> results = ICatalogTool(dmd.Devices).search('Products.ZenModel.Device.Device')
    >>> results.total
    

     

    That should give you the total number of devices in your system. If that works, we've narrowed it to the DeviceFacade, the DeviceRouter, or javascript, and I have a patch for you that /might/ solve the problem.

     

    the_jack: Don't worry, we're on it. I've been looking at it for a while now, but it's difficult when one cannot reproduce it locally.

     

     

    --------------------------------------
    Ian McCracken
    Senior Software Developer
    Zenoss, Inc.
    O: 410.990.0274 x7018
  • s_aldinger Rank: White Belt 9 posts since
    Aug 4, 2010
    Currently Being Moderated
    21. Aug 13, 2010 11:21 AM (in response to Ian McCracken)
    Re: Devices "missing in action"?

    $ zendmd

    Welcome to the Zenoss dmd command shell!

    'dmd' is bound to the DataRoot. 'zhelp()' to get a list of commands.

    Use TAB-TAB to see a list of zendmd related commands.

    Tab completion also works for objects -- hit tab after an object name and

    '.'

    (eg dmd. + tab-key).

    >>> from Products.Zuul.interfaces import ICatalogTool

    >>> results =

    ICatalogTool(dmd.Devices).search('Products.ZenModel.Device.Device')

    >>> results.total

    0

  • the_jack Rank: White Belt 28 posts since
    Jun 24, 2010
    Currently Being Moderated
    22. Aug 13, 2010 11:24 AM (in response to Ian McCracken)
    Re: Devices "missing in action"?

    On my system that query also returns 0.  I would assume this means something to you, because there are definately devices in the system.

  • s_aldinger Rank: White Belt 9 posts since
    Aug 4, 2010
    Currently Being Moderated
    23. Aug 13, 2010 12:14 PM (in response to Ian McCracken)
    Re: Devices "missing in action"?

    I've got this instance running on a VM. If it would expedite things, I can

    snapshot it and throw it onto my FTP site so that you can grab a personal

    copy to play with at you leisure.

  • Ian McCracken ZenossEmployee 257 posts since
    Feb 26, 2007
    Currently Being Moderated
    24. Aug 13, 2010 5:48 PM (in response to s_aldinger)
    Re: Devices "missing in action"?

    Yeah, any ssh access or vm snapshots or anything would be great, as I'm totally unable to reproduce this here. Basically, things are /not/ being indexed, despite zencatalog successfully running through them (or they're being indexed and then something is, for whatever reason, unindexing them).

     

    --------------------------------------
    Ian McCracken
    Senior Software Developer
    Zenoss, Inc.
    O: 410.990.0274 x7018
  • the_jack Rank: White Belt 28 posts since
    Jun 24, 2010
    Currently Being Moderated
    25. Aug 16, 2010 11:57 AM (in response to Ian McCracken)
    Re: Devices "missing in action"?

    Ian,  I have sent you a PM with SSH information.

     

    Jack

  • Adrian Bool Rank: White Belt 11 posts since
    Apr 1, 2010
    Currently Being Moderated
    26. Aug 16, 2010 12:06 PM (in response to Ian McCracken)
    Re: Devices "missing in action"?

    I too seem to be missing devices.  This was a Zenoss 2.5 install; upgraded to 3.0 and then 3.01.

     

    There is one device from before the upgrade that seems to be missing.

     

    New devices that I try to add seem not to be appearing either - despite log manager saying that they were imported fine.

     

    From your previous post,

    >>> results = ICatalogTool(dmd.Devices).search('Products.ZenModel.Device.Device')
    >>> results.total
    13

     

    This number corresponds to the number of devices I can see; and is about 4 or 5 lower than what I expect.

     

    I went into the Zope DMD interface and navigated to,

     

    /zport/dmd/Devices/Network/Switch/Cisco/devices

     

    Interestingly, I can see my missing switches here.  I've had a wander round the hierarchy of a 'good' and a 'bad' device to try and see if there is some difference, but the only differences I can see are those that I would expect.

     

    Sorry, I don't know much about the internals of Zenoss to know how your Device ZenModel maps through to a Zend Device object...  It seems wherever this interface is; is likely the source of the problem.

  • Adrian Bool Rank: White Belt 11 posts since
    Apr 1, 2010
    Currently Being Moderated
    27. Aug 16, 2010 12:46 PM (in response to Adrian Bool)
    Re: Devices "missing in action"?

    Woops!  As per the start of this thread I ran,

     

    zencatalog start --forceindex --createcatalog --logseverity 10

     

    ... in the hope that this may find my missing switches.  How wrong could be - all but one switch missing now!

     

    mmm.

  • s_aldinger Rank: White Belt 9 posts since
    Aug 4, 2010
    Currently Being Moderated
    28. Aug 16, 2010 12:54 PM (in response to Adrian Bool)
    Re: Devices "missing in action"?

    huh, ya... you didn't want to do that

  • Adrian Bool Rank: White Belt 11 posts since
    Apr 1, 2010
    Currently Being Moderated
    29. Aug 16, 2010 2:55 PM (in response to s_aldinger)
    Re: Devices "missing in action"?

    It seems not ;-)  ...but at least others reading this thread can learn from my mistake...

More Like This

  • Retrieving data ...

Legend

  • Correct Answers - 4 points
  • Helpful Answers - 2 points