Home

Cisco WebEx Social Troubleshooting Guide, Release 3.0

1. some body here lt d textdescription gt e alldayevent xmlns e urn schemas calendar xmlns b urn uuid c2f41010 65b3 11d1 a29f 00aa00c14882 b dt boolean gt 0 lt e alldayevent gt e reminderoffset xmlns e urn schemas calendar xmlns b urn uuid c2f41010 65b3 11d1 a29f 00aa00c14882 b dt int gt 900 lt e reminderoffset gt e dtstart xmlns e urn schemas calendar xmlns b urn uuid c2f41010 65b3 11d1 a29f 00aa00c14882 b dt dateTime tz gt 2012 03 28T10 00 00 000Z lt e dtstart gt Cisco WebEx Social Troubleshooting Guide Release 3 0 01 27146 02 EX Chapter4 Logs Understanding Logs Step 8 Step 9 e dtend xmlns e urn schemas calendar xmlns b urn uuid c2f41010 65b3 11d1 a29f 00aa00c14882 b dt dateTime tz gt 2012 03 28T11 00 00 000Z lt e dtend gt lt e created xmlns e urn schemas calendar xmlns b urn uuid c2 41010 65b3 11d1 a29f 00aa00c14882 b dt dateTime tz gt 2012 03 08T10 49 58 000Z lt e created gt lt e recurrenceid xmlns e urn schemas calendar xmlns b urn uuid c2 41010 65b3 11d1 a29f 00aa00c14882 b dt dateTime tz gt 2012 03 11T10 00 00 000Z lt e recurrenceid gt lt e lastmodified xmlns e urn schemas calendar xmlns b urn uuid c2 41010 65b3 11d1 a29f 00aa00c14882 b dt dateTime tz gt 2012 04 10T14 29 08 000Z lt e lastmodified gt lt a prop gt lt a propstat gt lt a propstat gt lt a status gt HTTP 1 1 404 Resource Not Found lt a st
2. Polling Scheduler messages messages_ready messages_ackno wledged node Server fd_total Message Queue fd_used mem_limit mem_used proc_total proc_used sockets_total sockets_used uptime ActiveMQ TotalEnqueueCount Message Queue Broker TotalDequeueCount TotalConsumerCount TotalMessageCount MemoryLimit MemoryPercentUsage StoreLimit StorePercentUsage ActiveMQ QueueSize Message Queue Queue EnqueueCount DequeueCount ConsumerCount DispatchCount ExpiredCount InFlightCount CursorMemoryUsage CursorPercentUsage MemoryLimit Monitored Health Metrics This section summarizes the resources that are monitored by monit to ensure good health of the system Monit automatically takes corrective action if a process stops or becomes unresponsive A syslog message is generated on alert and when corrective action is taken Monit checks are only done on Enabled applications This data can be accessed in several ways OL 27146 02 Cisco WebEx Social Troubleshooting Guide Release 3 0 Performance and Health Monitoring From the Director UI System Health Through the WebEx Social API Table 3 2 Monitored Health Metrics Monitored Health Metrics CheckName Filename Type Checks Action Role jms message queue Process pid Restart Message Queue process activemq cpu gt
3. CISCO Cisco WebEx Social Troubleshooting Guide Release 3 0 Revised August 24 2012 Americas Headquarters Cisco Systems Inc 170 West Tasman Drive San Jose CA 95134 1706 USA http www cisco com Tel 408 526 4000 800 553 NETS 6387 Fax 408 527 0883 Text Part Number OL 27146 02 THE SPECIFICATIONS AND INFORMATION REGARDING THE PRODUCTS IN THIS MANUAL ARE SUBJECT TO CHANGE WITHOUT NOTICE ALL STATEMENTS INFORMATION AND RECOMMENDATIONS IN THIS MANUAL ARE BELIEVED TO BE ACCURATE BUT ARE PRESENTED WITHOUT WARRANTY OF ANY KIND EXPRESS OR IMPLIED USERS MUST TAKE FULL RESPONSIBILITY FOR THEIR APPLICATION OF ANY PRODUCTS THE SOFTWARE LICENSE AND LIMITED WARRANTY FOR THE ACCOMPANYING PRODUCT ARE SET FORTH IN THE INFORMATION PACKET THAT SHIPPED WITH THE PRODUCT AND ARE INCORPORATED HEREIN BY THIS REFERENCE IF YOU ARE UNABLE TO LOCATE THE SOFTWARE LICENSE OR LIMITED WARRANTY CONTACT YOUR CISCO REPRESENTATIVE FOR A COPY The following information is for FCC compliance of Class A devices This equipment has been tested and found to comply with the limits for a Class A digital device pursuant to part 15 of the FCC rules These limits are designed to provide reasonable protection against harmful interference when the equipment is operated in a commercial environment This equipment generates uses and can radiate radio frequency energy and if not installed and used in accordance with the instruction manual may cause harmful int
4. GMT 2012 Sat May 05 20 59 59 getCachedListEvents AggCalCacheUtil Mail Chain 10195 14610005 Sat Mar 31 21 00 00 GMT 2012 Sat May 05 20 59 59 Cisco WebEx Social Troubleshooting Guide Release 3 0 OL 27146 02 Chapter4 Logs Understanding Logs Getting a Month Worth of Meetings with Configured WebDAV No Cached Data Step 1 Step 2 Step 3 Step 4 Step 5 When you click on the arrow to go to the next month in the Calendar application assuming this that is the first time you request the data that is there is no data in the cache the application goes through the following steps logging the respective messages Display the Exchange settings that are used to connect to Exchange DEBUG 13 52 37 382 AGGREGATED_CALENDAR 65 Using Exchange Calendar settings for user r2 Username vm2007 Password URL https 198 51 100 35 exchange vm2007 Domain Try to get the events for Exchange from the cache without success INFO 13 52 37 385 AGGREGATED_CALENDAR 78 getCachedListEvents AggCalCacheUtil Cache miss for Mail Chain 10195 1410026 Sun Mar 25 21 00 00 GMT 2012 Sun May 06 20 59 59 GMT 2012 we got 0 meetings Execute a WebDAV query to log into WebDAV DEBUG 13 52 37 421 AGGREGATED_CALENDAR 65 Search Query lt xml version 1 0 gt lt d searchrequest xmlns d DAV d sql SELECT urn schemas httpmail subject urn sche
5. keepalive logging open reading sending starting waiting App Server amp Worker Cisco WebEx Social Troubleshooting Guide Release 3 0 OL 27146 02 Chapter3 Performance and Health Monitoring Table 3 1 Collected Performance Data Collected Performance Data continued Type Instance Matrix Description State StateManager HTTP activemq code App Server amp Manager Response Code Worker cache code digest code graph code index code json code notifier code quad code quad analytics code rabbitmq code rdbms code recommendatio n code search code Processes fork fork rate Number of new process forked per second ps state blocked Count of processes in Blocked state If consistently high alert condition need attention paging Count of processes in Paging state If consistently high or growing alert condition need attention running Count of processes in running state Typically less or equal to num of cores sleeping Count of processes in sleeping state Typically most processes are in this state stopped Count of processes in Stopped state zombies Count of processes in Zombies state If consistently high or growing alert condition need attention TCP Port 80 App Server close wait App Server Connection Worker Port 80 Worker oF x
6. Collected Performance Data continued Collected Performance Data Type Instance Matrix Description MongoDB cache misses Analytics Store JSON Store connections page fault lock ratio96 flushes flushes flushes avg ms memory mapped resident virtual network bytesin bytesout oplogs difftimesec storagesizemb usedsizemb replication health optimelagsec state total operations command delete getmore insert query update MongoDB databases quad recommendation collections indexes num extents object count data file size index file size storage file size Tomcat activeSessions expiredSessions processExpiresF requency processingTime rejectedSessions sessionAverage AliveTimes sessionCounter sessionCreateRa te sessionExpireRa te App Server Worker 01 27146 02 Cisco WebEx Social Troubleshooting Guide Release 3 0 H Chapter 3 Performance and Health Monitoring Hs Monitored Health Metrics Table 3 1 Collected Performance Data continued Type Instance Matrix Description Role RabbitMQ Queue Activity consumers Message Queue Analytics EMailDigest Migrate
7. ERROR for normal operation DEBUG to get more information To log events such as sending or receiving to from Message Queue also set the QUAD EVENT category to DEBUG When viewing logs look for the AGGREGATED CALENDAR log key Be sure to restart the Worker nodes for the log level to go into effect on that role Analytics log messages can appear in appserver log worker log or analyticsmrscheduler log My Library FAQs and Troubleshooting My Library Troubleshooting page 1 15 Cisco WebEx Social Troubleshooting Guide Release 3 0 EM OL 27146 02 Chapter FAQs and Troubleshooting Framework FAQs and Troubleshooting My Library Troubleshooting This section provides the following troubleshooting information Symptom The My Library page does not seem to be responding to user actions dialogs are not opening up the Delete button does nothing and so on Symptom The My Library page does not seem to be responding to user actions dialogs are not opening up the Delete button does nothing and so on Possible Cause Javascript error has occurred on the page Possible Javascript errors include File not found loaded This type of error is displayed in red color and contains the missing file name Inline Javascript failure This error occurs if Javascript code inside a jsp file has failed and any processing of the rest of the code in the jsp file has been halted Example follows SLAB wait er
8. 15 20 40 35 quad web a monit 19684 monit HTTP server stopped Mar 15 20 40 35 quad web a monit 19684 monit daemon with pid 19684 killed Mar 15 20 40 35 quad web a monit 19684 system quad web a example com Monit stopped Mar 15 20 40 35 quad web a monit 27469 Starting monit daemon with http interface at 2812 Mar 15 20 40 35 quad web a monit 27469 Monit start delay set pause for 120s Mar 15 20 42 35 quad web a monit 27472 Starting monit HTTP server at 2812 Mar 15 20 42 35 quad web a monit 27472 monit HTTP server started Mar 15 20 42 35 quad web a monit 27472 system quad web a example com Monit started Monit Check Failed These log entries are generated when collectd and httpd are not running and are failing to start Mar 15 21 05 27 quad web b monit 16949 collectd process is not running Mar 15 21 05 27 quad web b monit 16949 collectd trying to restart Mar 15 21 05 27 quad web b monit 16949 collectd start etc init d collectd Mar 15 20 17 27 quad web a monit 19684 httpd process is not running Mar 15 20 17 27 quad web a monit 19684 httpd trying to restart Mar 15 20 17 27 quad web a monit 19684 httpd start etc init d httpd Mar 15 20 17 57 quad web a monit 19684 httpd failed to start Manually Restarting Monit These log entries are generated when a service is restarted manually in which case monit detects the PID change and logs it May 22 18 02 13 qua
9. Ecc MapReduce Jobs completed Exiting Program To see if all mapreduce jobs completed successfully run cat worker host name analyticsmrscheduler log grep exitValue The command should return something similar to Apr 26 00 00 08 ecp 10 194 190 32 example com analyticsmrscheduler INFO ANALYTICS MR SCHEDULER pool 32 thread 2 Process cmd user library usage exitValue 0 Cisco WebEx Social Troubleshooting Guide Release 3 0 01 27146 02 EN Chapter4 Logs Understanding Logs An exitValue 0 signifies that the command has executed successfully If any command has exitValue not equal to 0 there is likely some issue executing the mapreduce jobs e If you see messages similar to login failed check for the following Execute usr bin mongo u username p password analytics store host portldbName lopt cisco scheduler analytics mapreduce user library usage js Verify that username analytics store host port and dbName match the respective properties set in portal ext properties If they match ensure that the credentials are valid for the quadanalytics database on the Analytics Store If the credentials look good but the login still fails there might be no primary Analytics Store node on the cluster all available nodes might be in secondary mode Check if that is the case by running db isMaster inside the mongo console on each Analytics Store node If you
10. Files Stored on the Director continued Log filename RDBMS Store 5 oracle quad log xml 5 oracle alert quad log 5 oracle rdfprod log xml 5 oracle alert rdfprod log 5 oracle sglnet log Common logs all roles 5 secure 5 mail log 5 cron HOSTNAME _spooler HOSTNAME _boot log HOSTNAME _collectd log HOSTNAME _monit log HOSTNAME _puppet log HOSTNAME _messages HOSTNAME _nagios log HOSTNAME _faillog HOSTNAME _lastlog HOSTNAME _snmpd log HOSTNAME _yum log HOSTNAME _tallylog HOSTNAME _vmware_tools_guestd HOSTNAME _wtmp HOSTNAME _audit_local_log 5 mail statistics HOSTNAME _pm suspend log HOSTNAME _prelink log HOSTNAME _mod jk log HOSTNAME _rewrite log HOSTNAME _ssl_access_log HOSTNAME _ssl_request_log HOSTNAME _ssl_error_log HOSTNAME _install log HOSTNAME _install log syslog HOSTNAME _salt_minion log Localy stored Log Files by Role This sections lists the log files that some roles store localy Cisco WebEx Social Troubleshooting Guide Release 3 0 OL 27146 02 Chapter4 Logs Understanding Logs Table 4 2 Localy stored Log Files Role Log filename Message Queue opt cisco rabbitmq log rabbit lt hostname gt log lopt cisco rabbitmg log rabbit lt hostname gt sasl log RDBMS Sto
11. NonHeapMemo ryUsage init NonHeapMemo ryUsage max NonHeapMemo ryUsage used Search Store Index Store Message Queue App Server Worker Java fd OpenFileDescri ptorCount Search Store Index Store 01 27146 02 Cisco WebEx Social Troubleshooting Guide Release 3 0 H Chapter3 Performance and Health Monitoring Collected Performance Data Table 3 1 Collected Performance Data continued Type Instance Matrix Description Role Non Java ps count processes Total number of processes including child forked for particular Analytics Store Application program JSON Store processes threads Total number of threads created for particular program RabbitMQ ps code Analytics Store JSON Store Cache ps data Analytics Store JSON Store Cache ps rss Analytics Store JSON Store Cache ps stacksize Analytics Store JSON Store Cache ps vm Analytics Store JSON Store Cache ps cputime syst Analytics Store JSON Store ASEL Cache ps_disk_octets read Analytics Store JSON Store write Cache ps disk ops read Analytics Store JSON Store write Cache ps pagefaults majfit Analytics Store JSON Store minfit Cache Cisco WebEx Social Troubleshooting Guide Release 3 0 Em OL 27146 02 Chapter3 Performance and Health Monitoring Table 3 1
12. OK Total 1 services are monitored The text highlighted in red shows that There have been four successive failures which causes Nagios to generate an email alert The email address that the alert was sent to test Gexample com The text that was sent in the email the rest of the message The very last line shows The service recovering indicated by the OK Total 1 services are monitored The email address that the alert was sent to test example com informing the service has gone back online Rsyslog Starts Up Shuts Down These log entries are generated during normal rsyslog startup shutdown May 31 01 22 16 quad web a kernel Kernel logging proc stopped May 31 01 22 16 quad web a rsyslogd origin software rsyslogd swVersion 5 8 6 x pid 1612 x info http www rsyslog com exiting on signal 15 May 31 01 22 17 quad web a kernel imklog 5 8 6 log source proc kmsg started May 31 01 22 17 quad web a rsyslogd origin software rsyslogd swVersion 5 8 6 x pid 28666 x info http www rsyslog com start Cisco WebEx Social Troubleshooting Guide Release 3 0 Em OL 27146 02 Chapter4 1005 Understanding Logs Rsyslog is Rate Limited These log entries are generated when rsyslog has reached the default maximum of 200 input log messages per 5 seconds Any excess messages are dropped for the process May 25 23 37 36 quad web a rsyslogd 2177 imuxsoc
13. pid Restart Director process_saltmaster tcp on port 4506 for 1 poll Syslog Err Msg cpu gt 98 for 5 pol Syslog Err Msg saltminion Process pid Restart All process_saltminion cpu gt 98 for 5 pol Syslog Err Msg search Process pid Restart Search Store process_searchstore cpu gt 98 for 5 pol Syslog Err Msg sshd Process pid Restart All process_sshd Built in monit protocol check for Syslog Err Msg ssh on port 22 for 1 poll cpu gt 25 for 5 pol Syslog Err Msg worker Process pid Restart Worker process worker cpu gt 98 for 5 pol Syslog Err Msg oracle Program script script return value for 10 polls Restart RDBMS Store program_oracle Graph Store integrity Program script script return value Syslog Err Msg All program_integrity Disk usage check opt gt 85 Nagios Warning All opt gt 95 Nagios Alert boot gt 99 Nagios Alert root gt 99 Nagios Alert Pem Eum Arbiter check available only where there are multiple Json Analytics VMs Arbiter check available only where there are multiple Json Analytics VMs Postfix service monitored only when maildomain external host and external SMTP port are provisioned The check is done using etc init d dbora status Restarting is done using etc init d dbora start Only services that are not running Enterprise Manager Database etc are started Checks are not made during database installation 5 The disk utilization check uses perfo
14. response gt lt a href gt https 198 51 100 35 exchange vm2007 Calendar Have 20fun EML lt a href gt lt a propstat gt lt a status gt HTTP 1 1 200 OK lt a status gt lt a prop gt lt d to gt vm2010 amp 1t vm2010 ex7aquila com amp gt vm2007 amp 1t vm2007 ex7aquila com amp gt lt d to gt lt d cc gt amp lt vm2003 ex3aquila com amp gt lt d cc gt d from vm2010 amp 1t vm2010 ex7aquila com amp gt lt d from gt lt e organizer gt vm2010 amp 1lt vm2010 ex7aquila com amp gt lt e organizer gt lt a prop gt lt a propstat gt lt a response gt lt a multistatus gt Dump all returned events DEBUG 13 52 37 521 AGGREGATED_CALENDAR 65 Event Object eventId 040000008200E00074C5B7101A82E008000000006C327C3319FDCC010000000000000000100000003A D41318CFA170488967581FBBC63202 2012 03 11T10 00 00 000Z subject Have fun location some location Cisco WebEx Social Troubleshooting Guide Release 3 0 EN OL 27146 02 Chapter4 Logs Understanding Logs organizer email vm2010 ex7aquila com screenName fullName vm2010 attendees email vm2007 ex7aquila com screenName fullName vm2007 email vm2003 ex3aquila com screenName fullName nonSendableTo required null resource null htmlDescription null hasattachment false importance null allDayEvent false reminderOffset 900 href https 198 51 100 35 exchange vm2007 Calendar Have 20fun 5 EML busyStat
15. significantly affects the performance of the system e QUAD EVENTING If you still need further information because activity creation depends on rabbitmq events Note that turning this category to DEBUG will log every event that is occurring in WebEx Social UC Integrations FAQs and Troubleshooting UC Integrations Troubleshooting page 1 16 UC Integrations Troubleshooting This section provides the following troubleshooting information Symptom These errors appear when the user tries to switch the Cisco Call Plug in from computer audio to desktop phone mode cwic eUnknownFailure cwic Login Error and cwic unregisterPhone Symptom These errors appear when the user tries to switch the Cisco Call Plug in from computer audio to desktop phone mode cwic eUnknownFailure cwic Login Error and cwic unregisterPhone Possible Cause The list of Unified Communications Manager UCM servers contains an IP address that does not correspond to a UCM server Recommended Action Sign in to Cisco WebEx Social as Administrator go to Account Settings gt Server gt Common Configurations gt WebDialer find the offending entry in the list of Registered UCM Clusters and correct or remove it Use the Cisco Call Plug in log on the user computer to identify the offending UCM entry Cisco WebEx Social Troubleshooting Guide Release 3 0 01 27146 02 CHAPTER General Procedures This chapter provides verification procedu
16. the message format used in the security and auditing log The basic security event logging format is shown below Some of the fields may be empty if they are not applicable to that event Date time Date and time the message was logged Host Originating host Process Name quad Log Level Is always INFO Category What type of security event this is See Q What message categories are defined in the security and auditing log Thread Name What thread within Tomcat did the event originate in Principal User account this message pertains to Source Where the message comes from for example the IP address of the system performing the action Component What area is affected Action What type of action is taking place on the resource Resource What is being affected for example Post Message Boards Status Success or Failure Reason Additional information 01 27146 02 Cisco WebEx Social Troubleshooting Guide Release 3 0 H Chapter1 FAQs and Troubleshooting Director FAQs and Troubleshooting Po I see a particular log for one day but not another Why 15 this Logs does not show up unless that log was written to I want to check a log file for a past date but the directory for that date seems to have disappeared To prevent the disk space from filling up the oldest log directories are deleted when the opt partition on the Director exceeds 85 disk usage Director FAQs and Trouble
17. waits for that interval before it runs again Depending on a number of related factors some users may be skipped when creating digests Recommended Action Wait for worker digestscheduler mainJobRepeatInterval to run out 30 min if left at its default then the digests should start arriving on schedule Possible Cause The user has requested a daily digest and you have set worker digestscheduler mainJobRepeatInterval to a large value that makes the next run of the Digest Scheduler to fall into the next day Recommended Action When you are setting the worker digestscheduler mainJobRepeatInterval parameter take the Daily Digest Notification Time value Director gt Application gt Portal gt Email Digest in consideration Set worker digestscheduler mainJobRepeatInterval to a value that allows the Digest Scheduler to run at least once in the time frame between Daily Digest Notification Time and the end of the day For example if you have set Daily Digest Notification Time to 23 00 11 pm that leaves the Digest Scheduler only 1 hour to start and complete its run ensure this by setting worker digestscheduler mainJobRepeatInterval to less than an hour Possible Cause The user has recently changed their time zone If the new time zone has already been notified the affected user does not receive their daily report Recommended Action Keeping the time zone setting should allow the user to receive future daily reports on schedule
18. 07 AGGREGATED CALENDAR 78 getCachedEvent AggCalCacheUtil Cache miss for C5FA8FA61382B436C22579DE003AE145 1335456000000 1335459600000 10195 14610005 Initiate a call to the Domino server INFO 14 37 44 507 AGGREGATED CALENDAR 78 Get events with ID C5FA48FA61382B436C22579DE003AE145 1335456000000 1335459600000 INFO 14 37 44 512 AGGREGATED CALENDAR 78 Domino session was successfully created for user vmdomino domino Log a message just before the Domino call is initiated DEBUG 14 37 44 527 AGGREGATED CALENDAR 65 Get meeting details for event C5F48FA61382B436C22579DE003AE145 1335456000000 1335459600000 Parse each Domino meeting attendees by common name CN DEBUG 14 37 44 534 AGGREGATED CALENDAR 65 Search user document for common name CN vmdomino domino DEBUG 14 37 44 544 AGGREGATED CALENDAR 65 Search user document for common name CN no mail Cisco WebEx Social Troubleshooting Guide Release 3 0 Ex OL 27146 02 Chapter4 1005 Understanding Logs Ml Step7 Cache the event after it has been successfully retrieved DEBUG 14 37 44 557 AGGREGATED_CALENDAR 65 1 cacheMeeting AggCalCacheUtil Meeting cached for C5F48FA61382B436C22579DE003AE145 1335456000000 1335459600000 10195 14610005 Framework Logs This section is organized as follows Incorrect Theme ID page 4 19 I
19. 12 Sat May 05 20 59 59 GMT 2012 1333375200000 1333378800000 101 cacheMeeting 1334066400000 1334070000000 101 cacheMeeting 1334133900000 1334134800000 101 cacheMeeting 1334140200000 1334143800000 101 cacheMeeting 1334483100000 1334484000000 101 Step 12 Cache asynchronously the list of received WebEx events 20 DEBUG 14 37 44 377 AGGREGATED CALENDAR 65 cacheMeeting 95 1 95 95 1 95 1 1461 AggCalCache 1461 AggCalCache 1461 AggCalCache 1461 AggCalCache 95 1 46 10005 AggCalCache 10005 10005 10005 10005 til til til til til cacheListEvents AggCalCacheUtil meetings cached for WebEx Chain 10195 14610005 Sat Mar 31 21 00 00 GMT 2012 Sat May 05 20 59 59 GMT 2012 Getting a Month Worth of Meetings with Configured Domino and WebEx Cached Data When you click on the arrow to go to the next month in the Calendar application assuming that this is not the first time you request the data that is there is data in the cache the application logs the following messages INFO Cache hit for WebEx Chain 10195 14 GMT 2012 we got 20 meetings INFO Cache hit for 12 50 05 479 AGGREGATED CALENDAR 78 12 50 05 479 AGGREGATED CALENDAR 78 GMT 2012 we got 26 meetings 610005 Sat Mar 31 21 00 00 getCachedListEvents AggCalCacheUtil
20. 2 The logs on the Director can be accessed through the Director GUI see the Cisco WebEx Social Administration Guide for details or through the Cisco WebEx Social API Log Files Stored on the Director by Role This sections lists the log files that each role sends to the Director Cisco WebEx Social Troubleshooting Guide Release 3 0 01 27146 02 EN Chapter4 Logs LogFiles Stored the Director by Role Table 4 1 Log Files Stored on the Director Role Log filename Director 5 director web log 5 catalina log HOSTNAME _localhost log HOSTNAME _manager log HOSTNAME _host_manager log HOSTNAME _deploy_db log HOSTNAME _graphite_access log HOSTNAME _graphite_exception log HOSTNAME _graphite_info log HOSTNAME _graphite_error log HOSTNAME _carbon_console log HOSTNAME _salt_master log HOSTNAME _mongod log HOSTNAME _jsonstore log HOSTNAME _analyticsstore log App Server HOSTNAME _appserver log HOSTNAME _analyticsmrscheduler log HOSTNAME _catalina log HOSTNAME _localhost log HOSTNAME _tomcat access log HOSTNAME _manager log HOSTNAME _host_manager log HOSTNAME _httpd_access log HOSTNAME _httpd_error log HOSTNAME _cmanager log HOSTNAME _cmanager_debug log HOSTNAME _cmanager_info log HOSTNAME _cmanager_warn log HOSTNAME _cmanager_error log HOSTNAME _deploy_db log HOSTNAME _audit log Worker HOSTNAME _worker log HOSTNAME _cata
21. 25 18 36 42 ecp 10 194 189 67 example com quad DEBUG socialActivities 4 S 2 4 TP Processor4 PostActivityHandler handleSynchProcess for POST CREATE classNameId 10060 classPK 2500002 Time 7msecs End Apr 25 18 36 42 ecp 10 194 189 67 example com quad DEBUG socialActivities TP Processor4 handleSync for POST CREATE classNameId 10060 classPK 2500002 Time 7msecs End e If DEBUG has been enabled for the QUAD EVENTING log category Apr 25 18 36 42 ecp 10 194 189 67 example com quad DEBUG QUAD EVENTING TP Processor44 Sending event POST CREATE Cisco WebEx Social Troubleshooting Guide Release 3 0 01 27146 02 Chapter4 Logs Understanding Logs Apr 25 18 36 42 ecp 10 194 189 67 example com quad DEBUG QUAD_EVENTING TP Processor44 Event content for event POST_CREATE addedRecipients class com cisco ecp vdl post model impl PostRecipientImpl id 110112 permission allPermissions null authorize true authorized true class com cisco ecp vdl post model impl PostPermissionImp1 comment true commentable true edit true editable true share true shared true view true 1 recipientType USER attachmentInfo attachments class com cisco ecp vdl attachment PostAttachmentInfoImpl postVersion 1 tnailURLs totalNum
22. 7581FBBC63202 e uid e instancetype xmlns e urn schemas calendar xmlns b urn uuid c2f41010 65b3 11d1 a29f 00aa00c14882 b dt int gt 3 lt e instancetype gt d htmldescription xmlns d urn schemas httpmail amp lt DOCTYPE HTML PUBLIC W3C DTD HTML 3 2 EN amp gt amp lt HTML amp gt amp lt HEAD amp gt amp lt HTTP EQUIV Content Type CONTENT text html charset utf 8 amp gt amp l ETA NAME Generator CONTENT MS Exchange Server version 08 03 0083 000 amp gt amp l TLE amp gt Have fun amp lt TITLE amp gt amp lt HEAD amp gt amp lt BODY amp gt amp lt Converted from text plain format amp gt amp lt P amp gt amp lt FONT SIZE 2 amp gt When Wednesday March 28 2012 3 00 AM 4 00 AM GMT 08 00 Pacific Time US amp amp amp Canada amp lt BR amp gt Where some location amp lt BR amp gt amp lt BR amp gt xk amp lt BR amp gt amp lt BR amp gt amp amp nbsp some body here amp lt BR amp gt amp lt FONT amp gt amp lt P amp gt amp lt BODY amp gt amp lt HTML amp gt d htmldescription d hasattachment xmlns d urn schemas httpmail xmlns b urn uuid c2f41010 65b3 11d1 a29f 00aa00c14882 b dt boolean gt 0 lt d hasattachment gt lt e busystatus xmlns e urn schemas calendar gt TENTATIVE lt e busystatus gt d textdescription xmlns d urn schemas httpmail gt When Wednesday March 28 2012 3 00 AM 4 00 AM GMT 08 00 Pacific Time US amp amp Canada Where some location
23. 98 for 5 poll Syslog Err Msg analyticsstore Process pid Restart Analytic Store process analyticsstore tcp on port 27001 for 1 poll Syslog Err Msg analyticsstore Process pid Restart Director process analyticsstore tcp on port 27001 for 1 poll Syslog Err Msg cpu gt 98 for 5 poll Syslog Err Msg cache Process pid Restart Cache process cache Built in monit protocol check for Syslog Err Msg memcache on port 11211 for 1 poll cpu gt 98 for 5 po Syslog Err Msg carbon Process pid Restart Director process carbon cpu gt 25 for 5 po Syslog Err Msg cmanager Process pid Restart WebEx Social process cmanager cpu gt 98 for 5 po Syslog Err Msg collectd Process pid Restart process collectd cpu gt 25 for 5 po Syslog Err Msg director web Process pid Restart Director process cps cpu gt 98 for 5 po Syslog Err Msg Disk Space opt gt 85 for 5 poll Purge opt logs Except today s log cron Process pid Restart All process_cron httpd Process pid Restart Director WebEx process_httpd Social Worker indexstore Process pid Restart Index Store process_indexstore cpu gt 98 for 5 poll Syslog Err Msg jsonstore Process pid Restart JSON Store process_jsonstore tcp on port 27000 for 1 poll Syslog Err Msg cpu gt 98 for 5 poll Syslog Err Msg jsonstore Process pid Restart Director vendre process Jsonstore tcp on port 27000 for 1 poll Syslog Err Msg cpu gt 98 for 5 po Syslog Err Msg nagios Process pid Restart Director process nagi
24. Attachm ents 0 class com cisco ecp vdl event model impl post PostCreateEvent classNameIl d 10060 classPK 2500002 clientIp Apr 25 18 36 42 ecp 10 194 189 67 example com 0 companyId 10193 content hello sucharitha eventCreatorFirstName shanthi eventCreatorMedium1PortraitId 110561 eventCreatorMedium2PortraitId 110562 eventCreatorMedium3PortraitId 3610011 eventCr eatorName shanthi n eventCreatorScreenName shanthi eventCreatorSmallPortraitId 110560 eventCreat orUserId 110112 eventCreatorUtil null eventTime 1335379001899 eventType POST C REATE excludes addedRecipients recipient extraAttributes null includes null mentionedUsers ownerName shanthi n ownerScreenName shanthi ownerUserId 110112 postType MICRO POST publicSco pe true quadServerIp 0 question false quickComment tags title hello sucharitha version 1 01 27146 02 Cisco WebEx Social Troubleshooting Guide Release 3 0 Chapter4 Logs Understanding Logs Cisco WebEx Social Troubleshooting Guide Release 3 0 01 27146 02
25. CALENDAR 65 SELECT IsAvailable CalendarDateTime amp GExplode CalendarDateTime GExplode GTextToTime 04 01 2012 12 00 00 AM ZE2 05 05 2012 11 59 59 PM ZE2 IsAvailable EndDateTime amp Explode EndDateTime Explode TextToTime 04 01 2012 12 00 00 AM ZE2 05 05 2012 11 59 59 PM ZE2 amp IsUnavailable FailureReason amp IsAvailable AppointmentType amp AppointmentType lt gt 1 amp AppointmentType lt gt 4 amp Form Appointment Parse each Domino meeting attendees by common name CN EBUG 14 07 40 376 AGGREGATED_CALENDAR 65 Search user document for common name gp 14 07 40 386 AGGREGATED_CALENDAR 65 Search user document for common name example com EBUG 14 07 40 388 AGGREGATED_CALENDAR 65 Search user document for common name N vmdomino domino Output each Domino meeting after we have processed it QUQUOQU tj 09 TRACE 14 07 40 397 AGGREGATED CALENDAR 53 Events eventId 594B9C51FA2258CCC22579AC00431138 1335862800000 1335872700000 subject Domino host location organizer email vmdomino 8 dominotest com screenName vmdomino fullName vmdomino domino attendees email gp 68 dominotest com screenName fullName gp gp email r2 8 example com screenName fullame r2 68 example com nonSendableTo null required null resource null htmlDescription null hasatt
26. Director FAQs 1 12 Director Troubleshooting 1 12 Worker FAQs and Troubleshooting 1 13 Worker FAQs 1 13 Message Queue FAQs and Troubleshooting 1 13 Message Queue Troubleshooting 1 13 Analytics FAQs and Troubleshooting 1 14 Analytics FAQs 1 14 My Library FAQs and Troubleshooting 1 14 My Library Troubleshooting 1 15 Framework FAQs and Troubleshooting 1 15 Framework FAQs 1 15 Streams FAQs and Troubleshooting 1 15 Cisco WebEx Social Troubleshooting Guide Release 3 0 01 27146 02 m Contents Streams FAQs 1 15 UC Integrations FAQs and Troubleshooting 1 16 UC Integrations Troubleshooting 1 16 General Procedures 2 1 Obtaining Third Party Tools 2 1 Modifying Advanced Portal Properties 2 1 Checking Where solr Indexes Reside 2 2 On Search Store Nodes 2 2 On Index Store Nodes 2 2 Performance and Health Monitoring 3 1 Collected Performance Data 3 1 Monitored Health Metrics 3 10 Logs 41 Logs Overview 4 1 Log Files Stored on the Director by Role 4 1 Localy stored Log Files by Role 4 4 Understanding Logs 4 5 Monit Starts Up 4 6 Monit Check Failed 4 6 Manually Restarting Monit 4 6 Resource Overutilization 4 6 Purging opt 4 6 Nagios Starts Up Shuts Down 4 7 Common False Positives 4 7 Node is No Longer Active Available but Exists in the Topology 4 7 Monit service Not Running on a Node 4 7 Chart Data Missing fora Node 4 7 Failure Core Service is Down for an Extended Period of Time 4 8 Rsyslog Starts Up Sh
27. ENTAL DAMAGES INCLUDING WITHOUT LIMITATION LOST PROFITS OR LOSS OR DAMAGE TO DATA ARISING OUT OF THE USE OR INABILITY TO USE THIS MANUAL EVEN IF CISCO OR ITS SUPPLIERS HAVE BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGES Cisco and the Cisco logo are trademarks or registered trademarks of Cisco and or its affiliates in the U S and other countries To view a list of Cisco trademarks go to this URL www cisco com go trademarks Third party trademarks mentioned are the property of their respective owners The use of the word partner does not imply a partnership relationship between Cisco and any other company 1110R Cisco WebEx Social Troubleshooting Guide Release 3 0 2012 Cisco Systems Inc rights reserved CONTENTS Preface v FAQs and Troubleshooting 1 1 Core Functionality FAQs and Troubleshooting 1 1 Core Functionality Troubleshooting 1 1 Email Integration FAQs and Troubleshooting 1 2 Email Integration Troubleshooting 1 2 Calendar FAQs and Troubleshooting 1 4 Calendar FAQs 1 4 Calendar Troubleshooting 1 5 Video Calls FAQs and Troubleshooting 1 6 Video Calls FAOs 1 6 Video Calls Troubleshooting 1 7 Search FAQs and Troubleshooting 1 8 Search Troubleshooting 1 8 Health and Performance Monitoring FAQs and Troubleshooting 1 9 Health and Performance Monitoring FAQs 1 10 Health and Performance Monitoring Troubleshooting 1 10 Logs FAQs and Troubleshooting 1 10 Logs FAQs 1 10 Director FAQs and Troubleshooting 1 12
28. Symptom Users receive multiple daily digests Possible Cause The Administrator has changed the Daily Digest Notification Time after the daily digest has been sent out for the day Recommended Action If you want to avoid duplicate daily digests when changing Daily Digest Notification Time to an earlier time ensure you make the change before the original time comes for the day Possible Cause The user has recently changed their time zone If the new time zone has not been notified yet the affected user receives a second report Recommended Action Keeping the time zone setting should allow the user to receive future daily reports on schedule 01 27146 02 Cisco WebEx Social Troubleshooting Guide Release 3 0 H Chapter1 FAQs and Troubleshooting Calendar FAQs and Troubleshooting Symptom Users receive multiple weekly digests Possible Cause The Administrator has changed the Weekly Digest Notification Date forward after the weekly digest has been sent out for the week Recommended Action If you want to avoid duplicate weekly digests ensure you make the change to Weekly Digest Notification Date before the original time comes for the week Symptom Inbound email does not appear as content in Cisco WebEx Social Possible Cause The Worker node is restarting or has just been restarted Recommended Action Wait for about 10 minutes After that the emails that have been sent should appear as content Symptom Some replies are
29. WebEx Social Cisco WebEx Social Troubleshooting Guide Release 3 0 01 27146 02 Chapter 1 FAQs and Troubleshooting Video Calls FAQs and Troubleshooting Q Why does the video always appear on top hiding other WebEx Social elements A With the intention to provide the best possible video experience to users WebEx Social tries to use hardware acceleration when available Because of that most other HTML elements cannot be placed on top of the video frame Some web browsers may behave differently than others Q Does the WebEx Social Call Plug in log information during installation A If you face problems when installing or uninstalling the WebEx Social Call Plug in locate the installation log under Windows 7 7 USERPROFILE A ppData Local Temp WebCommunicator LOG Windows XP 7 USERPROFILE Local Settings Temp WebCommunicator LOG Mac OSX private var log install log Q Does the WebEx Social Call Plug in log information during operation A If you suspect the WebEx Social Call Plug in is not operating correctly locate the operation log under Windows 7 7 USERPROFILE A ppData Local softphone log Windows XP 7 USERPROFILE Local Settings Application Data softphone log Mac OSX Users USER J Library Application Support softphone log Video Calls Troubleshooting This section provides the following troubleshooting information e Symptom choose to send my video but the remote device does not displ
30. achment false importance null allDayEvent false reminderOffset null href null busyStatus BUSY textDescription THis is some rich text 01 27146 02 Cisco WebEx Social Troubleshooting Guide Release 3 0 H Chapter4 Logs Understanding Logs Lets see what goes to the client startDate Tue May 01 09 endDate Tue May 01 11 45 isRecurring false recurrencePattern null hasPartialMeetingData false webExDetails null 00 00 GMT 20 00 GMT 2012 12 Step 10 Cache asynchronously the list of received Domino events 26 DEBUG 14 37 41 408 AGGREGATED CALENDAR 65 Step 11 Cache asynchronously each Domino event DEBU DEBU ODE DEBU DEBU 4D3 Meeting cached for DCAI G 14 37 41 410 AGGREGATED_CA LENDAR 65 ED24B00328A37C22579B90057D567 Meeting cached for 08C580301255FC22579DC002A8062 G 14 37 41 410 AGGREGATED CA Meeting cached for 371DB4510E56367C22579DC0025E5EA8 G 14 37 41 411 AGGREGATED CA Meeting cached for EABDBD784C22579DC002C3108 14 37 41 411 AGGREGATED CA Meeting cached for 2426637 G G 14 37 41 410 AGGREGATED CA LENDAR 65 LENDAR 65 LENDAR 65 LENDAR 65 EF E6229EF5DCA07C22579DC002D2E cacheListEvents AggCalCacheUtil meetings cached for Mail Chain 10195 14610005 Sat Mar 31 21 00 00 GMT 20
31. alException Cannot interpret private activity Note that this type of error is logged even for activities that are excluded from the user Streams for normal reasons such as privacy so they do not necessarily mean exceptions Cisco WebEx Social Troubleshooting Guide Release 3 0 01 27146 02 Chapter4 Logs Understanding Logs VDL Backend Debugging If you want to debug Streams API calls on the backend enable Debug logging for SocialActivity Application see Streams FAQs page 1 15 then look for the following in the App Server logs When you refresh the Home page or navigate to it Apr 25 18 08 01 ecp 10 194 189 67 example com quad DEBUG socialActivities TP Processor47 getUserActivities for 110060 Start Apr 25 18 08 01 ecp 10 194 189 67 example com quad DEBUG socialActivities TP Processor47 getUserActivities for 110060 ResultSize 1 Time 21msecs End Where getUserActivities is the API called 110060 is the userid ResultSize shows how many activities have been returned Time shows how long this call took e When you navigate to your profile Apr 25 18 32 16 ecp 10 194 189 67 example com quad DEBUG socialActivities TP Processor44 getUserPublicActivities for 110060 Start Apr 25 18 32 16 ecp 10 194 189 67 example com quad DEBUG socialActivities TP Processor44 getUserPublicActivities for 110060 ResultSize 3 Time 2msecs End When you navigat
32. ator CONTENT MS Exchange Server version 08 03 0083 000 amp gt amp lt TITLE amp gt Have fun amp lt TITLE amp gt amp lt HEAD amp gt amp lt BODY amp gt amp lt Converted from text plain format amp gt amp lt P amp gt amp lt FONT SIZE 2 amp gt When Wednesday March 28 2012 3 00 AM 4 00 AM GMT 08 00 Pacific Time US amp amp amp Canada amp lt BR amp gt Where some location amp lt BR amp gt amp lt BR amp gt KKK amp lt BR amp gt amp lt BR amp gt amp amp nbsp some body here amp lt BR amp gt amp lt FONT amp gt amp lt P amp gt amp lt BODY amp gt amp lt HTML amp gt d htmldescription d hasattachment b dt boolean gt 0 lt d hasattachment gt lt e busystatus gt TENTATIVE lt e busystatus gt lt d textdescription gt When Wednesday March 28 2012 3 00 AM 4 00 AM GMT 08 00 Pacific Time US amp amp Canada Where some location Ring o nh ech dak some body here lt d textdescription gt lt e alldayevent b dt boolean gt 0 lt e alldayevent gt lt e reminderoffset b dt int gt 900 lt e reminderoffset gt e dtstart b dt dateTime tz gt 2012 03 28T10 00 00 000Z lt e dtstart gt e dtend b dt dateTime tz gt 2012 03 28T11 00 00 000Z lt e dtend gt e created b dt dateTime tz gt 2012 03 08T10 49 58 000Z lt e created gt e recurrenceid b dt dateTime tz gt 2012 03 11T10 00 00 000Z lt e recurrenceid gt e lastmodified b dt dateTi
33. atus gt lt a prop gt f to xmlns f urn schemas mailheader gt f cc xmlns f urn schemas mailheader gt lt g nonsendableto xmlns g http schemas microsoft com mapi gt lt f from xmlns f urn schemas mailheader gt lt e organizer xmlns e urn schemas calendar gt lt a prop gt lt a propstat gt lt a response gt DEBUG 13 52 37 509 AGGREGATED_CALENDAR 65 Event with missing information subject Have fun Query for additional event details DEBUG 13 52 37 509 AGGREGATED_CALENDAR 65 Search Query lt xml version 1 0 d searchrequest xmlns d DAV gt lt d sql gt SELECT urn schemas mailheader to urn schemas mailheader cc urn schemas mailheader from urn schemas calendar organizer FROM Scope SHALLOW TRAVERSAL OF https 198 51 100 35 exchange vm2007 calendar WHERE urn schemas calendar instancetype 1 AND urn schemas calendar uid 040000008200E00074C5B7101A82E008000000006C327C3319FDCC010000000000000000100000003AD41318C FA170488967581FBBC63202 lt d sql gt lt d searchrequest gt INFO 13 52 37 518 AGGREGATED CALENDAR 78 Number of events we got 1 TRACE 13 52 37 519 AGGREGATED CALENDAR 53 Response Document xml version 1 0 encoding UTF 16 gt lt a multistatus xmlns a DAV xmlns b urn uuid c2f41010 65b3 11d1 a29f 00aa00c14882 xmins c xml xmlns d urn schemas mailheader xmlns e urn schemas calendar gt lt a
34. ay it e Symptom Video originating from WebEx Social does not utilize the entire screen on some hardware communication devices Symptom I choose to send my video but the remote device does not display it Possible Cause A network Internet security softwere on your computer is blocking the outbound connection Recommended Action The security software may or may not notify you of blocked connections In both cases the solution is to whitelist the WebEx Social Call Plug in in your security software Symptom Video originating from WebEx Social does not utilize the entire screen on some hardware communication devices Possible Cause The device does not have RTCP enabled RTCP allows devices connected to CUCM to negotiate the best possible video resolution between endpoints The option is enabled on the WebEx Social Call Plug in by default Recommended Action In your Cisco Unified Communications Manager ensure RTC is enabled for any devices that receives video from WebEx Social 01 27146 02 Cisco WebEx Social Troubleshooting Guide Release 3 0 H Chapter1 FAQs and Troubleshooting Search FAQs and Troubleshooting Search FAQs and Troubleshooting e Search Troubleshooting page 1 8 Search Troubleshooting This section provides the following troubleshooting information e Symptom When do a global or local search I get the Internal Server 500 error Symptom When I open My Library I get the unexpected er
35. ble Cause Only if Use LDAP Directory Synchronization is checked in the Calendar Configuration under Server Common Configurations The user email address has been changed Because WebEx Social uses the prefix of the email address to construct the WebDAV URL the user can be prevented from connecting to Microsoft Exchange Recommended Action Ask the user to complete these steps Open your profile menu and click Account Settings Click Calendar and WebEx login Under Microsoft Exchange change the Server URL as follows 1 Identify your email prefix in the URL It is the ending part starting right after the last forward slash For example if your URL is http dev example com Exchange emma jones emma jones is your email prefix Replace your previous email prefix with your new email prefix For example if your email prefix has been changed from emma jones to ejones your URL should look like this http dev example com Exchange ejones Click Test 01 27146 02 Cisco WebEx Social Troubleshooting Guide Release 3 0 H Chapter1 FAQs and Troubleshooting Video Calls FAQs and Troubleshooting The connection should succeed Symptom Domino users who connect through SSL cannot connect after upgrading WebEx Social Possible Cause The IBM Lotus Domino SSL security certificate has been invalidated by WebEx Social Recommended Action Reimport the SSL security certificate See the Administration Guide for deta
36. chine open opt cisco search conf solrconfig xml for viewing and find the lt dataDir gt entry If the value is solr data dir solr data then opt cisco search data contains the indexes Otherwise the full path to the data directory is specified for example quaddata search solr data On Index Store Nodes Log in to the machine open opt cisco search conf solrconfig xml for viewing and find the lt dataDir gt entry For posts check the dataDir entry in solrconfig xml under lopt cisco searchcache multicore post conf If no entry is present lopt cisco searchcache multicore post data is the folder Otherwise the full path to the data directory 18 specified For social activity check the lt dataDir gt entry in solrconfig xml under lopt cisco searchcache multicore social conf If no entry is present lopt cisco searchcache multicore social data is the folder Otherwise the full path to the data directory is specified For video check the dataDir entry in solrconfig xml under lopt cisco searchcache multicore video conf If no entry is present lopt cisco searchcache multicore video data is the folder Otherwise the full path to the data directory is specified For followers check the lt dataDir gt entry in solrconfig xml under lopt cisco searchcache multicore follower conf If no entry is present lopt cisco searchcache multicore follower data is the folder Otherwise the full path to the data directory is speci
37. closed Director Web Port 80 Director Web csse Message Queue Port 61616 Message Search Store Queue established Index Store Analytics Store Port 8983 Search fin waitl JSON Store Store fin wait Port 7973 Index Store gt Port 27001 Analytics last_ack Store listen Port 27000 JSON Store syn Port 11211 Cache syn sent time wait 01 27146 02 Cisco WebEx Social Troubleshooting Guide Release 3 0 H Chapter 3 Performance and Health Monitoring Collected Performance Data Table 3 1 Collected Performance Data continued Type Instance Matrix Description Oracle blockingLock cacheHitRatio dbBlockBufferC acheHitRatio dictionaryCache HitRatio diskSortRatio invalidObjects latchHitRatio libraryCacheHit Ratio lock lockedUserCou nt offlineDataFiles pgalnMemoryS ortRatio rollBlockConten tionRatio rollHeaderConte ntionRatio rollHitRatio rollbackSegmen tWait sessionPGAMe mory sessionUGAMe mory sgaDataBufferH istRatio sgaSharedPoolF ree sgaSharedPoolR eloadRatio softParseRatio staleStatistics RDBMS Store Graph Store ioPerTableSpace ecp_data sysaux system undotbs1 users PHY_BLK_R Phy_BLK_W RDBMS Store Graph Store oraUsageTablespace ecp_data sysaux system undotbs1 users fr
38. d by the guest operating system and the time used by virtualization code for tasks for this virtual machine Percentage of cpu utilization is used ms number of core elapsed ms Memory active mb Retrieves the amount of memory the virtual machine is actively using its estimated working set size balooned mb Retrieves the amount of memory that has been reclaimed from this virtual machine by the vSphere memory balloon driver also referred to as the vmmemctl driver limit mb Retrieves the upper limit of memory that is available to the virtual machine mapped mb Retrieves the amount of memory that is allocated to the virtual machine Memory that is ballooned swapped or has never been accessed is excluded reservation mb Retrieves the minimum amount of memory that is reserved for the virtual machine shares Retrieves the amount of physical memory associated with this virtual machine that is copy on write COW shared on the host swapped mb Retrieves the amount of memory that has been reclaimed from this virtual machine by transparently swapping guest memory to disk used mb Retrieves the estimated amount of physical host memory currently consumed for this virtual machine s physical memory apache connecti ons apache idle wo rkers App Server amp Worker apache scoreboard closing dnslookup finishing idle cleanup
39. d web c monit 1811 rsyslog process PID changed from 1425 to 2959 May 22 18 03 13 quad web c monit 1811 rsyslog process PID has not changed since last cycle Resource Overutilization Purging opt These log entries are generated when monit has detected that a resource utilization has gone over the prefedined threshold May 27 18 25 11 quad web a monit 2236 rsyslog cpu usage of 50 1 matches resource limit cpu usage gt 50 0 These log entries are generated when monit has detected that the opt usage has grown beynd 85 and the purge action has been performed Jun 5 01 05 44 quad test monit 16057 opt space usage 92 6 matches resource limit space usage gt 85 0 Jun 5 01 05 44 quad test monit 16057 opt exec bin bash Cisco WebEx Social Troubleshooting Guide Release 3 0 Em OL 27146 02 Chapter4 1005 Understanding Logs Ml Jun 5 01 05 44 quad test monit opt disk usage exceeded 85 threshold Purging log folder opt logs 2012_06_03 These log entries are generated when today is the only remaining folder and there is nothing left to purge Jun 5 01 07 44 quad test monit opt disk usage exceeded 85 threshold Purging log folder Nagios Starts Up Shuts Down These log entries are generated during normal Nagios startup shutdown 1336003714 Nagios 3 3 1 starting PID 9416 1336003714 Local time is Thu May 03 00 08 34 UTC 2012 1336003714 VERSION 2 0 1336003714 Finished daemoni
40. doesn t seem to stop RabbitMQ Possible Cause The described case is a known defect Recommended Action Try executing sudo killall u rabbitmq as admin Cisco WebEx Social Troubleshooting Guide Release 3 0 01 27146 02 Chapter1 FAQs and Troubleshooting Analytics FAQs and Troubleshooting Symptom I removed a node from a cluster and now rabbitmq is not functioning correctly Possible Cause The described case is a known defect Recommended Action As admin stop rabbitmq on the remaining cluster nodes then execute rm rf opt cisco rabbitmq data and finally restart rabbitmq on all nodes Symptom RabbitMQ fails to start and shows this error ERROR failed to load application amqp client such file or directory amqp client app Possible Cause A RabbitMQ plug in has freezed Recommended Action Run the following commands as admin to reset the amqp client plug in sudo rabbitmq plugins disable rabbitmq management sudo service rabbitmq server stop sudo service rabbitmq server start sudo rabbitmq plugins enable rabbitmq management Analytics FAQs and Troubleshooting Analytics FAQs page 1 14 Analytics FAQs How do I set the log trace levels for analytics Q How do I set the log trace levels for analytics A Assystem administrator go to Account Settings Server Server Administration Log Properties and set the Analytics category for the App Server and Worker roles
41. e specifically these conditions must have all been true The Cisco Social session timeout has been increased in Web xml to more than the default 8 hours The attachment clean up interval parameter com cisco ecp vdl attachment cleanup job interval has not been changed The update has been posted after waiting on the compose screen for a significant amount of time more than com cisco ecp vdl attachment cleanup job interval Recommended Action To prevent this issue from appearing again sign in to the Director go to Application Portal Advanced Portal Properties and search for com cisco ecp vdl attachment cleanup job interval Set its value to be one hour longer than the session timeout Note that the com cisco ecp vdl attachment cleanup job interval is in minutes while the session timeout is in hours Email Integration FAQs and Troubleshooting Email Integration Troubleshooting page 1 2 Email Integration Troubleshooting This section provides the following troubleshooting information Symptom reply created using Outlook OWA is added as first level comment in WebEx Social instead of as a reply Symptom of the Office auto replies to WebEx Social email notifications are added as content in WebEx Social Symptom A number of or all users did not receive their email digests summary of important updates Symptom Users receive multiple daily digests Symptom Users receive multiple weekly digests Symptom Inbou
42. e to the profile of another user Apr 25 18 37 06 ecp 10 194 189 67 example com quad DEBUG socialActivities TP Processor47 getUserPulbicActivities for 110112 Start Apr 25 18 37 06 ecp 10 194 189 67 example com quad DEBUG socialActivities TP Processor47 getUserPublicActivities for 110112 ResultSize 1 Time 1msecs End Where 1100112 is user ID of the user whose profile activities you are requesting Ifa certain activity does not appear on the Home page check if it is supposed to be there If it is supposed to appear then check the logs for errors If there is an error returning the activity to the user interface you see a warning like this followed by an exception Ignoring activity due to an error while building activity entry for cnId classname id cpk postid or documentid etc If there is an error during the activity creation process it is logged The example that follows is for a successful post creation activity In case of an error you see the start message but not the end message and an exception is logged Apr 25 18 36 42 ecp 10 194 189 67 example com quad DEBUG socialActivities TP Processor44 handleSync for POST CREATE classNameId 10060 classPK 2500002 Start Apr 25 18 36 42 ecp 10 194 189 67 example com quad DEBUG socialActivities TP Processor4 PostActivityHandler handleSynchProcess for POST CREATE classNameId 10060 classPK 2500002 Start 2 4 S Apr
43. ee_mb percent_free percent_used size_mb RDBMS Store Graph Store Cisco WebEx Social Troubleshooting Guide Release 3 0 OL 27146 02 Chapter3 Performance and Health Monitoring Table 3 1 Collected Performance Data Collected Performance Data continued Type Instance Matrix Description Solr Search avgRequestsPer Second Number of requests server per second avgTimePerReq uest average time taken to server each request errors Rate of error requests that returned error requests Rate of request servered by SOLR timeouts Rate of request timed out request that failed due to time out error Search Store Search documentcache fieldvaluecache filtercache queryresultcache Index autocompletefieldvalue followerfieldvaluecache postfieldvaluecache socialfieldvaluecache videofieldvaluecache cumulative evic tions cumulative hits cumulative inse rts cumulative look ups evictions hitratio hits inserts lookups size warmupTime Search Store Index Store Search searcher Index autocomplete follower post social video maxDoc numDocs Search Store Index Store Java Memory HeapMemoryUs age committed HeapMemoryUs age init HeapMemoryUs age max HeapMemoryUs age used NonHeapMemo ryUsage commi tted
44. erference to radio communications Operation of this equipment in a residential area is likely to cause harmful interference in which case users will be required to correct the interference at their own expense The following information is for FCC compliance of Class B devices The equipment described in this manual generates and may radiate radio frequency energy If it is not installed in accordance with Cisco s installation instructions it may cause interference with radio and television reception This equipment has been tested and found to comply with the limits for a Class B digital device in accordance with the specifications in part 15 of the FCC rules These specifications are designed to provide reasonable protection against such interference in a residential installation However there is no guarantee that interference will not occur in a particular installation Modifying the equipment without Cisco s written authorization may result in the equipment no longer complying with FCC requirements for Class A or Class B digital devices In that event your right to use the equipment may be limited by FCC regulations and you may be required to correct any interference to radio or television communications at your own expense You can determine whether your equipment is causing interference by turning it off If the interference stops it was probably caused by the Cisco equipment or one of its peripheral devices If the equipment causes interference
45. fied Cisco WebEx Social Troubleshooting Guide Release 3 0 Em OL 27146 02 CHAPTER Performance and Health Monitoring This chapter is organized as follows Collected Performance Data page 3 1 e Monitored Health Metrics page 3 10 Collected Performance Data This section summarizes the performance data collected by the collectd monitoring agent which is installed on all nodes While some of the collected system specific performance data is common for all nodes for example disk space CPU the collectd agent uses plug ins to collect application specific data for example for MBean Tomcat Apache This data can be accessed in several ways From the Director UI gt System gt Stats Through the WebEx Social API Table 3 1 Collected Performance Data Type Instance Matrix Description Role CPU core idle Percentage of time that the CPU or CPUs were idle and the system All did not have an outstanding disk I O request interrupt Percentage of time spent by the CPU or CPUs to service hardware interrupts nice Percentage of CPU utilization that occurred while executing at the user level with nice priority softirq Percentage of time spent by the CPU or CPUs to service software interrupts steal Percentage of time spent in involuntary wait by the virtual CPU or CPUs while the hypervisor was servicing another virtual processor system Percentage of CPU utilization that occurred while executing at
46. formation e Symptom restarted monit but monitoring does not seem to be working for that node e Symptom I do not recieve health data for a node Symptom I restarted monit but monitoring does not seem to be working for that node Possible Cause The initialization of monit has not completed Recommended Action Wait for the initialization delay of monit about 2 minutes Symptom I do not recieve health data for a node Possible Cause If a node is marked as Disabled in the Topology page on the Director monit does not perform checks on that node Recommended Action Enable the node Logs FAQs and Troubleshooting e Logs FAQs page 1 10 Logs FAQs e How do I access Cisco WebEx Social logs e Q What is security logging e Q What message categories are defined in the security and auditing log e Q What is the message format used in the security and auditing log e Q Isee a particular log for one day but not another Why is this e Q Iwantto check a log file for a past date but the directory for that date seems to have disappeared Q How do I access Cisco WebEx Social logs A Alllogs are accessible through HTTP from the Director Visit this URL to see them http lt director gt logs Cisco WebEx Social Troubleshooting Guide Release 3 0 ELM OL 27146 02 Chapter 1 FAQs and Troubleshooting Logs FAQs and Troubleshooting Where director is the URL you use to access the Director web UI A
47. gs Step 10 Step 11 recurrencePattern null hasPartialMeetingData false webExDetails 1 null Cache asynchronously the list of received WebDav events DEBUG 13 52 37 567 AGGREGATED CALENDAR 65 cacheListEvents AggCalCacheUtil 7 meetings cached for Mail Chain 10195 1410026 Sun Mar 25 21 00 00 GMT 2012 Sun May 06 20 59 59 GMT 2012 Cache asynchronously each WebDav event DEBUG 13 52 37 568 AGGREGATED CALENDAR 65 cacheMeeting AggCalCacheUtil Meeting cached for 040000008200E00074C5B7101A82E008000000006C327C3319FDCC010000000000000000100000003AD41318C FA170488967581FBBC63202 2012 03 11T10 00 00 000Z 10195 1410026 Selecting a Domino Event from the List of Events Step 1 Step 2 Step 3 Step 4 Step 5 Step 6 The following messages are logged when a Domino event is clicked to be expanded in the list of events The event has not been previously cached Initiating call to the VDL local service DEBUG 14 37 44 494 AGGREGATED CALENDAR 65 getMeetingDetails method from AggregatedCalendarLocalServiceImpl called Display the Domino settings that are used to connect to Domino DEBUG 14 37 44 504 AGGREGATED CALENDAR 65 Using Domino Calendar settings for user r3 Username vmdomino domino Password URL 198 51 100 35 Domain dominotest Try to get the events for Domino from the cache without success INFO 14 37 44 5
48. iled instructions Symptom I added a new attendee to a recurring meeting using Microsoft Outlook but the new name does not appear in the Calendar application in Cisco WebEx Social Possible Cause There is a know issue with some versions of Microsoft Exchange Server when calendaring information is fetched over WebDAV Recommended Action Use Microsoft Outlook Web Access to edit the recurring meeting instead of Microsoft Outlook Video Calls FAOs and Troubleshooting e Video Calls FAQs page 1 6 e Video Calls Troubleshooting page 1 7 Video Calls FAQs e Q How do I check what Call Plug in version is available on WebEx Social e Q 15 there a direct URL to download the Call Plug in e Q Why does the video always appear on top hiding other WebEx Social elements Q Does the WebEx Social Call Plug in log information during installation Q Does the WebEx Social Call Plug in log information during operation How do I check what Call Plug in version is available on WebEx Social A Open the following URL http lt WS base url plugin cwc CWICPlugin Version where WS base url is the URL you use to access WebEx Social Q Is there a direct URL to download the Call Plug in A Yes Use this URL For the Windows plug in http lt WS base url gt plugin cwc CiscoWebCommunicator exe For the Mac plug in http lt WS base url gt plugin cwc CiscoWebCommunicator dmg where lt WS base url gt is the URL you use to access
49. k begins to drop messages from pid 2061 due to rate limiting May 25 23 40 02 quad web a rsyslogd 2177 imuxsock lost 1085 messages from pid 2061 due to rate limiting Service is Down If a service is down collectd won t be able to collect stats for that service for example if the Worker service is not running then the Health state manager check fails and collectd logs the following Jun 4 21 01 44 quad web b collectd 7176 curl_json plugin curl_easy_perform failed with status 7 couldn t connect to host http localhost 8080 monit status do output json If Memcached is not running you see a message like this Jun 7 00 04 24 quad cache 1 collectd 6847 memcached Could not connect to daemon Analytics Service Initialized Successfully This log message appears if the Analytics service on an App Server or Worker node initializes successfully AnalyticEventReceiver initialized MapReduce Scheduler Logs Mapreduce jobs are run for analytics and suggestions Typically these jobs are run once per day unless you change the Analytics Store Cron Job Hour of Day UTC on the Director in which case the scheduler job might run again for the day when it was changed The mapreduce scheduler logs are writen to worker host name_analyticsmrscheduler log One of the Worker nodes picks up the entire job for execution e To verify the job has started look for Running Map Reduce Jobs e The end of the job is signified by this message
50. l disk access served two or more logical operations disk octets read Bytes read from disk per second disk octets Bytes written to disk per second write disk ops read Read operation from disk per seconds disk ops write Write operation to disk per seconds disk time read Average time an I O read operation took to complete equivalent to svctime of vmstat disk time write Average time an I O write operation took to complete equivalent to svctime of vmstat Disk Usage boot opt root free Used space on a specified partition All reserved Space on a opt partition reserved for root user used Free space on a specified partition DNS octets queries Number of octets sent All responses Number of octets recieved opcode opcode9 Number of packets with a specific opcode e g the number of All packets that contained a query query TBD qtype 0 Number of queries for each record type 0 All a Number of queries for each record type a aaaa Number of queries for each record type aaa ptr Number of queries for each record type ptr txt Number of queries for each record type txt Interface ethO if_errors rx Rate of Error in receiving data by network interface All if_errors tx Rate of Error in transmitting data by network interface if_octets rx Rate of Bytes received by network interface if_octets tx Rate of Bytes transferred by network interface if_packets rx Rate of packets receivedby network interface if_packets tx Rate of packets transferred by net
51. lina log HOSTNAME _localhost log HOSTNAME _manager log HOSTNAME _host_manager log HOSTNAME _httpd_access log HOSTNAME _httpd_error log HOSTNAME _cmanager log HOSTNAME _cmanager_debug log HOSTNAME _cmanager_info log HOSTNAME _cmanager_warn log HOSTNAME _cmanager_error log Release 3 0 Cisco WebEx Social Troubleshooting Guide OL 27146 02 Chapter4 1005 Table 4 1 Log Files Stored on the Director by Role Log Files Stored on the Director continued Log filename Message Queue 5 message queue wrapper log 5 message queue log 5 message queue shutdown err HOSTNAME _message queue_startup_err HOSTNAME _message queue_shutdown log HOSTNAME _message queue_startup log Notifier HOSTNAME _notifier log HOSTNAME _notifier_nohup out HOSTNAME _notifier_debug log HOSTNAME _notifier_info log HOSTNAME _notifier_warn log HOSTNAME _notifier_error log Cache HOSTNAME _messages Search Store HOSTNAME _search log HOSTNAME _search request log Index Store HOSTNAME _index log HOSTNAME _index request log Analytics Store HOSTNAME _analyticsstore log HOSTNAME _mongod log JSON Store HOSTNAME _jsonstore log HOSTNAME _mongod log 01 27146 02 Cisco WebEx Social Troubleshooting Guide Release 3 0 E Chapter4 Logs Localy stored Log Files by Role Table 4 1 Log
52. lternativly if you need to perform advanced actions with logs such as tracing logs in real time log in to the Director node go to opt logs and then enter the directory for the date you need What is security logging Starting from this release security and auditing logs have been grouped into high level security categories and consolidated into one audit log per App Server node In addition the log message format has been improved to make it easier to process and aggregate Note however that you can enable debugging in the App Server logs to cause the same logging to show in the normal App Server application logs What message categories are defined in the security and auditing log The following categories are defined e security auth Authentication events related to signing in signing out and so on e security authentication Authentication events related to signing in signing out and so on e security authorization Authorization events such as creating a Post sharing a Post with a user editing a Post and so on e security admin Changes to administrative screens such as those on the control panel as well as configuration changes to control panels of applications for example External Document Repository Community Calendar and so on e security threat Log messages from AntiSamy post security HTML sanitizer CSRF mismatch token violations and so on e security policy Reserved for future use What is
53. mas calendar location urn schemas mailheader to urn schemas mailheader cc http schemas microsoft com mapi nonsendableto urn schemas mailheader from urn schemas calendar organizer urn schemas calendar uid urn schemas calendar instancetype urn schemas httpmail htmldescription urn schemas httpmail hasattachment urn schemas calendar busystatus urn schemas httpmail textdescription urn schemas calendar alldayevent urn schemas calendar reminderoffset urn schemas calendar dtstart urn schemas calendar dtend urn schemas calendar created urn schemas calendar recurrenceid urn schemas calendar lastmodified FROM Scope SHALLOW TRAVERSAL OF https 198 51 100 35 exchange vm2007 calendar WHERE NOT urn schemas calendar instancetype 1 AND urn schemas calendar dtend amp lt 5 2012 04 27 13 52 37 4217 as dateTime AND urn schemas calendar dtstart amp gt CAST 2012 04 26T13 52 37 421Z2 as dateTime ORDER BY urn schemas calendar dtstart ASC lt d sql gt lt d searchrequest gt Get the response INFO 13 52 37 440 AGGREGATED_CALENDAR 78 Number of events we got 0 TRACE 13 52 37 441 AGGREGATED CALENDAR 53 1 Response Document lt xml version 1 0 encoding UTF 16 gt lt a multistatus xmlns a DAV xmlns b urn uuid c2f41010 65b3 11d1 a29f 00aa00c14882 xmilns c xml xmlns d urn schemas httpmail xmlns e urn schemas calendar xml
54. me tz gt 2012 04 10T14 29 08 000Z lt e lastmodified gt lt a prop gt lt a propstat gt lt a propstat gt a status HTTP 1 1 404 Resource Not Found lt a status gt Cisco WebEx Social Troubleshooting Guide Release 3 0 Ex OL 27146 02 Chapter4 1005 Understanding Logs lt a prop gt f tore lt gt g nonsendableto f from e organizer a prop a propstat lt a response gt lt a multistatus gt Step 7 Receive a warning because there is a meeting without an organizer WARN 13 52 37 505 AGGREGATED CALENDAR 90 Failed to get organizer for WebDav event Have fun with ID 040000008200E00074C5B7101A82E008000000006C327C3319FDCC010000000000000000100000003AD41318C 170488967581 6320282012 03 11 10 00 00 00021 DEBUG 13 52 37 508 AGGREGATED CALENDAR 65 lt xml version 1 0 encoding UTF 16 gt lt a response xmlns a DAV gt lt a href gt https 198 51 100 35 exchange vm2007 Calendar Have 20fun 5 EML lt a href gt lt a propstat gt lt a status gt HTTP 1 1 200 OK lt a status gt lt a prop gt lt d subject xmlns d urn schemas httpmail gt Have fun lt d subject gt lt e location xmlns e urn schemas calendar gt some location lt e location gt lt e uid xmlns e urn schemas calendar gt 040000008200E00074C5B7101A82E008000000006C327C3319FDCC010000000000000000100000003AD41318CF A17048896
55. minotest Try to get the events for Domino from the cache without success INFO 14 07 40 279 AGGREGATED_CALENDAR 78 getCachedListEvents AggCalCacheUtil Cache miss for Mail Chain 10195 14610005 Sat Mar 31 21 00 00 GMT 2012 Sat May 05 20 59 59 GMT 2012 we got 0 meetings Try to get the events for WebEx from the cache without success Cisco WebEx Social Troubleshooting Guide Release 3 0 EXAM OL 27146 02 Chapter4 Logs Step 4 Step 5 Step 6 Step 7 Step 8 Step 9 Understanding Logs INFO 14 07 40 279 AGGREGATED_CALENDAR 78 getCachedListEvents AggCalCacheUtil Cache miss for WebEx Chain 10195 14610005 Sat Mar 31 21 00 00 GMT 2012 Sat May 05 20 59 59 GMT 2012 we got 0 meetings Display the period for which the events are being retrieved from Domino INFO 14 07 40 279 AGGREGATED CALENDAR 78 Get events from Sat Mar 31 21 00 00 GMT 2012 to Sat May 05 20 59 59 GMT 2012 Display the period for which the events are being retrieved from WebEx INFO 14 07 40 281 AGGREGATED CALENDAR 78 Get events from Sat Mar 31 21 00 00 GMT 2012 to Sat May 05 20 59 59 GMT 2012 Successful creation of a Domino session INFO 14 07 40 289 AGGREGATED CALENDAR 78 Domino session was successfully created for user vmdomino domino Execute a query to get the events from Domino DEBUG 14 07 40 293 AGGREGATED
56. ncorrect Theme ID ERROR org apache velocity TP Processor49 Exception in macro content_include called at SERVLET CONTEXT html themes classic templates portal normal vm line 559 column 33 If you see this error it is probably the theme ID that is misconfigured Check if these advanced portal properties have values as follows default regular theme id albani control panel layout regular theme id albani Streams Logs This section is organized as follows e Errors During Interpretation page 4 19 VDL Backend Debugging page 4 20 Errors During Interpretation The most common exceptions when interpreting social activities are due to permission related errors when accessing resources like documents or images If any other type of exception appears when interpreting a social activity that activity is ignored when displaying the list of activities to the user in which case you would usually see a log entry similar to quad web 2 example com 2012 04 17 20 52 22 522 ERROR socialActivities TP Processor42 alafemin 10B879E3B61F30994AEE245D77F8F84B quad web 2 example comjvm PostActivityInterpreter doInterpretTOoJSON Cannot interpret private activity quad web 2 example com 2012 04 17 20 52 22 523 ERROR social model BaseSocialActivityInterpreter TP Processor42 alafemin 10B879E3B61F30994AEE245D77F8F84B quad web 2 example comjvm Unable to interpret activity com liferay portal Port
57. nd email does not appear as content in Cisco WebEx Social Symptom Some replies are saved as new posts containing the entire email thread as opposed to comments to the original content Symptom Users are not receiving any emails generated by Cisco WebEx Social Symptom reply created using Outlook OWA is added as first level comment in WebEx Social instead of as a reply Possible Cause Your organization is using Microsoft Exchange Server 2003 without the KB908027 fix applied Recommended Action Apply the fix or upgrade to the latest version of Microsoft Exchange Server 2003 For more information see http support microsoft com kb 908027 Cisco WebEx Social Troubleshooting Guide Release 3 0 Em OL 27146 02 Chapter 1 FAQs and Troubleshooting Email Integration FAQs and Troubleshooting Symptom Out of the Office auto replies to WebEx Social email notifications are added as content in WebEx Social Possible Cause The user account sending the Out of Office message is hosted on Microsoft Exchange Server 2003 Recommended Action Mail accounts running on later versions of Microsoft Exchange Server or IBM Lotus Domino should not run into this issue Symptom number of or all users did not receive their email digests summary of important updates Possible Cause You have recently increased or decreased worker digestscheduler mainJobRepeatInterval After the value has been modified and saved the Digest Scheduler
58. ns f urn schemas mailheader xmlns g http schemas microsoft com mapi Execute another WebDav query to get the events for the month DEBUG 13 52 37 441 AGGREGATED_CALENDAR 65 login exchange server sucessful DEBUG 13 52 37 442 AGGREGATED_CALENDAR 65 resolveMailServerInfo success code 200 DEBUG 13 52 37 442 AGGREGATED CALENDAR 65 Search Query lt xml version 1 0 gt lt d searchrequest xmlns d DAV d sql SELECT urn schemas httpmail subject urn schemas calendar location urn schemas mailheader to urn schemas mailheader cc http schemas microsoft com mapi nonsendableto urn schemas mailheader from urn schemas calendar organizer urn schemas calendar uid urn schemas calendar instancetype urn schemas httpmail htmldescription urn schemas httpmail hasattachment urn schemas calendar busystatus urn schemas httpmail textdescription urn schemas calendar alldayevent urn schemas calendar reminderoffset 01 27146 02 Cisco WebEx Social Troubleshooting Guide Release 3 0 H Chapter4 Logs Understanding Logs Step 6 urn Schemas calendar dtstart urn schemas calendar dtend urn schemas calendar created urn schemas calendar recurrenceid urn schemas calendar lastmodified FROM Scope SHALLOW TRAVERSAL OF https 198 51 100 35 exchange vm2007 calendar WHERE NOT urn schemas calendar instancetype 1 AND u
59. ntified the machine that stores the corrupt indexes log in to it as admin and stop solr For Search Store machines sudo service search stop e For Index Store machines sudo service searchcache stop Delete data directories for all cores See Checking Where solr Indexes Reside page 2 2 to understand how to indentify the data directories Restart solr For Search Store machines run this command as admin sudo service search start For Index Store machines run this command as admin sudo service searchcache start Symptom When I open My Library I get the An unexpected error occurred message Possible Cause For possible causes and recommended actions see Symptom When I do a global or local search I get the Internal Server 500 error page 1 8 Health and Performance Monitoring FAQs and Troubleshooting Health and Performance Monitoring FAQs page 1 10 Health and Performance Monitoring Troubleshooting page 1 10 01 27146 02 Cisco WebEx Social Troubleshooting Guide Release 3 0 H Chapter1 FAQs and Troubleshooting Logs FAQs and Troubleshooting Health and Performance Monitoring FAQs How do I set the log trace levels for health and performance monitoring Q How do I set the log trace levels for health and performance monitoring A See the respective FAQ in the Analytics FAQs section Health and Performance Monitoring Troubleshooting This section provides the following troubleshooting in
60. ntry laws governing import export transfer and use Delivery of Cisco cryptographic products does not imply third party authority to import export distribute or use encryption Importers exporters distributors and users are responsible for compliance with U S and local country laws By using this product you agree to comply with applicable laws and regulations If you are unable to comply with U S and local laws return this product immediately Further information regarding U S export regulations may be found at http www access gpo gov bis ear ear data html Document Conventions Convention This document uses the following conventions Description boldface font Commands and keywords are in boldface italic font Arguments for which you supply values are in italics Elements in square brackets are optional xlylz Alternative keywords are grouped in braces and separated by vertical bars xlylz Optional alternative keywords are grouped in brackets and separated by vertical bars string A nonquoted set of characters Do not use quotation marks around the string or the string will include the quotation marks screen font Terminal sessions and information the system displays are in screen font boldface screen font Information you must enter is in boldface screen font italic screen font Arguments for which you supply values are in italic screen font Cisc
61. o WebEx Social Troubleshooting Guide Release 3 0 OL 27146 02 1 Preface Convention Description The symbol represents the key labeled Control for example the key combination D in a screen display means hold down the Control key while you press the D key Nonprinting characters such as passwords are in angle brackets S Note A Means reader take note Notes contain helpful suggestions or references to material not covered in the publication Caution A Means reader be careful In this situation you might do something that could result in equipment damage or loss of data Warnings use the following convention Warning IMPORTANT SAFETY INSTRUCTIONS This warning symbol means danger You are in a situation that could cause bodily injury Before you work on any equipment be aware of the hazards involved with electrical circuitry and be familiar with standard practices for preventing accidents Use the statement number provided at the end of each warning to locate its translation in the translated safety warnings that accompanied this device Statement 1071 SAVE THESE INSTRUCTIONS 01 27146 02 Cisco WebEx Social Troubleshooting Guide Release 3 0 H Preface 1 Cisco WebEx Social Troubleshooting Guide Release 3 0 Em OL 27146 02 CHAPTER 1 FAQs and Troubleshooting This chapter provides FAQs and troubleshooting hints for various Cisco WebEx S
62. ocial The information in the chapter is organized as Frequently Asked Questions FAQs and or troubleshooting topics General Procedures Provides extended verification and debugging information as well as general procedures Performance and Health Monitoring Provides information about the facilities in Cisco WebEx Social that provide for performance and health data Logs Provides information about log file names and locations as well as other log related information Related Documentation e Cisco WebEx Social Installation and Upgrade Guide e Cisco WebEx Social Administration Guide Cisco WebEx Social Troubleshooting Guide Release 3 0 01 27146 02 EN Preface 1 Open Source Licenses and Notices for Cisco WebEx Social Cisco WebEx Social Disaster Recovery Using Snapshots Cisco WebEx Compatibility Guide Cisco WebEx Social API Reference Guide Obtaining Documentation Obtaining Support and Security Guidelines For information on obtaining documentation obtaining support providing documentation feedback security guidelines and also recommended aliases and general Cisco documents see the monthly What s New in Cisco Product Documentation which also lists all new and revised Cisco technical documentation at http www cisco com en US docs general whatsnew whatsnew html Cisco Product Security Overview This product contains cryptographic features and is subject to United States and local cou
63. ocial Troubleshooting Guide Release 3 0 01 27146 02 EN Chapter4 Logs Understanding Logs May 29 16 00 09 quad queue 2 collectd 3793 GenericJMXConfValue query Querying attribute TotalEnqueueCount failed May 29 16 00 09 quad queue 2 collectd 3793 GenericJMXConfValue query getAttribute failed javax management RuntimeMBeanException java lang NullPointerException This is normal behavior in this case as the other AMQ node is currently active Failure Core Service is Down for an Extended Period of Time These log entries are generated when a core service has not been running for an extended period of time 1335317564 SERVICE ALERT quad test example com ntpd CRITICAL SOFT 1 CRITICAL PROCESS ntpd failed to start 1335317624 SERVICE ALERT quad test example com ntpd CRITICAL SOFT 2 CRITICAL PROCESS ntpd failed to start 1335317684 SERVICE ALERT quad test example com ntpd CRITICAL SOFT 3 CRITICAL PROCESS ntpd failed to start 1335317744 SERVICE ALERT quad test example com ntpd CRITICAL HARD 4 CRITICAL PROCESS ntpd failed to start 1335317744 SERVICE NOTIFICATION testQGexample com quad test example com ntpd CRITICAL notify service by email CRITICAL PROCESS ntpd failed to start 1335318044 SERVICE ALERT quad test example com ntpd OK HARD 4 OK Total 1 services are monitored 1335318044 SERVICE NOTIFICATION test example com quad test example com ntpd OK notify service by email
64. ocial components This chapter is organized as follows Core Functionality FAQs and Troubleshooting page 1 1 Email Integration FAQs and Troubleshooting page 1 2 e Calendar FAQs and Troubleshooting page 1 4 e Video Calls FAQs and Troubleshooting page 1 6 e Search FAQs and Troubleshooting page 1 8 Health and Performance Monitoring FAQs and Troubleshooting page 1 9 Logs FAQs and Troubleshooting page 1 10 Director FAQs and Troubleshooting page 1 12 e Worker FAQs and Troubleshooting page 1 13 Message Queue FAQs and Troubleshooting page 1 13 e Analytics FAQs and Troubleshooting page 1 14 My Library FAQs and Troubleshooting page 1 14 Framework FAQs and Troubleshooting page 1 15 e Streams FAQs and Troubleshooting page 1 15 UC Integrations FAQs and Troubleshooting page 1 16 Core Functionality FAQs and Troubleshooting Core Functionality Troubleshooting page 1 1 Core Functionality Troubleshooting This section provides the following troubleshooting information e Symptom File attached to an update is not visible in full page view Cisco WebEx Social Troubleshooting Guide Release 3 0 01 27146 02 EN Chapter1 FAQs and Troubleshooting Email Integration FAQs and Troubleshooting Symptom File attached to an update is not visible in full page view Possible Cause This issue can appear when you have your browser idle in Cisco WebEx Social for a long period for example 8 hours Mor
65. operation e INFO to track cache misses This level should be relatively safe to use for long periods of time DEBUG to track all calls to the cache Avoid using this level for long periods on production environments TRACE if you want to see the responses from the different servers and should be used for troubleshooting purposes on a case by case basis When viewing logs look for the AGGREGATED CALENDAR log key Can I switch a user from Microsoft Exchange to Lotus Domino or vice versa The described is not possible in the current release After the user account has been configured to connect to a certain type of calendar server it cannot be changed In Account Settings the user continues to see the same type of calendar server even if the administrator changes the type for the organization in Control Panel In what time zone are the calendar events displayed The Calendar application displays events in the time zone of the browser Server side all dates are accepted and returned in UTC Date transformation to user time is performed in the browser Calendar Troubleshooting Step 1 Step 2 Step 3 Step 4 This section provides the following troubleshooting information Symptom LDAP user cannot connect to Microsoft Exchange Server through WebDAV Symptom Domino users who connect through SSL cannot connect after upgrading WebEx Social Symptom LDAP user cannot connect to Microsoft Exchange Server through WebDAV Possi
66. os cpu gt 25 for 5 po Syslog Err Msg ntpd Process pid Restart process ntpd cpu gt 25 for 5 po Syslog Err Msg notifier Process pid Restart Notifier process openfire cpu gt 98 for 5 po Syslog Err Msg 01 27146 02 Cisco WebEx Social Troubleshooting Guide Release 3 0 H Chapter3 Performance and Health Monitoring Hs Monitored Health Metrics Table 3 2 Monitored Health Metrics continued CheckName Filename Type Checks Action Role postfix Process pid Restart Director Worker process postfix cpu gt 40 for 2 poll Syslog Err Msg cpu gt 60 for 5 poll Restart Built in monit protocol check for Syslog Err Msg SMTP for 1 poll Children gt 2000 Syslog Err Msg Memory 2GB for 2 poll Restart puppet Process pid Restart process puppet cpu gt 98 for 5 poll Syslog Err Msg puppetmaster Process pid Restart Director process puppetmaster tcp on port 8140 for 1 poll Syslog Err Msg cpu gt 98 for 5 poll Syslog Err Msg quad Process pid Restart WebEx Social process quad cpu gt 98 for 5 poll Syslog Err Msg message queue Process pid Restart Message Queue process rabbitmq cpu gt 98 for 5 poll Syslog Err Msg rsyslog Process pid Restart process rsyslog tcp on port 514 for 1 poll Syslog Err Msg Director cpu gt 50 for 5 poll Syslog Err Msg All saltmaster Process
67. plication gt Security but it does not seem to be taking effect Cisco WebEx Social Troubleshooting Guide Release 3 0 EN OL 27146 02 Chapter FAQs and Troubleshooting Worker FAQs and Troubleshooting Symptom I have uploaded a new security cerfiticate using Application gt Security but it does not seem to be taking effect Possible Cause Puppet did not restart the nodes the certificates were pushed to Recommended Action Manually restart all App Server and Worker nodes Worker FAQs and Troubleshooting e Worker FAQs page 1 13 Worker FAOs e Q What tasks are processed by the Worker role Q What tasks are processed by the Worker role A In the current release the following features leverage the worker framework e Email digest generation Outbound email processing Metrics and reports generation e Activity feed processing Data migration Message Queue FAQs and Troubleshooting Message Queue Troubleshooting page 1 13 Message Queue Troubleshooting This section provides the following troubleshooting information e Symptom Executing service rabbitmq server stop doesn t seem to stop RabbitMQ e Symptom Iremoved a node from a cluster and now rabbitmq is not functioning correctly e Symptom RabbitMQ fails to start and shows this error ERROR failed to load application on client no such file or directory amqp client app Symptom Executing service rabbitmq server stop
68. re opt oracle app oracle diag rdbms quad rdfprod quad rdfprod cdump opt oracle app oracle admin quad rdfprod adump opt oracle app oracle diag tnslsnr listener alert log xml lopt oracle app oracle diag tnslsnr listener trace listener log lopt oracle app oracle diag rdbms quad rdfprod quad rdfprod trace trc trm Common logs var log sa sa all roles var log httpd ssl log var log anaconda var log btmp var log dmesg var log dracut log Understanding Logs This section contains log excerpts for variuos normal and abnormal events as follows Monit Starts Up page 4 6 Monit Check Failed page 4 6 Manually Restarting Monit page 4 6 Resource Overutilization page 4 6 Purging opt page 4 6 Nagios Starts Up Shuts Down page 4 7 Common False Positives page 4 7 Failure Core Service is Down for an Extended Period of Time page 4 8 Rsyslog Starts Up Shuts Down page 4 8 Rsyslog is Rate Limited page 4 9 Service is Down page 4 9 Analytics Service Initialized Successfully page 4 9 MapReduce Scheduler Logs page 4 9 Calendar Logs page 4 10 Framework Logs page 4 19 Streams Logs page 4 19 01 27146 02 Cisco WebEx Social Troubleshooting Guide Release 3 0 H Chapter4 Logs Understanding Logs Monit Starts Up These log entries are generated during normal monit startup Mar 15 20 40 35 quad web a monit 19684 Shutting down monit HTTP server Mar
69. res debugging procedures maintenance and remedial procedures and other general information that may be used in other chapters of this guide This chapter is organized as follows e Obtaining Third Party Tools page 2 1 Modifying Advanced Portal Properties page 2 1 e Checking Where solr Indexes Reside page 2 2 Obtaining Third Party Tools The following publicly available troubleshooting tools or equivalent are required for some of the instructions in this chapter e WinSCP Utility for navigating and transferring files to from nix servers through SFTP SCP or FTP Freeware available at www winscp net e puTTY SSH client used to invoke CLI on nix servers Available at http www putty org Firebug Firefox plug in that allows real time debugging of web pages Obtain at http getfirefox com Modifying Advanced Portal Properties You may want to change various Advanced Portal Properties when following the troubleshooting instructions in this document To avoid clutter instructions as to how to modify an advanced property are not always provided Instead refer to the Cisco WebEx Social Administration Guide for the instructions Cisco WebEx Social Troubleshooting Guide Release 3 0 01 27146 02 EN Chapter2 General Procedures Checking Where solr Indexes Reside Checking Where solr Indexes Reside On Search Store Nodes These instructions apply to both master and slave nodes Log in to the ma
70. rmance statistics as collected by collectd Cisco WebEx Social Troubleshooting Guide Release 3 0 OL 27146 02 Chapter3 Performance and Health Monitoring Monitored Health Metrics Cisco WebEx Social Troubleshooting Guide Release 3 0 01 27146 02 Chapter3 Performance and Health Monitoring Hs Monitored Health Metrics Cisco WebEx Social Troubleshooting Guide Release 3 0 01 27146 02 Logs This chapter provides information about log file names and locations as well as other log related information This chapter is organized as follows Logs Overview page 4 1 Log Files Stored on the Director by Role page 4 1 e Localy stored Log Files by Role page 4 4 e Understanding Logs page 4 5 Logs Overview Most Cisco WebEx Social logs are centralized on the Director node There are a few exceptions log files with dynamic name patterns and non critical logs where log files are managed localy on nodes instead of streaming to the Director node Cisco WebEx Social uses rsyslog as a logging framework rsyslog sends critical logs to the Director node but if configured can also stream logs to an upstream host see the Cisco WebEx Social Administration Guide for details The central log location on the Director node is opt logs date where date is the date that the log message was written For example opt logs 2012 12 01 would contain all log messages generated on Dec 1 201
71. rn schemas calendar dtend amp lt CAST 2012 05 06T20 59 59 999Z as dateTime AND urn schemas calendar dtstart amp gt CAST 2012 03 25T21 00 00 000Z as dateTime ORDER BY urn schemas calendar dtstart ASC lt d sql gt lt d searchrequest gt Get the response INFO 13 52 37 466 AGGREGATED_CALENDAR 78 Number of events we got 7 TRACE 13 52 37 475 AGGREGATED_CALENDAR 53 Response Document lt xml version 1 0 encoding UTF 16 gt lt a multistatus xmlns a DAV xmlns b urn uuid c2f41010 65b3 11d1 a29f 00aa00c14882 xmilns c xml xmlns d urn schemas httpmail xmlns e urn schemas calendar xmlns f urn schemas mailheader xmlns g http schemas microsoft com mapi gt lt gt lt a href gt https 198 51 100 35 exchange vm2007 Calendar Have 20fun 5 EML lt a href gt lt a propstat gt lt a status gt HTTP 1 1 200 OK lt a status gt lt a prop gt lt d subject gt Have fun lt d subject gt lt e location gt some location lt e location gt lt e uid gt 040000008200E00074C5B7101A82E008000000006C327C3319FDCC010000000000000000100000003AD41318CF A170488967581FBBC63202 e uid e instancetype b dt int gt 3 lt e instancetype gt lt d htmldescription gt amp lt DOCTYPE HTML PUBLIC W3C DTD HTML 3 2 EN amp gt amp lt HTML amp gt amp lt amp lt EQUIV Content Type CONTENT text html charset utf 8 amp gt amp lt META NAME Gener
72. ror caught SyntaxError missing before statement Recommended Action Try reloading the page if the problem persists try loading the page with another web browser Framework FAQs and Troubleshooting Framework FAQs page 1 15 Framework FAQs e How do I set the log trace levels for the framework Q How do I set the log trace levels for the framework Assystem administrator go to Account Settings gt Server gt Server Administration gt Log Properties and set the Portal UI Framework category ERROR for normal operation DEBUG to get more information Streams FAQs and Troubleshooting e Streams FAQs page 1 15 Streams FAQs e Q How do I set the log trace levels for Streams Q How do I set the log trace levels for Streams Cisco WebEx Social Troubleshooting Guide Release 3 0 01 27146 02 EZ Chapter1 FAQs and Troubleshooting UC Integrations FAQs and Troubleshooting Assystem administrator go to Account Settings gt Server gt Server Administration gt Log Properties and set these categories SocialActivity Application For general logging Set ERROR for normal operation and DEBUG to get more information Note that leaving the DEBUG level on significantly affects the performance of the system Notification lIf you want to check logs for dynamic XMPP updates Set ERROR for normal operation and DEBUG to get more information Note that leaving the DEBUG level on
73. ror occurred message Symptom When I do a global or local search I get the Internal Server 500 error Possible Cause Unfunctioning service Recommended Action Check if the master Search Store all slave Search Store nodes and the Index Store if enabled are operational These are actions you can take On Search Store nodes run this command as admin sudo service search status On the Index Store node run this command as admin sudo service searchcache status Check if the Java process is running by running this command on all nodes as admin sudo ps ef grep start jar Log in to the solr administrator portal page to check if solr searchcache is up Possible Cause Misconfiguration Recommended Action Check if the master Search Store all slave Search Store nodes and the Index Store if enabled are properly configured in portal ext properties on the App Server These parameters must be set in accordance with your specific deployment solr masters solr slave region 1 and other slaves if solr slave regions gt 1 search cache url search cache post url search cache video url search cache social url search cache follower url Possible Cause Not enough disk space Recommended Action Check disk space on each Search Store machine using the df h command and if the machine has run out of disk space stop Search service search stop clean up disk space and then restart Search service search start Cisco WebEx Social T
74. roubleshooting Guide Release 3 0 OL 27146 02 Chapter FAQs and Troubleshooting Step 1 Step 2 Step 3 Step 4 Health and Performance Monitoring FAQs and Troubleshooting Possible Cause Server errors 500 Internal Server Error Recommended Action If you are getting 500 Internal Server Error in the logs the App Server logs the master slave Search Store logs or the Index Store request logs under insread of 200 status codes for each request then the machine may be out of disk space or the indexes may be corrupt If the machine is out of disk space see the of disk space Possible Cause above Otherwise the indexes may be corrupt Take these corrective steps First verify that the indexes are indeed corrupted Check solr out log in solr bin logs Indexes most probably corrupt if the log file contains either of the following e lucene error messages e Non 200 statuses of HTTP requests e Lock related error messages such as org apache solr common SolrException Lock obtain timed out SimpleFSLock Another symptom is to see a core or more missing in the Index Store administrator portal There should be a total of 5 cores linked as Admin post Admin video Admin social Admin follower and Admin autocomplete If any of those cores is missing chances are that it is corrupt and you should see 404 error messages in the Index Store logs for the missing core After you have ide
75. saved as new posts containing the entire email thread as opposed to comments to the original content Possible Cause This issue can arise if the original email has not yet been processed by Cisco WebEx Social Recommended Action If you experience this issue often check the Dashboard for the Worker nodes Director GUI gt Stats If the App Server Worker nodes are under heavy load as indicated by the CPU and Load charts then consider adding more App Server or Worker nodes or both Symptom Users are not receiving any emails generated by Cisco WebEx Social Possible Cause Your email relay is not relaying messages coming from Cisco WebEx Social Recommended Action Configure your email relay host to properly relay messages coming from Worker nodes Calendar FAQs and Troubleshooting Calendar FAQs page 1 4 e Calendar Troubleshooting page 1 5 Calendar FAQs e How do I set the log trace levels for the Calendar Q CanI switch a user from Microsoft Exchange to Lotus Domino or vice versa e In what time zone are the calendar events displayed Q How do I set the log trace levels for the Calendar Assystem administrator go to Account Settings gt Server gt Server Administration gt Log Properties and set the Calendar category to Cisco WebEx Social Troubleshooting Guide Release 3 0 Em OL 27146 02 Chapter 1 FAQs and Troubleshooting Calendar FAQs and Troubleshooting ERROR for normal
76. see that there are no scheduler logs being generated go to the Director gt Configuration and check the running schedule it is set to run at midnight GMT by default If the schedule run has passed check if the MessageQueue Scheduler Queue has some messages stuck If you see the messages are stuck check if the Worker role shows exceptions If there are no exceptions ensure Message Queue is working properly Calendar Logs This section explains the following procedures from logging standpoint e Getting a Month Worth of Meetings with Configured Domino and WebEx No Cached Data page 4 10 e Getting a Month Worth of Meetings with Configured Domino and WebEx Cached Data page 4 12 e Getting a Month Worth of Meetings with Configured WebDAV No Cached Data page 4 13 e Selecting a Domino Event from the List of Events page 4 18 Getting a Month Worth of Meetings with Configured Domino and WebEx No Cached Data Step 1 Step 2 Step 3 When you click on the arrow to go to the next month in the Calendar application assuming that this is the first time you request the data that is there is no data in the cache the application goes through the following steps logging the respective messages Display the Domino settings that are used to connect to Domino DEBUG 14 07 40 269 AGGREGATED CALENDAR 65 Using Domino Calendar settings for user r3 Username vmdomino domino Password URL 198 51 100 35 Domain do
77. shooting Director FAQs Director FAQs page 1 12 Director Troubleshooting page 1 12 Q Enable Disable buttons are missing for some roles on the Topology page Q What is Certificate Management Enable Disable buttons are missing for some roles on the Topology page Starting from this release you do not have the option to Enable Disable most roles Only the App Server Worker and Cache roles have Enable Disable buttons What is Certificate Management Certificate Management is a new feature of the Director UI Its main function is to help streamline the management and deployment of various certificates and keys used throughout Cisco WebEx Social from one centralized UI Additionally because the uploaded keystores certificates are persisted as part of the Director DB they are preserved during backup and restores In the current version the following functional areas are managed by Certificate Management e WebEx Meetings SSO keystore management WebEx Instant Messaging keystore management e Certificate Authority Trust Certificate management including LDAPS LDAP over SSL Visual Voicemail replaces the existing Visual Voicemail keystore UI OpenSocial Show and Share integration when connecting over SSL and Sharepoint integration when connecting over SSL Director Troubleshooting This section provides the following troubleshooting information Symptom I have uploaded a new security cerfiticate using Ap
78. the system level kernel Note that this does not include time spent servicing hardware and software interrupts user Percentage of CPU utilization that occurred while executing at the user level application wait Percentage of time that the CPU or CPUs were idle during which the system had an outstanding disk I O request Cisco WebEx Social Troubleshooting Guide Release 3 0 01 27146 02 EN Chapter 3 Performance and Health Monitoring Collected Performance Data Table 3 1 Collected Performance Data continued Type Instance Matrix Description Role Disk Usage boot used Used space on partition boot reserved Space on boot partition reserved for root user free Free space on partition boot opt used Used space on partition opt reserved Space on opt partition reserved for root user free Free Space on opt partition root used Used space on partition reserved Space on opt partition reserved for root user free Free Space on opt partition Disk sda sdal sda2 sdb disk merged The number of read operations that could be merged into other read already queued operations i e one physical disk access served two or more logical operations disk merged The number of write operations that could be merged into other write already queued operations i e one physica
79. to radio or television reception try to correct the interference by using one or more of the following measures Turn the television or radio antenna until the interference stops Move the equipment to one side or the other of the television or radio Move the equipment farther away from the television or radio Plug the equipment into an outlet that is on a different circuit from the television or radio That is make certain the equipment and the television or radio are on circuits controlled by different circuit breakers or fuses Modifications to this product not authorized by Cisco Systems Inc could void the FCC approval and negate your authority to operate the product The Cisco implementation of TCP header compression is an adaptation of a program developed by the University of California Berkeley UCB as part of UCB s public domain version of the UNIX operating system rights reserved Copyright O 1981 Regents of the University of California NOTWITHSTANDING ANY OTHER WARRANTY HEREIN ALL DOCUMENT FILES AND SOFTWARE OF THESE SUPPLIERS ARE PROVIDED AS IS WITH ALL FAULTS CISCO AND THE ABOVE NAMED SUPPLIERS DISCLAIM ALL WARRANTIES EXPRESSED OR IMPLIED INCLUDING WITHOUT LIMITATION THOSE OF MERCHANTABILITY FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT OR ARISING FROM A COURSE OF DEALING USAGE OR TRADE PRACTICE IN NO EVENT SHALL CISCO OR ITS SUPPLIERS BE LIABLE FOR ANY INDIRECT SPECIAL CONSEQUENTIAL OR INCID
80. us TENTATIVE textDescription When Wednesday March 28 2012 3 00 AM 4 00 AM GMT 08 00 Pacific Time US amp Canada Where some location some body here startDate Wed Mar 28 10 00 00 GMT 2012 endDate Wed Mar 28 11 00 00 GMT 2012 isRecurring true recurrencePattern null hasPartialMeetingData false webExDetails 1 null DEBUG 13 52 37 531 AGGREGATED CALENDAR 65 Event Object eventId 040000008200E00074C5B7101A82E008000000006C5CD2 E7F2F2CC01000000000000000010000000A6 30507C9F849A4D9D57EC07207E54ED subject VM2010 is a host vm 2007 is invitee location Location organizer email vm2010 ex7aquila com screenName fullName vm2010 attendees email vm2007 ex7aquila com screenName fullName vm2007 nonSendableTo required null resource null htmlDescription null hasattachment false importance null allDayEvent false reminderOffset 900 href https 198 51 100 35 exchange vm2007 Calendar VM2010 20is 20a 20host 20vm 2020072 20is 20i nvitee 2 EML busyStatus TENTATIVE textDescription When Wednesday March 28 2012 11 00 AM 12 00 PM GMT 08 00 Pacific Time US amp Canada Where Location Body startDate Wed Mar 28 18 00 00 GMT 2012 endDate Wed Mar 28 19 00 00 GMT 2012 isRecurring false 01 27146 02 Cisco WebEx Social Troubleshooting Guide Release 3 0 gy Chapter4 Logs Understanding Lo
81. uts Down 4 8 Rsyslog is Rate Limited 4 9 Service is Down 4 9 Analytics Service Initialized Successfully 4 9 MapReduce Scheduler Logs 4 9 Calendar Logs 4 10 Getting a Month Worth of Meetings with Configured Domino and WebEx No Cached Data 4 10 Getting a Month Worth of Meetings with Configured Domino and WebEx Cached Data 4 12 Cisco WebEx Social Troubleshooting Guide Release 3 0 mm OL 27146 02 Contents MI Getting a Month Worth of Meetings with Configured WebDAV No Cached Data 4 13 Selecting a Domino Event from the List of Events 4 18 Framework Logs 4 19 Incorrect Theme ID 4 19 Streams Logs 4 19 Errors During Interpretation 4 19 VDL Backend Debugging 4 20 Cisco WebEx Social Troubleshooting Guide Release 3 0 01 27146 02 m Contents Cisco WebEx Social Troubleshooting Guide Release 3 0 mm OL 27146 02 Preface Overview This guide provides troubleshooting hints FAQs and other information which can help you find and repair known faults which may occur with Cisco WebEx Social and its components Audience This manual is intended for the system or portal administrator of Cisco WebEx Social It can also be used by someone who administers a Cisco WebEx Social community Organization This manual is organized as follows Chapter Description FAQs and Troubleshooting Provides hints on how to overcome known issues or difficulties with configuring operating or using Cisco WebEx S
82. work interface lo if_errors rx All if_errors tx if_packets tx Cisco WebEx Social Troubleshooting Guide Release 3 0 OL 27146 02 Chapter3 Performance and Health Monitoring Collected Performance Data Table 3 1 Collected Performance Data continued Type Instance Matrix Description Role Load longterm longterm represents the average system load over 15 min period All of time midterm midterm represents the average system load over 5 min period of time shortterm shortterm represents the average system load over 1 min period of time Refer top w uptime man page for more details Memory buffered The amount of memory used as buffers cached The amount of memory used for caching free The amount of idle memory used The amount of memory used Refer free vmwtat man page for more details NTP frequency offset loop time dispersion local lt NTPServer gt Value indicates the magnitude of jitter between several time queries in MS time_offset error All loop lt NTPServer gt Value shows the difference between the reference time and the system clock in MS delay lt NTPServer gt Value is derived from the roundtrip time of the queries in MS All Swap swap cached Memory that once was swapped out is swapped back in but still All also is in the swapfile if memory is needed it doesn t need to be swapped out AGAIN because it is alread
83. y in the swapfile This saves I O http www redhat com advice tips meminfo html free Total amount of swap space available used Total amount of swap space used swap_io in Amount of memory swapped in from disk All out Amount of memory swapped out from disk Uptime uptime Second since VM is running All Cisco WebEx Social Troubleshooting Guide Release 3 0 01 27146 02 Chapter 3 Performance and Health Monitoring Collected Performance Data Table 3 1 Collected Performance Data continued Type Instance Matrix Description VMWare CPU elapsed ms Retrieves the number of milliseconds that have passed in the virtual machine since it last started running on the server The count of elapsed time restarts each time the virtual machine is powered on resumed or migrated using VMotion limit mhz Retrieves the upper limit of processor use in MHz available to the virtual machine reservation mhz Retrieves the minimum processing power in MHz reserved for the virtual machine shares Retrieves the number of CPU shares allocated to the virtual machine stolen ms Retrieves the number of milliseconds that the virtual machine was in a ready state able to transition to a run state but was not scheduled to run used ms Retrieves the number of milliseconds during which the virtual machine has used the CPU This value includes the time use
84. zing New PID 9417 1335307549 Auto save of retention data completed successfully 1336003770 Caught SIGTERM shutting down 1336003770 Successfully shutdown 9417 Common False Positives These false positives are known to appear e Node is No Longer Active Available but Exists in the Topology e Monit service Not Running on a Node e Chart Data Missing for a Node Node is No Longer Active Available but Exists in the Topology 1335313142 SERVICE ALERT test example com Load midterm UNKNOWN HARD 4 check graphite stats err getData failed 500 1335296859 SERVICE ALERT test example com Disk opt CRITICAL SOFT 1 CRITICAL Exception Errno 113 No route to host Monit service Not Running on a Node Node name in the example test example com 1335946047 SERVICE NOTIFICATION nagiosadmin test example com cron CRITICAL notify service by email CRITICAL Exception Errno 111 Connection refused Chart Data Missing for a Node The charts are fed by collectd If you are missing data for a particular node look for the collectd log on the Director for that node In many cases the counters are either 0 or missing for certain attributes on certain nodes For example with ActiveMQ there is only one active node at any one time The other node is in standby mode waiting to take over The resulting log messages look like this for the standby AMQ node Cisco WebEx S

Cisco WebEx Social Troubleshooting Guide, Release 3.0

Contents

Download Pdf Manuals

Related Search

Related Contents