Skip to Content.
Sympa Menu

perfsonar-user - Re: [perfsonar-user] MaDDash crashed due to email send fail

Subject: perfSONAR User Q&A and Other Discussion

List archive

Re: [perfsonar-user] MaDDash crashed due to email send fail


Chronological Thread 
  • From: Andrew Lake <>
  • To: perfsonar-user <>, Hyojoon Kim <>
  • Subject: Re: [perfsonar-user] MaDDash crashed due to email send fail
  • Date: Fri, 8 Dec 2017 06:04:50 -0800
  • Ironport-phdr: 9a23:DE3p1RJ/nnv/68oBfNmcpTZWNBhigK39O0sv0rFitYgfLfTxwZ3uMQTl6Ol3ixeRBMOAuqIC07KempujcFRI2YyGvnEGfc4EfD4+ouJSoTYdBtWYA1bwNv/gYn9yNs1DUFh44yPzahANS47xaFLIv3K98yMZFAnhOgppPOT1HZPZg9iq2+yo9ZDeZwZFiCChbb9uMR67sRjfus4KjIV4N60/0AHJonxGe+RXwWNnO1eelAvi68mz4ZBu7T1et+ou+MBcX6r6eb84TaFDAzQ9L281/szrugLdQgaJ+3ART38ZkhtMAwjC8RH6QpL8uTb0u+ZhxCWXO9D9QLYpUjqg8qhrUgflhicFOD4392/YhcJ+gqFGrhy/uxNy2JTbbJ2POfdkZK7RYdEXSGxcVchRTSxBBYa8YpMTAuoHIOlYtZfyplUTphW4HwasB/3gwSJPi3Ds2601zuQgHBrY0ww7Bd4OtmrbrMnsOaoUTOu7wq7IzTDZYPNX3zfw8IjIcgw9ofGURrJ/b9DRyVcxGAPflVWQtZbqPymJ1usTrmeX9e1gVfigi2I/qQFxpSOgxt0xionPnYIVyk7L9SF9wIovP924VUh7bca4EJtQrSGVKZF5Td44T2FypSY6zKUKuZuhcycX1Zso3QXfa/ydf4iK5RLsT/2RLS9jhHJhdrKyiBSy/VKnyu3mWcm4yFBKritCktXWqn8N1wTf5tWZRvZ/5EutxSyD2xzJ5u1ZOUw0jrfbK5g7zr42iJUTrVzPHjTol0XykqCZalkk+u+y6+T9f7XmoJmcOJFuig3kKKQuh8q/DOIlOQYNR2iW4fmw2KPg8EHjTrhGlPI7nrTDvJ3bJskXvrC1DxNR34o56BuyDy2q3MoFkXQINl5Ieg+Lgo70MF/UOv/4F+2wg1G0nTdr2f/GOrrhD43DLnfdnrrtZ7J95FVYyAYpwtBf4IxUBqkAIPL1REDxqMTVAgInPwG32erqBs9x24wDVW6VA6KUM7vesVqS6eIuJ+mMapUVuDH4K/U9/fHui2I2mF8GcKa3xpsbcna4Eep6I0mBe3rjns8BEXsWvgo5VOHqkEONUSRdZ3apWKI84Cs0CJi/AYfeXYCinqaB0Ty/Hp1XfWBGFkuMHWnye4WFXfcMdDydItVnkjMaSbitVZUt2g+zuw/nmPJbKb/M9zcWrpXl3cIw+vbej1lm7TFuAd+a1WiXCnxvk3kgRjkq0bp5rFAnjFqPzP48y9xJEt5U4PUBcQY/fcreyOt8CPjqQAPHddqVT1DgT9m7V2IfVNU0lvYIb1xwBJ2GhxPOl36jBbMEv7GQQpo57vSPjDDKO89hxiOeh+EahF48T54XOA==

Hi,

I think the error that caused the crash was not the email exception, but the "java.lang.UnsatisfiedLinkError: no net in java.library.path” error. That can happen if Java gets updated while your java process is running. In theory a restart should fix that. As for the email exception if you would like that to go away you either need to run sendmail if you want to get notification email or you need to remove the you need to remove the “notifications” section of /etc/maddash/maddash-server/maddash.yaml.

Thanks,
Andy



On December 7, 2017 at 3:47:26 PM, Hyojoon Kim () wrote:

Hi, 

MaDDash process crashed around 2am today (12/7/2017) in our MaDDash server (v2.0.2-1.el6).  

Based on "/var/log/maddash/maddash-server.out”, it seems it was because MaDDash failed sending a notification email. I thought this crash scenario was worth sharing. 

Thanks, 
Joon 


JarClassLoader: Warning: com/mchange/v2/util/ResourceClosedException.class in lib/c3p0-0.9.1.1.jar is hidden by lib/mchange-commons-java-0.2.11.jar (with different bytecode)
SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
SLF4J: Defaulting to no-operation (NOP) logger implementation
MLog initialization issue: slf4j found no binding or threatened to use its (dangerously silent) NOPLogger. We consider the slf4j library not found.
Dec 07, 2017 2:10:29 AM org.glassfish.grizzly.http.server.NetworkListener start
INFO: Started listener bound to [localhost:8881]
Dec 07, 2017 2:10:29 AM org.glassfish.grizzly.http.server.HttpServer start
INFO: [HttpServer] Started.
org.apache.commons.mail.EmailException: Sending the email to the following server failed : 127.0.0.1:25
        at org.apache.commons.mail.Email.sendMimeMessage(Email.java:1421)
        at org.apache.commons.mail.Email.send(Email.java:1448)
        at net.es.maddash.notifications.EmailNotification.send(EmailNotification.java:203)
        at net.es.maddash.jobs.NotifyJob.execute(NotifyJob.java:173)
        at org.quartz.core.JobRunShell.run(JobRunShell.java:202)
        at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:573)
Caused by: java.lang.InternalError
        at sun.misc.URLClassPath$JarLoader.getResource(URLClassPath.java:875)
        at sun.misc.URLClassPath.getResource(URLClassPath.java:226)
        at sun.misc.URLClassPath.getResource(URLClassPath.java:278)
        at java.lang.ClassLoader.getBootstrapResource(ClassLoader.java:1308)
        at java.lang.ClassLoader.getResource(ClassLoader.java:1147)
        at java.lang.ClassLoader.getResource(ClassLoader.java:1145)
        at java.lang.ClassLoader.getSystemResource(ClassLoader.java:1270)
        at java.lang.ClassLoader.getSystemResourceAsStream(ClassLoader.java:1373)
        at java.lang.Class.getResourceAsStream(Class.java:2109)
        at javax.activation.SecuritySupport$2.run(SecuritySupport.java:63)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.activation.SecuritySupport.getResourceAsStream(SecuritySupport.java:60)
        at javax.activation.MailcapCommandMap.loadResource(MailcapCommandMap.java:178)
        at javax.activation.MailcapCommandMap.<init>(MailcapCommandMap.java:163)
        at javax.activation.CommandMap.getDefaultCommandMap(CommandMap.java:72)
        at javax.activation.DataHandler.getCommandMap(DataHandler.java:154)
        at javax.activation.DataHandler.getDataContentHandler(DataHandler.java:617)
        at javax.activation.DataHandler.writeTo(DataHandler.java:316)
        at javax.mail.internet.MimeUtility.getEncoding(MimeUtility.java:323)
        at javax.mail.internet.MimeBodyPart.updateHeaders(MimeBodyPart.java:1495)
        at javax.mail.internet.MimeBodyPart.updateHeaders(MimeBodyPart.java:1125)
        at javax.mail.internet.MimeMultipart.updateHeaders(MimeMultipart.java:515)
        at javax.mail.internet.MimeBodyPart.updateHeaders(MimeBodyPart.java:1458)
        at javax.mail.internet.MimeMessage.updateHeaders(MimeMessage.java:2190)
        at javax.mail.internet.MimeMessage.saveChanges(MimeMessage.java:2151)
        at javax.mail.Transport.send(Transport.java:123)
        at org.apache.commons.mail.Email.sendMimeMessage(Email.java:1411)
        ... 5 more
Caused by: java.io.FileNotFoundException: /usr/lib/jvm/java-1.7.0-openjdk-1.7.0.151.x86_64/jre/lib/resources.jar
        at sun.misc.URLClassPath$JarLoader.getJarFile(URLClassPath.java:763)
        at sun.misc.URLClassPath$JarLoader.access$700(URLClassPath.java:626)
        at sun.misc.URLClassPath$JarLoader$1.run(URLClassPath.java:711)
        at sun.misc.URLClassPath$JarLoader$1.run(URLClassPath.java:704)
        at java.security.AccessController.doPrivileged(Native Method)
        at sun.misc.URLClassPath$JarLoader.ensureOpen(URLClassPath.java:703)
        at sun.misc.URLClassPath$JarLoader.getResource(URLClassPath.java:873)
        ... 31 more
org.apache.commons.mail.EmailException: Sending the email to the following server failed : 127.0.0.1:25
        at org.apache.commons.mail.Email.sendMimeMessage(Email.java:1421)
        at org.apache.commons.mail.Email.send(Email.java:1448)
        at net.es.maddash.notifications.EmailNotification.send(EmailNotification.java:203)
        at net.es.maddash.jobs.NotifyJob.execute(NotifyJob.java:173)
        at org.quartz.core.JobRunShell.run(JobRunShell.java:202)
        at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:573)
Caused by: java.lang.InternalError
        at sun.misc.URLClassPath$JarLoader.getResource(URLClassPath.java:875)
        at sun.misc.URLClassPath.getResource(URLClassPath.java:226)
        at sun.misc.URLClassPath.getResource(URLClassPath.java:278)
        at java.lang.ClassLoader.getBootstrapResource(ClassLoader.java:1308)
        at java.lang.ClassLoader.getResource(ClassLoader.java:1147)
        at java.lang.ClassLoader.getResource(ClassLoader.java:1145)
        at java.lang.ClassLoader.getSystemResource(ClassLoader.java:1270)
        at java.lang.ClassLoader.getSystemResourceAsStream(ClassLoader.java:1373)
        at java.lang.Class.getResourceAsStream(Class.java:2109)
        at javax.activation.SecuritySupport$2.run(SecuritySupport.java:63)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.activation.SecuritySupport.getResourceAsStream(SecuritySupport.java:60)
        at javax.activation.MailcapCommandMap.loadResource(MailcapCommandMap.java:178)
        at javax.activation.MailcapCommandMap.<init>(MailcapCommandMap.java:163)
        at javax.activation.CommandMap.getDefaultCommandMap(CommandMap.java:72)
        at javax.activation.DataHandler.getCommandMap(DataHandler.java:154)
        at javax.activation.DataHandler.getDataContentHandler(DataHandler.java:617)
        at javax.activation.DataHandler.writeTo(DataHandler.java:316)
        at javax.mail.internet.MimeUtility.getEncoding(MimeUtility.java:323)
        at javax.mail.internet.MimeBodyPart.updateHeaders(MimeBodyPart.java:1495)
        at javax.mail.internet.MimeBodyPart.updateHeaders(MimeBodyPart.java:1125)
        at javax.mail.internet.MimeMultipart.updateHeaders(MimeMultipart.java:515)
        at javax.mail.internet.MimeBodyPart.updateHeaders(MimeBodyPart.java:1458)
        at javax.mail.internet.MimeMessage.updateHeaders(MimeMessage.java:2190)
        at javax.mail.internet.MimeMessage.saveChanges(MimeMessage.java:2151)
        at javax.mail.Transport.send(Transport.java:123)
        at org.apache.commons.mail.Email.sendMimeMessage(Email.java:1411)
        ... 5 more
Caused by: java.io.FileNotFoundException: /usr/lib/jvm/java-1.7.0-openjdk-1.7.0.151.x86_64/jre/lib/resources.jar
        at sun.misc.URLClassPath$JarLoader.getJarFile(URLClassPath.java:763)
        at sun.misc.URLClassPath$JarLoader.access$700(URLClassPath.java:626)
        at sun.misc.URLClassPath$JarLoader$1.run(URLClassPath.java:711)
        at sun.misc.URLClassPath$JarLoader$1.run(URLClassPath.java:704)
        at java.security.AccessController.doPrivileged(Native Method)
        at sun.misc.URLClassPath$JarLoader.ensureOpen(URLClassPath.java:703)
        at sun.misc.URLClassPath$JarLoader.getResource(URLClassPath.java:873)
        ... 31 more
Dec 07, 2017 2:57:13 PM org.glassfish.grizzly.nio.SelectorRunner doSelect
SEVERE: doSelect exception
java.lang.UnsatisfiedLinkError: no net in java.library.path
        at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1889)
        at java.lang.Runtime.loadLibrary0(Runtime.java:849)
        at java.lang.System.loadLibrary(System.java:1088)
        at sun.net.ExtendedOptionsImpl$1.run(ExtendedOptionsImpl.java:50)
        at sun.net.ExtendedOptionsImpl$1.run(ExtendedOptionsImpl.java:47)
        at java.security.AccessController.doPrivileged(Native Method)
        at sun.net.ExtendedOptionsImpl.<clinit>(ExtendedOptionsImpl.java:47)
        at sun.nio.ch.SocketChannelImpl$DefaultOptionsHolder.defaultOptions(SocketChannelImpl.java:242)
        at sun.nio.ch.SocketChannelImpl$DefaultOptionsHolder.<clinit>(SocketChannelImpl.java:229)
        at sun.nio.ch.SocketChannelImpl.supportedOptions(SocketChannelImpl.java:251)
        at sun.nio.ch.SocketChannelImpl.setOption(SocketChannelImpl.java:169)
        at sun.nio.ch.SocketAdaptor.setBooleanOption(SocketAdaptor.java:295)
        at sun.nio.ch.SocketAdaptor.setReuseAddress(SocketAdaptor.java:413)
        at org.glassfish.grizzly.nio.transport.TCPNIOTransport$DefaultChannelConfigurator.preConfigure(TCPNIOTransport.java:763)
        at org.glassfish.grizzly.nio.transport.TCPNIOServerConnection.configureAcceptedChannel(TCPNIOServerConnection.java:175)
        at org.glassfish.grizzly.nio.transport.TCPNIOServerConnection.onAccept(TCPNIOServerConnection.java:238)
        at org.glassfish.grizzly.nio.transport.TCPNIOTransport.fireIOEvent(TCPNIOTransport.java:518)
        at org.glassfish.grizzly.strategies.AbstractIOStrategy.fireIOEvent(AbstractIOStrategy.java:112)
        at org.glassfish.grizzly.strategies.SameThreadIOStrategy.executeIoEvent(SameThreadIOStrategy.java:103)
        at org.glassfish.grizzly.strategies.AbstractIOStrategy.executeIoEvent(AbstractIOStrategy.java:89)
        at org.glassfish.grizzly.nio.SelectorRunner.iterateKeyEvents(SelectorRunner.java:415)
        at org.glassfish.grizzly.nio.SelectorRunner.iterateKeys(SelectorRunner.java:384)
        at org.glassfish.grizzly.nio.SelectorRunner.doSelect(SelectorRunner.java:348)
        at org.glassfish.grizzly.nio.SelectorRunner.run(SelectorRunner.java:279)
        at org.glassfish.grizzly.threadpool.AbstractThreadPool$Worker.doWork(AbstractThreadPool.java:591)
        at org.glassfish.grizzly.threadpool.AbstractThreadPool$Worker.run(AbstractThreadPool.java:571)
        at java.lang.Thread.run(Thread.java:748)




Archive powered by MHonArc 2.6.19.

Top of Page