netty non-daemon thread blocking server shutdown

Discussion:

Colm

2012-11-23 11:41:39 UTC

Hi there,

I've observed an intermittent shutdown issue on some VMware Centos VMs being used for automated testing where the non-daemon netty thread listed below is preventing the shutdown of the JVM. We're using Akka 2.0.3 (with jdk 1.7 u5) and all Actor Systems have been shutdown. There are no other akka/netty threads present in the blocked JVM. Unfortunately (and thankfully) the behaviour cant be reproduced in other environments. Has anyone seen similar behaviour ?

Regards,

Colm.

"New I/O server boss #1 ([id: 0x434ab4fa, /<ip address>:<port>])" prio=10 tid=0x0000000011444000 nid=0x4b3c runnable [0x0000000043901000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
- locked <0x00000000ccc84038> (a sun.nio.ch.Util$2)
- locked <0x00000000ccc84048> (a java.util.Collections$UnmodifiableSet)
- locked <0x00000000ccc83ff0> (a sun.nio.ch.EPollSelectorImpl)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.jboss.netty.channel.socket.nio.NioServerSocketPipelineSink$Boss.run(NioServerSocketPipelineSink.java:227)
at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:102)
at org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:722)

Read the docs: http://akka.io/docs/
Check the FAQ: http://akka.io/faq/
Search the archives: https://groups.google.com/group/akka-user

---
You received this message because you are subscribed to the Google Groups "Akka User List" group.
To post to this group, send email to akka-user-/JYPxA39Uh5TLH3MbocFF+G/***@public.gmane.org
To unsubscribe from this group, send email to akka-user+***@googlegroups.com.
Visit this group at http://groups.google.com/group/akka-user?hl=en.

Patrik Nordwall

2012-11-23 13:07:33 UTC

Permalink

Could it be the same problem as in this ticket:
https://www.assembla.com/spaces/akka/tickets/2733 ?

Post by Colm
Hi there,
I've observed an intermittent shutdown issue on some VMware Centos VMs being used for automated testing where the non-daemon netty thread listed below is preventing the shutdown of the JVM. We're using Akka 2.0.3 (with jdk 1.7 u5) and all Actor Systems have been shutdown. There are no other akka/netty threads present in the blocked JVM. Unfortunately (and thankfully) the behaviour cant be reproduced in other environments. Has anyone seen similar behaviour ?
Regards,
Colm.
"New I/O server boss #1 ([id: 0x434ab4fa, /<ip address>:<port>])" prio=10 tid=0x0000000011444000 nid=0x4b3c runnable [0x0000000043901000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
- locked <0x00000000ccc84038> (a sun.nio.ch.Util$2)
- locked <0x00000000ccc84048> (a java.util.Collections$UnmodifiableSet)
- locked <0x00000000ccc83ff0> (a sun.nio.ch.EPollSelectorImpl)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.jboss.netty.channel.socket.nio.NioServerSocketPipelineSink$Boss.run(NioServerSocketPipelineSink.java:227)
at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:102)
at org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:722)
--

Read the docs: http://akka.io/docs/
Check the FAQ: http://akka.io/faq/
Search the archives: https://groups.google.com/group/akka-user

---
You received this message because you are subscribed to the Google Groups
"Akka User List" group.
To unsubscribe from this group, send email to
Visit this group at http://groups.google.com/group/akka-user?hl=en.

--
Patrik Nordwall
Typesafe <http://typesafe.com/> - The software stack for applications that
scale
Twitter: patriknw

Post by Colm

Read the docs: http://akka.io/docs/
Check the FAQ: http://akka.io/faq/
Search the archives: https://groups.google.com/group/akka-user

Colm

2012-11-23 16:07:22 UTC

Permalink

Thanks Patrik. Similar expect it's Workers rather than the Boss. I'll watch
that ticket.

Post by Patrik Nordwall
https://www.assembla.com/spaces/akka/tickets/2733 ?

Read the docs: http://akka.io/docs/
Check the FAQ: http://akka.io/faq/
Search the archives: https://groups.google.com/group/akka-user

---
You received this message because you are subscribed to the Google Groups
"Akka User List" group.
.
To unsubscribe from this group, send email to
Visit this group at http://groups.google.com/group/akka-user?hl=en.

--
Patrik Nordwall
Typesafe <http://typesafe.com/> - The software stack for applications
that scale
Twitter: patriknw

Post by Patrik Nordwall

Post by Colm

Read the docs: http://akka.io/docs/
Check the FAQ: http://akka.io/faq/
Search the archives: https://groups.google.com/group/akka-user