Welcome!

IBM Cloud Authors: Elizabeth White, Dalibor Siroky, William Schmarzo, John Worthington, Liz McMillan

Related Topics: IBM Cloud

IBM Cloud: Article

WebSphere Application Server Java Dumps

Description and problem determination

Example 2 – You can see the Compiled Code and Inlined Compiled Code references where the line number in a typical stack trace is observed. Threads have states, as shown in Example 1. Most threads will indicate either an R or a CW state. The following is a list of states and a brief description of each:
  • R – A Runnable Thread that can run or is running. On platforms such as AIX and Linux, you can see which thread is actually running via the XHPI - Current Thread Details.
  • CW – A Conditional Wait Thread is waiting on a condition variable, typically a certain condition to occur. For example, a thread may be waiting for a resource to become available.
  • MW – A Monitor Wait Thread is waiting on a monitor lock.
  • S – A Suspended Thread is suspended.

Looking into Monitors – LK Dump Routine
The following table shows how the LK Dump routine is broken down into five subsections:

  • Monitor Pool Info provides basic monitor information, such as, the current total number of monitors, and so on.
  • Monitor Pool Dump lists the monitors that exist in the JVM at the time of the Java dump along with the threads waiting for that particular monitor and the owner of each monitor. Monitors can be owned or not owned as indicated in the file. You can use this section to identify any problems, such as, too many threads waiting on a monitor.
  • JVM System Monitor Dump is similar to the monitor pool dump except that instead of listing any monitor, it lists all of the system monitors on the JVM for which the Java dump was captured.
  • Java Object Monitor Dump is the same as the monitor pool dump except that additional JVM internal information is provided.
  • Thread Identifiers provide an association between the XM dump routine and the monitor pool dump. You can use this section as a pointer to the location of the problem identified in the monitor pool dump.

Looking into Classloaders – CL Dump Routine
The CL dump routine shows the list of class loaders and their corresponding classes. The respective address for each class and class loader is also shown in this section of the Java dump. The type for each class loader is shown to the left of the name of the class loader indicating if the class loader is primordial, extension, shareable, middleware, system, or trusted.

WebSphere Application Server Java Dumps
There are several types of threads that appear when you generate a Java dump in a WebSphere Application Server. The following list contains the types of threads that reside in most WebSphere Application Server Java dumps:
  • Server Socket threads – Server Socket threads listen for the incoming request in the Web container component of WebSphere Application Server. When the threads get a request they delegate the work to the Servlet Engine Transport thread. For example, the Server Socket thread listens to incoming Web requests (port 9080, by default) and delegates the request to the Servlet Engine Transport threads. When there’s a backlog of connections, the Server Socket threads operate like the Apache Web server, which means that there’ll be a maximum of 511 backlog connections supported. When there are more than 511 clients in addition to the Servlet Engine Transport thread maximum, the next client will be refused service.
3XMTHREADINFO “ServerSocket[addr=0.0.0.0/
  0.0.0.0,port=0,localport=9085]” (TID:0x10628F00,
sys_thread_t:0x4D87A80, state:R, native ID:0x9C4) 
  prio=5
4XESTACKTRACE at java.net.PlainSocketImpl.
  socketAccept(Native Method)
4XESTACKTRACE at java.net.PlainSocketImpl.
  accept(PlainSocketImpl.java(Compiled Code))
4XESTACKTRACE at java.net.ServerSocket.
  implAccept(ServerSocket.java(Compiled Code))
4XESTACKTRACE at java.net.ServerSocket.
  accept(ServerSocket.java(Compiled Code))
4XESTACKTRACE at com.ibm.ws.http.HttpTransport.
  run(HttpTransport.java:235)
4XESTACKTRACE at java.lang.Thread.run(Thread.java:568)
Example 3 – This example shows the Server Socket thread listening to port 9085 on an IBM V1.4.1 JVM and accepting a connection.
  • Servlet Engine Transport threads – WebSphere Application Server maintains the Servlet Engine Transport threads in a thread pool. These threads execute the service methods of the servlets. Depending on the settings for the thread pool and the number of new incoming requests, you can create transport threads or use ones from the thread pool. The number of transport threads occupied by requests coincides with the number of unique clients connected to the Web container. If you enable the KeepAlive parameter, the connection persists as long as you specify through this parameter and the Servlet Engine Transport thread will be reserved for a particular user during this time. In other words, a blocking Input/Output (I/O) operation is performed in the Servlet Engine Transport thread.
3XMTHREADINFO “Servlet.Engine.Transports : 0” 
  (TID:0x10631CC8, sys_thread_t:0x4E397A8, state:R,
native ID:0xEF4) prio=5
4XESTACKTRACE at java.net.SocketInputStream.
  socketRead0(Native Method)
4XESTACKTRACE at java.net.SocketInputStream.
  read(SocketInputStream.java(Compiled Code))
4XESTACKTRACE at com.ibm.ws.io.Stream.read(Stream.
  java:17)
4XESTACKTRACE at com.ibm.ws.io.ReadStream.
  readBuffer(ReadStream.java(Compiled Code))
4XESTACKTRACE at com.ibm.ws.io.ReadStream.
  read(ReadStream.java(Compiled Code))
4XESTACKTRACE at com.ibm.ws.http.HttpRequest.
  readRequestLine(HttpRequest.java(Compiled Code))
4XESTACKTRACE at com.ibm.ws.http.HttpRequest.
  readRequest(HttpRequest.java:302)
4XESTACKTRACE at com.ibm.ws.http.HttpConnection.
  readAndHandleRequest(HttpConnection.java:596)
4XESTACKTRACE at com.ibm.ws.http.HttpConnection.
  run(HttpConnection.java:443)
4XESTACKTRACE at com.ibm.ws.util.ThreadPool$Worker.
  run(ThreadPool.java(Compiled Code))

More Stories By Dipak Patel

Dipak M. Patel is a Senior IT specialist for IBM Software Services Performance Technology group. He has been focused on solving complex performance related problems involving WebSphere Application Server and Business Integration solutions. Dipak has a bachelors degree in Electrical Engineering and a masters degree in Computer Science from the University of Akron.

More Stories By Michel Betancourt

Michel Betancourt has been focused on WebSphere Application Server problem determination while part of IBM’s World Wide WebSphere Solutions War Room team. He was graduated from Florida International University in 2001 with a bachelor’s in computer engineering.

More Stories By Lorrie Barber

Lorrie M. Barber has been in WebSphere Application Server information development since 2001 focusing on system administration. She has a BS in computer information systems from the University of North Carolina at Wilmington and an MS in technical communication from North Carolina State University.

Comments (2) View Comments

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


Most Recent Comments
WebSphere News Desk 07/29/05 05:13:02 PM EDT

WebSphere Application Server Java Dumps
This article is meant to bring you up to speed on Java dumps and their debugging purposes quickly. It assumes that you?re familiar with basic Java, the Java Virtual Machine (JVM), and threading concepts. Some information about Java dumps and their contents is intentionally omitted from the discussion to simplify things since it?s not relevant to the type of problem determination discussed here.

WebSphere News Desk 07/29/05 05:08:40 PM EDT

WebSphere Application Server Java Dumps
This article is meant to bring you up to speed on Java dumps and their debugging purposes quickly. It assumes that you?re familiar with basic Java, the Java Virtual Machine (JVM), and threading concepts. Some information about Java dumps and their contents is intentionally omitted from the discussion to simplify things since it?s not relevant to the type of problem determination discussed here.

@ThingsExpo Stories
SYS-CON Events announced today that CrowdReviews.com has been named “Media Sponsor” of SYS-CON's 22nd International Cloud Expo, which will take place on June 5–7, 2018, at the Javits Center in New York City, NY. CrowdReviews.com is a transparent online platform for determining which products and services are the best based on the opinion of the crowd. The crowd consists of Internet users that have experienced products and services first-hand and have an interest in letting other potential buye...
"MobiDev is a software development company and we do complex, custom software development for everybody from entrepreneurs to large enterprises," explained Alan Winters, U.S. Head of Business Development at MobiDev, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
SYS-CON Events announced today that Telecom Reseller has been named “Media Sponsor” of SYS-CON's 22nd International Cloud Expo, which will take place on June 5-7, 2018, at the Javits Center in New York, NY. Telecom Reseller reports on Unified Communications, UCaaS, BPaaS for enterprise and SMBs. They report extensively on both customer premises based solutions such as IP-PBX as well as cloud based and hosted platforms.
WebRTC is great technology to build your own communication tools. It will be even more exciting experience it with advanced devices, such as a 360 Camera, 360 microphone, and a depth sensor camera. In his session at @ThingsExpo, Masashi Ganeko, a manager at INFOCOM Corporation, introduced two experimental projects from his team and what they learned from them. "Shotoku Tamago" uses the robot audition software HARK to track speakers in 360 video of a remote party. "Virtual Teleport" uses a multip...
Gemini is Yahoo’s native and search advertising platform. To ensure the quality of a complex distributed system that spans multiple products and components and across various desktop websites and mobile app and web experiences – both Yahoo owned and operated and third-party syndication (supply), with complex interaction with more than a billion users and numerous advertisers globally (demand) – it becomes imperative to automate a set of end-to-end tests 24x7 to detect bugs and regression. In th...
"Space Monkey by Vivent Smart Home is a product that is a distributed cloud-based edge storage network. Vivent Smart Home, our parent company, is a smart home provider that places a lot of hard drives across homes in North America," explained JT Olds, Director of Engineering, and Brandon Crowfeather, Product Manager, at Vivint Smart Home, in this SYS-CON.tv interview at @ThingsExpo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
"IBM is really all in on blockchain. We take a look at sort of the history of blockchain ledger technologies. It started out with bitcoin, Ethereum, and IBM evaluated these particular blockchain technologies and found they were anonymous and permissionless and that many companies were looking for permissioned blockchain," stated René Bostic, Technical VP of the IBM Cloud Unit in North America, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Conventi...
"Cloud Academy is an enterprise training platform for the cloud, specifically public clouds. We offer guided learning experiences on AWS, Azure, Google Cloud and all the surrounding methodologies and technologies that you need to know and your teams need to know in order to leverage the full benefits of the cloud," explained Alex Brower, VP of Marketing at Cloud Academy, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clar...
It is of utmost importance for the future success of WebRTC to ensure that interoperability is operational between web browsers and any WebRTC-compliant client. To be guaranteed as operational and effective, interoperability must be tested extensively by establishing WebRTC data and media connections between different web browsers running on different devices and operating systems. In his session at WebRTC Summit at @ThingsExpo, Dr. Alex Gouaillard, CEO and Founder of CoSMo Software, presented ...
A strange thing is happening along the way to the Internet of Things, namely far too many devices to work with and manage. It has become clear that we'll need much higher efficiency user experiences that can allow us to more easily and scalably work with the thousands of devices that will soon be in each of our lives. Enter the conversational interface revolution, combining bots we can literally talk with, gesture to, and even direct with our thoughts, with embedded artificial intelligence, whic...
Coca-Cola’s Google powered digital signage system lays the groundwork for a more valuable connection between Coke and its customers. Digital signs pair software with high-resolution displays so that a message can be changed instantly based on what the operator wants to communicate or sell. In their Day 3 Keynote at 21st Cloud Expo, Greg Chambers, Global Group Director, Digital Innovation, Coca-Cola, and Vidya Nagarajan, a Senior Product Manager at Google, discussed how from store operations and ...
In his session at 21st Cloud Expo, Carl J. Levine, Senior Technical Evangelist for NS1, will objectively discuss how DNS is used to solve Digital Transformation challenges in large SaaS applications, CDNs, AdTech platforms, and other demanding use cases. Carl J. Levine is the Senior Technical Evangelist for NS1. A veteran of the Internet Infrastructure space, he has over a decade of experience with startups, networking protocols and Internet infrastructure, combined with the unique ability to it...
"There's plenty of bandwidth out there but it's never in the right place. So what Cedexis does is uses data to work out the best pathways to get data from the origin to the person who wants to get it," explained Simon Jones, Evangelist and Head of Marketing at Cedexis, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
SYS-CON Events announced today that Evatronix will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Evatronix SA offers comprehensive solutions in the design and implementation of electronic systems, in CAD / CAM deployment, and also is a designer and manufacturer of advanced 3D scanners for professional applications.
Leading companies, from the Global Fortune 500 to the smallest companies, are adopting hybrid cloud as the path to business advantage. Hybrid cloud depends on cloud services and on-premises infrastructure working in unison. Successful implementations require new levels of data mobility, enabled by an automated and seamless flow across on-premises and cloud resources. In his general session at 21st Cloud Expo, Greg Tevis, an IBM Storage Software Technical Strategist and Customer Solution Architec...
To get the most out of their data, successful companies are not focusing on queries and data lakes, they are actively integrating analytics into their operations with a data-first application development approach. Real-time adjustments to improve revenues, reduce costs, or mitigate risk rely on applications that minimize latency on a variety of data sources. In his session at @BigDataExpo, Jack Norris, Senior Vice President, Data and Applications at MapR Technologies, reviewed best practices to ...
An increasing number of companies are creating products that combine data with analytical capabilities. Running interactive queries on Big Data requires complex architectures to store and query data effectively, typically involving data streams, an choosing efficient file format/database and multiple independent systems that are tied together through custom-engineered pipelines. In his session at @BigDataExpo at @ThingsExpo, Tomer Levi, a senior software engineer at Intel’s Advanced Analytics gr...
When talking IoT we often focus on the devices, the sensors, the hardware itself. The new smart appliances, the new smart or self-driving cars (which are amalgamations of many ‘things’). When we are looking at the world of IoT, we should take a step back, look at the big picture. What value are these devices providing? IoT is not about the devices, it’s about the data consumed and generated. The devices are tools, mechanisms, conduits. In his session at Internet of Things at Cloud Expo | DXWor...
Everything run by electricity will eventually be connected to the Internet. Get ahead of the Internet of Things revolution. In his session at @ThingsExpo, Akvelon expert and IoT industry leader Sergey Grebnov provided an educational dive into the world of managing your home, workplace and all the devices they contain with the power of machine-based AI and intelligent Bot services for a completely streamlined experience.
SYS-CON Events announced today that Synametrics Technologies will exhibit at SYS-CON's 22nd International Cloud Expo®, which will take place on June 5-7, 2018, at the Javits Center in New York, NY. Synametrics Technologies is a privately held company based in Plainsboro, New Jersey that has been providing solutions for the developer community since 1997. Based on the success of its initial product offerings such as WinSQL, Xeams, SynaMan and Syncrify, Synametrics continues to create and hone inn...