kernel.watchdog: BUG: soft lockup - CPU #8 stuck for 48s! [udt:3228134]

Platform: RHEL 8.5
DB: Unidata 8.2.1 hf11

I have a customer who is seeing this message popup on people's screens.  The process in question isn't doing much of anything but they're obviously concerned.  Any idea what causes this?

(You're likely going to tell me that this needs to go through the normal support channels but the VAR that this customer bought from isn't a VAR anymore, or so we have been told.  So they're kinda orphaned.)

Kevin,

These are Linux messages indicating a system resource shortage; what that resource might be would require profiling the system resource utilisation.

A few 'shots in the dark'

• A directory in use which is massively populated - both Unix and Windows are not very good at handling scans and updates to directories in this state and bottlenecks arise.
• Semaphores
• Paging
• Use of Linux disk/folder  encryption - this can impose quite a large overhead on all file operations.
• Working in a cloud environment where the system is being throttled by the hosting environment on a  key resource (e.g. number of IOPS)

Other possibilities exist - from a simple RAM shortage to the more esoteric with PSU under-voltage.

There are some pointers on the net regarding situations in which this can occur, though most seem to indicated that some system analysis is required - e.g.:

• https://ubuntuforums.org/showthread.php?t=2205211

• https://knowledge.broadcom.com/external/article/170185/cause-and-possible-remedies-for-kernel-b.html

Hoping this helps to get you started at least
​
JJ