Discussion:
[libvirt-users] [BUG] Not exiting media forced a promptly close of libvirt 3.10
Holger Schranz
2017-12-22 08:52:33 UTC
Permalink
Hello,

In the .xml file I use a media which is no longer available.
In the past, I got the information media not available and the
creation of the VM was stopped - O.k. behavior.
Since 3.10 the libvirtd stopped promptly and all open
consoles windows and the virt-manager closed promptly.

For diagnose:
etcsvms1:/kvm/CS8200/M5 # coredumpctl
TIME PID UID GID SIG PRESENT EXE
Fri 2017-12-22 08:16:35 CET 7056 0 0 11 *
/usr/local/sbin/libvirtd
Fri 2017-12-22 08:19:46 CET 10611 0 0 11 *
/usr/local/sbin/libvirtd
Fri 2017-12-22 09:28:48 CET 10728 0 0 11 *
/usr/local/sbin/libvirtd

etcsvms1:/kvm/CS8200/M5 # coredumpctl info libvirtd
.
.
.
PID: 10728 (libvirtd)
UID: 0 (root)
GID: 0 (root)
Signal: 11 (SEGV)
Timestamp: Fri 2017-12-22 09:28:39 CET (15min ago)
Command Line: /usr/local/sbin/libvirtd -d
Executable: /usr/local/sbin/libvirtd
Control Group: /
Slice: -.slice
Boot ID: 01603763bc784c7380e310d5eea124d6
Machine ID: 89c660865c00403a9bacef32b6828556
Hostname: etcsvms1
Coredump:
/var/lib/systemd/coredump/core.libvirtd.0.01603763bc784c7380e310
Message: Process 10728 (libvirtd) of user 0 dumped core.

etcsvms1:/kvm/CS8200/M5 # coredumpctl dump libvirtd
PID: 10728 (libvirtd)
UID: 0 (root)
GID: 0 (root)
Signal: 11 (SEGV)
Timestamp: Fri 2017-12-22 09:28:39 CET (16min ago)
Command Line: /usr/local/sbin/libvirtd -d
Executable: /usr/local/sbin/libvirtd
Control Group: /
Slice: -.slice
Boot ID: 01603763bc784c7380e310d5eea124d6
Machine ID: 89c660865c00403a9bacef32b6828556
Hostname: etcsvms1
Coredump:
/var/lib/systemd/coredump/core.libvirtd.0.01603763bc784c7380e310d5eea124d6.10728.1513931319000000.xz
Message: Process 10728 (libvirtd) of user 0 dumped core.
Refusing to dump core to tty.

etcsvms1:/kvm/CS8200/M5 # coredumpctl gdb libvirtd
PID: 10728 (libvirtd)
UID: 0 (root)
GID: 0 (root)
Signal: 11 (SEGV)
Timestamp: Fri 2017-12-22 09:28:39 CET (18min ago)
Command Line: /usr/local/sbin/libvirtd -d
Executable: /usr/local/sbin/libvirtd
Control Group: /
Slice: -.slice
Boot ID: 01603763bc784c7380e310d5eea124d6
Machine ID: 89c660865c00403a9bacef32b6828556
Hostname: etcsvms1
Coredump:
/var/lib/systemd/coredump/core.libvirtd.0.01603763bc784c7380e310d5eea124d6.10728.1513931319000000.xz
Message: Process 10728 (libvirtd) of user 0 dumped core.

GNU gdb (GDB; openSUSE Leap 42.3) 8.0.1
Copyright (C) 2017 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later
<http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law. Type "show copying"
and "show warranty" for details.
This GDB was configured as "x86_64-suse-linux".
Type "show configuration" for configuration details.
For bug reporting instructions, please see:
<http://bugs.opensuse.org/>.
Find the GDB manual and other documentation resources online at:
<http://www.gnu.org/software/gdb/documentation/>.
For help, type "help".
Type "apropos word" to search for commands related to "word"...
Reading symbols from /usr/local/sbin/libvirtd...done.
[New LWP 10729]
[New LWP 10731]
[New LWP 10733]
[New LWP 10735]
[New LWP 10732]
[New LWP 10739]
[New LWP 10730]
[New LWP 10741]
[New LWP 10743]
[New LWP 10734]
[New LWP 10736]
[New LWP 11276]
[New LWP 10737]
[New LWP 10738]
[New LWP 10728]
[New LWP 10740]
[New LWP 10751]
[New LWP 10742]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib64/libthread_db.so.1".
Core was generated by `/usr/local/sbin/libvirtd -d'.
Program terminated with signal SIGSEGV, Segmentation fault.
#0 virStorageFileReportBrokenChain (errcode=2,
src=***@entry=0x7f0d4004ac40, parent=0x7f0d4004ac40)
at storage/storage_source.c:422
422 unsigned int access_user = src->drv->uid;
[Current thread is 1 (Thread 0x7f0d525ab700 (LWP 10729))]
Missing separate debuginfos, use: zypper install
device-mapper-debuginfo-1.02.97-77.1.x86_64
glibc-debuginfo-2.22-8.4.x86_64 krb5-debuginfo-1.12.5-12.1.x86_64
libapparmor1-debuginfo-2.10.3-16.1.x86_64
libavahi-client3-debuginfo-0.6.32-3.5.x86_64
libavahi-common3-debuginfo-0.6.32-3.5.x86_64
libblkid1-debuginfo-2.29.2-5.1.x86_64
libcap2-debuginfo-2.22-18.16.x86_64
libcom_err2-debuginfo-1.42.11-15.1.x86_64
libcurl4-debuginfo-7.37.0-23.1.x86_64
libdbus-1-3-debuginfo-1.8.22-5.1.x86_64
libffi4-debuginfo-5.3.1+r233831-10.1.x86_64
libgmp10-debuginfo-5.1.3-7.15.x86_64
libgnutls28-debuginfo-3.3.27-1.5.x86_64
libhogweed2-debuginfo-2.7.1-12.1.x86_64
libidn11-debuginfo-1.28-8.3.x86_64
libkeyutils1-debuginfo-1.5.9-7.13.x86_64
libldap-2_4-2-debuginfo-2.4.44-18.1.x86_64
liblzma5-debuginfo-5.2.2-3.15.x86_64
libnettle4-debuginfo-2.7.1-12.1.x86_64
libnl1-debuginfo-1.1.4-6.13.x86_64
libopenssl1_0_0-debuginfo-1.0.2j-16.1.x86_64
libp11-kit0-debuginfo-0.20.7-1.2.x86_64
libpciaccess0-debuginfo-0.13.4-4.3.x86_64
libpcre1-debuginfo-8.39-11.1.x86_64
libsasl2-3-debuginfo-2.1.26-14.1.x86_64
libselinux1-debuginfo-2.5-4.17.x86_64
libssh2-1-debuginfo-1.4.3-18.3.x86_64
libtasn1-6-debuginfo-4.9-1.2.x86_64 libudev1-debuginfo-228-38.1.x86_64
libuuid1-debuginfo-2.29.2-5.1.x86_64
libxml2-2-debuginfo-2.9.4-12.1.x86_64
libyajl2-debuginfo-2.0.1-21.3.x86_64 libz1-debuginfo-1.2.8-13.15.x86_64
(gdb)

Best regards

Holger

---
Diese E-Mail wurde von Avast Antivirus-Software auf Viren geprüft.
https://www.avast.com/antivirus
Daniel P. Berrange
2017-12-22 09:01:01 UTC
Permalink
Post by Holger Schranz
etcsvms1:/kvm/CS8200/M5 # coredumpctl gdb libvirtd
PID: 10728 (libvirtd)
UID: 0 (root)
GID: 0 (root)
Signal: 11 (SEGV)
Timestamp: Fri 2017-12-22 09:28:39 CET (18min ago)
Command Line: /usr/local/sbin/libvirtd -d
Executable: /usr/local/sbin/libvirtd
Control Group: /
Slice: -.slice
Boot ID: 01603763bc784c7380e310d5eea124d6
Machine ID: 89c660865c00403a9bacef32b6828556
Hostname: etcsvms1
Coredump: /var/lib/systemd/coredump/core.libvirtd.0.01603763bc784c7380e310d5eea124d6.10728.1513931319000000.xz
Message: Process 10728 (libvirtd) of user 0 dumped core.
Core was generated by `/usr/local/sbin/libvirtd -d'.
Program terminated with signal SIGSEGV, Segmentation fault.
#0 virStorageFileReportBrokenChain (errcode=2,
at storage/storage_source.c:422
422 unsigned int access_user = src->drv->uid;
[Current thread is 1 (Thread 0x7f0d525ab700 (LWP 10729))]
Missing separate debuginfos, use: zypper install
(gdb)
You've not given a full stack trace here - just the top most frame.
Can you do it again and run

(gdb) thread apply all backtrace full

Regards,
Daniel
--
|: https://berrange.com -o- https://www.flickr.com/photos/dberrange :|
|: https://libvirt.org -o- https://fstop138.berrange.com :|
|: https://entangle-photo.org -o- https://www.instagram.com/dberrange :|
Holger Schranz
2017-12-22 09:21:20 UTC
Permalink
Hi Daniel,

sorry. Here the requested stack trace.

Best regards

Holger

=====================================================================================

Thread 18 (Thread 0x7f0d495e0700 (LWP 10742)):
#0  0x00007f0d55e690bf in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f0d5892176a in virCondWait (c=***@entry=0x5557f238db28,
m=***@entry=0x5557f238db00) at util/virthread.c:154
        ret = <optimized out>
#2  0x00007f0d58922543 in virThreadPoolWorker
(opaque=***@entry=0x5557f23848f0) at util/virthreadpool.c:124
        data = 0x0
        pool = 0x5557f238dac0
        cond = 0x5557f238db28
        priority = false
        curWorkers = 0x5557f238dba0
        maxLimit = 0x5557f238db88
        job = 0x0
#3  0x00007f0d58921288 in virThreadHelper (data=<optimized out>) at
util/virthread.c:206
        args = 0x0
        local = {func = 0x7f0d589223b0 <virThreadPoolWorker>, funcName
= 0x5557f0d8879d "virNetServerHandleJob", worker = true,
          opaque = 0x5557f23848f0}
#4  0x00007f0d55e64744 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f0d55ba2aad in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 17 (Thread 0x7f0d47d73700 (LWP 10751)):
#0  0x00007f0d55e690bf in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f0d5892176a in virCondWait (c=***@entry=0x7f0d40017a20,
m=***@entry=0x7f0d400179e0) at util/virthread.c:154
        ret = <optimized out>
#2  0x00007f0d4bebb5e8 in udevEventHandleThread (opaque=<optimized out>)
at node_device/node_device_udev.c:1729
        priv = 0x7f0d400179d0
        device = <optimized out>
        __FUNCTION__ = "udevEventHandleThread"
#3  0x00007f0d589212b2 in virThreadHelper (data=<optimized out>) at
util/virthread.c:206
        args = 0x0
        local = {func = 0x7f0d4bebb590 <udevEventHandleThread>,
funcName = 0x7f0d4bec6f4e "udevEventHandleThread", worker = false,
          opaque = 0x0}
#4  0x00007f0d55e64744 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f0d55ba2aad in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 16 (Thread 0x7f0d4a5e2700 (LWP 10740)):
#0  0x00007f0d55e690bf in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f0d5892176a in virCondWait (c=***@entry=0x5557f238db28,
m=***@entry=0x5557f238db00) at util/virthread.c:154
        ret = <optimized out>
---Type <return> to continue, or q <return> to quit---
#2  0x00007f0d58922543 in virThreadPoolWorker
(opaque=***@entry=0x5557f238dde0) at util/virthreadpool.c:124
        data = 0x0
        pool = 0x5557f238dac0
        cond = 0x5557f238db28
        priority = false
        curWorkers = 0x5557f238dba0
        maxLimit = 0x5557f238db88
        job = 0x0
#3  0x00007f0d58921288 in virThreadHelper (data=<optimized out>) at
util/virthread.c:206
        args = 0x0
        local = {func = 0x7f0d589223b0 <virThreadPoolWorker>, funcName
= 0x5557f0d8879d "virNetServerHandleJob", worker = true,
          opaque = 0x5557f238dde0}
#4  0x00007f0d55e64744 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f0d55ba2aad in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 15 (Thread 0x7f0d595fb840 (LWP 10728)):
#0  0x00007f0d55b9a20d in poll () from /lib64/libc.so.6
No symbol table info available.
#1  0x00007f0d588c177a in poll (__timeout=5000, __nfds=30,
__fds=<optimized out>) at /usr/include/bits/poll2.h:46
No locals.
#2  virEventPollRunOnce () at util/vireventpoll.c:641
        fds = 0x5557f238fe40
        ret = <optimized out>
        timeout = 5000
        nfds = 30
        __func__ = "virEventPollRunOnce"
        __FUNCTION__ = "virEventPollRunOnce"
#3  0x00007f0d588c01a2 in virEventRunDefaultImpl () at util/virevent.c:327
        __func__ = "virEventRunDefaultImpl"
#4  0x00007f0d58a5a00d in virNetDaemonRun (dmn=0x5557f2385150) at
rpc/virnetdaemon.c:838
        timerid = -1
        timerActive = false
        __FUNCTION__ = "virNetDaemonRun"
        __func__ = "virNetDaemonRun"
#5  0x00005557f0d26645 in main (argc=<optimized out>, argv=<optimized
out>) at libvirtd.c:1498
        dmn = 0x5557f2385150
        srv = 0x5557f23853d0
        srvAdm = 0x5557f238d9d0
        remote_config_file = 0x5557f2384fd0
"/usr/local/etc/libvirt/libvirtd.conf"
        statuswrite = -1
        ret = 1
        pid_file_fd = 5
        pid_file = 0x5557f2392e30 "/usr/local/var/run/libvirtd.pid"
        sock_file = 0x5557f2392db0
"/usr/local/var/run/libvirt/libvirt-sock"
---Type <return> to continue, or q <return> to quit---
        sock_file_ro = 0x5557f2392ae0
"/usr/local/var/run/libvirt/libvirt-sock-ro"
        sock_file_adm = 0x5557f2391ec0
"/usr/local/var/run/libvirt/libvirt-admin-sock"
        timeout = -1
        verbose = 0
        godaemon = 1
        ipsock = 0
        config = 0x5557f23845a0
        privileged = <optimized out>
        implicit_conf = <optimized out>
        run_dir = 0x5557f2392d30 "/usr/local/var/run/libvirt"
        old_umask = <optimized out>
        opts = {{name = 0x5557f0d76acc "verbose", has_arg = 0, flag =
0x7ffdf2c76860, val = 118}, {name = 0x5557f0d76ad4 "daemon",
            has_arg = 0, flag = 0x7ffdf2c76864, val = 100}, {name =
0x5557f0d76adb "listen", has_arg = 0, flag = 0x7ffdf2c76868,
            val = 108}, {name = 0x5557f0d76bb6 "config", has_arg = 1,
flag = 0x0, val = 102}, {name = 0x5557f0d76b31 "timeout",
            has_arg = 1, flag = 0x0, val = 116}, {name = 0x5557f0d76ae2
"pid-file", has_arg = 1, flag = 0x0, val = 112}, {
            name = 0x5557f0d76aeb "version", has_arg = 0, flag = 0x0,
val = 86}, {name = 0x5557f0d76af3 "help", has_arg = 0, flag = 0x0,
            val = 104}, {name = 0x0, has_arg = 0, flag = 0x0, val = 0}}
        __func__ = "main"

Thread 14 (Thread 0x7f0d4dda2700 (LWP 10738)):
#0  0x00007f0d55e690bf in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f0d5892176a in virCondWait (c=***@entry=0x5557f23855c8,
m=***@entry=0x5557f2385500) at util/virthread.c:154
        ret = <optimized out>
#2  0x00007f0d589224db in virThreadPoolWorker
(opaque=***@entry=0x5557f2391d40) at util/virthreadpool.c:124
        data = 0x0
        pool = 0x5557f23854c0
        cond = 0x5557f23855c8
        priority = true
        curWorkers = 0x5557f23855b8
        maxLimit = 0x5557f23855b0
        job = 0x0
#3  0x00007f0d58921288 in virThreadHelper (data=<optimized out>) at
util/virthread.c:206
        args = 0x0
        local = {func = 0x7f0d589223b0 <virThreadPoolWorker>, funcName
= 0x5557f0d8879d "virNetServerHandleJob", worker = true,
          opaque = 0x5557f2391d40}
#4  0x00007f0d55e64744 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f0d55ba2aad in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 13 (Thread 0x7f0d4e5a3700 (LWP 10737)):
#0  0x00007f0d55e690bf in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f0d5892176a in virCondWait (c=***@entry=0x5557f23855c8,
m=***@entry=0x5557f2385500) at util/virthread.c:154
        ret = <optimized out>
---Type <return> to continue, or q <return> to quit---
#2  0x00007f0d589224db in virThreadPoolWorker
(opaque=***@entry=0x5557f2391c60) at util/virthreadpool.c:124
        data = 0x0
        pool = 0x5557f23854c0
        cond = 0x5557f23855c8
        priority = true
        curWorkers = 0x5557f23855b8
        maxLimit = 0x5557f23855b0
        job = 0x0
#3  0x00007f0d58921288 in virThreadHelper (data=<optimized out>) at
util/virthread.c:206
        args = 0x0
        local = {func = 0x7f0d589223b0 <virThreadPoolWorker>, funcName
= 0x5557f0d8879d "virNetServerHandleJob", worker = true,
          opaque = 0x5557f2391c60}
#4  0x00007f0d55e64744 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f0d55ba2aad in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 12 (Thread 0x7f0d485de700 (LWP 11276)):
#0  0x00007f0d55e690bf in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f0d5892176a in virCondWait (c=***@entry=0x7f0d400ddc68,
m=***@entry=0x7f0d400ddc40) at util/virthread.c:154
        ret = <optimized out>
#2  0x00007f0d58922543 in virThreadPoolWorker
(opaque=***@entry=0x5557f2393440) at util/virthreadpool.c:124
        data = 0x0
        pool = 0x7f0d400ddc00
        cond = 0x7f0d400ddc68
        priority = false
        curWorkers = 0x7f0d400ddce0
        maxLimit = 0x7f0d400ddcc8
        job = 0x0
#3  0x00007f0d58921288 in virThreadHelper (data=<optimized out>) at
util/virthread.c:206
        args = 0x0
        local = {func = 0x7f0d589223b0 <virThreadPoolWorker>, funcName
= 0x7f0d4b63dc60 "qemuProcessEventHandler", worker = true,
          opaque = 0x5557f2393440}
#4  0x00007f0d55e64744 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f0d55ba2aad in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 11 (Thread 0x7f0d4eda4700 (LWP 10736)):
#0  0x00007f0d55e690bf in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f0d5892176a in virCondWait (c=***@entry=0x5557f23855c8,
m=***@entry=0x5557f2385500) at util/virthread.c:154
        ret = <optimized out>
#2  0x00007f0d589224db in virThreadPoolWorker
(opaque=***@entry=0x5557f2391d40) at util/virthreadpool.c:124
        data = 0x0
---Type <return> to continue, or q <return> to quit---
        pool = 0x5557f23854c0
        cond = 0x5557f23855c8
        priority = true
        curWorkers = 0x5557f23855b8
        maxLimit = 0x5557f23855b0
        job = 0x0
#3  0x00007f0d58921288 in virThreadHelper (data=<optimized out>) at
util/virthread.c:206
        args = 0x0
        local = {func = 0x7f0d589223b0 <virThreadPoolWorker>, funcName
= 0x5557f0d8879d "virNetServerHandleJob", worker = true,
          opaque = 0x5557f2391d40}
#4  0x00007f0d55e64744 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f0d55ba2aad in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 10 (Thread 0x7f0d4fda6700 (LWP 10734)):
#0  0x00007f0d55e690bf in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f0d5892176a in virCondWait (c=***@entry=0x5557f23855c8,
m=***@entry=0x5557f2385500) at util/virthread.c:154
        ret = <optimized out>
#2  0x00007f0d589224db in virThreadPoolWorker
(opaque=***@entry=0x5557f2391c60) at util/virthreadpool.c:124
        data = 0x0
        pool = 0x5557f23854c0
        cond = 0x5557f23855c8
        priority = true
        curWorkers = 0x5557f23855b8
        maxLimit = 0x5557f23855b0
        job = 0x0
#3  0x00007f0d58921288 in virThreadHelper (data=<optimized out>) at
util/virthread.c:206
        args = 0x0
        local = {func = 0x7f0d589223b0 <virThreadPoolWorker>, funcName
= 0x5557f0d8879d "virNetServerHandleJob", worker = true,
          opaque = 0x5557f2391c60}
#4  0x00007f0d55e64744 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f0d55ba2aad in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 9 (Thread 0x7f0d48ddf700 (LWP 10743)):
#0  0x00007f0d55e690bf in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f0d5892176a in virCondWait (c=***@entry=0x5557f238db28,
m=***@entry=0x5557f238db00) at util/virthread.c:154
        ret = <optimized out>
#2  0x00007f0d58922543 in virThreadPoolWorker
(opaque=***@entry=0x5557f238dde0) at util/virthreadpool.c:124
        data = 0x0
        pool = 0x5557f238dac0
        cond = 0x5557f238db28
---Type <return> to continue, or q <return> to quit---
        priority = false
        curWorkers = 0x5557f238dba0
        maxLimit = 0x5557f238db88
        job = 0x0
#3  0x00007f0d58921288 in virThreadHelper (data=<optimized out>) at
util/virthread.c:206
        args = 0x0
        local = {func = 0x7f0d589223b0 <virThreadPoolWorker>, funcName
= 0x5557f0d8879d "virNetServerHandleJob", worker = true,
          opaque = 0x5557f238dde0}
#4  0x00007f0d55e64744 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f0d55ba2aad in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 8 (Thread 0x7f0d49de1700 (LWP 10741)):
#0  0x00007f0d55e690bf in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f0d5892176a in virCondWait (c=***@entry=0x5557f238db28,
m=***@entry=0x5557f238db00) at util/virthread.c:154
        ret = <optimized out>
#2  0x00007f0d58922543 in virThreadPoolWorker
(opaque=***@entry=0x5557f238dfb0) at util/virthreadpool.c:124
        data = 0x0
        pool = 0x5557f238dac0
        cond = 0x5557f238db28
        priority = false
        curWorkers = 0x5557f238dba0
        maxLimit = 0x5557f238db88
        job = 0x0
#3  0x00007f0d58921288 in virThreadHelper (data=<optimized out>) at
util/virthread.c:206
        args = 0x0
        local = {func = 0x7f0d589223b0 <virThreadPoolWorker>, funcName
= 0x5557f0d8879d "virNetServerHandleJob", worker = true,
          opaque = 0x5557f238dfb0}
#4  0x00007f0d55e64744 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f0d55ba2aad in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 7 (Thread 0x7f0d51daa700 (LWP 10730)):
#0  0x00007f0d55e690bf in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f0d5892176a in virCondWait (c=***@entry=0x5557f2385528,
m=***@entry=0x5557f2385500) at util/virthread.c:154
        ret = <optimized out>
#2  0x00007f0d58922543 in virThreadPoolWorker
(opaque=***@entry=0x5557f2391d40) at util/virthreadpool.c:124
        data = 0x0
        pool = 0x5557f23854c0
        cond = 0x5557f2385528
        priority = false
        curWorkers = 0x5557f23855a0
---Type <return> to continue, or q <return> to quit---
        maxLimit = 0x5557f2385588
        job = 0x0
#3  0x00007f0d58921288 in virThreadHelper (data=<optimized out>) at
util/virthread.c:206
        args = 0x0
        local = {func = 0x7f0d589223b0 <virThreadPoolWorker>, funcName
= 0x5557f0d8879d "virNetServerHandleJob", worker = true,
          opaque = 0x5557f2391d40}
#4  0x00007f0d55e64744 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f0d55ba2aad in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 6 (Thread 0x7f0d4ade3700 (LWP 10739)):
#0  0x00007f0d55e690bf in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f0d5892176a in virCondWait (c=***@entry=0x5557f238db28,
m=***@entry=0x5557f238db00) at util/virthread.c:154
        ret = <optimized out>
#2  0x00007f0d58922543 in virThreadPoolWorker
(opaque=***@entry=0x5557f23848f0) at util/virthreadpool.c:124
        data = 0x0
        pool = 0x5557f238dac0
        cond = 0x5557f238db28
        priority = false
        curWorkers = 0x5557f238dba0
        maxLimit = 0x5557f238db88
        job = 0x0
#3  0x00007f0d58921288 in virThreadHelper (data=<optimized out>) at
util/virthread.c:206
        args = 0x0
        local = {func = 0x7f0d589223b0 <virThreadPoolWorker>, funcName
= 0x5557f0d8879d "virNetServerHandleJob", worker = true,
          opaque = 0x5557f23848f0}
#4  0x00007f0d55e64744 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f0d55ba2aad in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 5 (Thread 0x7f0d50da8700 (LWP 10732)):
#0  0x00007f0d55e690bf in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f0d5892176a in virCondWait (c=***@entry=0x5557f2385528,
m=***@entry=0x5557f2385500) at util/virthread.c:154
        ret = <optimized out>
#2  0x00007f0d58922543 in virThreadPoolWorker
(opaque=***@entry=0x5557f2391e70) at util/virthreadpool.c:124
        data = 0x0
        pool = 0x5557f23854c0
        cond = 0x5557f2385528
        priority = false
        curWorkers = 0x5557f23855a0
        maxLimit = 0x5557f2385588
        job = 0x0
---Type <return> to continue, or q <return> to quit---
#3  0x00007f0d58921288 in virThreadHelper (data=<optimized out>) at
util/virthread.c:206
        args = 0x0
        local = {func = 0x7f0d589223b0 <virThreadPoolWorker>, funcName
= 0x5557f0d8879d "virNetServerHandleJob", worker = true,
          opaque = 0x5557f2391e70}
#4  0x00007f0d55e64744 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f0d55ba2aad in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 4 (Thread 0x7f0d4f5a5700 (LWP 10735)):
#0  0x00007f0d55e690bf in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f0d5892176a in virCondWait (c=***@entry=0x5557f23855c8,
m=***@entry=0x5557f2385500) at util/virthread.c:154
        ret = <optimized out>
#2  0x00007f0d589224db in virThreadPoolWorker
(opaque=***@entry=0x5557f2391e70) at util/virthreadpool.c:124
        data = 0x0
        pool = 0x5557f23854c0
        cond = 0x5557f23855c8
        priority = true
        curWorkers = 0x5557f23855b8
        maxLimit = 0x5557f23855b0
        job = 0x0
#3  0x00007f0d58921288 in virThreadHelper (data=<optimized out>) at
util/virthread.c:206
        args = 0x0
        local = {func = 0x7f0d589223b0 <virThreadPoolWorker>, funcName
= 0x5557f0d8879d "virNetServerHandleJob", worker = true,
          opaque = 0x5557f2391e70}
#4  0x00007f0d55e64744 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f0d55ba2aad in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 3 (Thread 0x7f0d505a7700 (LWP 10733)):
#0  0x00007f0d55e690bf in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f0d5892176a in virCondWait (c=***@entry=0x5557f2385528,
m=***@entry=0x5557f2385500) at util/virthread.c:154
        ret = <optimized out>
#2  0x00007f0d58922543 in virThreadPoolWorker
(opaque=***@entry=0x5557f2391d40) at util/virthreadpool.c:124
        data = 0x0
        pool = 0x5557f23854c0
        cond = 0x5557f2385528
        priority = false
        curWorkers = 0x5557f23855a0
        maxLimit = 0x5557f2385588
        job = 0x0
#3  0x00007f0d58921288 in virThreadHelper (data=<optimized out>) at
util/virthread.c:206
        args = 0x0
---Type <return> to continue, or q <return> to quit---
        local = {func = 0x7f0d589223b0 <virThreadPoolWorker>, funcName
= 0x5557f0d8879d "virNetServerHandleJob", worker = true,
          opaque = 0x5557f2391d40}
#4  0x00007f0d55e64744 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f0d55ba2aad in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 2 (Thread 0x7f0d515a9700 (LWP 10731)):
#0  0x00007f0d55e690bf in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f0d5892176a in virCondWait (c=***@entry=0x5557f2385528,
m=***@entry=0x5557f2385500) at util/virthread.c:154
        ret = <optimized out>
#2  0x00007f0d58922543 in virThreadPoolWorker
(opaque=***@entry=0x5557f2391c60) at util/virthreadpool.c:124
        data = 0x0
        pool = 0x5557f23854c0
        cond = 0x5557f2385528
        priority = false
        curWorkers = 0x5557f23855a0
        maxLimit = 0x5557f2385588
        job = 0x0
#3  0x00007f0d58921288 in virThreadHelper (data=<optimized out>) at
util/virthread.c:206
        args = 0x0
        local = {func = 0x7f0d589223b0 <virThreadPoolWorker>, funcName
= 0x5557f0d8879d "virNetServerHandleJob", worker = true,
          opaque = 0x5557f2391c60}
#4  0x00007f0d55e64744 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f0d55ba2aad in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 1 (Thread 0x7f0d525ab700 (LWP 10729)):
#0  virStorageFileReportBrokenChain (errcode=2,
src=***@entry=0x7f0d4004ac40, parent=0x7f0d4004ac40) at
storage/storage_source.c:422
        access_user = <optimized out>
        access_group = <optimized out>
        __FUNCTION__ = "virStorageFileReportBrokenChain"
#1  0x00007f0d4b56a262 in qemuDomainDetermineDiskChain
(driver=***@entry=0x7f0d40240bf0, vm=***@entry=0x7f0d400e66d0,
    disk=***@entry=0x7f0d4037fa80, force_probe=***@entry=true,
report_broken=***@entry=true)
    at qemu/qemu_domain.c:6383
        cfg = 0x7f0d400be000
        src = 0x7f0d4004ac40
        ret = -1
        uid = 1074685768
        gid = 32525
        __FUNCTION__ = "qemuDomainDetermineDiskChain"
#2  0x00007f0d4b594c92 in qemuProcessPrepareHostStorage (flags=17,
vm=0x7f0d400e66d0, driver=0x7f0d40240bf0) at qemu/qemu_process.c:5562
        idx = 0
        disk = 0x7f0d4037fa80
---Type <return> to continue, or q <return> to quit---
        i = 1
        cold_boot = true
#3  qemuProcessPrepareHost (driver=***@entry=0x7f0d40240bf0,
vm=***@entry=0x7f0d400e66d0, flags=***@entry=17)
    at qemu/qemu_process.c:5668
        ret = -1
        hostdev_flags = <optimized out>
        priv = <optimized out>
        cfg = 0x7f0d400be000
        __func__ = "qemuProcessPrepareHost"
        __FUNCTION__ = "qemuProcessPrepareHost"
#4  0x00007f0d4b59ac3b in qemuProcessStart
(conn=***@entry=0x7f0d24002340, driver=***@entry=0x7f0d40240bf0,
    vm=***@entry=0x7f0d400e66d0, updatedCPU=***@entry=0x0,
asyncJob=***@entry=QEMU_ASYNC_JOB_START,
    migrateFrom=***@entry=0x0, migrateFd=***@entry=-1,
migratePath=***@entry=0x0, snapshot=***@entry=0x0,
    vmop=***@entry=VIR_NETDEV_VPORT_PROFILE_OP_CREATE, flags=17,
***@entry=1) at qemu/qemu_process.c:6128
        priv = 0x7f0d402924a0
        incoming = 0x0
        stopFlags = <optimized out>
        relabel = false
        ret = -1
        rv = <optimized out>
        __func__ = "qemuProcessStart"
        __FUNCTION__ = "qemuProcessStart"
#5  0x00007f0d4b603036 in qemuDomainObjStart (conn=0x7f0d24002340,
driver=***@entry=0x7f0d40240bf0, vm=0x7f0d400e66d0,
    flags=***@entry=0, asyncJob=QEMU_ASYNC_JOB_START) at
qemu/qemu_driver.c:7283
        ret = <optimized out>
        managed_save = 0x7f0d40397a80
"/usr/local/var/lib/libvirt/qemu/save/S1VCS82M5-IUP0.save"
        start_paused = false
        autodestroy = false
        bypass_cache = false
        force_boot = false
        start_flags = 1
        priv = 0x7f0d402924a0
#6  0x00007f0d4b603776 in qemuDomainCreateWithFlags (dom=0x7f0d4009b1c0,
flags=0) at qemu/qemu_driver.c:7337
        driver = 0x7f0d40240bf0
        vm = 0x7f0d400e66d0
        ret = -1
        __FUNCTION__ = "qemuDomainCreateWithFlags"
#7  0x00007f0d589e573c in virDomainCreate
(domain=***@entry=0x7f0d4009b1c0) at libvirt-domain.c:6531
        ret = <optimized out>
        conn = <optimized out>
        __func__ = "virDomainCreate"
        __FUNCTION__ = "virDomainCreate"
#8  0x00005557f0d53ea3 in remoteDispatchDomainCreate
(server=0x5557f23853d0, msg=0x5557f23936a0, args=<optimized out>,
    rerr=0x7f0d525aac90, client=0x5557f238fac0) at remote_dispatch.h:4222
        dom = 0x7f0d4009b1c0
        priv = <optimized out>
---Type <return> to continue, or q <return> to quit---
#9  remoteDispatchDomainCreateHelper (server=0x5557f23853d0,
client=0x5557f238fac0, msg=0x5557f23936a0, rerr=0x7f0d525aac90,
    args=<optimized out>, ret=0x7f0d403683c0) at remote_dispatch.h:4198
        rv = -231146816
        __func__ = "remoteDispatchDomainCreateHelper"
#10 0x00007f0d58a60ed2 in virNetServerProgramDispatchCall
(msg=0x5557f23936a0, client=0x5557f238fac0, server=0x5557f23853d0,
    prog=0x5557f2391a70) at rpc/virnetserverprogram.c:437
        ret = 0x7f0d403683c0 ""
        rv = -1
        i = <optimized out>
        identity = 0x7f0d400166e0
        arg = 0x7f0d4033eaa0 "\340:\t@\r\177"
        dispatcher = 0x5557f0fa03b0 <remoteProcs+432>
        rerr = {code = 0, domain = 0, message = 0x0, level = 0, dom =
0x0, str1 = 0x0, str2 = 0x0, str3 = 0x0, int1 = 0, int2 = 0,
          net = 0x0}
#11 virNetServerProgramDispatch (prog=0x5557f2391a70,
server=***@entry=0x5557f23853d0, client=0x5557f238fac0,
msg=0x5557f23936a0)
    at rpc/virnetserverprogram.c:307
        rerr = {code = 0, domain = 0, message = 0x0, level = 0, dom =
0x0, str1 = 0x0, str2 = 0x0, str3 = 0x0, int1 = 0, int2 = 0,
          net = 0x0}
        __func__ = "virNetServerProgramDispatch"
        __FUNCTION__ = "virNetServerProgramDispatch"
#12 0x00005557f0d6a19d in virNetServerProcessMsg (msg=<optimized out>,
prog=<optimized out>, client=<optimized out>, srv=0x5557f23853d0)
    at rpc/virnetserver.c:148
        ret = -1
#13 virNetServerHandleJob (jobOpaque=<optimized out>,
opaque=0x5557f23853d0) at rpc/virnetserver.c:169
        srv = 0x5557f23853d0
        job = 0x5557f2393820
        __func__ = "virNetServerHandleJob"
#14 0x00007f0d58922491 in virThreadPoolWorker
(opaque=***@entry=0x5557f2391e70) at util/virthreadpool.c:167
        data = 0x0
        pool = 0x5557f23854c0
        cond = 0x5557f2385528
        priority = false
        curWorkers = 0x5557f23855a0
        maxLimit = 0x5557f2385588
        job = 0x5557f238ef70
#15 0x00007f0d58921288 in virThreadHelper (data=<optimized out>) at
util/virthread.c:206
        args = 0x0
        local = {func = 0x7f0d589223b0 <virThreadPoolWorker>, funcName
= 0x5557f0d8879d "virNetServerHandleJob", worker = true,
          opaque = 0x5557f2391e70}
#16 0x00007f0d55e64744 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#17 0x00007f0d55ba2aad in clone () from /lib64/libc.so.6
No symbol table info available.
(gdb)
Post by Daniel P. Berrange
Post by Holger Schranz
etcsvms1:/kvm/CS8200/M5 # coredumpctl gdb libvirtd
PID: 10728 (libvirtd)
UID: 0 (root)
GID: 0 (root)
Signal: 11 (SEGV)
Timestamp: Fri 2017-12-22 09:28:39 CET (18min ago)
Command Line: /usr/local/sbin/libvirtd -d
Executable: /usr/local/sbin/libvirtd
Control Group: /
Slice: -.slice
Boot ID: 01603763bc784c7380e310d5eea124d6
Machine ID: 89c660865c00403a9bacef32b6828556
Hostname: etcsvms1
Coredump: /var/lib/systemd/coredump/core.libvirtd.0.01603763bc784c7380e310d5eea124d6.10728.1513931319000000.xz
Message: Process 10728 (libvirtd) of user 0 dumped core.
Core was generated by `/usr/local/sbin/libvirtd -d'.
Program terminated with signal SIGSEGV, Segmentation fault.
#0 virStorageFileReportBrokenChain (errcode=2,
at storage/storage_source.c:422
422 unsigned int access_user = src->drv->uid;
[Current thread is 1 (Thread 0x7f0d525ab700 (LWP 10729))]
Missing separate debuginfos, use: zypper install
(gdb)
You've not given a full stack trace here - just the top most frame.
Can you do it again and run
(gdb) thread apply all backtrace full
Regards,
Daniel
---
Diese E-Mail wurde von Avast Antivirus-Software auf Viren geprüft.
https://www.avast.com/antivirus
Jim Fehlig
2017-12-22 21:27:21 UTC
Permalink
parent=0x7f0d4004ac40) at storage/storage_source.c:422
        access_user = <optimized out>
        access_group = <optimized out>
        __FUNCTION__ = "virStorageFileReportBrokenChain"
#1  0x00007f0d4b56a262 in qemuDomainDetermineDiskChain
This bug has already been fixed

https://libvirt.org/git/?p=libvirt.git;a=commit;h=2d07f1f0ebd44b0348daa61afa0de34f3f838c22

Regards,
Jim
Holger Schranz
2017-12-23 08:56:36 UTC
Permalink
Hello,

thanks for the information.

Please let me ask: If understand correctly this issue occoured and reported
in 3.9? And the fix is for 3.11 or 4.0?

Best regards

Holger
Post by Jim Fehlig
Post by Holger Schranz
#0  virStorageFileReportBrokenChain (errcode=2,
storage/storage_source.c:422
         access_user = <optimized out>
         access_group = <optimized out>
         __FUNCTION__ = "virStorageFileReportBrokenChain"
#1  0x00007f0d4b56a262 in qemuDomainDetermineDiskChain
This bug has already been fixed
https://libvirt.org/git/?p=libvirt.git;a=commit;h=2d07f1f0ebd44b0348daa61afa0de34f3f838c22
Regards,
Jim
---
Diese E-Mail wurde von Avast Antivirus-Software auf Viren geprüft.
https://www.avast.com/antivirus
Holger Schranz
2017-12-23 09:20:37 UTC
Permalink
Sorry for an additional question:

In the bug report where Jim was wrote in his answer:
https://libvirt.org/git/?p=libvirt.git;a=commit;h=2d07f1f0ebd44b0348daa61afa0de34f3f838c22

is a pointer to the report:
https://bugzilla.redhat.com/show_bug.cgi?id=1522682

In this report the fixed version is: libvirt-3.9.0-6.el7

How can I check/find whether this fix is include in the 3.10 which
I used?

Best regards

Holger
Post by Holger Schranz
Hello,
thanks for the information.
Please let me ask: If understand correctly this issue occoured and reported
in 3.9? And the fix is for 3.11 or 4.0?
Best regards
Holger
Post by Jim Fehlig
Post by Holger Schranz
#0  virStorageFileReportBrokenChain (errcode=2,
storage/storage_source.c:422
         access_user = <optimized out>
         access_group = <optimized out>
         __FUNCTION__ = "virStorageFileReportBrokenChain"
#1  0x00007f0d4b56a262 in qemuDomainDetermineDiskChain
This bug has already been fixed
https://libvirt.org/git/?p=libvirt.git;a=commit;h=2d07f1f0ebd44b0348daa61afa0de34f3f838c22
Regards,
Jim
---
Diese E-Mail wurde von Avast Antivirus-Software auf Viren geprüft.
https://www.avast.com/antivirus
_______________________________________________
libvirt-users mailing list
https://www.redhat.com/mailman/listinfo/libvirt-users
Michal Privoznik
2017-12-23 21:47:02 UTC
Permalink
Post by Jim Fehlig
https://libvirt.org/git/?p=libvirt.git;a=commit;h=2d07f1f0ebd44b0348daa61afa0de34f3f838c22
https://bugzilla.redhat.com/show_bug.cgi?id=1522682
In this report the fixed version is: libvirt-3.9.0-6.el7
How can I check/find whether this fix is include in the 3.10 which
I used?
It's not fixed there:

$ git describe 2d07f1f0ebd44b0348daa61afa0de34f3f838c22
v3.10.0-32-g2d07f1f0e

Which means, that the commit is 32'nd after 3.10.0 release. You'll have
to wait for:

a) new release,
b) your distro to pick up the commit and backport it.

Michal
Jim Fehlig
2017-12-28 17:36:50 UTC
Permalink
Post by Michal Privoznik
Post by Jim Fehlig
https://libvirt.org/git/?p=libvirt.git;a=commit;h=2d07f1f0ebd44b0348daa61afa0de34f3f838c22
https://bugzilla.redhat.com/show_bug.cgi?id=1522682
In this report the fixed version is: libvirt-3.9.0-6.el7
How can I check/find whether this fix is include in the 3.10 which
I used?
$ git describe 2d07f1f0ebd44b0348daa61afa0de34f3f838c22
v3.10.0-32-g2d07f1f0e
Which means, that the commit is 32'nd after 3.10.0 release. You'll have
a) new release,
b) your distro to pick up the commit and backport it.
b was done on 14 Dec.

Holger, the fix is available in the 3.10.0 libvirt package in the OBS
Virtualization project

https://build.opensuse.org/package/show/Virtualization/libvirt

Regards,
Jim

Loading...