[linux-lvm] Can't create thin lv

[Marc MERLIN]

Howdy,

Kernel 4.17, trying thin LV for the first time, and I'm getting this:
gargamel:~# lvcreate -L 14.50TiB -Zn -T vgds2/thinpool2
Using default stripesize 64.00 KiB.
Thin pool volume with chunk size 8.00 MiB can address at most <1.98 PiB of data.
/dev/mapper/vgds2-thinpool2_tmeta: open failed: No such file or directory
Failed to activate new LV.

any idea what I should try next?

gargamel:~# vgdisplay
--- Volume group ---
VG Name vgds2
System ID
Format lvm2
Metadata Areas 1
Metadata Sequence No 32
VG Access read/write
VG Status resizable
MAX LV 0
Cur LV 0
Open LV 0
Max PV 0
Cur PV 1
Act PV 1
VG Size 14.55 TiB
PE Size 4.00 MiB
Total PE 3815316
Alloc PE / Size 0 / 0
Free PE / Size 3815316 / 14.55 TiB
VG UUID pc1cTH-kFo7-g0Kz-dELp-j51s-1yOO-v20WIV

gargamel:~# lvdisplay
gargamel:~#


Thanks,
Marc

[Marc MERLIN]

Post by Marc MERLIN
Howdy,
gargamel:~# lvcreate -L 14.50TiB -Zn -T vgds2/thinpool2
Using default stripesize 64.00 KiB.
Thin pool volume with chunk size 8.00 MiB can address at most <1.98 PiB of data.
/dev/mapper/vgds2-thinpool2_tmeta: open failed: No such file or directory
Failed to activate new LV.
any idea what I should try next?

Interestingly I got a different error, once:
gargamel:~# lvcreate -L 14.50TiB -Zn -T vgds2/thinpool2
Using default stripesize 64.00 KiB.
Thin pool volume with chunk size 8.00 MiB can address at most <1.98 PiB of data.
/dev/vgds2/lvol0: not found: device not cleared
Aborting. Failed to wipe start of new LV.

gargamel:~# mkdir /dev/vgds2/
gargamel:~# l /dev/mapper/
total 0
drwxr-xr-x 2 root root 200 Jul 25 17:27 ./
drwxr-xr-x 20 root root 5280 Jul 26 00:15 ../
crw------- 1 root root 10, 236 Jul 25 17:25 control
lrwxrwxrwx 1 root root 7 Jul 23 08:57 cryptroot -> ../dm-0
lrwxrwxrwx 1 root root 7 Jul 25 06:40 dshelf1 -> ../dm-1
lrwxrwxrwx 1 root root 7 Jul 26 00:11 dshelf2 -> ../dm-2
lrwxrwxrwx 1 root root 7 Jul 25 06:40 eswap1 -> ../dm-3
lrwxrwxrwx 1 root root 7 Jul 25 06:40 raid0d1 -> ../dm-4
lrwxrwxrwx 1 root root 7 Jul 25 06:40 raid0d2 -> ../dm-5
lrwxrwxrwx 1 root root 7 Jul 25 06:40 varchange -> ../dm-6
gargamel:~# vgchange -ay
0 logical volume(s) in volume group "vgds2" now active

gargamel:~# lvcreate -L 14.50TiB -Zn -T vgds2/thinpool2
Using default stripesize 64.00 KiB.
Thin pool volume with chunk size 8.00 MiB can address at most <1.98 PiB of data.
/dev/mapper/vgds2-thinpool2_tmeta: open failed: No such file or directory
Failed to activate new LV.

gargamel:~# psg lvm
root 2378 0.0 0.0 31600 488 ? Ss Jul25 0:00 /sbin/lvmetad

gargamel:~# lvcreate --version
LVM version: 2.02.176(2) (2017-11-03)
Library version: 1.02.145 (2017-11-03)
Driver version: 4.39.0
Configuration: ./configure --build=i686-linux-gnu --prefix=/usr --includedir=${prefix}/include --mandir=${prefix}/share/man --infodir=${prefix}/share/info --sysconfdir=/etc --localstatedir=/var --disable-silent-rules --libdir=${prefix}/lib/i386-linux-gnu --libexecdir=${prefix}/lib/i386-linux-gnu --runstatedir=/run --disable-maintainer-mode --disable-dependency-tracking --exec-prefix= --bindir=/bin --libdir=/lib/i386-linux-gnu --sbindir=/sbin --with-usrlibdir=/usr/lib/i386-linux-gnu --with-optimisation=-O2 --with-cache=internal --with-clvmd=corosync --with-cluster=internal --with-device-uid=0 --with-device-gid=6 --with-device-mode=0660 --with-default-pid-dir=/run --with-default-run-dir=/run/lvm --with-default-locking-dir=/run/lock/lvm --with-thin=internal --with-thin-check=/usr/sbin/thin_check --with-thin-dump=/usr/sbin/thin_dump --with-thin-repair=/usr/sbin/thin_repair --enable-applib --enable-blkid_wiping --enable-cmdlib --enable-cmirrord --enable-dmeventd --enable-dbus-service
--enable-lvmetad --enable-lvmlockd-dlm --enable-lvmlockd-sanlock --enable-lvmpolld --enable-notify-dbus --enable-pkgconfig --enable-readline --enable-udev_rules --enable-udev_sync


strace shows:
openat(AT_FDCWD, "/dev/vgds2/lvol0", O_RDWR|O_DIRECT|O_LARGEFILE|O_NOATIME) = 7
openat(AT_FDCWD, "/proc/self/maps", O_RDONLY|O_LARGEFILE) = 7
openat(AT_FDCWD, "/dev/urandom", O_RDONLY|O_LARGEFILE) = 8
openat(AT_FDCWD, "/proc/self/maps", O_RDONLY|O_LARGEFILE) = 7
stat64("/dev/mapper/dshelf2", {st_mode=S_IFBLK|0660, st_rdev=makedev(253, 2), ...}) = 0
stat64("/dev/mapper/dshelf2", {st_mode=S_IFBLK|0660, st_rdev=makedev(253, 2), ...}) = 0
openat(AT_FDCWD, "/sys/dev/block/253:7/bdi/read_ahead_kb", O_RDONLY|O_LARGEFILE) = 7
openat(AT_FDCWD, "/sys/dev/block/253:7/bdi/read_ahead_kb", O_WRONLY|O_LARGEFILE) = 7
stat64("/dev/mapper/control", {st_mode=S_IFCHR|0600, st_rdev=makedev(10, 236), ...}) = 0
openat(AT_FDCWD, "/dev/mapper/control", O_RDWR|O_LARGEFILE) = 4
stat64("/dev/vgds2/thinpool2", {st_mode=S_IFBLK|0660, st_rdev=makedev(253, 7), ...}) = 0
lstat64("/dev/vgds2/thinpool2", {st_mode=S_IFLNK|0777, st_size=7, ...}) = 0
lstat64("/dev/vgds2/lvol0", 0xffe9462c) = -1 ENOENT (No such file or directory)
stat64("/dev/vgds2/thinpool2", {st_mode=S_IFBLK|0660, st_rdev=makedev(253, 7), ...}) = 0
openat(AT_FDCWD, "/dev/vgds2/thinpool2", O_RDWR|O_DIRECT|O_LARGEFILE|O_NOATIME) = 7
openat(AT_FDCWD, "/proc/self/maps", O_RDONLY|O_LARGEFILE) = 7
openat(AT_FDCWD, "/dev/urandom", O_RDONLY|O_LARGEFILE) = 8
openat(AT_FDCWD, "/dev/urandom", O_RDONLY|O_LARGEFILE) = 8
stat64("/sys//dev/block/253:2/queue/minimum_io_size", {st_mode=S_IFREG|0444, st_size=4096, ...}) = 0
openat(AT_FDCWD, "/sys//dev/block/253:2/queue/minimum_io_size", O_RDONLY|O_LARGEFILE) = 7
stat64("/etc/lvm/backup", {st_mode=S_IFDIR|0700, st_size=10, ...}) = 0
access("/etc/lvm/backup", R_OK|W_OK|X_OK) = 0
openat(AT_FDCWD, "/etc/lvm/backup/.lvm_gargamel.svh.merlins.org_19532_130993407", O_WRONLY|O_CREAT|O_EXCL|O_APPEND|O_LARGEFILE, 0666) = 7
rename("/etc/lvm/backup/.lvm_gargamel.svh.merlins.org_19532_130993407", "/etc/lvm/backup/vgds2.tmp") = 0
rename("/etc/lvm/backup/vgds2.tmp", "/etc/lvm/backup/vgds2") = 0
stat64("/etc/lvm/backup/vgds2.tmp", 0xffe96b7c) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, "/etc/lvm/backup", O_RDONLY|O_LARGEFILE) = 7
openat(AT_FDCWD, "/proc/self/maps", O_RDONLY|O_LARGEFILE) = 7
stat64("/dev/mapper/dshelf2", {st_mode=S_IFBLK|0660, st_rdev=makedev(253, 2), ...}) = 0
stat64("/dev/mapper/dshelf2", {st_mode=S_IFBLK|0660, st_rdev=makedev(253, 2), ...}) = 0
stat64("/dev/mapper/dshelf2", {st_mode=S_IFBLK|0660, st_rdev=makedev(253, 2), ...}) = 0
stat64("/dev/mapper/dshelf2", {st_mode=S_IFBLK|0660, st_rdev=makedev(253, 2), ...}) = 0
openat(AT_FDCWD, "/sys/dev/block/253:7/bdi/read_ahead_kb", O_RDONLY|O_LARGEFILE) = 8
openat(AT_FDCWD, "/sys/dev/block/253:7/bdi/read_ahead_kb", O_WRONLY|O_LARGEFILE) = 8
openat(AT_FDCWD, "/sys/dev/block/253:8/bdi/read_ahead_kb", O_RDONLY|O_LARGEFILE) = 8
openat(AT_FDCWD, "/sys/dev/block/253:8/bdi/read_ahead_kb", O_WRONLY|O_LARGEFILE) = 8
openat(AT_FDCWD, "/dev/mapper/vgds2-thinpool2_tmeta", O_RDONLY|O_LARGEFILE) = -1 ENOENT (No such file or directory)
/dev/mapper/vgds2-thinpool2_tmeta: open failed: No such file or directory
Failed to activate new LV.


gargamel:~# strace -etrace=file lvcreate -L 14.50TiB -Zn -T vgds2/thinpool2 2>&1 |grep thinpool2
execve("/sbin/lvcreate", ["lvcreate", "-L", "14.50TiB", "-Zn", "-T", "vgds2/thinpool2"], [/* 33 vars */]) = 0
stat64("/dev/vgds2/thinpool2", {st_mode=S_IFBLK|0660, st_rdev=makedev(253, 7), ...}) = 0
lstat64("/dev/vgds2/thinpool2", {st_mode=S_IFLNK|0777, st_size=7, ...}) = 0
stat64("/dev/vgds2/thinpool2", {st_mode=S_IFBLK|0660, st_rdev=makedev(253, 7), ...}) = 0
openat(AT_FDCWD, "/dev/vgds2/thinpool2", O_RDWR|O_DIRECT|O_LARGEFILE|O_NOATIME) = 7
openat(AT_FDCWD, "/dev/mapper/vgds2-thinpool2_tmeta", O_RDONLY|O_LARGEFILE) = -1 ENOENT (No such file or directory)
/dev/mapper/vgds2-thinpool2_tmeta: open failed: No such file or directory

Any ideas?

Thanks,
Marc

[Zdenek Kabelac]

Post by Marc MERLIN

Post by Marc MERLIN
Howdy,
gargamel:~# lvcreate -L 14.50TiB -Zn -T vgds2/thinpool2
Using default stripesize 64.00 KiB.
Thin pool volume with chunk size 8.00 MiB can address at most <1.98 PiB of data.
/dev/mapper/vgds2-thinpool2_tmeta: open failed: No such file or directory
Failed to activate new LV.
any idea what I should try next?

gargamel:~# lvcreate -L 14.50TiB -Zn -T vgds2/thinpool2
Using default stripesize 64.00 KiB.
Thin pool volume with chunk size 8.00 MiB can address at most <1.98 PiB of data.
/dev/vgds2/lvol0: not found: device not cleared
Aborting. Failed to wipe start of new LV.
gargamel:~# mkdir /dev/vgds2/
gargamel:~# l /dev/mapper/
total 0
drwxr-xr-x 2 root root 200 Jul 25 17:27 ./
drwxr-xr-x 20 root root 5280 Jul 26 00:15 ../
crw------- 1 root root 10, 236 Jul 25 17:25 control
lrwxrwxrwx 1 root root 7 Jul 23 08:57 cryptroot -> ../dm-0
lrwxrwxrwx 1 root root 7 Jul 25 06:40 dshelf1 -> ../dm-1
lrwxrwxrwx 1 root root 7 Jul 26 00:11 dshelf2 -> ../dm-2
lrwxrwxrwx 1 root root 7 Jul 25 06:40 eswap1 -> ../dm-3
lrwxrwxrwx 1 root root 7 Jul 25 06:40 raid0d1 -> ../dm-4
lrwxrwxrwx 1 root root 7 Jul 25 06:40 raid0d2 -> ../dm-5
lrwxrwxrwx 1 root root 7 Jul 25 06:40 varchange -> ../dm-6
gargamel:~# vgchange -ay
0 logical volume(s) in volume group "vgds2" now active
gargamel:~# lvcreate -L 14.50TiB -Zn -T vgds2/thinpool2
Using default stripesize 64.00 KiB.
Thin pool volume with chunk size 8.00 MiB can address at most <1.98 PiB of data.
/dev/mapper/vgds2-thinpool2_tmeta: open failed: No such file or directory
Failed to activate new LV.
gargamel:~# psg lvm
root 2378 0.0 0.0 31600 488 ? Ss Jul25 0:00 /sbin/lvmetad
gargamel:~# lvcreate --version
LVM version: 2.02.176(2) (2017-11-03)
Library version: 1.02.145 (2017-11-03)
Driver version: 4.39.0
Configuration: ./configure --build=i686-linux-gnu --prefix=/usr --includedir=${prefix}/include --mandir=${prefix}/share/man --infodir=${prefix}/share/info --sysconfdir=/etc --localstatedir=/var --disable-silent-rules --libdir=${prefix}/lib/i386-linux-gnu --libexecdir=${prefix}/lib/i386-linux-gnu --runstatedir=/run --disable-maintainer-mode --disable-dependency-tracking --exec-prefix= --bindir=/bin --libdir=/lib/i386-linux-gnu --sbindir=/sbin --with-usrlibdir=/usr/lib/i386-linux-gnu --with-optimisation=-O2 --with-cache=internal --with-clvmd=corosync --with-cluster=internal --with-device-uid=0 --with-device-gid=6 --with-device-mode=0660 --with-default-pid-dir=/run --with-default-run-dir=/run/lvm --with-default-locking-dir=/run/lock/lvm --with-thin=internal --with-thin-check=/usr/sbin/thi
n_check --with-thin-dump=/usr/sbin/thin_dump --with-thin-repair=/usr/sbin/thin_repair --enable-applib --enable-blkid_wiping --enable-cmdlib --enable-cmirrord --enable-dmeventd --enable-dbus-service
--enable-lvmetad --enable-lvmlockd-dlm --enable-lvmlockd-sanlock --enable-lvmpolld --enable-notify-dbus --enable-pkgconfig --enable-readline --enable-udev_rules --enable-udev_sync
openat(AT_FDCWD, "/dev/vgds2/lvol0", O_RDWR|O_DIRECT|O_LARGEFILE|O_NOATIME) = 7
openat(AT_FDCWD, "/proc/self/maps", O_RDONLY|O_LARGEFILE) = 7
openat(AT_FDCWD, "/dev/urandom", O_RDONLY|O_LARGEFILE) = 8
openat(AT_FDCWD, "/proc/self/maps", O_RDONLY|O_LARGEFILE) = 7
stat64("/dev/mapper/dshelf2", {st_mode=S_IFBLK|0660, st_rdev=makedev(253, 2), ...}) = 0
stat64("/dev/mapper/dshelf2", {st_mode=S_IFBLK|0660, st_rdev=makedev(253, 2), ...}) = 0
openat(AT_FDCWD, "/sys/dev/block/253:7/bdi/read_ahead_kb", O_RDONLY|O_LARGEFILE) = 7
openat(AT_FDCWD, "/sys/dev/block/253:7/bdi/read_ahead_kb", O_WRONLY|O_LARGEFILE) = 7
stat64("/dev/mapper/control", {st_mode=S_IFCHR|0600, st_rdev=makedev(10, 236), ...}) = 0
openat(AT_FDCWD, "/dev/mapper/control", O_RDWR|O_LARGEFILE) = 4
stat64("/dev/vgds2/thinpool2", {st_mode=S_IFBLK|0660, st_rdev=makedev(253, 7), ...}) = 0
lstat64("/dev/vgds2/thinpool2", {st_mode=S_IFLNK|0777, st_size=7, ...}) = 0
lstat64("/dev/vgds2/lvol0", 0xffe9462c) = -1 ENOENT (No such file or directory)
stat64("/dev/vgds2/thinpool2", {st_mode=S_IFBLK|0660, st_rdev=makedev(253, 7), ...}) = 0
openat(AT_FDCWD, "/dev/vgds2/thinpool2", O_RDWR|O_DIRECT|O_LARGEFILE|O_NOATIME) = 7
openat(AT_FDCWD, "/proc/self/maps", O_RDONLY|O_LARGEFILE) = 7
openat(AT_FDCWD, "/dev/urandom", O_RDONLY|O_LARGEFILE) = 8
openat(AT_FDCWD, "/dev/urandom", O_RDONLY|O_LARGEFILE) = 8
stat64("/sys//dev/block/253:2/queue/minimum_io_size", {st_mode=S_IFREG|0444, st_size=4096, ...}) = 0
openat(AT_FDCWD, "/sys//dev/block/253:2/queue/minimum_io_size", O_RDONLY|O_LARGEFILE) = 7
stat64("/etc/lvm/backup", {st_mode=S_IFDIR|0700, st_size=10, ...}) = 0
access("/etc/lvm/backup", R_OK|W_OK|X_OK) = 0
openat(AT_FDCWD, "/etc/lvm/backup/.lvm_gargamel.svh.merlins.org_19532_130993407", O_WRONLY|O_CREAT|O_EXCL|O_APPEND|O_LARGEFILE, 0666) = 7
rename("/etc/lvm/backup/.lvm_gargamel.svh.merlins.org_19532_130993407", "/etc/lvm/backup/vgds2.tmp") = 0
rename("/etc/lvm/backup/vgds2.tmp", "/etc/lvm/backup/vgds2") = 0
stat64("/etc/lvm/backup/vgds2.tmp", 0xffe96b7c) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, "/etc/lvm/backup", O_RDONLY|O_LARGEFILE) = 7
openat(AT_FDCWD, "/proc/self/maps", O_RDONLY|O_LARGEFILE) = 7
stat64("/dev/mapper/dshelf2", {st_mode=S_IFBLK|0660, st_rdev=makedev(253, 2), ...}) = 0
stat64("/dev/mapper/dshelf2", {st_mode=S_IFBLK|0660, st_rdev=makedev(253, 2), ...}) = 0
stat64("/dev/mapper/dshelf2", {st_mode=S_IFBLK|0660, st_rdev=makedev(253, 2), ...}) = 0
stat64("/dev/mapper/dshelf2", {st_mode=S_IFBLK|0660, st_rdev=makedev(253, 2), ...}) = 0
openat(AT_FDCWD, "/sys/dev/block/253:7/bdi/read_ahead_kb", O_RDONLY|O_LARGEFILE) = 8
openat(AT_FDCWD, "/sys/dev/block/253:7/bdi/read_ahead_kb", O_WRONLY|O_LARGEFILE) = 8
openat(AT_FDCWD, "/sys/dev/block/253:8/bdi/read_ahead_kb", O_RDONLY|O_LARGEFILE) = 8
openat(AT_FDCWD, "/sys/dev/block/253:8/bdi/read_ahead_kb", O_WRONLY|O_LARGEFILE) = 8
openat(AT_FDCWD, "/dev/mapper/vgds2-thinpool2_tmeta", O_RDONLY|O_LARGEFILE) = -1 ENOENT (No such file or directory)
/dev/mapper/vgds2-thinpool2_tmeta: open failed: No such file or directory
Failed to activate new LV.
gargamel:~# strace -etrace=file lvcreate -L 14.50TiB -Zn -T vgds2/thinpool2 2>&1 |grep thinpool2
execve("/sbin/lvcreate", ["lvcreate", "-L", "14.50TiB", "-Zn", "-T", "vgds2/thinpool2"], [/* 33 vars */]) = 0
stat64("/dev/vgds2/thinpool2", {st_mode=S_IFBLK|0660, st_rdev=makedev(253, 7), ...}) = 0
lstat64("/dev/vgds2/thinpool2", {st_mode=S_IFLNK|0777, st_size=7, ...}) = 0
stat64("/dev/vgds2/thinpool2", {st_mode=S_IFBLK|0660, st_rdev=makedev(253, 7), ...}) = 0
openat(AT_FDCWD, "/dev/vgds2/thinpool2", O_RDWR|O_DIRECT|O_LARGEFILE|O_NOATIME) = 7
openat(AT_FDCWD, "/dev/mapper/vgds2-thinpool2_tmeta", O_RDONLY|O_LARGEFILE) = -1 ENOENT (No such file or directory)
/dev/mapper/vgds2-thinpool2_tmeta: open failed: No such file or directory

Hi

What are you trying to achieve with 'mkdir /dev/vgds2/' ?

You shall never ever touch /dev content - it's always under full control of
udev - if you start to create there your own files and directories you will
break whole usability of the system.

It's always udev having full control over all the symlinks there.

If you do not want to use udev - you need to compiled lvm2 without udev
support - in this case lvm2 will fallback to creation of all devices itself.

However I can't image in which todays distribution you would want to use it..

Anyway - the best 'debugging' you will get with 'lvcreate -vvvv'
it will always tell you what is failing.

Regards

Zdenek

[Marc MERLIN]

Post by Zdenek Kabelac
What are you trying to achieve with 'mkdir /dev/vgds2/' ?
You shall never ever touch /dev content - it's always under full control
of udev - if you start to create there your own files and directories you
will break whole usability of the system.
It's always udev having full control over all the symlinks there.

Yes, I know udev manages it, but given that things weren't working, I
randomly tried that (and yes I have udev)

Post by Zdenek Kabelac
However I can't image in which todays distribution you would want to use it..
Anyway - the best 'debugging' you will get with 'lvcreate -vvvv'
it will always tell you what is failing.

Looks like my problem was that udev was too old, and there was no
dependency for the newer package. I upgraded from udev 232 from 239

It's looking better now:
gargamel:~# lvcreate -L 14.50TiB -Zn -T vgds2/thinpool2
Using default stripesize 64.00 KiB.
Thin pool volume with chunk size 8.00 MiB can address at most <1.98 PiB of data.
semid 1376260: semop failed for cookie 0xd4d162f: incorrect semaphore state
Failed to set a proper state for notification semaphore identified by cookie value 223155759 (0xd4d162f) to initialize waiting for incoming notifications.
Logical volume "thinpool2" created.
semid 1441796: semop failed for cookie 0xd4dad79: incorrect semaphore state
Failed to set a proper state for notification semaphore identified by cookie value 223194489 (0xd4dad79) to initialize waiting for incoming notifications.
gargamel:~# lvdisplay
--- Logical volume ---
LV Name thinpool2
VG Name vgds2
LV UUID rxJCsT-ImNv-ibvM-zOS0-Xzqv-O8AU-1STUH9
LV Write Access read/write
LV Creation host, time gargamel.svh.merlins.org, 2018-07-26 08:42:51 -0700
LV Pool metadata thinpool2_tmeta
LV Pool data thinpool2_tdata
LV Status available
# open 0
LV Size 14.50 TiB
Allocated pool data 0.00%
Allocated metadata 0.42%
Current LE 3801088
Segments 1
Allocation inherit
Read ahead sectors auto
- currently set to 8192
Block device 253:9


This is what -vvvv said before udev was upgraded.

#mm/memlock.c:373 Locked 20828160 bytes
#activate/dev_manager.c:2945 Creating ACTIVATE tree for vgds2/thinpool2.
#activate/dev_manager.c:696 Getting device info for vgds2-thinpool2 [LVM-pc1cTHkFo7g0KzdELpj51s1yOOv20WIVtagm8tt2DwYykD0jixmnUbYQIglsp3ce-pool].
#ioctl/libdm-iface.c:1848 dm info LVM-pc1cTHkFo7g0KzdELpj51s1yOOv20WIVtagm8tt2DwYykD0jixmnUbYQIglsp3ce-pool [ opencount flush ] [16384] (*1)
#ioctl/libdm-iface.c:1848 dm info LVM-pc1cTHkFo7g0KzdELpj51s1yOOv20WIVtagm8tt2DwYykD0jixmnUbYQIglsp3ce [ opencount flush ] [16384] (*1)
#activate/dev_manager.c:696 Getting device info for vgds2-thinpool2-real [LVM-pc1cTHkFo7g0KzdELpj51s1yOOv20WIVtagm8tt2DwYykD0jixmnUbYQIglsp3ce-real].
#ioctl/libdm-iface.c:1848 dm info LVM-pc1cTHkFo7g0KzdELpj51s1yOOv20WIVtagm8tt2DwYykD0jixmnUbYQIglsp3ce-real [ opencount flush ] [16384] (*1)
#activate/dev_manager.c:696 Getting device info for vgds2-thinpool2-cow [LVM-pc1cTHkFo7g0KzdELpj51s1yOOv20WIVtagm8tt2DwYykD0jixmnUbYQIglsp3ce-cow].
#ioctl/libdm-iface.c:1848 dm info LVM-pc1cTHkFo7g0KzdELpj51s1yOOv20WIVtagm8tt2DwYykD0jixmnUbYQIglsp3ce-cow [ opencount flush ] [16384] (*1)
#activate/dev_manager.c:696 Getting device info for vgds2-thinpool2-tpool [LVM-pc1cTHkFo7g0KzdELpj51s1yOOv20WIVtagm8tt2DwYykD0jixmnUbYQIglsp3ce-tpool].
#ioctl/libdm-iface.c:1848 dm info LVM-pc1cTHkFo7g0KzdELpj51s1yOOv20WIVtagm8tt2DwYykD0jixmnUbYQIglsp3ce-tpool [ opencount flush ] [16384] (*1)
#activate/dev_manager.c:696 Getting device info for vgds2-thinpool2_tmeta [LVM-pc1cTHkFo7g0KzdELpj51s1yOOv20WIVB3HuP3X42OjPM31JY4ScCSrRN2WoZWGx-tmeta].
#ioctl/libdm-iface.c:1848 dm info LVM-pc1cTHkFo7g0KzdELpj51s1yOOv20WIVB3HuP3X42OjPM31JY4ScCSrRN2WoZWGx-tmeta [ opencount flush ] [16384] (*1)
#ioctl/libdm-iface.c:1848 dm info LVM-pc1cTHkFo7g0KzdELpj51s1yOOv20WIVB3HuP3X42OjPM31JY4ScCSrRN2WoZWGx [ opencount flush ] [16384] (*1)
#activate/dev_manager.c:696 Getting device info for vgds2-thinpool2_tmeta-real [LVM-pc1cTHkFo7g0KzdELpj51s1yOOv20WIVB3HuP3X42OjPM31JY4ScCSrRN2WoZWGx-real].
#ioctl/libdm-iface.c:1848 dm info LVM-pc1cTHkFo7g0KzdELpj51s1yOOv20WIVB3HuP3X42OjPM31JY4ScCSrRN2WoZWGx-real [ opencount flush ] [16384] (*1)
#activate/dev_manager.c:696 Getting device info for vgds2-thinpool2_tmeta-cow [LVM-pc1cTHkFo7g0KzdELpj51s1yOOv20WIVB3HuP3X42OjPM31JY4ScCSrRN2WoZWGx-cow].
#ioctl/libdm-iface.c:1848 dm info LVM-pc1cTHkFo7g0KzdELpj51s1yOOv20WIVB3HuP3X42OjPM31JY4ScCSrRN2WoZWGx-cow [ opencount flush ] [16384] (*1)
#activate/dev_manager.c:696 Getting device info for vgds2-thinpool2_tdata [LVM-pc1cTHkFo7g0KzdELpj51s1yOOv20WIVj2xjlvzkpKsioFrUJdZAIDTzTm1Yhh8f-tdata].
#ioctl/libdm-iface.c:1848 dm info LVM-pc1cTHkFo7g0KzdELpj51s1yOOv20WIVj2xjlvzkpKsioFrUJdZAIDTzTm1Yhh8f-tdata [ opencount flush ] [16384] (*1)
#ioctl/libdm-iface.c:1848 dm info LVM-pc1cTHkFo7g0KzdELpj51s1yOOv20WIVj2xjlvzkpKsioFrUJdZAIDTzTm1Yhh8f [ opencount flush ] [16384] (*1)
#activate/dev_manager.c:696 Getting device info for vgds2-thinpool2_tdata-real [LVM-pc1cTHkFo7g0KzdELpj51s1yOOv20WIVj2xjlvzkpKsioFrUJdZAIDTzTm1Yhh8f-real].
#ioctl/libdm-iface.c:1848 dm info LVM-pc1cTHkFo7g0KzdELpj51s1yOOv20WIVj2xjlvzkpKsioFrUJdZAIDTzTm1Yhh8f-real [ opencount flush ] [16384] (*1)
#activate/dev_manager.c:696 Getting device info for vgds2-thinpool2_tdata-cow [LVM-pc1cTHkFo7g0KzdELpj51s1yOOv20WIVj2xjlvzkpKsioFrUJdZAIDTzTm1Yhh8f-cow].
#ioctl/libdm-iface.c:1848 dm info LVM-pc1cTHkFo7g0KzdELpj51s1yOOv20WIVj2xjlvzkpKsioFrUJdZAIDTzTm1Yhh8f-cow [ opencount flush ] [16384] (*1)
#activate/dev_manager.c:2591 Adding new LV vgds2/thinpool2 to dtree
#libdm-deptree.c:623 Not matched uuid LVM-pc1cTHkFo7g0KzdELpj51s1yOOv20WIVtagm8tt2DwYykD0jixmnUbYQIglsp3ce-tpool in deptree.
#libdm-deptree.c:623 Not matched uuid LVM-pc1cTHkFo7g0KzdELpj51s1yOOv20WIVtagm8tt2DwYykD0jixmnUbYQIglsp3ce-tpool in deptree.
#activate/dev_manager.c:2513 Checking kernel supports thin-pool segment type for vgds2/thinpool2-tpool
#activate/dev_manager.c:2591 Adding new LV vgds2/thinpool2_tmeta to dtree
#libdm-deptree.c:623 Not matched uuid LVM-pc1cTHkFo7g0KzdELpj51s1yOOv20WIVB3HuP3X42OjPM31JY4ScCSrRN2WoZWGx-tmeta in deptree.
#libdm-deptree.c:623 Not matched uuid LVM-pc1cTHkFo7g0KzdELpj51s1yOOv20WIVB3HuP3X42OjPM31JY4ScCSrRN2WoZWGx-tmeta in deptree.
#activate/dev_manager.c:2513 Checking kernel supports striped segment type for vgds2/thinpool2_tmeta
#ioctl/libdm-iface.c:1848 dm deps (253:2) [ opencount flush ] [16384] (*1)
#metadata/metadata.c:2171 Calculated readahead of LV thinpool2_tmeta is 8192
#activate/dev_manager.c:2591 Adding new LV vgds2/thinpool2_tdata to dtree
#libdm-deptree.c:623 Not matched uuid LVM-pc1cTHkFo7g0KzdELpj51s1yOOv20WIVj2xjlvzkpKsioFrUJdZAIDTzTm1Yhh8f-tdata in deptree.
#libdm-deptree.c:623 Not matched uuid LVM-pc1cTHkFo7g0KzdELpj51s1yOOv20WIVj2xjlvzkpKsioFrUJdZAIDTzTm1Yhh8f-tdata in deptree.
#activate/dev_manager.c:2513 Checking kernel supports striped segment type for vgds2/thinpool2_tdata
#metadata/metadata.c:2171 Calculated readahead of LV thinpool2_tdata is 8192
#libdm-config.c:997 Setting activation/thin_pool_autoextend_threshold to 100
#libdm-deptree.c:591 Matched uuid LVM-pc1cTHkFo7g0KzdELpj51s1yOOv20WIVB3HuP3X42OjPM31JY4ScCSrRN2WoZWGx-tmeta in deptree.
#libdm-deptree.c:591 Matched uuid LVM-pc1cTHkFo7g0KzdELpj51s1yOOv20WIVj2xjlvzkpKsioFrUJdZAIDTzTm1Yhh8f-tdata in deptree.
#metadata/metadata.c:2171 Calculated readahead of LV thinpool2 is 8192
#libdm-deptree.c:2004 Creating vgds2-thinpool2_tmeta
#ioctl/libdm-iface.c:1848 dm create vgds2-thinpool2_tmeta LVM-pc1cTHkFo7g0KzdELpj51s1yOOv20WIVB3HuP3X42OjPM31JY4ScCSrRN2WoZWGx-tmeta [ noopencount flush ] [16384] (*1)
#libdm-deptree.c:2859 Loading vgds2-thinpool2_tmeta table (253:7)
#libdm-deptree.c:2803 Adding target to (253:7): 0 237568 linear 253:2 31138752512
#ioctl/libdm-iface.c:1848 dm table (253:7) [ opencount flush ] [16384] (*1)
#ioctl/libdm-iface.c:1848 dm reload (253:7) [ noopencount flush ] [16384] (*1)
#libdm-deptree.c:2912 Table size changed from 0 to 237568 for vgds2-thinpool2_tmeta (253:7).
#libdm-deptree.c:1368 Resuming vgds2-thinpool2_tmeta (253:7)
#ioctl/libdm-iface.c:1848 dm resume (253:7) [ noopencount flush ] [16384] (*1)
#libdm-common.c:1475 vgds2-thinpool2_tmeta: Stacking NODE_ADD (253,7) 0:6 0660 [trust_udev]
#libdm-common.c:1485 vgds2-thinpool2_tmeta: Stacking NODE_READ_AHEAD 8192 (flags=1)
#libdm-deptree.c:2004 Creating vgds2-thinpool2_tdata
#ioctl/libdm-iface.c:1848 dm create vgds2-thinpool2_tdata LVM-pc1cTHkFo7g0KzdELpj51s1yOOv20WIVj2xjlvzkpKsioFrUJdZAIDTzTm1Yhh8f-tdata [ noopencount flush ] [16384] (*1)
#libdm-deptree.c:2859 Loading vgds2-thinpool2_tdata table (253:8)
#libdm-deptree.c:2803 Adding target to (253:8): 0 31138512896 linear 253:2 239616
#ioctl/libdm-iface.c:1848 dm table (253:8) [ opencount flush ] [16384] (*1)
#ioctl/libdm-iface.c:1848 dm reload (253:8) [ noopencount flush ] [16384] (*1)
#libdm-deptree.c:2912 Table size changed from 0 to 31138512896 for vgds2-thinpool2_tdata (253:8).
#libdm-deptree.c:1368 Resuming vgds2-thinpool2_tdata (253:8)
#ioctl/libdm-iface.c:1848 dm resume (253:8) [ noopencount flush ] [16384] (*1)
#libdm-common.c:1475 vgds2-thinpool2_tdata: Stacking NODE_ADD (253,8) 0:6 0660 [trust_udev]
#libdm-common.c:1485 vgds2-thinpool2_tdata: Stacking NODE_READ_AHEAD 8192 (flags=1)
#libdm-common.c:1478 vgds2-thinpool2: Skipping NODE_DEL [trust_udev]
#libdm-common.c:1475 vgds2-thinpool2_tmeta: Skipping NODE_ADD (253,7) 0:6 0660 [trust_udev]
#libdm-common.c:1485 vgds2-thinpool2_tmeta: Processing NODE_READ_AHEAD 8192 (flags=1)
#libdm-common.c:1239 vgds2-thinpool2_tmeta (253:7): read ahead is 256
#libdm-common.c:1289 vgds2-thinpool2_tmeta (253:7): Setting read ahead to 8192
#libdm-common.c:1475 vgds2-thinpool2_tdata: Skipping NODE_ADD (253,8) 0:6 0660 [trust_udev]
#libdm-common.c:1485 vgds2-thinpool2_tdata: Processing NODE_READ_AHEAD 8192 (flags=1)
#libdm-common.c:1239 vgds2-thinpool2_tdata (253:8): read ahead is 256
#libdm-common.c:1289 vgds2-thinpool2_tdata (253:8): Setting read ahead to 8192
#libdm-config.c:975 global/thin_check_executable not found in config: defaulting to /usr/sbin/thin_check
#config/config.c:1468 global/thin_check_options not found in config: defaulting to thin_check_options = [ "-q" ]
#activate/dev_manager.c:1832 /dev/mapper/vgds2-thinpool2_tmeta: open failed: No such file or directory
#libdm-deptree.c:2933 Reverting vgds2-thinpool2_tdata.
#libdm-deptree.c:1043 Removing vgds2-thinpool2_tdata (253:8)
#ioctl/libdm-iface.c:1848 dm remove (253:8) [ noopencount flush ] [16384] (*1)
#libdm-common.c:1478 vgds2-thinpool2_tdata: Stacking NODE_DEL [trust_udev]
#libdm-deptree.c:2933 Reverting vgds2-thinpool2_tmeta.
#libdm-deptree.c:1043 Removing vgds2-thinpool2_tmeta (253:7)
#ioctl/libdm-iface.c:1848 dm remove (253:7) [ noopencount flush ] [16384] (*1)
#libdm-common.c:1478 vgds2-thinpool2_tmeta: Stacking NODE_DEL [trust_udev]
#libdm-deptree.c:3087 <backtrace>

Thanks,
Marc

[Zdenek Kabelac]

Post by Marc MERLIN

Post by Zdenek Kabelac
What are you trying to achieve with 'mkdir /dev/vgds2/' ?
You shall never ever touch /dev content - it's always under full control
of udev - if you start to create there your own files and directories you
will break whole usability of the system.
It's always udev having full control over all the symlinks there.

Yes, I know udev manages it, but given that things weren't working, I
randomly tried that (and yes I have udev)

Post by Zdenek Kabelac
However I can't image in which todays distribution you would want to use it..
Anyway - the best 'debugging' you will get with 'lvcreate -vvvv'
it will always tell you what is failing.

Looks like my problem was that udev was too old, and there was no
dependency for the newer package. I upgraded from udev 232 from 239
gargamel:~# lvcreate -L 14.50TiB -Zn -T vgds2/thinpool2
Using default stripesize 64.00 KiB.
Thin pool volume with chunk size 8.00 MiB can address at most <1.98 PiB of data.
semid 1376260: semop failed for cookie 0xd4d162f: incorrect semaphore state
Failed to set a proper state for notification semaphore identified by cookie value 223155759 (0xd4d162f) to initialize waiting for incoming notifications.
Logical volume "thinpool2" created.
semid 1441796: semop failed for cookie 0xd4dad79: incorrect semaphore state
Failed to set a proper state for notification semaphore identified by cookie value 223194489 (0xd4dad79) to initialize waiting for incoming notifications.

Hi

These messages are informing you that your udev system and SysV semaphores
support do not work properly together at all.

In practice lvm2 detected semaphores are useless on your system and fallback
to actually ignore them to not stay blocked endlessly waiting on udev work to
get finished.

So I'm unsure what are you trying to reach - are you building your own
linux-from-scratch system - I doubt that any widely usable modern distro has
such broken SysV support built-in in their mainstream kernel.

IMHO if you are trying to build your own linux system yourself and you do not
need udev otherwise at all - you could probably better build lvm2 without
udev_sync support - so you will not see those ugly error messages with every
creation command you will run.


Zdenek

[Marc MERLIN]

Post by Zdenek Kabelac

Post by Marc MERLIN
gargamel:~# lvcreate -L 14.50TiB -Zn -T vgds2/thinpool2
Using default stripesize 64.00 KiB.
Thin pool volume with chunk size 8.00 MiB can address at most <1.98 PiB of data.
semid 1376260: semop failed for cookie 0xd4d162f: incorrect semaphore state
Failed to set a proper state for notification semaphore identified by
cookie value 223155759 (0xd4d162f) to initialize waiting for incoming
notifications.
Logical volume "thinpool2" created.
semid 1441796: semop failed for cookie 0xd4dad79: incorrect semaphore state
Failed to set a proper state for notification semaphore identified by
cookie value 223194489 (0xd4dad79) to initialize waiting for incoming
notifications.

Hi
These messages are informing you that your udev system and SysV semaphores
support do not work properly together at all.
In practice lvm2 detected semaphores are useless on your system and
fallback to actually ignore them to not stay blocked endlessly waiting on
udev work to get finished.
So I'm unsure what are you trying to reach - are you building your own
linux-from-scratch system - I doubt that any widely usable modern distro
has such broken SysV support built-in in their mainstream kernel.
IMHO if you are trying to build your own linux system yourself and you do
not need udev otherwise at all - you could probably better build lvm2
without udev_sync support - so you will not see those ugly error messages
with every creation command you will run.

I running debian/testing on a 32 bit server.
The only thing is that I don't run 'dist-upgrade" regularly due to the
amount of stuff that changes and breaks for no reason, usually at times I
don't have time to deal with it.

So, my udev was out of date for lvm2 and there was a missing package
dependency on minimum version required. However, what I pasted above was
with the latest udev version intesting, so there may be other missing
dependencies or problems.
I don't have systemd on that system, still regular init.

I have sysvinit 2.88dsf-59.2 . Is that too old and causing issues too?

Thanks,
Marc