panic: Stopped at kqueue_scan

[Aaron Bieber]

Hola,

For roughly a week I have been able to reliably produce panics on
amd64 (virtual machine and physical machine) using disk IO heavy
applications (gitea, syncthing).

Unfortunately on the physical machine - the one I can reliably panic
within < 1 minute - I don't have a serial console, so here are links
to photos:

https://goo.gl/photos/Z8g225UXXpCXQpGcA
mirror/google averse: https://deftly.net/panic-2017-07-06/

Also with machdep.forceukbd=1, once I ran `mach ddbcpu 0`, every
subsequent key press puked out an "splassert" line, I attempted to run
a "trace" again, but things seemed to be completely locked up after that.

Cheers,
Aaron

OpenBSD 6.1-current (GENERIC.MP) #89: Thu Jul 6 01:02:18 MDT 2017
***@amd64.openbsd.org:/usr/src/sys/arch/amd64/compile/GENERIC.MP
real mem = 4231942144 (4035MB)
avail mem = 4097892352 (3908MB)
mpath0 at root
scsibus0 at mpath0: 256 targets
mainbus0 at root
bios0 at mainbus0: SMBIOS rev. 2.7 @ 0xe0840 (49 entries)
bios0: vendor Phoenix Technologies Ltd. version "CDV_T30 X64" date 09/17/2012
bios0: Intel Corporation Milstead Platform
acpi0 at bios0: rev 2
acpi0: sleep states S0 S1 S3 S4 S5
acpi0: tables DSDT FACP SLIC SSDT HPET APIC MCFG SSDT UEFI UEFI POAT UEFI
acpi0: wakeup devices P0P1(S4) USB0(S4) USB1(S4) USB2(S4) USB3(S4) EHC1(S4) USB4(S4) USB5(S4) USB6(S4) EHC2(S4) PXSX(S4) RP01(S4) PXSX(S4) RP02(S4) PXSX(S4) RP03(S4) [...]
acpitimer0 at acpi0: 3579545 Hz, 24 bits
acpihpet0 at acpi0: 14318179 Hz
acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat
cpu0 at mainbus0: apid 0 (boot processor)
cpu0: Intel(R) Atom(TM) CPU D2550 @ 1.86GHz, 1862.32 MHz
cpu0: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,DTES64,MWAIT,DS-CPL,TM2,SSSE3,CX16,xTPR,PDCM,MOVBE,NXE,LONG,LAHF,PERF,ITSC,SENSOR,ARAT
cpu0: 512KB 64b/line 8-way L2 cache
cpu0: TSC frequency 1862322420 Hz
cpu0: smt 0, core 0, package 0
mtrr: Pentium Pro MTRR support, 8 var ranges, 88 fixed ranges
cpu0: apic clock running at 133MHz
cpu0: mwait min=64, max=64, C-substates=0.1, IBE
cpu1 at mainbus0: apid 1 (application processor)
cpu1: Intel(R) Atom(TM) CPU D2550 @ 1.86GHz, 1862.01 MHz
cpu1: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,DTES64,MWAIT,DS-CPL,TM2,SSSE3,CX16,xTPR,PDCM,MOVBE,NXE,LONG,LAHF,PERF,ITSC,SENSOR,ARAT
cpu1: 512KB 64b/line 8-way L2 cache
cpu1: smt 1, core 0, package 0
cpu2 at mainbus0: apid 2 (application processor)
cpu2: Intel(R) Atom(TM) CPU D2550 @ 1.86GHz, 1862.01 MHz
cpu2: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,DTES64,MWAIT,DS-CPL,TM2,SSSE3,CX16,xTPR,PDCM,MOVBE,NXE,LONG,LAHF,PERF,ITSC,SENSOR,ARAT
cpu2: 512KB 64b/line 8-way L2 cache
cpu2: smt 0, core 1, package 0
cpu3 at mainbus0: apid 3 (application processor)
cpu3: Intel(R) Atom(TM) CPU D2550 @ 1.86GHz, 1862.01 MHz
cpu3: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,DTES64,MWAIT,DS-CPL,TM2,SSSE3,CX16,xTPR,PDCM,MOVBE,NXE,LONG,LAHF,PERF,ITSC,SENSOR,ARAT
cpu3: 512KB 64b/line 8-way L2 cache
cpu3: smt 1, core 1, package 0
ioapic0 at mainbus0: apid 1 pa 0xfec00000, version 20, 24 pins
acpimcfg0 at acpi0 addr 0xe0000000, bus 0-255
acpiprt0 at acpi0: bus 0 (PCI0)
acpiprt1 at acpi0: bus 7 (P0P1)
acpiprt2 at acpi0: bus 1 (RP01)
acpiprt3 at acpi0: bus 2 (RP02)
acpiprt4 at acpi0: bus 3 (RP03)
acpiprt5 at acpi0: bus 4 (RP04)
acpiprt6 at acpi0: bus 5 (RP05)
acpicpu0 at acpi0: C1(@1 halt!)
acpicpu1 at acpi0: C1(@1 halt!)
acpicpu2 at acpi0: C1(@1 halt!)
acpicpu3 at acpi0: C1(@1 halt!)
"PNP0A05" at acpi0 not configured
"PNP0501" at acpi0 not configured
"PNP0501" at acpi0 not configured
acpibtn0 at acpi0: PWRB
acpibtn1 at acpi0: SLPB
"INT340E" at acpi0 not configured
acpivideo0 at acpi0: GFX0
acpivout0 at acpivideo0: DD02
pci0 at mainbus0 bus 0
pchb0 at pci0 dev 0 function 0 "Intel Atom D2000/N2000 Host" rev 0x04
"Intel GMA 3600" rev 0x0b at pci0 dev 2 function 0 not configured
uhci0 at pci0 dev 26 function 0 "Intel 82801JI USB" rev 0x00: apic 1 int 16
uhci1 at pci0 dev 26 function 1 "Intel 82801JI USB" rev 0x00: apic 1 int 21
uhci2 at pci0 dev 26 function 2 "Intel 82801JI USB" rev 0x00: apic 1 int 18
ehci0 at pci0 dev 26 function 7 "Intel 82801JI USB" rev 0x00: apic 1 int 18
usb0 at ehci0: USB revision 2.0
uhub0 at usb0 configuration 1 interface 0 "Intel EHCI root hub" rev 2.00/1.00 addr 1
azalia0 at pci0 dev 27 function 0 "Intel 82801JI HD Audio" rev 0x00: msi
azalia0: codecs: Intel/0x2880, Realtek ALC262, using Realtek ALC262
audio0 at azalia0
ppb0 at pci0 dev 28 function 0 "Intel 82801JI PCIE" rev 0x00: msi
pci1 at ppb0 bus 1
em0 at pci1 dev 0 function 0 "Intel 82574L" rev 0x00: msi, address 00:14:fd:17:6f:46
ppb1 at pci0 dev 28 function 1 "Intel 82801JI PCIE" rev 0x00: msi
pci2 at ppb1 bus 2
em1 at pci2 dev 0 function 0 "Intel 82574L" rev 0x00: msi, address 00:14:fd:17:6f:47
ppb2 at pci0 dev 28 function 2 "Intel 82801JI PCIE" rev 0x00: msi
pci3 at ppb2 bus 3
ppb3 at pci0 dev 28 function 3 "Intel 82801JI PCIE" rev 0x00: msi
pci4 at ppb3 bus 4
ppb4 at pci0 dev 28 function 4 "Intel 82801JI PCIE" rev 0x00: msi
pci5 at ppb4 bus 5
5:0:0: mem address conflict 0xc0100000/0x2000
xhci0 at pci5 dev 0 function 0 "Renesas uPD720202 xHCI" rev 0x02: msi
usb1 at xhci0: USB revision 3.0
uhub1 at usb1 configuration 1 interface 0 "Renesas xHCI root hub" rev 3.00/1.00 addr 1
ppb5 at pci0 dev 28 function 5 "Intel 82801JI PCIE" rev 0x00: msi
pci6 at ppb5 bus 6
6:0:0: mem address conflict 0xc0004000/0x80
6:0:0: mem address conflict 0xc0000000/0x4000
sili0 at pci6 dev 0 function 0 "CMD Technology SiI3132 SATA" rev 0x01: apic 1 int 17
scsibus1 at sili0: 2 targets
uhci3 at pci0 dev 29 function 0 "Intel 82801JI USB" rev 0x00: apic 1 int 23
uhci4 at pci0 dev 29 function 1 "Intel 82801JI USB" rev 0x00: apic 1 int 19
uhci5 at pci0 dev 29 function 2 "Intel 82801JI USB" rev 0x00: apic 1 int 18
ehci1 at pci0 dev 29 function 7 "Intel 82801JI USB" rev 0x00: apic 1 int 23
usb2 at ehci1: USB revision 2.0
uhub2 at usb2 configuration 1 interface 0 "Intel EHCI root hub" rev 2.00/1.00 addr 1
ppb6 at pci0 dev 30 function 0 "Intel 82801BA Hub-to-PCI" rev 0x90
pci7 at ppb6 bus 7
pcib0 at pci0 dev 31 function 0 "Intel 82801JIR LPC" rev 0x00
ahci0 at pci0 dev 31 function 2 "Intel 82801JI AHCI" rev 0x00: msi, AHCI 1.2
ahci0: port 0: 3.0Gb/s
ahci0: port 1: 1.5Gb/s
ahci0: port 2: 3.0Gb/s
ahci0: port 3: 3.0Gb/s
ahci0: port 4: 3.0Gb/s
ahci0: port 5: 3.0Gb/s
scsibus2 at ahci0: 32 targets
sd0 at scsibus2 targ 0 lun 0: <ATA, AFAYA MDS 1GB, 1110> SCSI3 0/direct fixed t10.ATA_AFAYA_MDS_1GB_20111007A10600002FE0
sd0: 964MB, 512 bytes/sector, 1974672 sectors
sd1 at scsibus2 targ 1 lun 0: <ATA, ST3250410AS, 3.AA> SCSI3 0/direct fixed t10.ATA_ST3250410AS_6RY5839J
sd1: 238475MB, 512 bytes/sector, 488397168 sectors
sd2 at scsibus2 targ 2 lun 0: <ATA, WDC WD20EZRX-19D, 81.0> SCSI3 0/direct fixed naa.50014ee2b3e2654f
sd2: 1907729MB, 512 bytes/sector, 3907029168 sectors
sd3 at scsibus2 targ 3 lun 0: <ATA, WDC WD20EZRX-19D, 81.0> SCSI3 0/direct fixed naa.50014ee25e8c6ddb
sd3: 1907729MB, 512 bytes/sector, 3907029168 sectors
sd4 at scsibus2 targ 4 lun 0: <ATA, WDC WD20EZRX-19D, 81.0> SCSI3 0/direct fixed naa.50014ee25e8c6f58
sd4: 1907729MB, 512 bytes/sector, 3907029168 sectors
sd5 at scsibus2 targ 5 lun 0: <ATA, WDC WD20EZRX-00D, 80.0> SCSI3 0/direct fixed naa.50014ee2b364b6c0
sd5: 1907729MB, 512 bytes/sector, 3907029168 sectors
ichiic0 at pci0 dev 31 function 3 "Intel 82801JI SMBus" rev 0x00: apic 1 int 18
iic0 at ichiic0
iic0: addr 0x2d 00=05 01=4c 02=00 03=40 04=5a 10=d1 11=81 12=7d 13=78 16=0f 17=fe 18=0f 19=fe 1a=c0 1b=c0 1c=21 1d=c0 1e=af 1f=fb 21=00 23=00 25=00 27=00 28=64 29=5f 2a=64 2b=5f 2c=3c 2d=37 2e=00 30=00 31=f0 32=f0 33=00 34=00 35=00 36=30 5a=04 5b=10 5c=20 5d=19 5e=34 60=44 61=0a 62=94 63=07 64=00 65=00 66=00 67=0f 69=55 6a=64 6b=46 6c=64 6d=46 70=0f 74=00 80=0f 84=00 90=00 91=00 92=0f a0=46 a1=3c a2=32 a3=28 a5=d9 a6=b2 a7=99 a8=80 b0=46 b1=3c b2=32 b3=28 b5=d9 b6=b2 b7=99 b8=80 f0=00 f1=00 f2=00 f3=00 f4=00 f5=00 f6=3a f7=37 f8=02 f9=46 fa=0c ff=27 words 00=05e0 01=4c73 02=002d 03=4081 04=5ad1 05=ffc8 06=ff75 07=ff1e
iic0: addr 0x2e 00=05 01=0c 02=00 03=40 04=5c 10=d3 11=7d 12=7d 13=7d 16=0f 17=fe 18=0f 19=fe 1a=c0 1b=c0 1c=22 1d=20 1e=aa 1f=00 21=00 23=00 25=00 27=00 28=64 29=5f 2a=64 2b=5f 2c=3c 2d=37 2e=00 30=00 31=f0 32=f0 33=00 34=00 35=00 36=30 5a=04 5b=10 5c=20 5d=19 5e=34 60=44 61=0a 62=94 63=07 64=00 65=00 66=00 67=0f 69=55 6a=64 6b=46 6c=64 6d=46 70=0f 74=00 80=0f 84=00 90=00 91=00 92=0f a0=46 a1=3c a2=32 a3=28 a5=d9 a6=b2 a7=99 a8=80 b0=46 b1=3c b2=32 b3=28 b5=d9 b6=b2 b7=99 b8=80 f0=00 f1=00 f2=00 f3=00 f4=00 f5=00 f6=3f f7=f0 f8=01 f9=4b fa=0c ff=27 words 00=05ea 01=0cbe 02=0027 03=408b 04=5cc9 05=ffc2 06=ff7f 07=ff14
spdmem0 at iic0 addr 0x50: 2GB DDR3 SDRAM PC3-8500 SO-DIMM
spdmem1 at iic0 addr 0x51: 2GB DDR3 SDRAM PC3-8500 SO-DIMM
usb3 at uhci0: USB revision 1.0
uhub3 at usb3 configuration 1 interface 0 "Intel UHCI root hub" rev 1.00/1.00 addr 1
usb4 at uhci1: USB revision 1.0
uhub4 at usb4 configuration 1 interface 0 "Intel UHCI root hub" rev 1.00/1.00 addr 1
usb5 at uhci2: USB revision 1.0
uhub5 at usb5 configuration 1 interface 0 "Intel UHCI root hub" rev 1.00/1.00 addr 1
usb6 at uhci3: USB revision 1.0
uhub6 at usb6 configuration 1 interface 0 "Intel UHCI root hub" rev 1.00/1.00 addr 1
usb7 at uhci4: USB revision 1.0
uhub7 at usb7 configuration 1 interface 0 "Intel UHCI root hub" rev 1.00/1.00 addr 1
usb8 at uhci5: USB revision 1.0
uhub8 at usb8 configuration 1 interface 0 "Intel UHCI root hub" rev 1.00/1.00 addr 1
isa0 at pcib0
isadma0 at isa0
com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo
com1 at isa0 port 0x2f8/8 irq 3: ns16550a, 16 byte fifo
pckbc0 at isa0 port 0x60/5 irq 1 irq 12
pckbd0 at pckbc0 (kbd slot)
wskbd0 at pckbd0: console keyboard
pcppi0 at isa0 port 0x61
spkr0 at pcppi0
it0 at isa0 port 0x2e/2: IT8728F rev 1, EC port 0x290
efifb0 at mainbus0: 1024x768, 32bpp
wsdisplay0 at efifb0 mux 1: console (std, vt100 emulation), using wskbd0
wsdisplay0: screen 1-5 added (std, vt100 emulation)
uhub9 at uhub2 port 1 configuration 1 interface 0 "NEC Corporation USB2.0 Hub Controller" rev 2.00/1.00 addr 2
uhub10 at uhub9 port 2 configuration 1 interface 0 "Chicony Generic USB Hub" rev 1.10/1.02 addr 3
uhidev0 at uhub10 port 1 configuration 1 interface 0 "Chicony PFU-65 USB Keyboard" rev 1.10/1.02 addr 4
uhidev0: iclass 3/1
ukbd0 at uhidev0: 8 variable keys, 6 key codes
wskbd1 at ukbd0 mux 1
wskbd1: connecting to wsdisplay0
uplcom0 at uhub7 port 2 configuration 1 interface 0 "Prolific Technology Inc. USB-Serial Controller" rev 1.10/3.00 addr 2
ucom0 at uplcom0
vscsi0 at root
scsibus3 at vscsi0: 256 targets
softraid0 at root
scsibus4 at softraid0: 256 targets
softraid0: sd6 was not shutdown properly
sd6 at scsibus4 targ 1 lun 0: <OPENBSD, SR RAID 1, 006> SCSI2 0/direct fixed
sd6: 1907728MB, 512 bytes/sector, 3907028640 sectors
softraid0: sd7 was not shutdown properly
sd7 at scsibus4 targ 2 lun 0: <OPENBSD, SR RAID 1, 006> SCSI2 0/direct fixed
sd7: 1907728MB, 512 bytes/sector, 3907028640 sectors
root on sd1a (6563fbf5b9db78d3.a) swap on sd1b dump on sd1b
WARNING: / was not properly unmounted
wskbd1: disconnecting from wsdisplay0
wskbd1 detached
ukbd0 detached
uhidev0 detached
uhidev0 at uhub10 port 1 configuration 1 interface 0 "Chicony PFU-65 USB Keyboard" rev 1.10/1.02 addr 4
uhidev0: iclass 3/1
ukbd0 at uhidev0: 8 variable keys, 6 key codes
wskbd1 at ukbd0: console keyboard, using wsdisplay0
softraid0: sd8 was not shutdown properly
sd8 at scsibus4 targ 3 lun 0: <OPENBSD, SR RAID 0, 006> SCSI2 0/direct fixed
sd8: 3815457MB, 512 bytes/sector, 7814056192 sectors

[Ted Unangst]

Post by Aaron Bieber
For roughly a week I have been able to reliably produce panics on
amd64 (virtual machine and physical machine) using disk IO heavy
applications (gitea, syncthing).

these are also network applications, no? i think that's the io that causes
trouble.

[Aaron Bieber]

Post by Ted Unangst

Post by Aaron Bieber
For roughly a week I have been able to reliably produce panics on
amd64 (virtual machine and physical machine) using disk IO heavy
applications (gitea, syncthing).

these are also network applications, no? i think that's the io that causes
trouble.

They are, ya. Tracked it down to kern_event.c:763 if that helps at all.

[Juan Francisco Cantero Hurtado]

Post by Aaron Bieber
Hola,
For roughly a week I have been able to reliably produce panics on
amd64 (virtual machine and physical machine) using disk IO heavy
applications (gitea, syncthing).
Unfortunately on the physical machine - the one I can reliably panic
within < 1 minute - I don't have a serial console, so here are links
https://goo.gl/photos/Z8g225UXXpCXQpGcA
mirror/google averse: https://deftly.net/panic-2017-07-06/
Also with machdep.forceukbd=1, once I ran `mach ddbcpu 0`, every
subsequent key press puked out an "splassert" line, I attempted to run
a "trace" again, but things seemed to be completely locked up after that.

I'm seeing the same panic but I can't run ddb. Also with syncthing.

[Martin Pieuchot]

This post might be inappropriate. Click to display it.

[Juan Francisco Cantero Hurtado]

Post by Martin Pieuchot

Post by Juan Francisco Cantero Hurtado

Post by Aaron Bieber
Hola,
For roughly a week I have been able to reliably produce panics on
amd64 (virtual machine and physical machine) using disk IO heavy
applications (gitea, syncthing).
Unfortunately on the physical machine - the one I can reliably panic
within < 1 minute - I don't have a serial console, so here are links
https://goo.gl/photos/Z8g225UXXpCXQpGcA
mirror/google averse: https://deftly.net/panic-2017-07-06/
Also with machdep.forceukbd=1, once I ran `mach ddbcpu 0`, every
subsequent key press puked out an "splassert" line, I attempted to run
a "trace" again, but things seemed to be completely locked up after that.

I'm seeing the same panic but I can't run ddb. Also with syncthing.

Here's a fix. The problem certainly comes from a contented NET_LOCK()
which means that we now have a sleeping point where we're not allowed
to sleep.
Diff below revert the solock()/sounlock() dances in the kqueue filters,
let me know if it works for you.

The kernel doesn't panic with your patch. Thanks!.

Post by Martin Pieuchot
Index: kern/uipc_socket.c
===================================================================
RCS file: /cvs/src/sys/kern/uipc_socket.c,v
retrieving revision 1.192
diff -u -p -r1.192 uipc_socket.c
--- kern/uipc_socket.c 4 Jul 2017 12:58:32 -0000 1.192
+++ kern/uipc_socket.c 7 Jul 2017 10:46:40 -0000
@@ -1998,10 +1998,8 @@ int
filt_sowrite(struct knote *kn, long hint)
{
struct socket *so = kn->kn_fp->f_data;
- int s, rv;
+ int rv;
- if (!(hint & NOTE_SUBMIT))
- s = solock(so);
kn->kn_data = sbspace(so, &so->so_snd);
if (so->so_state & SS_CANTSENDMORE) {
kn->kn_flags |= EV_EOF;
@@ -2017,8 +2015,6 @@ filt_sowrite(struct knote *kn, long hint
} else {
rv = (kn->kn_data >= so->so_snd.sb_lowat);
}
- if (!(hint & NOTE_SUBMIT))
- sounlock(s);
return (rv);
}
@@ -2027,13 +2023,8 @@ int
filt_solisten(struct knote *kn, long hint)
{
struct socket *so = kn->kn_fp->f_data;
- int s;
- if (!(hint & NOTE_SUBMIT))
- s = solock(so);
kn->kn_data = so->so_qlen;
- if (!(hint & NOTE_SUBMIT))
- sounlock(s);
return (kn->kn_data != 0);
}
Index: miscfs/fifofs/fifo_vnops.c
===================================================================
RCS file: /cvs/src/sys/miscfs/fifofs/fifo_vnops.c,v
retrieving revision 1.56
diff -u -p -r1.56 fifo_vnops.c
--- miscfs/fifofs/fifo_vnops.c 3 Jul 2017 08:31:39 -0000 1.56
+++ miscfs/fifofs/fifo_vnops.c 7 Jul 2017 10:46:57 -0000
@@ -531,10 +531,8 @@ int
filt_fiforead(struct knote *kn, long hint)
{
struct socket *so = (struct socket *)kn->kn_hook;
- int s, rv;
+ int rv;
- if (!(hint & NOTE_SUBMIT))
- s = solock(so);
kn->kn_data = so->so_rcv.sb_cc;
if (so->so_state & SS_CANTRCVMORE) {
kn->kn_flags |= EV_EOF;
@@ -543,8 +541,6 @@ filt_fiforead(struct knote *kn, long hin
kn->kn_flags &= ~EV_EOF;
rv = (kn->kn_data > 0);
}
- if (!(hint & NOTE_SUBMIT))
- sounlock(s);
return (rv);
}
@@ -563,10 +559,8 @@ int
filt_fifowrite(struct knote *kn, long hint)
{
struct socket *so = (struct socket *)kn->kn_hook;
- int s, rv;
+ int rv;
- if (!(hint & NOTE_SUBMIT))
- s = solock(so);
kn->kn_data = sbspace(so, &so->so_snd);
if (so->so_state & SS_CANTSENDMORE) {
kn->kn_flags |= EV_EOF;
@@ -575,8 +569,6 @@ filt_fifowrite(struct knote *kn, long hi
kn->kn_flags &= ~EV_EOF;
rv = (kn->kn_data >= so->so_snd.sb_lowat);
}
- if (!(hint & NOTE_SUBMIT))
- sounlock(s);
return (rv);
}
Index: sys/socketvar.h
===================================================================
RCS file: /cvs/src/sys/sys/socketvar.h,v
retrieving revision 1.72
diff -u -p -r1.72 socketvar.h
--- sys/socketvar.h 4 Jul 2017 12:58:32 -0000 1.72
+++ sys/socketvar.h 7 Jul 2017 10:46:32 -0000
@@ -186,7 +186,10 @@ static inline long
sbspace(struct socket *so, struct sockbuf *sb)
{
KASSERT(sb == &so->so_rcv || sb == &so->so_snd);
+#if 0
+ /* XXXSMP kqueue_scan() calling filt_sowrite() cannot sleep. */
soassertlocked(so);
+#endif
return lmin(sb->sb_hiwat - sb->sb_cc, sb->sb_mbmax - sb->sb_mbcnt);
}

[Pavel Korovin]

Post by Martin Pieuchot
Here's a fix. The problem certainly comes from a contented NET_LOCK()
which means that we now have a sleeping point where we're not allowed
to sleep.
Diff below revert the solock()/sounlock() dances in the kqueue filters,
let me know if it works for you.

Martin, thanks!
No more crashes with your fix.

[Aaron Bieber]

Post by Martin Pieuchot

Post by Juan Francisco Cantero Hurtado

Post by Aaron Bieber
Hola,
For roughly a week I have been able to reliably produce panics on
amd64 (virtual machine and physical machine) using disk IO heavy
applications (gitea, syncthing).
Unfortunately on the physical machine - the one I can reliably panic
within < 1 minute - I don't have a serial console, so here are links
https://goo.gl/photos/Z8g225UXXpCXQpGcA
mirror/google averse: https://deftly.net/panic-2017-07-06/
Also with machdep.forceukbd=1, once I ran `mach ddbcpu 0`, every
subsequent key press puked out an "splassert" line, I attempted to run
a "trace" again, but things seemed to be completely locked up after that.

I'm seeing the same panic but I can't run ddb. Also with syncthing.

Here's a fix. The problem certainly comes from a contented NET_LOCK()
which means that we now have a sleeping point where we're not allowed
to sleep.
Diff below revert the solock()/sounlock() dances in the kqueue filters,
let me know if it works for you.

Seems to have fixed it for me as well.