Discussion:
ifconfig carpX a.b.c.d -> arpresolve: route contains no arp information
Remi Locherer
2017-07-10 15:52:34 UTC
Permalink
Synopsis: ifconfig carpX a.b.c.d -> arpresolve: route contains no arp information
Category: kernel
System : OpenBSD 6.1
Details : OpenBSD 6.1 (GENERIC.MP) #20: Sat Apr 1 13:45:56 MDT 2017
***@amd64.openbsd.org:/usr/src/sys/arch/amd64/compile/GENERIC.MP

Architecture: OpenBSD.amd64
Machine : amd64
After reconfiguring an existing carp interface with the same ip the gateway stops forwarding traffic (forwarding to directly connected hosts still works).
In /var/log/messages this can be found:

Jul 10 12:54:27 gw1 /bsd: arpresolve: 10.0.20.10: route contains no arp information
Gateway configuration:

# pfctl -d
(it doesn't matter if pf is enabled or not to reproduce the problem)

# ifconfig
lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> mtu 32768
index 5 priority 0 llprio 3
groups: lo
inet6 ::1 prefixlen 128
inet6 fe80::1%lo0 prefixlen 64 scopeid 0x5
inet 127.0.0.1 netmask 0xff000000
vio0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
lladdr 08:00:27:23:af:65
index 1 priority 0 llprio 3
groups: egress
media: Ethernet autoselect
status: active
inet 10.0.2.15 netmask 0xffffff00 broadcast 10.0.2.255
vio1: flags=8b43<UP,BROADCAST,RUNNING,PROMISC,ALLMULTI,SIMPLEX,MULTICAST> mtu 1500
lladdr 08:00:27:7d:87:23
index 2 priority 0 llprio 3
media: Ethernet autoselect
status: active
inet 10.0.10.2 netmask 0xffffff00 broadcast 10.0.10.255
vio2: flags=8b43<UP,BROADCAST,RUNNING,PROMISC,ALLMULTI,SIMPLEX,MULTICAST> mtu 1500
lladdr 08:00:27:7e:f3:d5
index 3 priority 0 llprio 3
media: Ethernet autoselect
status: active
inet 10.0.20.2 netmask 0xffffff00 broadcast 10.0.20.255
enc0: flags=0<>
index 4 priority 0 llprio 3
groups: enc
status: active
carp1: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
lladdr 00:00:5e:00:01:17
index 6 priority 15 llprio 3
carp: MASTER carpdev vio1 vhid 23 advbase 1 advskew 0
groups: carp
status: master
inet 10.0.10.1 netmask 0xffffff00 broadcast 10.0.10.255
carp2: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
lladdr 00:00:5e:00:01:17
index 7 priority 15 llprio 3
carp: MASTER carpdev vio2 vhid 23 advbase 1 advskew 0
groups: carp
status: master
inet 10.0.20.1 netmask 0xffffff00 broadcast 10.0.20.255
pflog0: flags=141<UP,RUNNING,PROMISC> mtu 33144
index 8 priority 0 llprio 3
groups: pflog

# route -n show -inet

Routing tables

Internet:
Destination Gateway Flags Refs Use Mtu Prio Iface
default 10.0.2.2 UGS 0 514 - 8 vio0
224/4 127.0.0.1 URS 0 0 32768 8 lo0
10.0.2/24 10.0.2.15 UCn 1 0 - 4 vio0
10.0.2.2 52:54:00:12:35:02 UHLch 2 412 - 3 vio0
10.0.2.15 08:00:27:23:af:65 UHLl 0 4 - 1 vio0
10.0.2.255 10.0.2.15 UHb 0 0 - 1 vio0
10.0.10/24 10.0.10.2 UCn 1 1 - 4 vio1
10.0.10/24 10.0.10.1 UCn 0 0 - 19 carp1
10.0.10.1 00:00:5e:00:01:17 UHLl 0 10 - 1 carp1
10.0.10.2 08:00:27:7d:87:23 UHLl 0 72 - 1 vio1
10.0.10.10 08:00:27:1e:30:02 UHLc 0 320 - 3 vio1
10.0.10.255 10.0.10.2 UHb 0 0 - 1 vio1
10.0.10.255 10.0.10.1 UHb 0 0 - 1 carp1
10.0.20/24 10.0.20.2 UCn 1 37 - 4 vio2
10.0.20/24 10.0.20.1 UCn 0 0 - 19 carp2
10.0.20.1 00:00:5e:00:01:17 UHLl 0 0 - 1 carp2
10.0.20.2 08:00:27:7e:f3:d5 UHLl 0 2 - 1 vio2
10.0.20.10 08:00:27:6b:9a:c1 UHLch 1 75 - 3 vio2
10.0.20.255 10.0.20.2 UHb 0 0 - 1 vio2
10.0.20.255 10.0.20.1 UHb 0 0 - 1 carp2
10.0.200/24 10.0.20.10 UGS 0 618 - 8 vio2
127/8 127.0.0.1 UGRS 0 0 32768 8 lo0
127.0.0.1 127.0.0.1 UHhl 1 2 32768 1 lo0

# arp -an

Host Ethernet Address Netif Expire Flags
10.0.2.2 52:54:00:12:35:02 vio0 19m59s
10.0.2.15 08:00:27:23:af:65 vio0 permanent l
10.0.10.1 00:00:5e:00:01:17 carp1 permanent l
10.0.10.2 08:00:27:7d:87:23 vio1 permanent l
10.0.10.10 08:00:27:1e:30:02 vio1 14m55s
10.0.20.1 00:00:5e:00:01:17 carp2 permanent l
10.0.20.2 08:00:27:7e:f3:d5 vio2 permanent l
10.0.20.10 08:00:27:6b:9a:c1 vio2 17m11s

With this setup ip address 10.0.10.10 can be pinged from 10.0.200.1.

Then do:

# ifconfig carp2 10.0.20.1/24
(this is the address already configured on carp2).

From this moment on the above ping stops working. The gateway logs
"gw1 /bsd: arpresolve: 10.0.20.10: route contains no arp information"
and sends "icmp: host 10.0.200.1 unreachable" to 10.0.10.10.

The routing table at this point:

Routing tables

Internet:
Destination Gateway Flags Refs Use Mtu Prio Iface
default 10.0.2.2 UGS 0 551 - 8 vio0
224/4 127.0.0.1 URS 0 0 32768 8 lo0
10.0.2/24 10.0.2.15 UCn 1 0 - 4 vio0
10.0.2.2 52:54:00:12:35:02 UHLch 2 441 - 3 vio0
10.0.2.15 08:00:27:23:af:65 UHLl 0 4 - 1 vio0
10.0.2.255 10.0.2.15 UHb 0 0 - 1 vio0
10.0.10/24 10.0.10.2 UCn 1 1 - 4 vio1
10.0.10/24 10.0.10.1 UCn 0 0 - 19 carp1
10.0.10.1 00:00:5e:00:01:17 UHLl 0 10 - 1 carp1
10.0.10.2 08:00:27:7d:87:23 UHLl 0 72 - 1 vio1
10.0.10.10 08:00:27:1e:30:02 UHLc 0 1314 - 3 vio1
10.0.10.255 10.0.10.2 UHb 0 0 - 1 vio1
10.0.10.255 10.0.10.1 UHb 0 0 - 1 carp1
10.0.20/24 10.0.20.2 UCn 0 64 - 4 vio2
10.0.20/24 10.0.20.1 UCn 0 0 - 19 carp2
10.0.20.1 00:00:5e:00:01:17 UHLl 0 0 - 1 carp2
10.0.20.2 08:00:27:7e:f3:d5 UHLl 0 2 - 1 vio2
10.0.20.255 10.0.20.2 UHb 0 0 - 1 vio2
10.0.20.255 10.0.20.1 UHb 0 0 - 1 carp2
10.0.200/24 10.0.20.10 UGS 0 1612 - 8 vio2
127/8 127.0.0.1 UGRS 0 0 32768 8 lo0
127.0.0.1 127.0.0.1 UHhl 1 2 32768 1 lo0

# arp -an

Host Ethernet Address Netif Expire Flags
10.0.2.2 52:54:00:12:35:02 vio0 19m36s
10.0.2.15 08:00:27:23:af:65 vio0 permanent l
10.0.10.1 00:00:5e:00:01:17 carp1 permanent l
10.0.10.2 08:00:27:7d:87:23 vio1 permanent l
10.0.10.10 08:00:27:1e:30:02 vio1 14m12s
10.0.20.1 00:00:5e:00:01:17 carp2 permanent l
10.0.20.2 08:00:27:7e:f3:d5 vio2 permanent l

I can reproduce this problem with:
- OpenBSD 6.1 -release
- OpenBSD 6.1 -stable (all patches applied with syspatch)
- OpenBSD 6.1 -current (7.7.2017)

With OpenBSD 6.0 3 pings are lost after executing ifconfig and then packages
are forwarded again as expected.
unknown. Workaround: route change 10.0.200.0/24 10.0.20.10



dmesg:
OpenBSD 6.1 (GENERIC.MP) #20: Sat Apr 1 13:45:56 MDT 2017
***@amd64.openbsd.org:/usr/src/sys/arch/amd64/compile/GENERIC.MP
real mem = 520028160 (495MB)
avail mem = 499650560 (476MB)
mpath0 at root
scsibus0 at mpath0: 256 targets
mainbus0 at root
bios0 at mainbus0: SMBIOS rev. 2.5 @ 0xe1000 (10 entries)
bios0: vendor innotek GmbH version "VirtualBox" date 12/01/2006
bios0: innotek GmbH VirtualBox
acpi0 at bios0: rev 2
acpi0: sleep states S0 S5
acpi0: tables DSDT FACP APIC SSDT
acpi0: wakeup devices
acpitimer0 at acpi0: 3579545 Hz, 32 bits
acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat
cpu0 at mainbus0: apid 0 (boot processor)
cpu0: Intel(R) Core(TM) i7-4600U CPU @ 2.10GHz, 2534.94 MHz
cpu0: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,HTT,SSE3,SSSE3,NXE,RDTSCP,LONG,LAHF,PERF
cpu0: 256KB 64b/line 8-way L2 cache
cpu0: smt 0, core 0, package 0
mtrr: CPU supports MTRRs but not enabled by BIOS
cpu0: apic clock running at 1010MHz
cpu1 at mainbus0: apid 1 (application processor)
cpu1: Intel(R) Core(TM) i7-4600U CPU @ 2.10GHz, 2560.43 MHz
cpu1: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,HTT,SSE3,SSSE3,NXE,RDTSCP,LONG,LAHF,PERF
cpu1: 256KB 64b/line 8-way L2 cache
cpu1: smt 0, core 1, package 0
ioapic0 at mainbus0: apid 2 pa 0xfec00000, version 11, 24 pins
acpiprt0 at acpi0: bus 0 (PCI0)
acpicpu0 at acpi0: C1(@1 halt!)
acpicpu1 at acpi0: C1(@1 halt!)
"PNP0303" at acpi0 not configured
"PNP0F03" at acpi0 not configured
"PNP0400" at acpi0 not configured
acpibat0 at acpi0: BAT0 model "1" serial 0 type VBOX oem "innotek"
acpiac0 at acpi0: AC unit online
pci0 at mainbus0 bus 0
pchb0 at pci0 dev 0 function 0 "Intel 82441FX" rev 0x02
pcib0 at pci0 dev 1 function 0 "Intel 82371SB ISA" rev 0x00
pciide0 at pci0 dev 1 function 1 "Intel 82371AB IDE" rev 0x01: DMA, channel 0 configured to compatibility, channel 1 configured to compatibility
wd0 at pciide0 channel 0 drive 0: <VBOX HARDDISK>
wd0: 128-sector PIO, LBA, 2048MB, 4194304 sectors
wd0(pciide0:0:0): using PIO mode 4, Ultra-DMA mode 2
atapiscsi0 at pciide0 channel 1 drive 0
scsibus1 at atapiscsi0: 2 targets
cd0 at scsibus1 targ 0 lun 0: <VBOX, CD-ROM, 1.0> ATAPI 5/cdrom removable
cd0(pciide0:1:0): using PIO mode 4, Ultra-DMA mode 2
vga1 at pci0 dev 2 function 0 "InnoTek VirtualBox Graphics Adapter" rev 0x00
wsdisplay0 at vga1 mux 1: console (80x25, vt100 emulation)
wsdisplay0: screen 1-5 added (80x25, vt100 emulation)
virtio0 at pci0 dev 3 function 0 "Qumranet Virtio Network" rev 0x00
vio0 at virtio0: address 08:00:27:23:af:65
virtio0: apic 2 int 19
"InnoTek VirtualBox Guest Service" rev 0x00 at pci0 dev 4 function 0 not configured
piixpm0 at pci0 dev 7 function 0 "Intel 82371AB Power" rev 0x08: SMBus disabled
virtio1 at pci0 dev 8 function 0 "Qumranet Virtio Network" rev 0x00
vio1 at virtio1: address 08:00:27:7d:87:23
virtio1: apic 2 int 16
virtio2 at pci0 dev 9 function 0 "Qumranet Virtio Network" rev 0x00
vio2 at virtio2: address 08:00:27:7e:f3:d5
virtio2: apic 2 int 17
isa0 at pcib0
isadma0 at isa0
pckbc0 at isa0 port 0x60/5 irq 1 irq 12
pckbdprobe: reset response 0xfa
pms0 at pckbc0 (aux slot)
wsmouse0 at pms0 mux 0
pckbd0 at pckbc0 (kbd slot)
wskbd0 at pckbd0: console keyboard, using wsdisplay0
pcppi0 at isa0 port 0x61
spkr0 at pcppi0
vscsi0 at root
scsibus2 at vscsi0: 256 targets
softraid0 at root
scsibus3 at softraid0: 256 targets
root on wd0a (a0883f32ad436647.a) swap on wd0b dump on wd0b

usbdevs:
usbdevs: no USB controllers found

pcidump:
Domain /dev/pci0:
0:0:0: Intel 82441FX
0x0000: Vendor ID: 8086 Product ID: 1237
0x0004: Command: 0000 Status: 0000
0x0008: Class: 06 Subclass: 00 Interface: 00 Revision: 02
0x000c: BIST: 00 Header Type: 00 Latency Timer: 00 Cache Line Size: 00
0x0010: BAR empty (00000000)
0x0014: BAR empty (00000000)
0x0018: BAR empty (00000000)
0x001c: BAR empty (00000000)
0x0020: BAR empty (00000000)
0x0024: BAR empty (00000000)
0x0028: Cardbus CIS: 00000000
0x002c: Subsystem Vendor ID: 0000 Product ID: 0000
0x0030: Expansion ROM Base Address: 00000000
0x0038: 00000000
0x003c: Interrupt Pin: 00 Line: 00 Min Gnt: 00 Max Lat: 00
0x0000: 12378086 00000000 06000002 00000000
0x0010: 00000000 00000000 00000000 00000000
0x0020: 00000000 00000000 00000000 00000000
0x0030: 00000000 00000000 00000000 00000000
0x0040: 00000000 00000000 00000000 00000000
0x0050: 00000000 00000000 00000000 00000000
0x0060: 00000000 00000000 00000000 00000000
0x0070: 00000000 00000000 00000000 00000000
0x0080: 00000000 00000000 00000000 00000000
0x0090: 00000000 00000000 00000000 00000000
0x00a0: 00000000 00000000 00000000 00000000
0x00b0: 00000000 00000000 00000000 00000000
0x00c0: 00000000 00000000 00000000 00000000
0x00d0: 00000000 00000000 00000000 00000000
0x00e0: 00000000 00000000 00000000 00000000
0x00f0: 00000000 00000000 00000000 00000000
0:1:0: Intel 82371SB ISA
0x0000: Vendor ID: 8086 Product ID: 7000
0x0004: Command: 0007 Status: 0200
0x0008: Class: 06 Subclass: 01 Interface: 00 Revision: 00
0x000c: BIST: 00 Header Type: 80 Latency Timer: 00 Cache Line Size: 00
0x0010: BAR empty (00000000)
0x0014: BAR empty (00000000)
0x0018: BAR empty (00000000)
0x001c: BAR empty (00000000)
0x0020: BAR empty (00000000)
0x0024: BAR empty (00000000)
0x0028: Cardbus CIS: 00000000
0x002c: Subsystem Vendor ID: 0000 Product ID: 0000
0x0030: Expansion ROM Base Address: 00000000
0x0038: 00000000
0x003c: Interrupt Pin: 00 Line: 00 Min Gnt: 00 Max Lat: 00
0x0000: 70008086 02000007 06010000 00800000
0x0010: 00000000 00000000 00000000 00000000
0x0020: 00000000 00000000 00000000 00000000
0x0030: 00000000 00000000 00000000 00000000
0x0040: 00000000 00000000 00000000 0003004d
0x0050: 00000000 00000000 00000000 00000000
0x0060: 090a0b0b 00000000 00000200 00000000
0x0070: 00000080 0c0c0000 00000002 00000000
0x0080: 00020000 00000000 00000000 00000000
0x0090: 00000000 00000000 00000000 00000000
0x00a0: 00000008 00000000 0000000f 0000ef00
0x00b0: 00000000 00000000 00000000 00000000
0x00c0: 00000000 00000000 00000000 00000000
0x00d0: 00000000 00000000 00000000 00be0000
0x00e0: 00000000 00000000 00000000 00000000
0x00f0: 00000000 00000000 00000000 00000000
0:1:1: Intel 82371AB IDE
0x0000: Vendor ID: 8086 Product ID: 7111
0x0004: Command: 0007 Status: 0000
0x0008: Class: 01 Subclass: 01 Interface: 8a Revision: 01
0x000c: BIST: 00 Header Type: 00 Latency Timer: 00 Cache Line Size: 00
0x0010: BAR empty (00000000)
0x0014: BAR empty (00000000)
0x0018: BAR empty (00000000)
0x001c: BAR empty (00000000)
0x0020: BAR io addr: 0x0000d000/0x0010
0x0024: BAR empty (00000000)
0x0028: Cardbus CIS: 00000000
0x002c: Subsystem Vendor ID: 0000 Product ID: 0000
0x0030: Expansion ROM Base Address: 00000000
0x0038: 00000000
0x003c: Interrupt Pin: 00 Line: 00 Min Gnt: 00 Max Lat: 00
0x0000: 71118086 00000007 01018a01 00000000
0x0010: 00000000 00000000 00000000 00000000
0x0020: 0000d001 00000000 00000000 00000000
0x0030: 00000000 00000000 00000000 00000000
0x0040: a307a307 00000000 02020005 00000000
0x0050: 00000000 00000000 00000000 00000000
0x0060: 00000000 00000000 00000000 00000000
0x0070: 00000000 00000000 00000000 00000000
0x0080: 00000000 00000000 00000000 00000000
0x0090: 00000000 00000000 00000000 00000000
0x00a0: 00000000 00000000 00000000 00000000
0x00b0: 00000000 00000000 00000000 00000000
0x00c0: 00000000 00000000 00000000 00000000
0x00d0: 00000000 00000000 00000000 00000000
0x00e0: 00000000 00000000 00000000 00000000
0x00f0: 00000000 00000000 00000000 00000000
0:2:0: InnoTek VirtualBox Graphics Adapter
0x0000: Vendor ID: 80ee Product ID: beef
0x0004: Command: 0007 Status: 0000
0x0008: Class: 03 Subclass: 00 Interface: 00 Revision: 00
0x000c: BIST: 00 Header Type: 00 Latency Timer: 00 Cache Line Size: 00
0x0010: BAR mem prefetchable 32bit addr: 0xe0000000/0x01000000
0x0014: BAR empty (00000000)
0x0018: BAR empty (00000000)
0x001c: BAR empty (00000000)
0x0020: BAR empty (00000000)
0x0024: BAR empty (00000000)
0x0028: Cardbus CIS: 00000000
0x002c: Subsystem Vendor ID: 0000 Product ID: 0000
0x0030: Expansion ROM Base Address: 00000000
0x0038: 00000000
0x003c: Interrupt Pin: 01 Line: 0b Min Gnt: 00 Max Lat: 00
0x0000: beef80ee 00000007 03000000 00000000
0x0010: e0000008 00000000 00000000 00000000
0x0020: 00000000 00000000 00000000 00000000
0x0030: 00000000 00000000 00000000 0000010b
0x0040: 00000000 00000000 00000000 00000000
0x0050: 00000000 00000000 00000000 00000000
0x0060: 00000000 00000000 00000000 00000000
0x0070: 00000000 00000000 00000000 00000000
0x0080: 00000000 00000000 00000000 00000000
0x0090: 00000000 00000000 00000000 00000000
0x00a0: 00000000 00000000 00000000 00000000
0x00b0: 00000000 00000000 00000000 00000000
0x00c0: 00000000 00000000 00000000 00000000
0x00d0: 00000000 00000000 00000000 00000000
0x00e0: 00000000 00000000 00000000 00000000
0x00f0: 00000000 00000000 00000000 00000000
0:3:0: Qumranet Virtio Network
0x0000: Vendor ID: 1af4 Product ID: 1000
0x0004: Command: 0007 Status: 0010
0x0008: Class: 02 Subclass: 00 Interface: 00 Revision: 00
0x000c: BIST: 00 Header Type: 00 Latency Timer: 00 Cache Line Size: 00
0x0010: BAR io addr: 0x0000d020/0x0020
0x0014: BAR empty (00000000)
0x0018: BAR empty (00000000)
0x001c: BAR empty (00000000)
0x0020: BAR empty (00000000)
0x0024: BAR empty (00000000)
0x0028: Cardbus CIS: 00000000
0x002c: Subsystem Vendor ID: 1af4 Product ID: 0001
0x0030: Expansion ROM Base Address: 00000000
0x0038: 00000000
0x003c: Interrupt Pin: 01 Line: 0a Min Gnt: 00 Max Lat: 00
0x0080: Capability 0x00: Reserved
0x0000: 10001af4 00100007 02000000 00000000
0x0010: 0000d021 00000000 00000000 00000000
0x0020: 00000000 00000000 00000000 00011af4
0x0030: 00000000 00000080 00000000 0000010a
0x0040: 00000000 00000000 00000000 00000000
0x0050: 00000000 00000000 00000000 00000000
0x0060: 00000000 00000000 00000000 00000000
0x0070: 00000000 00000000 00000000 00000000
0x0080: 00000000 00000000 00000000 00000000
0x0090: 00000000 00000000 00000000 00000000
0x00a0: 00000000 00000000 00000000 00000000
0x00b0: 00000000 00000000 00000000 00000000
0x00c0: 00000000 00000000 00000000 00000000
0x00d0: 00000000 00000000 00000000 00000000
0x00e0: 00000000 00000000 00000000 00000000
0x00f0: 00000000 00000000 00000000 00000000
0:4:0: InnoTek VirtualBox Guest Service
0x0000: Vendor ID: 80ee Product ID: cafe
0x0004: Command: 0007 Status: 0000
0x0008: Class: 08 Subclass: 80 Interface: 00 Revision: 00
0x000c: BIST: 00 Header Type: 00 Latency Timer: 00 Cache Line Size: 00
0x0010: BAR io addr: 0x0000d040/0x0020
0x0014: BAR mem 32bit addr: 0xf0000000/0x00400000
0x0018: BAR mem prefetchable 32bit addr: 0xf0400000/0x00004000
0x001c: BAR empty (00000000)
0x0020: BAR empty (00000000)
0x0024: BAR empty (00000000)
0x0028: Cardbus CIS: 00000000
0x002c: Subsystem Vendor ID: 0000 Product ID: 0000
0x0030: Expansion ROM Base Address: 00000000
0x0038: 00000000
0x003c: Interrupt Pin: 01 Line: 09 Min Gnt: 00 Max Lat: 00
0x0000: cafe80ee 00000007 08800000 00000000
0x0010: 0000d041 f0000000 f0400008 00000000
0x0020: 00000000 00000000 00000000 00000000
0x0030: 00000000 00000000 00000000 00000109
0x0040: 00000000 00000000 00000000 00000000
0x0050: 00000000 00000000 00000000 00000000
0x0060: 00000000 00000000 00000000 00000000
0x0070: 00000000 00000000 00000000 00000000
0x0080: 00000000 00000000 00000000 00000000
0x0090: 00000000 00000000 00000000 00000000
0x00a0: 00000000 00000000 00000000 00000000
0x00b0: 00000000 00000000 00000000 00000000
0x00c0: 00000000 00000000 00000000 00000000
0x00d0: 00000000 00000000 00000000 00000000
0x00e0: 00000000 00000000 00000000 00000000
0x00f0: 00000000 00000000 00000000 00000000
0:7:0: Intel 82371AB Power
0x0000: Vendor ID: 8086 Product ID: 7113
0x0004: Command: 0007 Status: 0280
0x0008: Class: 06 Subclass: 80 Interface: 00 Revision: 08
0x000c: BIST: 00 Header Type: 80 Latency Timer: 00 Cache Line Size: 00
0x0010: BAR empty (00000000)
0x0014: BAR empty (00000000)
0x0018: BAR empty (00000000)
0x001c: BAR empty (00000000)
0x0020: BAR empty (00000000)
0x0024: BAR empty (00000000)
0x0028: Cardbus CIS: 00000000
0x002c: Subsystem Vendor ID: 0000 Product ID: 0000
0x0030: Expansion ROM Base Address: 00000000
0x0038: 00000000
0x003c: Interrupt Pin: 01 Line: 09 Min Gnt: 00 Max Lat: 00
0x0000: 71138086 02800007 06800008 00800000
0x0010: 00000000 00000000 00000000 00000000
0x0020: 00000000 00000000 00000000 00000000
0x0030: 00000000 00000000 00000000 00000109
0x0040: 00000001 00000000 00000000 00000000
0x0050: 00000000 00000000 00000000 00000000
0x0060: 00000000 00000000 00000000 00000000
0x0070: 00000000 00000000 00000000 00000000
0x0080: 00000000 00000000 00000000 00000000
0x0090: 00000000 00000000 00000000 00000000
0x00a0: 00000000 00000000 00000000 00000000
0x00b0: 00000000 00000000 00000000 00000000
0x00c0: 00000000 00000000 00000000 00000000
0x00d0: 00000000 00000000 00000000 00000000
0x00e0: 00000000 00000000 00000000 00000000
0x00f0: 00000000 00000000 00000000 00000000
0:8:0: Qumranet Virtio Network
0x0000: Vendor ID: 1af4 Product ID: 1000
0x0004: Command: 0007 Status: 0010
0x0008: Class: 02 Subclass: 00 Interface: 00 Revision: 00
0x000c: BIST: 00 Header Type: 00 Latency Timer: 00 Cache Line Size: 00
0x0010: BAR io addr: 0x0000d060/0x0020
0x0014: BAR empty (00000000)
0x0018: BAR empty (00000000)
0x001c: BAR empty (00000000)
0x0020: BAR empty (00000000)
0x0024: BAR empty (00000000)
0x0028: Cardbus CIS: 00000000
0x002c: Subsystem Vendor ID: 1af4 Product ID: 0001
0x0030: Expansion ROM Base Address: 00000000
0x0038: 00000000
0x003c: Interrupt Pin: 01 Line: 09 Min Gnt: 00 Max Lat: 00
0x0080: Capability 0x00: Reserved
0x0000: 10001af4 00100007 02000000 00000000
0x0010: 0000d061 00000000 00000000 00000000
0x0020: 00000000 00000000 00000000 00011af4
0x0030: 00000000 00000080 00000000 00000109
0x0040: 00000000 00000000 00000000 00000000
0x0050: 00000000 00000000 00000000 00000000
0x0060: 00000000 00000000 00000000 00000000
0x0070: 00000000 00000000 00000000 00000000
0x0080: 00000000 00000000 00000000 00000000
0x0090: 00000000 00000000 00000000 00000000
0x00a0: 00000000 00000000 00000000 00000000
0x00b0: 00000000 00000000 00000000 00000000
0x00c0: 00000000 00000000 00000000 00000000
0x00d0: 00000000 00000000 00000000 00000000
0x00e0: 00000000 00000000 00000000 00000000
0x00f0: 00000000 00000000 00000000 00000000
0:9:0: Qumranet Virtio Network
0x0000: Vendor ID: 1af4 Product ID: 1000
0x0004: Command: 0007 Status: 0010
0x0008: Class: 02 Subclass: 00 Interface: 00 Revision: 00
0x000c: BIST: 00 Header Type: 00 Latency Timer: 00 Cache Line Size: 00
0x0010: BAR io addr: 0x0000d080/0x0020
0x0014: BAR empty (00000000)
0x0018: BAR empty (00000000)
0x001c: BAR empty (00000000)
0x0020: BAR empty (00000000)
0x0024: BAR empty (00000000)
0x0028: Cardbus CIS: 00000000
0x002c: Subsystem Vendor ID: 1af4 Product ID: 0001
0x0030: Expansion ROM Base Address: 00000000
0x0038: 00000000
0x003c: Interrupt Pin: 01 Line: 0b Min Gnt: 00 Max Lat: 00
0x0080: Capability 0x00: Reserved
0x0000: 10001af4 00100007 02000000 00000000
0x0010: 0000d081 00000000 00000000 00000000
0x0020: 00000000 00000000 00000000 00011af4
0x0030: 00000000 00000080 00000000 0000010b
0x0040: 00000000 00000000 00000000 00000000
0x0050: 00000000 00000000 00000000 00000000
0x0060: 00000000 00000000 00000000 00000000
0x0070: 00000000 00000000 00000000 00000000
0x0080: 00000000 00000000 00000000 00000000
0x0090: 00000000 00000000 00000000 00000000
0x00a0: 00000000 00000000 00000000 00000000
0x00b0: 00000000 00000000 00000000 00000000
0x00c0: 00000000 00000000 00000000 00000000
0x00d0: 00000000 00000000 00000000 00000000
0x00e0: 00000000 00000000 00000000 00000000
0x00f0: 00000000 00000000 00000000 00000000

acpidump:
begin-base64 644 APIC.3
QVBJQ1wAAAACT1ZCT1ggIFZCT1hBUElDAQAAAEFTTCBhAAAAAADg/gEAAAACCgAAAgAAAAAAAgoA
CQkAAAANAAAIAAABAAAAAAgBAQEAAAABDAIAAADA/gAAAAA=
====
begin-base64 644 DSDT.2
RFNEVJYbAAABjVZCT1ggIFZCT1hCSU9TAgAAAElOVEwoBRAgW4BEQkcwAQsAMAoEW4ELREJHMAFE
SEUxCFuBC0RCRzACREhFMhBbgQtEQkcwA0RIRTQgW4ENREJHMAEACERDSFIIFAxIRVhfAXBoREhF
MRQMSEVYMgFwaERIRTIUDEhFWDQBcGhESEU0FAxTTEVOAXBoYKSHYBQkUzJCRgFwaGByU0xFTmAB
YAhCVUZGEQJgcGhCVUZGpEJVRkYUKkRCR18BcGhgcFMyQkZgYXCHYWB2YHAAYqIQYHZgcIOIYWIA
RENIUnViCFBJQ00AFCFfUElDAURCR18NUGljIG1vZGU6IABIRVg0aHBoUElDTVuAU1lTSQELSEAK
CFuBEFNZU0kDSURYMCBEQVQwIFuGTQlJRFgwREFUMANNRU1MIFVJT0EgVUhQVCBVU01DIFVGREMg
VUNQMCBVQ1AxIFVDUDIgVUNQMyBNRU1IIFVSVEMgQ1BVTCBDUFVDIENQRVQgQ1BFViBOSUNBIEhE
QUEgUFdSUyBJT0NBIEhCQ0EgUENJQiBQQ0lMIFNMMEIgU0wwSSBTTDFCIFNMMUkgAEAMSU5JTiAA
QL5WQUlOIBCIWwFfU0JfFEkIX0lOSQBwDN7ArQtWQUlOREJHXw1NRU1MOiAASEVYNE1FTUxEQkdf
DVVJT0E6IABIRVg0VUlPQURCR18NVUhQVDogAEhFWDRVSFBUREJHXw1VU01DOiAASEVYNFVTTUNE
QkdfDVVGREM6IABIRVg0VUZEQ0RCR18NTUVNSDogAEhFWDRNRU1ICFBSMDAST2x4Eg0EDP//AgAA
TE5LQgASDQQM//8CAAFMTktDABIOBAz//wIACgJMTktEABIOBAz//wIACgNMTktBABINBAz//wMA
AExOS0MAEg0EDP//AwABTE5LRAASDgQM//8DAAoCTE5LQQASDgQM//8DAAoDTE5LQgASDQQM//8E
AABMTktEABINBAz//wQAAUxOS0EAEg4EDP//BAAKAkxOS0IAEg4EDP//BAAKA0xOS0MAEg0EDP//
BQAATE5LQQASDQQM//8FAAFMTktCABIOBAz//wUACgJMTktDABIOBAz//wUACgNMTktEABINBAz/
/wYAAExOS0IAEg0EDP//BgABTE5LQwASDgQM//8GAAoCTE5LRAASDgQM//8GAAoDTE5LQQASDQQM
//8HAABMTktDABINBAz//wcAAUxOS0QAEg4EDP//BwAKAkxOS0EAEg4EDP//BwAKA0xOS0IAEg0E
DP//CAAATE5LRAASDQQM//8IAAFMTktBABIOBAz//wgACgJMTktCABIOBAz//wgACgNMTktDABIN
BAz//wkAAExOS0EAEg0EDP//CQABTE5LQgASDgQM//8JAAoCTE5LQwASDgQM//8JAAoDTE5LRAAS
DQQM//8KAABMTktCABINBAz//woAAUxOS0MAEg4EDP//CgAKAkxOS0QAEg4EDP//CgAKA0xOS0EA
Eg0EDP//CwAATE5LQwASDQQM//8LAAFMTktEABIOBAz//wsACgJMTktBABIOBAz//wsACgNMTktC
ABINBAz//wwAAExOS0QAEg0EDP//DAABTE5LQQASDgQM//8MAAoCTE5LQgASDgQM//8MAAoDTE5L
QwASDQQM//8NAABMTktBABINBAz//w0AAUxOS0IAEg4EDP//DQAKAkxOS0MAEg4EDP//DQAKA0xO
S0QAEg0EDP//DgAATE5LQgASDQQM//8OAAFMTktDABIOBAz//w4ACgJMTktEABIOBAz//w4ACgNM
TktBABINBAz//w8AAExOS0MAEg0EDP//DwABTE5LRAASDgQM//8PAAoCTE5LQQASDgQM//8PAAoD
TE5LQgASDQQM//8QAABMTktEABINBAz//xAAAUxOS0EAEg4EDP//EAAKAkxOS0IAEg4EDP//EAAK
A0xOS0MAEg0EDP//EQAATE5LQQASDQQM//8RAAFMTktCABIOBAz//xEACgJMTktDABIOBAz//xEA
CgNMTktEABINBAz//xIAAExOS0IAEg0EDP//EgABTE5LQwASDgQM//8SAAoCTE5LRAASDgQM//8S
AAoDTE5LQQASDQQM//8TAABMTktDABINBAz//xMAAUxOS0QAEg4EDP//EwAKAkxOS0EAEg4EDP//
EwAKA0xOS0IAEg0EDP//FAAATE5LRAASDQQM//8UAAFMTktBABIOBAz//xQACgJMTktCABIOBAz/
/xQACgNMTktDABINBAz//xUAAExOS0EAEg0EDP//FQABTE5LQgASDgQM//8VAAoCTE5LQwASDgQM
//8VAAoDTE5LRAASDQQM//8WAABMTktCABINBAz//xYAAUxOS0MAEg4EDP//FgAKAkxOS0QAEg4E
DP//FgAKA0xOS0EAEg0EDP//FwAATE5LQwASDQQM//8XAAFMTktEABIOBAz//xcACgJMTktBABIO
BAz//xcACgNMTktCABINBAz//xgAAExOS0QAEg0EDP//GAABTE5LQQASDgQM//8YAAoCTE5LQgAS
DgQM//8YAAoDTE5LQwASDQQM//8ZAABMTktBABINBAz//xkAAUxOS0IAEg4EDP//GQAKAkxOS0MA
Eg4EDP//GQAKA0xOS0QAEg0EDP//GgAATE5LQgASDQQM//8aAAFMTktDABIOBAz//xoACgJMTktE
ABIOBAz//xoACgNMTktBABINBAz//xsAAExOS0MAEg0EDP//GwABTE5LRAASDgQM//8bAAoCTE5L
QQASDgQM//8bAAoDTE5LQgASDQQM//8cAABMTktEABINBAz//xwAAUxOS0EAEg4EDP//HAAKAkxO
S0IAEg4EDP//HAAKA0xOS0MAEg0EDP//HQAATE5LQQASDQQM//8dAAFMTktCABIOBAz//x0ACgJM
TktDABIOBAz//x0ACgNMTktEABINBAz//x4AAExOS0IAEg0EDP//HgABTE5LQwASDgQM//8eAAoC
TE5LRAASDgQM//8eAAoDTE5LQQASDQQM//8fAABMTktDABINBAz//x8AAUxOS0QAEg4EDP//HwAK
AkxOS0EAEg4EDP//HwAKA0xOS0IACFBSMDEST114EgsEDP//AgAAAAoSEgsEDP//AgABAAoTEgwE
DP//AgAKAgAKFBIMBAz//wIACgMAChUSCwQM//8DAAAAChMSCwQM//8DAAEAChQSDAQM//8DAAoC
AAoVEgwEDP//AwAKAwAKFhILBAz//wQAAAAKFBILBAz//wQAAQAKFRIMBAz//wQACgIAChYSDAQM
//8EAAoDAAoXEgsEDP//BQAAAAoVEgsEDP//BQABAAoWEgwEDP//BQAKAgAKFxIMBAz//wUACgMA
ChASCwQM//8GAAAAChYSCwQM//8GAAEAChcSDAQM//8GAAoCAAoQEgwEDP//BgAKAwAKERILBAz/
/wcAAAAKFxILBAz//wcAAQAKEBIMBAz//wcACgIAChESDAQM//8HAAoDAAoSEgsEDP//CAAAAAoQ
EgsEDP//CAABAAoREgwEDP//CAAKAgAKEhIMBAz//wgACgMAChMSCwQM//8JAAAAChESCwQM//8J
AAEAChISDAQM//8JAAoCAAoTEgwEDP//CQAKAwAKFBILBAz//woAAAAKEhILBAz//woAAQAKExIM
BAz//woACgIAChQSDAQM//8KAAoDAAoVEgsEDP//CwAAAAoTEgsEDP//CwABAAoUEgwEDP//CwAK
AgAKFRIMBAz//wsACgMAChYSCwQM//8MAAAAChQSCwQM//8MAAEAChUSDAQM//8MAAoCAAoWEgwE
DP//DAAKAwAKFxILBAz//w0AAAAKFRILBAz//w0AAQAKFhIMBAz//w0ACgIAChcSDAQM//8NAAoD
AAoQEgsEDP//DgAAAAoWEgsEDP//DgABAAoXEgwEDP//DgAKAgAKEBIMBAz//w4ACgMAChESCwQM
//8PAAAAChcSCwQM//8PAAEAChASDAQM//8PAAoCAAoREgwEDP//DwAKAwAKEhILBAz//xAAAAAK
EBILBAz//xAAAQAKERIMBAz//xAACgIAChISDAQM//8QAAoDAAoTEgsEDP//EQAAAAoREgsEDP//
EQABAAoSEgwEDP//EQAKAgAKExIMBAz//xEACgMAChQSCwQM//8SAAAAChISCwQM//8SAAEAChMS
DAQM//8SAAoCAAoUEgwEDP//EgAKAwAKFRILBAz//xMAAAAKExILBAz//xMAAQAKFBIMBAz//xMA
CgIAChUSDAQM//8TAAoDAAoWEgsEDP//FAAAAAoUEgsEDP//FAABAAoVEgwEDP//FAAKAgAKFhIM
BAz//xQACgMAChcSCwQM//8VAAAAChUSCwQM//8VAAEAChYSDAQM//8VAAoCAAoXEgwEDP//FQAK
AwAKEBILBAz//xYAAAAKFhILBAz//xYAAQAKFxIMBAz//xYACgIAChASDAQM//8WAAoDAAoREgsE
DP//FwAAAAoXEgsEDP//FwABAAoQEgwEDP//FwAKAgAKERIMBAz//xcACgMAChISCwQM//8YAAAA
ChASCwQM//8YAAEAChESDAQM//8YAAoCAAoSEgwEDP//GAAKAwAKExILBAz//xkAAAAKERILBAz/
/xkAAQAKEhIMBAz//xkACgIAChMSDAQM//8ZAAoDAAoUEgsEDP//GgAAAAoSEgsEDP//GgABAAoT
EgwEDP//GgAKAgAKFBIMBAz//xoACgMAChUSCwQM//8bAAAAChMSCwQM//8bAAEAChQSDAQM//8b
AAoCAAoVEgwEDP//GwAKAwAKFhILBAz//xwAAAAKFBILBAz//xwAAQAKFRIMBAz//xwACgIAChYS
DAQM//8cAAoDAAoXEgsEDP//HQAAAAoVEgsEDP//HQABAAoWEgwEDP//HQAKAgAKFxIMBAz//x0A
CgMAChASCwQM//8eAAAAChYSCwQM//8eAAEAChcSDAQM//8eAAoCAAoQEgwEDP//HgAKAwAKERIL
BAz//x8AAAAKFxILBAz//x8AAQAKEBIMBAz//x8ACgIAChESDAQM//8fAAoDAAoSCFBSU0ERCQoG
IyAOGHkACFBSU0IRCQoGIyAOGHkACFBSU0MRCQoGIyAOGHkACFBSU0QRCQoGIyAOGHkAW4JPglBD
STAIX0hJRAxB0AoDFAtfQURSAKRIQkNBCF9CQk4ACF9VSUQAFEsHX1BSVACgPZOQUElDTVVJT0EA
REJHXw1SRVRVUk5JTkcgUElDCgBwAF4uU0JSR0FQREVwAF4uU0JSR0FQQUSkUFIwMKE1REJHXw1S
RVRVUk5JTkcgQVBJQwoAcAq+Xi5TQlJHQVBERXAK714uU0JSR0FQQUSkUFIwMVuCT0JTQlJHFAtf
QURSAKRJT0NBW4BQQ0lDAgAK/1uBFlBDSUMBAEhWQVBBRAgAQBhBUERFCFuCSQdeUENJRQhfSElE
DEHQDAIIX1VJRAoRCENSU18REQoOhgkAAAAAANwAAAAEeQAUM19DUlMAikNSU18KBEJBUzGKQ1JT
XwoITEVOMXBQQ0lCQkFTMXBQQ0lMTEVOMaRDUlNfFBVfU1RBAKAJk1BDSUIApAChBKQKDluCN1BT
MksIX0hJRAxB0AMDFAlfU1RBAKQKDwhfQ1JTERgKFUcBYABgAAABRwFkAGQAAAEiAgB5AFuCNURN
QUMIX0hJRAxB0AIACF9DUlMRIAodRwEAAAAAARBHAYAAgAABEEcBwADAAAEgKhAFeQBbgk4FRkRD
MAhfSElEDEHQBwAUC19TVEEApFVGREMIX0NSUxEbChhHAfAD8AMBBkcB9wP3AwEBIkAAKgQAeQAI
X1BSUxEbChhHAfAD8AMBBkcB9wP3AwEBIkAAKgQAeQBbgidQUzJNCF9ISUQMQdAPAxQJX1NUQQCk
Cg8IX0NSUxEICgUiABB5AFuCN0xQVF8IX0hJRAxB0AQAFAlfU1RBAKQKDwhfQ1JTERgKFUcBeAN4
AwgIRwF4B3gHCAgigAB5AFuCTQheU1JMMAhfSElEDEHQBQEIX1VJRAEUFV9TVEEAoAmTU0wwQgCk
AKEEpAoPCENSU18REAoNRwH4A/gDAQgiEAB5ABRJBF9DUlMAi0NSU18KAk1JTjCLQ1JTXwoETUFY
MItDUlNfCglJUlEwcFNMMEJNSU4wcFNMMEJNQVgweQFTTDBJSVJRMKRDUlNfW4JOCF5TUkwxCF9I
SUQMQdAFAQhfVUlECgIUFV9TVEEAoAmTU0wxQgCkAKEEpAoPCENSU18REAoNRwH4AvgCAQgiCAB5
ABRJBF9DUlMAi0NSU18KAk1JTjGLQ1JTXwoETUFYMYtDUlNfCglJUlExcFNMMUJNSU4xcFNMMUJN
QVgxeQFTTDFJSVJRMaRDUlNfW4IqVElNUghfSElEDEHQAQAIX0NSUxEVChJHAUAAQAAABEcBUABQ
ABAEeQBbgitQSUNfCF9ISUQLQdAIX0NSUxEYChVHASAAIAAAAkcBoACgAAACIgQAeQBbgi5SVENf
CF9ISUQMQdALAAhfQ1JTEQ0KCkcBcABwAAECeQAUC19TVEEApFVSVENbgkUFSFBFVAhfSElEDEHQ
AQMIX0NJRAxB0AwBCF9VSUQAFAtfU1RBAKRVSFBUCENSU18RFwoUIgEAIgABhgkAAQAA0P4ABAAA
eQAUC19DUlMApENSU19bgk0EU01DXwhfSElEDAYQAAEIX0NJRA1zbWMtbmFwYQAUC19TVEEApFVT
TUMIQ1JTXxEQCg1HAQADAAMBICJAAHkAFAtfQ1JTAKRDUlNfW4I6R0lHRQhfSElEDEHQg5AUC19B
RFIApE5JQ0EUCEVXT0wBpAAUFV9TVEEAoAmTTklDQQCkAKEEpAoPW4JHCUhERUYUTgZfRFNNBHAS
KwQNbGF5b3V0LWlkABEHCgQHAAAADVBpbkNvbmZpZ3VyYXRpb25zABECAGCgMJNoERMKEMa3taAY
ExxEsMn+aV6vlJugGJNpAaAMk2oAcBEDAQNgpGCgBpNqAaRgcBEDAQBgpGAUC19BRFIApEhEQUEU
FV9TVEEAoAmTSERBQQCkAKEEpAoPW4JNI0JBVDAIX0hJRAxB0AwKCF9VSUQAEB9cX0dQRRQYX0ww
MACGXC8DX1NCX1BDSTBCQVQwCoFbgENCQVQBC0BACghbgRBDQkFUA0lEWDAgREFUMCBbhkYFSURY
MERBVDADU1RBVCBQUkFUIFJDQVAgUFZPTCBVTklUIERDQVAgTEZDUCBCVEVDIERWT0wgRFdSTiBE
TE9XIEdSTjEgR1JOMiBCU1RBIEFQU1IgFAtfU1RBAKRCU1RBCFBCSUYSKg0BDP///38M////fwD/
AAAKBAoEDTEADTAADVZCT1gADWlubm90ZWsACFBCU1QSEgQADP///38M////fwz///9/FE4PX0JJ
RgBwVU5JVIhQQklGAABwRENBUIhQQklGAQBwTEZDUIhQQklGCgIAcEJURUOIUEJJRgoDAHBEVk9M
iFBCSUYKBABwRFdSTohQQklGCgUAcERMT1eIUEJJRgoGAHBHUk4xiFBCSUYKBwBwR1JOMohQQklG
CggAREJHXw1fQklGOgoASEVYNIOIUEJJRgAASEVYNIOIUEJJRgEASEVYNIOIUEJJRgoCAEhFWDSD
iFBCSUYKAwBIRVg0g4hQQklGCgQASEVYNIOIUEJJRgoFAEhFWDSDiFBCSUYKBgBIRVg0g4hQQklG
CgcASEVYNIOIUEJJRgoIAKRQQklGFD1fQlNUAHBTVEFUiFBCU1QAAHBQUkFUiFBCU1QBAHBSQ0FQ
iFBCU1QKAgBwUFZPTIhQQlNUCgMApFBCU1RbgkQEQUNfXwhfSElEDUFDUEkwMDAzAAhfVUlEAAhf
UENMEgYBX1NCXxQSX1BTUgCkXl4uQkFUMEFQU1IUCV9TVEEApAoPEE4LX1NCXxBHC1BDSTAIQ1JT
XxFCBwpuiA0AAgwAAAAAAP8AAAAAAUcB+Az4DAEIiA0AAQwDAAAAAPcMAAD4DIgNAAEMAwAAAA3/
/wAAAPOHFwAADAMAAAAAAAAKAP//CwAAAAAAAAACAIcXAAAIAwAAAAAAAAAA///f/wAAAAAAAAAA
eQAUOF9DUlMAikNSU18KXFJBTVSKQ1JTXwpoUkFNUnBNRU1MUkFNVHQMAADg/1JBTVRSQU1SpENS
U18QSi5fU0JfW4EnLwNQQ0kwU0JSR1BDSUMBAEAwUElSQQhQSVJCCFBJUkMIUElSRAgIQlVGQREJ
CgYjAIAYeQCLQlVGQQFJQ1JTFBZMU1RBAXtoCoBgoAVgpAoJoQSkCgsUF0xDUlMBe2gKD2B5AWBJ
Q1JTpEJVRkEUFkxTUlMBi2gBSVNSU4JJU1JTYKR2YBQMTERJUwGkfWgKgABbgkEMTE5LQQhfSElE
DEHQDA8IX1VJRAEUH19TVEEAREJHXw1MTktBLl9TVEEKAKRMU1RBUElSQRQbX1BSUwBEQkdfDUxO
S0EuX1BSUwoApFBSU0EUI19ESVMAREJHXw1MTktBLl9ESVMKAHBMRElTUElSQVBJUkEUH19DUlMA
REJHXw1MTktBLl9DUlMKAKRMQ1JTUElSQRQqX1NSUwFEQkdfDUxOS0EuX1NSUzogAEhFWF9MU1JT
aHBMU1JTaFBJUkFbgkIITE5LQghfSElEDEHQDA8IX1VJRAoCFA9fU1RBAKRMU1RBUElSQhQLX1BS
UwCkUFJTQhQTX0RJUwBwTERJU1BJUkJQSVJCFA9fQ1JTAKRMQ1JTUElSQhQqX1NSUwFEQkdfDUxO
S0IuX1NSUzogAEhFWF9MU1JTaHBMU1JTaFBJUkJbgkIITE5LQwhfSElEDEHQDA8IX1VJRAoDFA9f
U1RBAKRMU1RBUElSQxQLX1BSUwCkUFJTQxQTX0RJUwBwTERJU1BJUkNQSVJDFA9fQ1JTAKRMQ1JT
UElSQxQqX1NSUwFEQkdfDUxOS0MuX1NSUzogAEhFWF9MU1JTaHBMU1JTaFBJUkNbgkIITE5LRAhf
SElEDEHQDA8IX1VJRAoEFA9fU1RBAKRMU1RBUElSRBQLX1BSUwCkUFJTRBQTX0RJUwBwTERJU1BJ
UkFQSVJEFA9fQ1JTAKRMQ1JTUElSRBQqX1NSUwFEQkdfDUxOS0QuX1NSUzogAEhFWF9MU1JTaHBM
U1JTaFBJUkQIX1MwXxIEAgAAoBN7UFdSUwoCAAhfUzFfEgQCAQGgFXtQV1JTChAACF9TNF8SBgIK
BQoFCF9TNV8SBgIKBQoFFCNfUFRTAURCR18NUHJlcGFyZSB0byBzbGVlcDogAEhFWF9o
====
begin-base64 644 FACP.1
RkFDUHQAAAAE81ZCT1ggIFZCT1hGQUNQAQAAAEFTTCBhAAAAAAL/H3AE/x8BAAkALkQAAKGgAAAA
QAAAAAAAAARAAAAAAAAAAAAAAAhAAAAgQAAAAAAAAAQCAAQCAAAAZQDpAwAAAAAAAAAAAAMAAEEF
AAA=
====
begin-base64 644 RSDT.0
UlNEVDAAAAABh1ZCT1ggIFZCT1hSU0RUAQAAAEFTTCBhAAAAcAD/H0AC/x+gAv8f
====
begin-base64 644 SSDT.4
U1NEVMwBAAAB4VZCT1ggIFZCT1hDUFVUAgAAAElOVEwoBRAgEEcaXF9QUl9bgwtDUFUwAAAAAAAA
W4MLQ1BVMQEAAAAAAKOjo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Oj
o6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Oj
o6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Oj
o6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Oj
o6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Oj
o6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Oj
o6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Ojo6Oj
o6Ojow==
====
begin-base64 644 headers
ClJTRCBQVFI6IENoZWNrc3VtPTY2LCBPRU1JRD1WQk9YLCBSc2R0QWRkcmVzcz0weDFmZmYwMDAw
CgoKUlNEVDogTGVuZ3RoPTQ4LCBSZXZpc2lvbj0xLCBDaGVja3N1bT0xMzUsCglPRU1JRD1WQk9Y
LCBPRU0gVGFibGUgSUQ9VkJPWFJTRFQsIE9FTSBSZXZpc2lvbj0weDEsCglDcmVhdG9yIElEPUFT
TCwgQ3JlYXRvciBSZXZpc2lvbj0weDYxCgoKCUVudHJpZXM9eyAweDFmZmYwMDcwLCAweDFmZmYw
MjQwLCAweDFmZmYwMmEwIH0KCgoJRFNEVD0weDFmZmYwNDcwCglJTlRfTU9ERUw9QVBJQwoJU0NJ
X0lOVD05CglTTUlfQ01EPTB4NDQyZSwgQUNQSV9FTkFCTEU9MHhhMSwgQUNQSV9ESVNBQkxFPTB4
YTAsIFM0QklPU19SRVE9MHgwCglQTTFhX0VWVF9CTEs9MHg0MDAwLTB4NDAwMwoJUE0xYV9DTlRf
QkxLPTB4NDAwNC0weDQwMDUKCVBNMl9UTVJfQkxLPTB4NDAwOC0weDQwMGIKCVBNMl9HUEUwX0JM
Sz0weDQwMjAtMHg0MDIxCglQX0xWTDJfTEFUPTEwMW1zLCBQX0xWTDNfTEFUPTEwMDFtcwoJRkxV
U0hfU0laRT0wLCBGTFVTSF9TVFJJREU9MAoJRFVUWV9PRkZTRVQ9MCwgRFVUWV9XSURUSD0wCglE
QVlfQUxSTT0wLCBNT05fQUxSTT0wLCBDRU5UVVJZPTAKCUZsYWdzPXtXQklOVkQsRklYX1JUQyxU
TVJfVkFMX0VYVH0KCgpEU0RUOiBMZW5ndGg9NzA2MiwgUmV2aXNpb249MSwgQ2hlY2tzdW09MTQx
LAoJT0VNSUQ9VkJPWCwgT0VNIFRhYmxlIElEPVZCT1hCSU9TLCBPRU0gUmV2aXNpb249MHgyLAoJ
Q3JlYXRvciBJRD1JTlRMLCBDcmVhdG9yIFJldmlzaW9uPTB4MjAxMDA1MjgKCgpBUElDOiBMZW5n
dGg9OTIsIFJldmlzaW9uPTIsIENoZWNrc3VtPTc5LAoJT0VNSUQ9VkJPWCwgT0VNIFRhYmxlIElE
PVZCT1hBUElDLCBPRU0gUmV2aXNpb249MHgxLAoJQ3JlYXRvciBJRD1BU0wsIENyZWF0b3IgUmV2
aXNpb249MHg2MQoKClNTRFQ6IExlbmd0aD00NjAsIFJldmlzaW9uPTEsIENoZWNrc3VtPTIyNSwK
CU9FTUlEPVZCT1gsIE9FTSBUYWJsZSBJRD1WQk9YQ1BVVCwgT0VNIFJldmlzaW9uPTB4MiwKCUNy
ZWF0b3IgSUQ9SU5UTCwgQ3JlYXRvciBSZXZpc2lvbj0weDIwMTAwNTI4Cgo=
====
Martin Pieuchot
2017-07-11 09:32:27 UTC
Permalink
Hello and thanks for the detailed bug report.
Post by Remi Locherer
Synopsis: ifconfig carpX a.b.c.d -> arpresolve: route contains no arp information
Category: kernel
System : OpenBSD 6.1
Details : OpenBSD 6.1 (GENERIC.MP) #20: Sat Apr 1 13:45:56 MDT 2017
Architecture: OpenBSD.amd64
Machine : amd64
After reconfiguring an existing carp interface with the same ip the gateway stops forwarding traffic (forwarding to directly connected hosts still works).
Jul 10 12:54:27 gw1 /bsd: arpresolve: 10.0.20.10: route contains no arp information
How does the routing table looks like when you see such message? And
the ARP table?

What happen if you destroy carp2 instead of re-adding the same address?
Do you see the same problem?
Remi Locherer
2017-07-11 11:23:11 UTC
Permalink
Post by Martin Pieuchot
Hello and thanks for the detailed bug report.
Post by Remi Locherer
Synopsis: ifconfig carpX a.b.c.d -> arpresolve: route contains no arp information
Category: kernel
System : OpenBSD 6.1
Details : OpenBSD 6.1 (GENERIC.MP) #20: Sat Apr 1 13:45:56 MDT 2017
Architecture: OpenBSD.amd64
Machine : amd64
After reconfiguring an existing carp interface with the same ip the
gateway stops forwarding traffic (forwarding to directly connected
hosts still works).
Jul 10 12:54:27 gw1 /bsd: arpresolve: 10.0.20.10: route contains no arp information
How does the routing table looks like when you see such message? And
the ARP table?
gw1# route -nv show -inet
Routing tables

Internet:
Destination Gateway Flags Refs Use Mtu Prio
Iface Label
default 10.0.2.2 UGS 0 22 - 8
vio0
224/4 127.0.0.1 URS 0 0 32768 8
lo0
10.0.2/24 10.0.2.15 UCn 1 0 - 4
vio0
10.0.2.2 52:54:00:12:35:02 UHLch 2 16 - 3
vio0
10.0.2.15 08:00:27:23:af:65 UHLl 0 4 - 1
vio0
10.0.2.255 10.0.2.15 UHb 0 0 - 1
vio0
10.0.10/24 10.0.10.2 UCn 1 1 - 4
vio1
10.0.10/24 10.0.10.1 UCn 0 0 - 19
carp1
10.0.10.1 00:00:5e:00:01:17 UHLl 0 0 - 1
carp1
10.0.10.2 08:00:27:7d:87:23 UHLl 0 1 - 1
vio1
10.0.10.10 08:00:27:1e:30:02 UHLc 0 93 - 3
vio1
10.0.10.255 10.0.10.2 UHb 0 0 - 1
vio1
10.0.10.255 10.0.10.1 UHb 0 0 - 1
carp1
10.0.20/24 10.0.20.2 UCn 0 2 - 4
vio2
10.0.20/24 10.0.20.1 UCn 0 0 - 19
carp2
10.0.20.1 00:00:5e:00:01:17 UHLl 0 0 - 1
carp2
10.0.20.2 08:00:27:7e:f3:d5 UHLl 0 1 - 1
vio2
10.0.20.255 10.0.20.2 UHb 0 0 - 1
vio2
10.0.20.255 10.0.20.1 UHb 0 0 - 1
carp2
10.0.200/24 10.0.20.10 UGS 0 89 - 8
vio2
127/8 127.0.0.1 UGRS 0 0 32768 8
lo0
127.0.0.1 127.0.0.1 UHhl 1 2 32768 1
lo0
gw1# arp -an
Host Ethernet Address Netif Expire
Flags
10.0.2.2 52:54:00:12:35:02 vio0 19m32s
10.0.2.15 08:00:27:23:af:65 vio0 permanent
l
10.0.10.1 00:00:5e:00:01:17 carp1 permanent
l
10.0.10.2 08:00:27:7d:87:23 vio1 permanent
l
10.0.10.10 08:00:27:1e:30:02 vio1 18m31s
10.0.20.1 00:00:5e:00:01:17 carp2 permanent
l
10.0.20.2 08:00:27:7e:f3:d5 vio2 permanent
l
gw1#
Post by Martin Pieuchot
What happen if you destroy carp2 instead of re-adding the same address?
Do you see the same problem?
Not 100% the same. My ping also stops and the same message is printed to
/var/log/mesages.
But the gateway does not send "icmp: host 10.0.200.1 unreachable" to
10.0.10.10.

The routing and arp table after destroying carp2:

gw1# ifconfig carp2 destroy
gw1# route -nv show -inet
Routing tables

Internet:
Destination Gateway Flags Refs Use Mtu Prio
Iface Label
default 10.0.2.2 UGS 0 26 - 8
vio0
224/4 127.0.0.1 URS 0 0 32768 8
lo0
10.0.2/24 10.0.2.15 UCn 1 0 - 4
vio0
10.0.2.2 52:54:00:12:35:02 UHLch 2 20 - 3
vio0
10.0.2.15 08:00:27:23:af:65 UHLl 0 4 - 1
vio0
10.0.2.255 10.0.2.15 UHb 0 0 - 1
vio0
10.0.10/24 10.0.10.2 UCn 1 1 - 4
vio1
10.0.10/24 10.0.10.1 UCn 0 0 - 19
carp1
10.0.10.1 00:00:5e:00:01:17 UHLl 0 0 - 1
carp1
10.0.10.2 08:00:27:7d:87:23 UHLl 0 1 - 1
vio1
10.0.10.10 08:00:27:1e:30:02 UHLc 0 247 - 3
vio1
10.0.10.255 10.0.10.2 UHb 0 0 - 1
vio1
10.0.10.255 10.0.10.1 UHb 0 0 - 1
carp1
10.0.20/24 10.0.20.2 UCn 0 8 - 4
vio2
10.0.20.2 08:00:27:7e:f3:d5 UHLl 0 2 - 1
vio2
10.0.20.255 10.0.20.2 UHb 0 0 - 1
vio2
10.0.200/24 10.0.20.10 UGS 0 243 - 8
vio2
127/8 127.0.0.1 UGRS 0 0 32768 8
lo0
127.0.0.1 127.0.0.1 UHhl 1 2 32768 1
lo0
gw1# arp -an
Host Ethernet Address Netif Expire
Flags
10.0.2.2 52:54:00:12:35:02 vio0 19m0s
10.0.2.15 08:00:27:23:af:65 vio0 permanent
l
10.0.10.1 00:00:5e:00:01:17 carp1 permanent
l
10.0.10.2 08:00:27:7d:87:23 vio1 permanent
l
10.0.10.10 08:00:27:1e:30:02 vio1 16m44s
10.0.20.2 08:00:27:7e:f3:d5 vio2 permanent
l
gw1#
Remi Locherer
2017-07-11 11:55:47 UTC
Permalink
Post by Remi Locherer
Post by Martin Pieuchot
Hello and thanks for the detailed bug report.
Post by Remi Locherer
Synopsis: ifconfig carpX a.b.c.d -> arpresolve: route contains no arp information
Category: kernel
System : OpenBSD 6.1
Details : OpenBSD 6.1 (GENERIC.MP) #20: Sat Apr 1 13:45:56 MDT 2017
Architecture: OpenBSD.amd64
Machine : amd64
After reconfiguring an existing carp interface with the same ip the
gateway stops forwarding traffic (forwarding to directly connected
hosts still works).
Jul 10 12:54:27 gw1 /bsd: arpresolve: 10.0.20.10: route contains no arp information
How does the routing table looks like when you see such message? And
the ARP table?
gw1# route -nv show -inet
Routing tables
Destination Gateway Flags Refs Use Mtu
Prio Iface Label
default 10.0.2.2 UGS 0 22 - 8
vio0
224/4 127.0.0.1 URS 0 0 32768 8 lo0
10.0.2/24 10.0.2.15 UCn 1 0 - 4 vio0
10.0.2.2 52:54:00:12:35:02 UHLch 2 16 - 3
vio0
10.0.2.15 08:00:27:23:af:65 UHLl 0 4 - 1 vio0
10.0.2.255 10.0.2.15 UHb 0 0 - 1 vio0
10.0.10/24 10.0.10.2 UCn 1 1 - 4 vio1
10.0.10/24 10.0.10.1 UCn 0 0 - 19 carp1
10.0.10.1 00:00:5e:00:01:17 UHLl 0 0 - 1
carp1
10.0.10.2 08:00:27:7d:87:23 UHLl 0 1 - 1
vio1
10.0.10.10 08:00:27:1e:30:02 UHLc 0 93 - 3
vio1
10.0.10.255 10.0.10.2 UHb 0 0 - 1 vio1
10.0.10.255 10.0.10.1 UHb 0 0 - 1 carp1
10.0.20/24 10.0.20.2 UCn 0 2 - 4
vio2
10.0.20/24 10.0.20.1 UCn 0 0 - 19 carp2
10.0.20.1 00:00:5e:00:01:17 UHLl 0 0 - 1 carp2
10.0.20.2 08:00:27:7e:f3:d5 UHLl 0 1 - 1
vio2
10.0.20.255 10.0.20.2 UHb 0 0 - 1 vio2
10.0.20.255 10.0.20.1 UHb 0 0 - 1 carp2
10.0.200/24 10.0.20.10 UGS 0 89 - 8
vio2
127/8 127.0.0.1 UGRS 0 0 32768 8 lo0
127.0.0.1 127.0.0.1 UHhl 1 2 32768 1 lo0
gw1# arp -an
Host Ethernet Address Netif Expire
Flags
10.0.2.2 52:54:00:12:35:02 vio0 19m32s
10.0.2.15 08:00:27:23:af:65 vio0
permanent l
10.0.10.1 00:00:5e:00:01:17 carp1
permanent l
10.0.10.2 08:00:27:7d:87:23 vio1
permanent l
10.0.10.10 08:00:27:1e:30:02 vio1 18m31s
10.0.20.1 00:00:5e:00:01:17 carp2
permanent l
10.0.20.2 08:00:27:7e:f3:d5 vio2
permanent l
gw1#
Post by Martin Pieuchot
What happen if you destroy carp2 instead of re-adding the same address?
Do you see the same problem?
Not 100% the same. My ping also stops and the same message is printed
to /var/log/mesages.
But the gateway does not send "icmp: host 10.0.200.1 unreachable" to
10.0.10.10.
I missed something here: In my test setup I have only a single gateway.
After
destroying carp2 the ip 10.0.20.1 is not configured anywhere. But that
ip is the
defautl gateway of the test client. That is why I do not see icmp
unreachable
messages sent by the gw1.
Post by Remi Locherer
gw1# ifconfig carp2 destroy
gw1# route -nv show -inet
Routing tables
Destination Gateway Flags Refs Use Mtu
Prio Iface Label
default 10.0.2.2 UGS 0 26 - 8
vio0
224/4 127.0.0.1 URS 0 0 32768 8 lo0
10.0.2/24 10.0.2.15 UCn 1 0 - 4 vio0
10.0.2.2 52:54:00:12:35:02 UHLch 2 20 - 3
vio0
10.0.2.15 08:00:27:23:af:65 UHLl 0 4 - 1 vio0
10.0.2.255 10.0.2.15 UHb 0 0 - 1 vio0
10.0.10/24 10.0.10.2 UCn 1 1 - 4 vio1
10.0.10/24 10.0.10.1 UCn 0 0 - 19 carp1
10.0.10.1 00:00:5e:00:01:17 UHLl 0 0 - 1
carp1
10.0.10.2 08:00:27:7d:87:23 UHLl 0 1 - 1
vio1
10.0.10.10 08:00:27:1e:30:02 UHLc 0 247 - 3
vio1
10.0.10.255 10.0.10.2 UHb 0 0 - 1 vio1
10.0.10.255 10.0.10.1 UHb 0 0 - 1 carp1
10.0.20/24 10.0.20.2 UCn 0 8 - 4
vio2
10.0.20.2 08:00:27:7e:f3:d5 UHLl 0 2 - 1 vio2
10.0.20.255 10.0.20.2 UHb 0 0 - 1 vio2
10.0.200/24 10.0.20.10 UGS 0 243 - 8
vio2
127/8 127.0.0.1 UGRS 0 0 32768 8 lo0
127.0.0.1 127.0.0.1 UHhl 1 2 32768 1 lo0
gw1# arp -an
Host Ethernet Address Netif Expire
Flags
10.0.2.2 52:54:00:12:35:02 vio0 19m0s
10.0.2.15 08:00:27:23:af:65 vio0
permanent l
10.0.10.1 00:00:5e:00:01:17 carp1
permanent l
10.0.10.2 08:00:27:7d:87:23 vio1
permanent l
10.0.10.10 08:00:27:1e:30:02 vio1 16m44s
10.0.20.2 08:00:27:7e:f3:d5 vio2
permanent l
gw1#
Martin Pieuchot
2017-07-12 09:34:55 UTC
Permalink
Post by Martin Pieuchot
Hello and thanks for the detailed bug report.
Post by Remi Locherer
Synopsis: ifconfig carpX a.b.c.d -> arpresolve: route contains no arp information
Category: kernel
System : OpenBSD 6.1
Details : OpenBSD 6.1 (GENERIC.MP) #20: Sat Apr 1 13:45:56 MDT 2017
Architecture: OpenBSD.amd64
Machine : amd64
After reconfiguring an existing carp interface with the same ip
the gateway stops forwarding traffic (forwarding to directly
connected hosts still works).
Jul 10 12:54:27 gw1 /bsd: arpresolve: 10.0.20.10: route contains
no arp information
How does the routing table looks like when you see such message? And
the ARP table?
Somehow a route attached to vio2 is removed from the routing table when
you modify carp2.

Could you run 'route monitor' then do 'ifconfig carp2 delete'? This
should hopefully reproduce the problem and the output of 'route monitor'
will give us more infos.
Remi Locherer
2017-07-12 12:04:56 UTC
Permalink
Post by Martin Pieuchot
Post by Martin Pieuchot
Hello and thanks for the detailed bug report.
Post by Remi Locherer
Synopsis: ifconfig carpX a.b.c.d -> arpresolve: route contains no arp information
Category: kernel
System : OpenBSD 6.1
Details : OpenBSD 6.1 (GENERIC.MP) #20: Sat Apr 1 13:45:56 MDT 2017
Architecture: OpenBSD.amd64
Machine : amd64
After reconfiguring an existing carp interface with the same ip
the gateway stops forwarding traffic (forwarding to directly
connected hosts still works).
Jul 10 12:54:27 gw1 /bsd: arpresolve: 10.0.20.10: route contains
no arp information
How does the routing table looks like when you see such message? And
the ARP table?
Somehow a route attached to vio2 is removed from the routing table when
you modify carp2.
Could you run 'route monitor' then do 'ifconfig carp2 delete'? This
should hopefully reproduce the problem and the output of 'route monitor'
will give us more infos.
This is the output captured on 6.1-stable:

gw1# route monitor
got message of size 144 on Wed Jul 12 16:02:07 2017
RTM_DELETE: Delete Route: len 144, priority 3, table 0, ifidx 3, pid: 0,
seq 0, errno 0
flags:<UP,HOST,DONE,LLINFO,CLONED,CACHED>
fmask:
use: 0 mtu: 0 expire: 0
locks: inits:
sockaddrs: <DST,GATEWAY>
10.0.20.10 08:00:27:6b:9a:c1
got message of size 192 on Wed Jul 12 16:02:07 2017
RTM_DELETE: Delete Route: len 192, priority 19, table 0, ifidx 7, pid:
0, seq 0, errno 0
flags:<DONE,CLONING,CONNECTED>
fmask:
use: 0 mtu: 0 expire: 0
locks: inits:
sockaddrs: <DST,GATEWAY,NETMASK,IFP,IFA>
10.0.20.0 10.0.20.1 255.255.255.0 00:00:5e:00:01:17 10.0.20.1
got message of size 176 on Wed Jul 12 16:02:07 2017
RTM_DELETE: Delete Route: len 176, priority 1, table 0, ifidx 7, pid: 0,
seq 0, errno 0
flags:<HOST,DONE,BROADCAST>
fmask:
use: 0 mtu: 0 expire: 0
locks: inits:
sockaddrs: <DST,GATEWAY,IFP,IFA>
10.0.20.255 10.0.20.1 00:00:5e:00:01:17 10.0.20.1
got message of size 192 on Wed Jul 12 16:02:07 2017
RTM_DELETE: Delete Route: len 192, priority 1, table 0, ifidx 7, pid: 0,
seq 0, errno 0
flags:<HOST,DONE,LOCAL>
fmask:
use: 0 mtu: 0 expire: 0
locks: inits:
sockaddrs: <DST,GATEWAY,IFP,IFA>
10.0.20.1 00:00:5e:00:01:17 00:00:5e:00:01:17 10.0.20.1
got message of size 96 on Wed Jul 12 16:02:07 2017
RTM_DELADDR: address being removed from iface: len 96, metric 0, flags:
sockaddrs: <NETMASK,IFP,IFA,BRD>
255.255.255.0 00:00:5e:00:01:17 10.0.20.1 10.0.20.255
got message of size 168 on Wed Jul 12 16:02:08 2017
RTM_IFINFO: iface status change: len 168, if# 7, name: carp2, link:
invalid, mtu: 1500, flags:<BROADCAST,SIMPLEX,MULTICAST>
Remi Locherer
2017-07-21 10:13:35 UTC
Permalink
Post by Remi Locherer
Synopsis: ifconfig carpX a.b.c.d -> arpresolve: route contains no arp information
Category: kernel
System : OpenBSD 6.1
Details : OpenBSD 6.1 (GENERIC.MP) #20: Sat Apr 1 13:45:56 MDT 2017
Architecture: OpenBSD.amd64
Machine : amd64
After reconfiguring an existing carp interface with the same ip the
gateway stops forwarding traffic (forwarding to directly connected
hosts still works).
Jul 10 12:54:27 gw1 /bsd: arpresolve: 10.0.20.10: route contains no arp information
[...]
Post by Remi Locherer
- OpenBSD 6.1 -release
- OpenBSD 6.1 -stable (all patches applied with syspatch)
- OpenBSD 6.1 -current (7.7.2017)
With OpenBSD 6.0 3 pings are lost after executing ifconfig and then packages
are forwarded again as expected.
unknown. Workaround: route change 10.0.200.0/24 10.0.20.10
Somebody suggested in a private mail to use /32 masks for carp
interfaces.
This fix/workaround helps indeed!
Martin Pieuchot
2017-07-24 12:22:33 UTC
Permalink
[...]
Somebody suggested in a private mail to use /32 masks for carp interfaces.
This fix/workaround helps indeed!
Good to know! However from my developer's chair there's still a bug.
Nothing should happen to a route attached to vio1 when you modify
something on carp1.

Could you repeat the "route monitor" steps with a kernel containing the
diff below?

Index: net/route.c
===================================================================
RCS file: /cvs/src/sys/net/route.c,v
retrieving revision 1.360
diff -u -p -r1.360 route.c
--- net/route.c 24 Jul 2017 09:20:32 -0000 1.360
+++ net/route.c 24 Jul 2017 12:19:23 -0000
@@ -627,7 +627,7 @@ rtdeletemsg(struct rtentry *rt, struct i
{
int error;
struct rt_addrinfo info;
- unsigned int ifidx;
+ struct sockaddr_rtlabel sa_rl;
struct sockaddr_in6 sa_mask;

KASSERT(rt->rt_ifidx == ifp->if_index);
@@ -637,16 +637,18 @@ rtdeletemsg(struct rtentry *rt, struct i
* deleted. That will allow the information being reported to
* be accurate (and consistent with route_output()).
*/
- bzero((caddr_t)&info, sizeof(info));
+ memset(&info, 0, sizeof(info));
info.rti_info[RTAX_DST] = rt_key(rt);
+ info.rti_info[RTAX_GATEWAY] = rt->rt_gateway;
if (!ISSET(rt->rt_flags, RTF_HOST))
info.rti_info[RTAX_NETMASK] = rt_plen2mask(rt, &sa_mask);
- info.rti_info[RTAX_GATEWAY] = rt->rt_gateway;
+ info.rti_info[RTAX_LABEL] = rtlabel_id2sa(rt->rt_labelid, &sa_rl);
info.rti_flags = rt->rt_flags;
- ifidx = rt->rt_ifidx;
+ info.rti_info[RTAX_IFP] = sdltosa(ifp->if_sadl);
+ info.rti_info[RTAX_IFA] = rt->rt_ifa->ifa_addr;
error = rtrequest_delete(&info, rt->rt_priority, ifp, &rt, tableid);
KERNEL_LOCK();
- rtm_miss(RTM_DELETE, &info, info.rti_flags, rt->rt_priority, ifidx,
+ rtm_miss(RTM_DELETE, &info, rt->rt_flags, rt->rt_priority, rt->rt_ifidx,
error, tableid);
KERNEL_UNLOCK();
if (error == 0)
Remi Locherer
2017-07-24 15:40:53 UTC
Permalink
Post by Martin Pieuchot
[...]
Somebody suggested in a private mail to use /32 masks for carp interfaces.
This fix/workaround helps indeed!
Good to know! However from my developer's chair there's still a bug.
Nothing should happen to a route attached to vio1 when you modify
something on carp1.
Could you repeat the "route monitor" steps with a kernel containing the
diff below?
here you go:

gw1# route monitor
got message of size 192 on Mon Jul 24 19:32:43 2017
RTM_DELETE: Delete Route: len 192, priority 3, table 0, ifidx 3, pid: 0, seq 0, errno 0
flags:<HOST,DONE,CLONED,CACHED>
fmask:
use: 0 mtu: 0 expire: 0
locks: inits:
sockaddrs: <DST,GATEWAY,IFP,IFA>
10.0.20.10 08:00:27:6b:9a:c1 08:00:27:7e:f3:d5 10.0.20.2
got message of size 192 on Mon Jul 24 19:32:43 2017
RTM_DELETE: Delete Route: len 192, priority 19, table 0, ifidx 7, pid: 0, seq 0, errno 0
flags:<DONE,CLONING,CONNECTED>
fmask:
use: 0 mtu: 0 expire: 0
locks: inits:
sockaddrs: <DST,GATEWAY,NETMASK,IFP,IFA>
10.0.20.0 10.0.20.1 255.255.255.0 00:00:5e:00:01:17 10.0.20.1
got message of size 176 on Mon Jul 24 19:32:43 2017
RTM_DELETE: Delete Route: len 176, priority 1, table 0, ifidx 7, pid: 0, seq 0, errno 0
flags:<HOST,DONE,BROADCAST>
fmask:
use: 0 mtu: 0 expire: 0
locks: inits:
sockaddrs: <DST,GATEWAY,IFP,IFA>
10.0.20.255 10.0.20.1 00:00:5e:00:01:17 10.0.20.1
got message of size 192 on Mon Jul 24 19:32:43 2017
RTM_DELETE: Delete Route: len 192, priority 1, table 0, ifidx 7, pid: 0, seq 0, errno 0
flags:<HOST,DONE,LOCAL>
fmask:
use: 0 mtu: 0 expire: 0
locks: inits:
sockaddrs: <DST,GATEWAY,IFP,IFA>
10.0.20.1 00:00:5e:00:01:17 00:00:5e:00:01:17 10.0.20.1
got message of size 96 on Mon Jul 24 19:32:43 2017
RTM_DELADDR: address being removed from iface: len 96, metric 0, flags:
sockaddrs: <NETMASK,IFP,IFA,BRD>
255.255.255.0 00:00:5e:00:01:17 10.0.20.1 10.0.20.255
got message of size 168 on Mon Jul 24 19:32:43 2017
RTM_IFINFO: iface status change: len 168, if# 7, name: carp2, link: invalid, mtu: 1500, flags:<BROADCAST,SIMPLEX,MULTICAST>
got message of size 104 on Mon Jul 24 19:32:43 2017
RTM_NEWADDR: address being added to iface: len 104, metric 0, flags:
sockaddrs: <NETMASK,IFP,IFA,BRD>
255.255.255.0 00:00:5e:00:01:17 10.0.20.1 default
got message of size 192 on Mon Jul 24 19:32:43 2017
RTM_ADD: Add Route: len 192, priority 1, table 0, ifidx 7, pid: 0, seq 0, errno 0
flags:<UP,HOST,DONE,LLINFO,LOCAL>
fmask:
use: 0 mtu: 0 expire: 0
locks: inits:
sockaddrs: <DST,GATEWAY,IFP,IFA>
10.0.20.1 00:00:5e:00:01:17 00:00:5e:00:01:17 10.0.20.1
got message of size 192 on Mon Jul 24 19:32:43 2017
RTM_ADD: Add Route: len 192, priority 147, table 0, ifidx 7, pid: 0, seq 0, errno 0
flags:<DONE,CLONING,CONNECTED>
fmask:
use: 0 mtu: 0 expire: 0
locks: inits:
sockaddrs: <DST,GATEWAY,NETMASK,IFP,IFA>
10.0.20.0 10.0.20.1 255.255.255.0 00:00:5e:00:01:17 10.0.20.1
got message of size 176 on Mon Jul 24 19:32:43 2017
RTM_ADD: Add Route: len 176, priority 129, table 0, ifidx 7, pid: 0, seq 0, errno 0
flags:<HOST,DONE,BROADCAST>
fmask:
use: 0 mtu: 0 expire: 0
locks: inits:
sockaddrs: <DST,GATEWAY,IFP,IFA>
10.0.20.255 10.0.20.1 00:00:5e:00:01:17 10.0.20.1
got message of size 168 on Mon Jul 24 19:32:43 2017
RTM_IFINFO: iface status change: len 168, if# 7, name: carp2, link: backup, mtu: 1500, flags:<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST>
got message of size 168 on Mon Jul 24 19:32:46 2017
RTM_IFINFO: iface status change: len 168, if# 7, name: carp2, link: master, mtu: 1500, flags:<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST>
Loading...