Troubles with running *.xclbin in "hw" mode

Hello, everyone!

I have some troubles with my program running with Amazon's FPGA.

In "sw_emu" mode everything works fine - I use *.xclbin file and calculations at FPGA are twice faster than at CPU. This is good.

But when I try to use "hw" version something goes wrong.
Firstly, using of *.xclbin isn't an option at all - I have error at run of my program:

[XRT]ERROR: Failed to load xclbin.
host.cpp:106 Error calling cl::Program program(context, devices, bins, NULL, &err), error code is: -44

Secondly, using of *.awsxclbin makes my program to run almost perfectly except timing - it takes more then 30 times longer at FPGA then at CPU (the same calculations takes about 0.8 sec at CPU and almost 30 sec at FPGA). I'm not quite sure that it is normal (actually, I'm quite sure it's not).

So, questions are:

1. Why XRT fails with loading of **.xclbin and works fine with **.awsxclbin?
2. Why working with **.awsxclbin is so slow (instead of **.xclbin in "sw_emu" mode and presumably in "hw" mode)?

Additional info:

Run sequence for my program:

sudo su
source /opt/xilinx/xrt/setup.sh
export TARGET="hw"
export DEVICE="xilinx_aws-vu9p-f1-04261818_dynamic_5_0"
unset XCL_EMULATION_MODE
/home/centos/MEM/host /home/centos/MEM/mem.$TARGET.$DEVICE.xclbin
# /home/centos/MEM/mem.$TARGET.$DEVICE.xclbin file exists of course

Used instance: f1.2xlarge

Used AMI: Vivado & SDx 2019.1 Developer AMI

Output of "yum info xrt*":

Installed Packages
Name        : xrt
Arch        : x86_64
Version     : 2.2.0
Release     : 1
Size        : 19 M
Repo        : installed
Summary     : Xilinx RunTime stack for use with Xilinx FPGA platforms
...
Name        : xrt-aws
Arch        : x86_64
Version     : 2.2.0
Release     : 1
Size        : 1.3 M
Repo        : installed
Summary     : Xilinx RunTime stack for use with Xilinx FPGA platforms

Output of "lsmod | grep xocl":

xocl                  416721  0
libcrc32c              12644  5 xfs,xocl,nf_nat,nf_conntrack,xclmgmt
drm                   397988  5 ttm,xocl,drm_kms_helper,cirrus

Output of "aws configure get default.region": us-west-2

Output of "aws ec2 describe-fpga-images --fpga-image-ids afi-0eba655b322d38c81 --region us-west-2":

{
    "FpgaImages": [
        {
            "UpdateTime": "2020-07-23T08:55:32.000Z",
            "Name": "mem",
            "Tags": [],
            "PciId": {
                "SubsystemVendorId": "0xfedd",
                "VendorId": "0x1d0f",
                "DeviceId": "0xf010",
                "SubsystemId": "0x1d51"
            },
            "DataRetentionSupport": false,
            "FpgaImageGlobalId": "agfi-0b31c868a8e024606",
            "Public": false,
            "State": {
                "Code": "available"
            },
            "ShellVersion": "0x04261818",
            "OwnerId": "736559660793",
            "FpgaImageId": "afi-0eba655b322d38c81",
            "CreateTime": "2020-07-23T08:22:05.000Z",
            "Description": "mem"
        }
    ]
}

Output of "sudo systemctl status mpd": Unit mpd.service could not be found.

Output of "dmesg": see below in next message

UPDATE: Nope, output of "dmesg" will be here due "message quotas" in forum:

Output of "dmesg":

[    0.000000] Initializing cgroup subsys cpuset
[    0.000000] Initializing cgroup subsys cpu
[    0.000000] Initializing cgroup subsys cpuacct
[    0.000000] Linux version 3.10.0-862.14.4.el7.x86_64 (mockbuild@kbuilder.bsys.centos.org) (gcc version 4.8.5 20150623 (Red Hat 4.8.5-28) (GCC) ) #1 SMP Wed Sep 26 15:12:11 UTC 2018
[    0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-3.10.0-862.14.4.el7.x86_64 root=UUID=8c1540fa-e2b4-407d-bcd1-59848a73e463 ro console=tty0 console=ttyS0,115200n8 crashkernel=auto console=ttyS0,115200 LANG=en_US.UTF-8
[    0.000000] e820: BIOS-provided physical RAM map:
[    0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009dfff] usable
[    0.000000] BIOS-e820: [mem 0x000000000009e000-0x000000000009ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000007fffffff] usable
[    0.000000] BIOS-e820: [mem 0x00000000fc000000-0x00000000ffffffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000100000000-0x0000001effffffff] usable
[    0.000000] NX (Execute Disable) protection: active
[    0.000000] SMBIOS 2.7 present.
[    0.000000] DMI: Xen HVM domU, BIOS 4.2.amazon 08/24/2006
[    0.000000] Hypervisor detected: Xen HVM
[    0.000000] Xen version 4.2.
[    0.000000] Xen Platform PCI: I/O protocol version 1
[    0.000000] Netfront and the Xen platform PCI driver have been compiled for this kernel: unplug emulated NICs.
[    0.000000] Blkfront and the Xen platform PCI driver have been compiled for this kernel: unplug emulated disks.
You might have to change the root device
from /dev/hd[a-d] to /dev/xvd[a-d]
in your root= kernel command line option
[    0.000000] HVMOP_pagetable_dying not supported
[    0.000000] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved
[    0.000000] e820: remove [mem 0x000a0000-0x000fffff] usable
[    0.000000] e820: last_pfn = 0x1f00000 max_arch_pfn = 0x400000000
[    0.000000] MTRR default type: write-back
[    0.000000] MTRR fixed ranges enabled:
[    0.000000]   00000-9FFFF write-back
[    0.000000]   A0000-BFFFF write-combining
[    0.000000]   C0000-FFFFF write-back
[    0.000000] MTRR variable ranges enabled:
[    0.000000]   0 base 000080000000 mask 3FFFC0000000 uncachable
[    0.000000]   1 base 0000C0000000 mask 3FFFE0000000 uncachable
[    0.000000]   2 base 0000E0000000 mask 3FFFF0000000 uncachable
[    0.000000]   3 base 0000F0000000 mask 3FFFF8000000 uncachable
[    0.000000]   4 base 0000F8000000 mask 3FFFFC000000 uncachable
[    0.000000]   5 base 002000000000 mask 3FE000000000 uncachable
[    0.000000]   6 disabled
[    0.000000]   7 disabled
[    0.000000] PAT configuration [0-7]: WB  WC  UC- UC  WB  WP  UC- UC  
[    0.000000] e820: last_pfn = 0x80000 max_arch_pfn = 0x400000000
[    0.000000] found SMP MP-table at [mem 0x000fbc50-0x000fbc5f] mapped at [ffffffffff200c50]
[    0.000000] Base memory trampoline at [ffff9c7580098000] 98000 size 24576
[    0.000000] Using GB pages for direct mapping
[    0.000000] BRK [0x10bd232000, 0x10bd232fff] PGTABLE
[    0.000000] BRK [0x10bd233000, 0x10bd233fff] PGTABLE
[    0.000000] BRK [0x10bd234000, 0x10bd234fff] PGTABLE
[    0.000000] BRK [0x10bd235000, 0x10bd235fff] PGTABLE
[    0.000000] BRK [0x10bd236000, 0x10bd236fff] PGTABLE
[    0.000000] RAMDISK: [mem 0x2f3f2000-0x339f0fff]
[    0.000000] Early table checksum verification disabled
[    0.000000] ACPI: RSDP 00000000000ea020 00024 (v02    Xen)
[    0.000000] ACPI: XSDT 00000000fc00e2a0 00054 (v01    Xen      HVM 00000000 HVML 00000000)
[    0.000000] ACPI: FACP 00000000fc00df60 000F4 (v04    Xen      HVM 00000000 HVML 00000000)
[    0.000000] ACPI: DSDT 00000000fc0021c0 0BD19 (v02    Xen      HVM 00000000 INTL 20090123)
[    0.000000] ACPI: FACS 00000000fc002180 00040
[    0.000000] ACPI: APIC 00000000fc00e060 000D8 (v02    Xen      HVM 00000000 HVML 00000000)
[    0.000000] ACPI: HPET 00000000fc00e1b0 00038 (v01    Xen      HVM 00000000 HVML 00000000)
[    0.000000] ACPI: WAET 00000000fc00e1f0 00028 (v01    Xen      HVM 00000000 HVML 00000000)
[    0.000000] ACPI: SSDT 00000000fc00e220 00031 (v02    Xen      HVM 00000000 INTL 20090123)
[    0.000000] ACPI: SSDT 00000000fc00e260 00033 (v02    Xen      HVM 00000000 INTL 20090123)
[    0.000000] ACPI: Local APIC address 0xfee00000
[    0.000000] No NUMA configuration found
[    0.000000] Faking a node at [mem 0x0000000000000000-0x0000001effffffff]
[    0.000000] NODE_DATA(0) allocated [mem 0x1efffd9000-0x1effffffff]
[    0.000000] Reserving 168MB of memory at 576MB for crashkernel (System RAM: 124927MB)
[    0.000000] Zone ranges:
[    0.000000]   DMA      [mem 0x00001000-0x00ffffff]
[    0.000000]   DMA32    [mem 0x01000000-0xffffffff]
[    0.000000]   Normal   [mem 0x100000000-0x1effffffff]
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x00001000-0x0009dfff]
[    0.000000]   node   0: [mem 0x00100000-0x7fffffff]
[    0.000000]   node   0: [mem 0x100000000-0x1effffffff]
[    0.000000] Initmem setup node 0 [mem 0x00001000-0x1effffffff]
[    0.000000] On node 0 totalpages: 31981469
[    0.000000]   DMA zone: 64 pages used for memmap
[    0.000000]   DMA zone: 21 pages reserved
[    0.000000]   DMA zone: 3997 pages, LIFO batch:0
[    0.000000]   DMA32 zone: 8128 pages used for memmap
[    0.000000]   DMA32 zone: 520192 pages, LIFO batch:31
[    0.000000]   Normal zone: 491520 pages used for memmap
[    0.000000]   Normal zone: 31457280 pages, LIFO batch:31
[    0.000000] ACPI: PM-Timer IO Port: 0xb008
[    0.000000] ACPI: Local APIC address 0xfee00000
[    0.000000] ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x01] lapic_id[0x02] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x02] lapic_id[0x04] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x03] lapic_id[0x06] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x04] lapic_id[0x01] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x05] lapic_id[0x03] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x06] lapic_id[0x05] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x07] lapic_id[0x07] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x08] lapic_id[0x00] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x09] lapic_id[0x00] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x00] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x00] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0c] lapic_id[0x00] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0d] lapic_id[0x00] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0e] lapic_id[0x00] disabled)
[    0.000000] ACPI: IOAPIC (id[0x01] address[0xfec00000] gsi_base[0])
[    0.000000] IOAPIC[0]: apic_id 1, version 17, address 0xfec00000, GSI 0-47
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 low level)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 low level)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 low level)
[    0.000000] ACPI: IRQ0 used by override.
[    0.000000] ACPI: IRQ5 used by override.
[    0.000000] ACPI: IRQ9 used by override.
[    0.000000] ACPI: IRQ10 used by override.
[    0.000000] ACPI: IRQ11 used by override.
[    0.000000] Using ACPI (MADT) for SMP configuration information
[    0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000
[    0.000000] smpboot: Allowing 15 CPUs, 7 hotplug CPUs
[    0.000000] PM: Registered nosave memory: [mem 0x0009e000-0x0009ffff]
[    0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000dffff]
[    0.000000] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff]
[    0.000000] PM: Registered nosave memory: [mem 0x80000000-0xfbffffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfc000000-0xffffffff]
[    0.000000] e820: [mem 0x80000000-0xfbffffff] available for PCI devices
[    0.000000] Booting paravirtualized kernel on Xen HVM
[    0.000000] setup_percpu: NR_CPUS:5120 nr_cpumask_bits:15 nr_cpu_ids:15 nr_node_ids:1
[    0.000000] PERCPU: Embedded 35 pages/cpu @ffff9c9405200000 s104920 r8192 d30248 u262144
[    0.000000] pcpu-alloc: s104920 r8192 d30248 u262144 alloc=1*2097152
[    0.000000] pcpu-alloc: [0] 00 01 02 03 04 05 06 07 [0] 08 09 10 11 12 13 14 -- 
[    0.000000] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes)
[    0.000000] Built 1 zonelists in Zone order, mobility grouping on.  Total pages: 31481736
[    0.000000] Policy zone: Normal
[    0.000000] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-3.10.0-862.14.4.el7.x86_64 root=UUID=8c1540fa-e2b4-407d-bcd1-59848a73e463 ro console=tty0 console=ttyS0,115200n8 crashkernel=auto console=ttyS0,115200 LANG=en_US.UTF-8
[    0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes)
[    0.000000] x86/fpu: xstate_offset[2]: 0240, xstate_sizes[2]: 0100
[    0.000000] xsave: enabled xstate_bv 0x7, cntxt size 0x340 using standard form
[    0.000000] Memory: 3884548k/130023424k available (7348k kernel code, 2097548k absent, 2329944k reserved, 6281k data, 1844k init)
[    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=15, Nodes=1
[    0.000000] x86/pti: Unmapping kernel while in userspace
[    0.000000] Hierarchical RCU implementation.
[    0.000000] 	RCU restricting CPUs from NR_CPUS=5120 to nr_cpu_ids=15.
[    0.000000] NR_IRQS:327936 nr_irqs:952 0
[    0.000000] xen:events: Xen HVM callback vector for event delivery is enabled
[    0.000000] Console: colour VGA+ 80x25
[    0.000000] console [tty0] enabled
[    0.000000] Cannot get hvm parameter CONSOLE_EVTCHN (18): -22!
[    0.000000] console [ttyS0] enabled
[    0.000000] allocated 511705088 bytes of page_cgroup
[    0.000000] please try 'cgroup_disable=memory' option if you don't want memory cgroups
[    0.000000] hpet clockevent registered
[    0.000000] tsc: Fast TSC calibration using PIT
[    0.000000] tsc: Detected 2300.163 MHz processor
[   46.364548] tsc: Detected 2300.068 MHz TSC
[   46.364548] Calibrating delay loop (skipped), value calculated using timer frequency.. 
[   46.371351] 4600.13 BogoMIPS (lpj=2300068)
[   46.380708] pid_max: default: 32768 minimum: 301
[   46.385591] Security Framework initialized
[   46.390431] SELinux:  Initializing.
[   46.394581] SELinux:  Starting in permissive mode
[   46.394582] Yama: becoming mindful.
[   46.405720] Dentry cache hash table entries: 16777216 (order: 15, 134217728 bytes)
[   46.434350] Inode-cache hash table entries: 8388608 (order: 14, 67108864 bytes)
[   46.450305] Mount-cache hash table entries: 262144 (order: 9, 2097152 bytes)
[   46.455661] Mountpoint-cache hash table entries: 262144 (order: 9, 2097152 bytes)
[   46.462385] Initializing cgroup subsys memory
[   46.465898] Initializing cgroup subsys devices
[   46.469583] Initializing cgroup subsys freezer
[   46.473201] Initializing cgroup subsys net_cls
[   46.476767] Initializing cgroup subsys blkio
[   46.480262] Initializing cgroup subsys perf_event
[   46.484482] Initializing cgroup subsys hugetlb
[   46.488302] Initializing cgroup subsys pids
[   46.491738] Initializing cgroup subsys net_prio
[   46.496216] mce: CPU supports 2 MCE banks
[   46.499609] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0
[   46.503585] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0
[   46.507586] tlb_flushall_shift: 6
[   46.510646] Speculative Store Bypass: Vulnerable
[   46.514478] FEATURE SPEC_CTRL Not Present
[   46.518180] FEATURE IBPB_SUPPORT Not Present
[   46.522544] Spectre V2 : Vulnerable: Retpoline without IBPB
[   46.528561] Freeing SMP alternatives: 24k freed
[   46.538094] ACPI: Core revision 20130517
[   46.545844] ACPI: All ACPI Tables successfully acquired
[   46.551550] ftrace: allocating 28105 entries in 110 pages
[   46.595813] random: fast init done
[   46.600746] IRQ remapping doesn't support X2APIC mode, disable x2apic.
[   46.608765] Switched APIC routing to physical flat.
[   46.616987] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=0 pin2=0
[   46.633204] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2686 v4 @ 2.30GHz (fam: 06, model: 4f, stepping: 01)
[   46.642860] Xen: using vcpuop timer interface
[   46.642867] installing Xen timer for CPU 0
[   46.647740] cpu 0 spinlock event irq 53
[   46.652050] Performance Events: unsupported p6 CPU model 79 no PMU driver, software events only.
[   46.663252] NMI watchdog: disabled (cpu0): hardware events not enabled
[   46.669209] NMI watchdog: Shutting down hard lockup detector on all cpus
[   46.674624] installing Xen timer for CPU 1
[   46.678062] smpboot: Booting Node   0, Processors  #1cpu 1 spinlock event irq 59
[   46.688246] installing Xen timer for CPU 2
[   46.691696]  #2cpu 2 spinlock event irq 65
[   46.698957] installing Xen timer for CPU 3
[   46.702532]  #3cpu 3 spinlock event irq 71
[   46.709828] installing Xen timer for CPU 4
[   46.713259]  #4cpu 4 spinlock event irq 77
[   46.720824] installing Xen timer for CPU 5
[   46.724832]  #5cpu 5 spinlock event irq 83
[   46.732256] installing Xen timer for CPU 6
[   46.736568]  #6cpu 6 spinlock event irq 89
[   46.743994] installing Xen timer for CPU 7
[   46.747628]  #7cpu 7 spinlock event irq 95
[   46.755017] Brought up 8 CPUs
[   46.757898] smpboot: Max logical packages: 2
[   46.761804] smpboot: Total of 8 processors activated (36801.08 BogoMIPS)
[   47.273010] node 0 initialised, 30427846 pages in 477ms
[   47.278919] devtmpfs: initialized
[   47.296252] EVM: security.selinux
[   47.300322] EVM: security.ima
[   47.304377] EVM: security.capability
[   47.311399] atomic64 test passed for x86-64 platform with CX8 and with SSE
[   47.320197] pinctrl core: initialized pinctrl subsystem
[   47.326925] RTC time:  6:30:01, date: 07/24/20
[   47.333617] NET: Registered protocol family 16
[   47.343612] ACPI: bus type PCI registered
[   47.360434] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[   47.370375] PCI: Using configuration type 1 for base access
[   47.391238] ACPI: Added _OSI(Module Device)
[   47.398033] ACPI: Added _OSI(Processor Device)
[   47.404982] ACPI: Added _OSI(3.0 _SCP Extensions)
[   47.411244] ACPI: Added _OSI(Processor Aggregator Device)
[   47.417927] ACPI: Added _OSI(Linux-Dell-Video)
[   47.425187] ACPI: EC: Look up EC in DSDT
[   47.428713] ACPI: Interpreter enabled
[   47.432448] ACPI: (supports S0 S3 S4 S5)
[   47.436260] ACPI: Using IOAPIC for interrupt routing
[   47.441113] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[   47.460681] ACPI: Enabled 2 GPEs in block 00 to 0F
[   47.532897] random: crng init done
[   47.582093] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])
[   47.588104] acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI]
[   47.594741] acpi PNP0A03:00: _OSC failed (AE_NOT_FOUND); disabling ASPM
[   47.601511] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge.
[   47.613662] acpiphp: Slot [0] registered
[   47.619369] acpiphp: Slot [3] registered
[   47.624650] acpiphp: Slot [4] registered
[   47.629797] acpiphp: Slot [5] registered
[   47.634604] acpiphp: Slot [6] registered
[   47.639808] acpiphp: Slot [7] registered
[   47.645012] acpiphp: Slot [8] registered
[   47.650260] acpiphp: Slot [9] registered
[   47.670451] acpiphp: Slot [10] registered
[   47.674717] acpiphp: Slot [11] registered
[   47.678905] acpiphp: Slot [12] registered
[   47.683227] acpiphp: Slot [13] registered
[   47.690544] acpiphp: Slot [14] registered
[   47.694701] acpiphp: Slot [15] registered
[   47.699245] acpiphp: Slot [16] registered
[   47.704890] acpiphp: Slot [17] registered
[   47.709424] acpiphp: Slot [18] registered
[   47.714207] acpiphp: Slot [19] registered
[   47.723188] acpiphp: Slot [20] registered
[   47.729011] acpiphp: Slot [21] registered
[   47.734155] acpiphp: Slot [22] registered
[   47.740327] acpiphp: Slot [23] registered
[   47.745691] acpiphp: Slot [24] registered
[   47.752411] acpiphp: Slot [25] registered
[   47.758223] acpiphp: Slot [26] registered
[   47.762226] acpiphp: Slot [27] registered
[   47.767812] acpiphp: Slot [28] registered
[   47.773653] acpiphp: Slot [29] registered
[   47.778195] acpiphp: Slot [30] registered
[   47.783619] acpiphp: Slot [31] registered
[   47.787303] PCI host bridge to bus 0000:00
[   47.791252] pci_bus 0000:00: root bus resource [bus 00-ff]
[   47.796852] pci_bus 0000:00: root bus resource [io  0x0000-0x0cf7 window]
[   47.805484] pci_bus 0000:00: root bus resource [io  0x0d00-0xffff window]
[   47.814225] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
[   47.825149] pci_bus 0000:00: root bus resource [mem 0x80000000-0xfbffffff window]
[   47.854607] pci_bus 0000:00: root bus resource [mem 0x2000000000-0x3fffffffff window]
[   47.863326] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000
[   47.864856] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100
[   47.867573] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180
[   47.868932] pci 0000:00:01.1: reg 0x20: [io  0xc100-0xc10f]
[   47.869502] pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io  0x01f0-0x01f7]
[   47.877926] pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io  0x03f6]
[   47.884594] pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io  0x0170-0x0177]
[   47.892426] pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io  0x0376]
[   47.899851] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000
[   47.899890] * Found PM-Timer Bug on the chipset. Due to workarounds for a bug,
* this clock source is slow. Consider trying other clock sources
[   47.917474] pci 0000:00:01.3: quirk: [io  0xb000-0xb03f] claimed by PIIX4 ACPI
[   47.928050] pci 0000:00:02.0: [1013:00b8] type 00 class 0x030000
[   47.928328] pci 0000:00:02.0: reg 0x10: [mem 0x80000000-0x81ffffff pref]
[   47.928535] pci 0000:00:02.0: reg 0x14: [mem 0x85622000-0x85622fff]
[   47.930834] pci 0000:00:03.0: [1d0f:ec20] type 00 class 0x020000
[   47.931341] pci 0000:00:03.0: reg 0x10: [mem 0x85610000-0x85613fff]
[   47.935621] pci 0000:00:1c.0: [1d0f:cd01] type 00 class 0x010802
[   47.936442] pci 0000:00:1c.0: reg 0x10: [mem 0x85614000-0x85617fff 64bit]
[   47.936852] pci 0000:00:1c.0: reg 0x18: [mem 0x85620000-0x85621fff 64bit pref]
[   47.939947] pci 0000:00:1d.0: [1d0f:1042] type 00 class 0x058000
[   47.940628] pci 0000:00:1d.0: reg 0x10: [mem 0x82000000-0x83ffffff]
[   47.941079] pci 0000:00:1d.0: reg 0x14: [mem 0x85400000-0x855fffff]
[   47.942156] pci 0000:00:1d.0: reg 0x18: [mem 0x85600000-0x8560ffff 64bit pref]
[   47.942606] pci 0000:00:1d.0: reg 0x20: [mem 0x2000000000-0x3fffffffff 64bit pref]
[   47.945565] pci 0000:00:1e.0: [1d0f:1041] type 00 class 0x058000
[   47.946419] pci 0000:00:1e.0: reg 0x10: [mem 0x85618000-0x8561bfff 64bit pref]
[   47.946876] pci 0000:00:1e.0: reg 0x18: [mem 0x8561c000-0x8561ffff 64bit pref]
[   47.947316] pci 0000:00:1e.0: reg 0x20: [mem 0x85000000-0x853fffff 64bit pref]
[   47.949654] pci 0000:00:1f.0: [5853:0001] type 00 class 0xff8000
[   47.950047] pci 0000:00:1f.0: reg 0x10: [io  0xc000-0xc0ff]
[   47.950346] pci 0000:00:1f.0: reg 0x14: [mem 0x84000000-0x84ffffff pref]
[   47.953463] ACPI: PCI Interrupt Link [LNKA] (IRQs *5 10 11)
[   47.962787] ACPI: PCI Interrupt Link [LNKB] (IRQs 5 *10 11)
[   47.972011] ACPI: PCI Interrupt Link [LNKC] (IRQs 5 10 *11)
[   47.983014] ACPI: PCI Interrupt Link [LNKD] (IRQs *5 10 11)
[   48.009419] xen:balloon: Initialising balloon driver
[   48.014566] vgaarb: device added: PCI:0000:00:02.0,decodes=io+mem,owns=io+mem,locks=none
[   48.022949] vgaarb: loaded
[   48.025855] vgaarb: bridge control possible 0000:00:02.0
[   48.034255] SCSI subsystem initialized
[   48.037935] ACPI: bus type USB registered
[   48.041844] usbcore: registered new interface driver usbfs
[   48.046034] usbcore: registered new interface driver hub
[   48.050422] usbcore: registered new device driver usb
[   48.054867] EDAC MC: Ver: 3.0.0
[   48.061007] PCI: Using ACPI for IRQ routing
[   48.065317] PCI: pci_cache_line_size set to 64 bytes
[   48.068605] e820: reserve RAM buffer [mem 0x0009e000-0x0009ffff]
[   48.068746] NetLabel: Initializing
[   48.073667] NetLabel:  domain hash size = 128
[   48.077981] NetLabel:  protocols = UNLABELED CIPSOv4
[   48.081981] NetLabel:  unlabeled traffic allowed by default
[   48.087683] HPET: 3 timers in total, 0 timers will be used for per-cpu timer
[   48.094526] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0
[   48.101317] hpet0: 3 comparators, 64-bit 62.500000 MHz counter
[   48.109971] amd_nb: Cannot enumerate AMD northbridges
[   48.117879] Switched to clocksource xen
[   48.127512] pnp: PnP ACPI init
[   48.132192] ACPI: bus type PNP registered
[   48.136777] system 00:00: [mem 0x00000000-0x0009ffff] could not be reserved
[   48.144790] system 00:00: Plug and Play ACPI device, IDs PNP0c02 (active)
[   48.144874] system 00:01: [io  0x08a0-0x08a3] has been reserved
[   48.150795] system 00:01: [io  0x0cc0-0x0ccf] has been reserved
[   48.157876] system 00:01: [io  0x04d0-0x04d1] has been reserved
[   48.163720] system 00:01: Plug and Play ACPI device, IDs PNP0c02 (active)
[   48.163748] xen: --> pirq=16 -> irq=8 (gsi=8)
[   48.163770] pnp 00:02: Plug and Play ACPI device, IDs PNP0b00 (active)
[   48.163790] xen: --> pirq=17 -> irq=12 (gsi=12)
[   48.163807] pnp 00:03: Plug and Play ACPI device, IDs PNP0f13 (active)
[   48.163824] xen: --> pirq=18 -> irq=1 (gsi=1)
[   48.163842] pnp 00:04: Plug and Play ACPI device, IDs PNP0303 PNP030b (active)
[   48.163859] xen: --> pirq=19 -> irq=6 (gsi=6)
[   48.163861] pnp 00:05: [dma 2]
[   48.163875] pnp 00:05: Plug and Play ACPI device, IDs PNP0700 (active)
[   48.163897] xen: --> pirq=20 -> irq=4 (gsi=4)
[   48.163916] pnp 00:06: Plug and Play ACPI device, IDs PNP0501 (active)
[   48.163967] system 00:07: [io  0x10c0-0x1141] has been reserved
[   48.171021] system 00:07: [io  0xb044-0xb047] has been reserved
[   48.178224] system 00:07: Plug and Play ACPI device, IDs PNP0c02 (active)
[   48.202629] pnp: PnP ACPI: found 8 devices
[   48.207146] ACPI: bus type PNP unregistered
[   48.220262] pci_bus 0000:00: resource 4 [io  0x0000-0x0cf7 window]
[   48.220264] pci_bus 0000:00: resource 5 [io  0x0d00-0xffff window]
[   48.220267] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]
[   48.220269] pci_bus 0000:00: resource 7 [mem 0x80000000-0xfbffffff window]
[   48.220271] pci_bus 0000:00: resource 8 [mem 0x2000000000-0x3fffffffff window]
[   48.220305] NET: Registered protocol family 2
[   48.226347] TCP established hash table entries: 524288 (order: 10, 4194304 bytes)
[   48.234873] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
[   48.242537] TCP: Hash tables configured (established 524288 bind 65536)
[   48.249208] TCP: reno registered
[   48.252769] UDP hash table entries: 65536 (order: 9, 2097152 bytes)
[   48.260614] UDP-Lite hash table entries: 65536 (order: 9, 2097152 bytes)
[   48.267395] NET: Registered protocol family 1
[   48.277135] pci 0000:00:00.0: Limiting direct PCI/PCI transfers
[   48.282498] pci 0000:00:01.0: PIIX3: Enabling Passive Release
[   48.287782] pci 0000:00:01.0: Activating ISA DMA hang workarounds
[   48.294362] pci 0000:00:02.0: Boot video device
[   48.295995] PCI: CLS 0 bytes, default 64
[   48.296040] Unpacking initramfs...
[   49.040512] Freeing initrd memory: 71676k freed
[   49.062689] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
[   49.068354] software IO TLB [mem 0x7c000000-0x80000000] (64MB) mapped at [ffff9c75fc000000-ffff9c75ffffffff]
[   49.076448] RAPL PMU: API unit is 2^-32 Joules, 3 fixed counters, 655360 ms ovfl timer
[   49.083339] RAPL PMU: hw unit of domain pp0-core 2^-14 Joules
[   49.088185] RAPL PMU: hw unit of domain package 2^-14 Joules
[   49.092969] RAPL PMU: hw unit of domain dram 2^-16 Joules
[   49.098780] sha1_ssse3: Using AVX2 optimized SHA-1 implementation
[   49.103967] sha256_ssse3: Using AVX2 optimized SHA-256 implementation
[   49.109784] futex hash table entries: 4096 (order: 6, 262144 bytes)
[   49.115038] Initialise system trusted keyring
[   49.119089] audit: initializing netlink socket (disabled)
[   49.123748] type=2000 audit(1595572203.056:1): initialized
[   49.150414] HugeTLB registered 1 GB page size, pre-allocated 0 pages
[   49.155763] HugeTLB registered 2 MB page size, pre-allocated 0 pages
[   49.162262] zpool: loaded
[   49.164884] zbud: loaded
[   49.167745] VFS: Disk quotas dquot_6.5.2
[   49.171348] Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[   49.176091] msgmni has been set to 32768
[   49.179490] Key type big_key registered
[   49.183032] SELinux:  Registering netfilter hooks
[   49.184936] NET: Registered protocol family 38
[   49.188979] Key type asymmetric registered
[   49.192298] Asymmetric key parser 'x509' registered
[   49.196030] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)
[   49.202050] io scheduler noop registered
[   49.205557] io scheduler deadline registered (default)
[   49.209617] io scheduler cfq registered
[   49.212937] io scheduler mq-deadline registered
[   49.217010] io scheduler kyber registered
[   49.221114] pci_hotplug: PCI Hot Plug PCI Core version: 0.5
[   49.226167] pciehp: PCI Express Hot Plug Controller Driver version: 0.4
[   49.232054] intel_idle: does not run on family 6 model 79
[   49.232154] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0
[   49.238882] ACPI: Power Button [PWRF]
[   49.242017] input: Sleep Button as /devices/LNXSYSTM:00/LNXSLPBN:00/input/input1
[   49.247791] ACPI: Sleep Button [SLPF]
[   49.251201] GHES: HEST is not enabled!
[   49.254667] xen: --> pirq=21 -> irq=47 (gsi=47)
[   49.254758] xen:grant_table: Grant tables using version 1 layout
[   49.259143] Grant table initialized
[   49.262234] Cannot get hvm parameter CONSOLE_EVTCHN (18): -22!
[   49.266845] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
[   49.298670] 00:06: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
[   49.303607] Non-volatile memory driver v1.3
[   49.307029] Linux agpgart interface v0.103
[   49.310537] crash memory driver: version 1.1
[   49.314086] rdac: device handler registered
[   49.317493] hp_sw: device handler registered
[   49.321140] emc: device handler registered
[   49.324901] alua: device handler registered
[   49.328753] libphy: Fixed MDIO Bus: probed
[   49.332637] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[   49.338050] ehci-pci: EHCI PCI platform driver
[   49.342169] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
[   49.347081] ohci-pci: OHCI PCI platform driver
[   49.350779] uhci_hcd: USB Universal Host Controller Interface driver
[   49.355264] usbcore: registered new interface driver usbserial
[   49.359424] usbcore: registered new interface driver usbserial_generic
[   49.363947] usbserial: USB Serial support registered for generic
[   49.368215] i8042: PNP: PS/2 Controller [PNP0303:PS2K,PNP0f13:PS2M] at 0x60,0x64 irq 1,12
[   49.375992] serio: i8042 KBD port at 0x60,0x64 irq 1
[   49.379761] serio: i8042 AUX port at 0x60,0x64 irq 12
[   49.383721] mousedev: PS/2 mouse device common for all mice
[   49.389247] rtc_cmos 00:02: rtc core: registered rtc_cmos as rtc0
[   49.389617] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input2
[   49.404661] rtc_cmos 00:02: alarms up to one day, 114 bytes nvram, hpet irqs
[   49.410401] intel_pstate: Intel P-state driver initializing
[   49.415432] cpuidle: using governor menu
[   49.419362] hidraw: raw HID events driver (C) Jiri Kosina
[   49.424147] usbcore: registered new interface driver usbhid
[   49.428951] usbhid: USB HID core driver
[   49.432693] drop_monitor: Initializing network drop monitor service
[   49.438182] TCP: cubic registered
[   49.442030] Initializing XFRM netlink socket
[   49.446122] NET: Registered protocol family 10
[   49.450455] NET: Registered protocol family 17
[   49.454595] mpls_gso: MPLS GSO support
[   49.458587] PM: Hibernation image not present or could not be loaded.
[   49.458591] Loading compiled-in X.509 certificates
[   49.463027] Loaded X.509 cert 'CentOS Linux kpatch signing key: ea0413152cde1d98ebdca3fe6f0230904c9ef717'
[   49.471626] Loaded X.509 cert 'CentOS Linux Driver update signing key: 7f421ee0ab69461574bb358861dbe77762a4201b'
[   49.480638] Loaded X.509 cert 'CentOS Linux kernel signing key: e4a1b68f468aca5c2284505318fd9dad724b1303'
[   49.487892] registered taskstats version 1
[   49.493622] Key type trusted registered
[   49.498801] Key type encrypted registered
[   49.502291] IMA: No TPM chip found, activating TPM-bypass! (rc=-19)
[   49.510229] xenbus_probe_frontend: Device with no driver: device/vbd/768
[   49.516037] xenbus_probe_frontend: Device with no driver: device/pci/0
[   49.521919]   Magic number: 12:920:519
[   49.526066] rtc_cmos 00:02: setting system clock to 2020-07-24 06:30:03 UTC (1595572203)
[   49.535561] Freeing unused kernel memory: 1844k freed
[   49.540778] Write protecting the kernel read-only data: 12288k
[   49.547486] Freeing unused kernel memory: 832k freed
[   49.553636] Freeing unused kernel memory: 676k freed
[   49.563951] systemd[1]: systemd 219 running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 -SECCOMP +BLKID +ELFUTILS +KMOD +IDN)
[   49.582217] systemd[1]: Detected virtualization xen.
[   49.595244] systemd[1]: Detected architecture x86-64.
[   49.599533] systemd[1]: Running in initial RAM disk.
[   49.608694] systemd[1]: No hostname configured.
[   49.612370] systemd[1]: Set hostname to <localhost>.
[   49.616498] systemd[1]: Initializing machine ID from random generator.
[   49.650626] systemd[1]: Cannot add dependency job for unit blk-availability.service, ignoring: Unit not found.
[   49.662014] systemd[1]: Created slice Root Slice.
[   49.665748] systemd[1]: Starting Root Slice.
[   49.672591] systemd[1]: Listening on udev Control Socket.
[   49.676601] systemd[1]: Starting udev Control Socket.
[   49.683589] systemd[1]: Reached target Local File Systems.
[   49.687671] systemd[1]: Starting Local File Systems.
[   49.712527] systemd[1]: Reached target Timers.
[   49.716478] systemd[1]: Starting Timers.
[   49.723569] systemd[1]: Listening on udev Kernel Socket.
[   49.728447] systemd[1]: Starting udev Kernel Socket.
[   49.736620] systemd[1]: Listening on Journal Socket.
[   49.741011] systemd[1]: Starting Journal Socket.
[   49.747504] systemd[1]: Created slice System Slice.
[   49.751460] systemd[1]: Starting System Slice.
[   49.757773] systemd[1]: Reached target Slices.
[   49.761373] systemd[1]: Starting Slices.
[   49.765072] systemd[1]: Starting Journal Service...
[   49.771754] systemd[1]: Starting Create list of required static device nodes for the current kernel...
[   49.782707] systemd[1]: Starting Apply Kernel Variables...
[   49.799918] systemd[1]: Starting Setup Virtual Console...
[   49.811604] systemd[1]: Starting dracut cmdline hook...
[   49.825309] systemd[1]: Reached target Local Encrypted Volumes.
[   49.832570] systemd[1]: Starting Local Encrypted Volumes.
[   49.844515] systemd[1]: Reached target Swap.
[   49.848192] systemd[1]: Starting Swap.
[   49.855049] systemd[1]: Started Journal Service.
[   49.962726] device-mapper: uevent: version 1.0.3
[   49.966309] device-mapper: ioctl: 4.37.1-ioctl (2018-04-03) initialised: dm-devel@redhat.com
[   50.006290] RPC: Registered named UNIX socket transport module.
[   50.012516] RPC: Registered udp transport module.
[   50.016966] RPC: Registered tcp transport module.
[   50.021134] RPC: Registered tcp NFSv4.1 backchannel transport module.
[   50.100053] tsc: Refined TSC clocksource calibration: 2300.000 MHz
[   50.220572] FDC 0 is a S82078B
[   50.227068] cryptd: max_cpu_qlen set to 100
[   50.227084] ena: Elastic Network Adapter (ENA) v1.2.0k
[   50.227182] nvme nvme0: pci function 0000:00:1c.0
[   50.227821] xen: --> pirq=11 -> irq=35 (gsi=35)
[   50.230246] ena 0000:00:03.0: Elastic Network Adapter (ENA) v1.2.0k
[   50.247762] input: ImExPS/2 Generic Explorer Mouse as /devices/platform/i8042/serio1/input/input3
[   50.282235] AVX2 version of gcm_enc/dec engaged.
[   50.283766] libata version 3.00 loaded.
[   50.286770] AES CTR mode by8 optimization enabled
[   50.294209] Loading iSCSI transport class v2.0-870.
[   50.295882] alg: No test for __gcm-aes-aesni (__driver-gcm-aes-aesni)
[   50.296028] alg: No test for __generic-gcm-aes-aesni (__driver-generic-gcm-aes-aesni)
[   50.330969] ena: ena device version: 0.10
[   50.334891] ena: ena controller version: 0.0.1 implementation version 1
[   50.356687] blkfront: xvda: barrier or flush: disabled; persistent grants: enabled; indirect descriptors: enabled;
[   50.357528]  xvda: xvda1
[   51.047246] ena 0000:00:03.0: creating 8 io queues. queue size: 1024
[   51.055612] ena 0000:00:03.0: Elastic Network Adapter (ENA) found at mem 85610000, mac addr 0a:b5:fa:8c:40:c8 Queues 8
[   51.064320] ata_piix 0000:00:01.1: version 2.13
[   51.065304] scsi host0: ata_piix
[   51.069743] scsi host1: ata_piix
[   51.074448] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc100 irq 14
[   51.079782] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc108 irq 15
[   51.084558] [TTM] Zone  kernel: Available graphics memory: 62835492 kiB
[   51.090098] [TTM] Zone   dma32: Available graphics memory: 2097152 kiB
[   51.095742] [TTM] Initializing pool allocator
[   51.099691] [TTM] Initializing DMA pool allocator
[   51.104256] [drm] fb mappable at 0x80000000
[   51.108042] [drm] vram aper at 0x80000000
[   51.111635] [drm] size 33554432
[   51.114745] [drm] fb depth is 24
[   51.117967] [drm]    pitch is 3072
[   51.121314] 8021q: 802.1Q VLAN Support v1.8
[   51.124567] fbcon: cirrusdrmfb (fb0) is primary device
[   51.139342] Console: switching to colour frame buffer device 128x48
[   51.148263] cirrus 0000:00:02.0: fb0: cirrusdrmfb frame buffer device
[   51.154951] [drm] Initialized cirrus 1.0.0 20110418 for 0000:00:02.0 on minor 0
[   51.315119] SGI XFS with ACLs, security attributes, no debug enabled
[   51.332409] XFS (xvda1): Mounting V5 Filesystem
[   52.814371] XFS (xvda1): Ending clean mount
[   53.860314] systemd-journald[129]: Received SIGTERM from PID 1 (systemd).
[   58.415473] type=1404 audit(1595572212.389:2): enforcing=1 old_enforcing=0 auid=4294967295 ses=4294967295
[   59.770226] SELinux: 2048 avtab hash slots, 106465 rules.
[   59.845966] SELinux: 2048 avtab hash slots, 106465 rules.
[   59.876020] SELinux:  8 users, 14 roles, 5009 types, 310 bools, 1 sens, 1024 cats
[   59.876023] SELinux:  97 classes, 106465 rules
[   59.880270] SELinux:  Completing initialization.
[   59.880272] SELinux:  Setting up existing superblocks.
[   59.889717] type=1403 audit(1595572213.862:3): policy loaded auid=4294967295 ses=4294967295
[   59.899452] systemd[1]: Successfully loaded SELinux policy in 1.566699s.
[   63.870560] ip_tables: (C) 2000-2006 Netfilter Core Team
[   63.874449] systemd[1]: Inserted module 'ip_tables'
[   63.900616] systemd[1]: Relabelled /dev and /run in 20.880ms.
[   75.105705] systemd-journald[609]: Received request to flush runtime journal from PID 1
[   82.556839] input: PC Speaker as /devices/platform/pcspkr/input/input4
[   82.722944] xocl: loading out-of-tree module taints kernel.
[   82.732742] xocl: module verification failed: signature and/or required key missing - tainting kernel
[   82.748464] xocl 0000:00:1d.0: xocl_register_subdev: creating subdev rom.u
[   82.753929] rom.u rom.u.232: feature_rom_probe: Found AWS VU9P Device without featureROM
[   82.760271] rom.u rom.u.232: feature_rom_probe: Enabling AWS dynamic 5.0 DSA
[   82.767967] rom.u rom.u.232: feature_rom_probe: ROM magic : \xffffffff\xffffffff\xffffffff\xffffffff
[   82.773992] rom.u rom.u.232: feature_rom_probe: VBNV: \xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff



[   82.789305] rom.u rom.u.232: feature_rom_probe: DDR channel count : 255
[   82.795920] rom.u rom.u.232: feature_rom_probe: DDR channel size: 255 GB
[   82.802636] rom.u rom.u.232: feature_rom_probe: Major Version: 255
[   82.808996] rom.u rom.u.232: feature_rom_probe: Minor Version: 255
[   82.815210] rom.u rom.u.232: feature_rom_probe: IPBuildID: 4294967295
[   82.821646] rom.u rom.u.232: feature_rom_probe: TimeSinceEpoch: ffffffffffffffff
[   82.828557] rom.u rom.u.232: feature_rom_probe: FeatureBitMap: ffffffffffffffff
[   82.835691] xocl 0000:00:1d.0: xocl_subdev_create_one: Created subdev rom.u
[   82.842455] xocl 0000:00:1d.0: xocl_register_subdev: creating subdev dma.xdma.u
[   82.849564] xocl:xdma_device_open: xocl device 0000:00:1d.0, 0xffff9c947f60f000.
[   82.854062] xocl:pci_check_extended_tag: 0xffff9c947f60f000 EXT_TAG disabled.
[   82.859466] xocl:xdma_device_open: ExtTag is disabled, try enable it.
[   82.864722] xocl:map_single_bar: map bar 0, len 33554432
[   82.868167] xocl:map_single_bar: map bar 1, len 2097152
[   82.871897] xocl:map_single_bar: BAR1 at 0x85400000 mapped at 0xffffa9ec4d400000, length=2097152(/2097152)
[   82.878485] xocl:map_single_bar: map bar 2, len 65536
[   82.883200] xocl:map_single_bar: BAR2 at 0x85600000 mapped at 0xffffa9ec4d340000, length=65536(/65536)
[   82.888532] xocl:map_bars: config bar 2, pos 1.
[   82.891626] xocl:map_single_bar: map bar 3, len 0
[   82.894888] xocl:map_single_bar: map bar 4, len 137438953472
[   82.898515] xocl:map_single_bar: map bar 5, len 0
[   82.901688] xocl:identify_bars: xdev 0xffff9c93f93f1000, bars 2, config at 1.
[   82.906173] xocl:identify_bars: 2 BARs: config 1, user 1, bypass -1.
[   82.916276] xocl:pci_keep_intx_enabled: 0000:00:1d.0: clear INTX_DISABLE, 0x406 -> 0x6.
[   82.920966] xocl:irq_msix_channel_setup: engine 0-H2C0-MM, irq#115.
[   82.924863] xocl:irq_msix_channel_setup: engine 0-H2C1-MM, irq#116.
[   82.929116] xocl:irq_msix_channel_setup: engine 0-H2C2-MM, irq#117.
[   82.932998] xocl:irq_msix_channel_setup: engine 0-H2C3-MM, irq#118.
[   82.937006] xocl:irq_msix_channel_setup: engine 0-C2H0-MM, irq#119.
[   82.940968] xocl:irq_msix_channel_setup: engine 0-C2H1-MM, irq#120.
[   82.945712] xocl:irq_msix_channel_setup: engine 0-C2H2-MM, irq#121.
[   82.950735] xocl:irq_msix_channel_setup: engine 0-C2H3-MM, irq#122.
[   82.955513] xocl:irq_msix_user_setup: 0-USR-0, IRQ#123 with 0xffff9c93f93f11a8
[   82.961095] xocl:irq_msix_user_setup: 0-USR-1, IRQ#124 with 0xffff9c93f93f11e0
[   82.966255] xocl:irq_msix_user_setup: 0-USR-2, IRQ#125 with 0xffff9c93f93f1218
[   82.971854] xocl:irq_msix_user_setup: 0-USR-3, IRQ#126 with 0xffff9c93f93f1250
[   82.976019] xocl:irq_msix_user_setup: 0-USR-4, IRQ#127 with 0xffff9c93f93f1288
[   82.981154] xocl:irq_msix_user_setup: 0-USR-5, IRQ#128 with 0xffff9c93f93f12c0
[   82.987439] xocl:irq_msix_user_setup: 0-USR-6, IRQ#129 with 0xffff9c93f93f12f8
[   82.993710] xocl:irq_msix_user_setup: 0-USR-7, IRQ#130 with 0xffff9c93f93f1330
[   82.999993] xocl:irq_msix_user_setup: 0-USR-8, IRQ#131 with 0xffff9c93f93f1368
[   83.006129] xocl:irq_msix_user_setup: 0-USR-9, IRQ#132 with 0xffff9c93f93f13a0
[   83.011098] xocl:irq_msix_user_setup: 0-USR-10, IRQ#133 with 0xffff9c93f93f13d8
[   83.016019] xocl:irq_msix_user_setup: 0-USR-11, IRQ#134 with 0xffff9c93f93f1410
[   83.021079] xocl:irq_msix_user_setup: 0-USR-12, IRQ#135 with 0xffff9c93f93f1448
[   83.026344] xocl:irq_msix_user_setup: 0-USR-13, IRQ#136 with 0xffff9c93f93f1480
[   83.030498] xocl:irq_msix_user_setup: 0-USR-14, IRQ#137 with 0xffff9c93f93f14b8
[   83.034445] xocl:irq_msix_user_setup: 0-USR-15, IRQ#138 with 0xffff9c93f93f14f0
[   83.038555] xocl 0000:00:1d.0: xocl_subdev_create_one: Created subdev dma.xdma.u
[   83.042567] xocl 0000:00:1d.0: xocl_register_subdev: creating subdev mb_scheduler.u
[   83.046760] xocl 0000:00:1d.0: exec_reset: exec_reset(0) cfg(0)
[   83.050479] [drm] command scheduler started
[   83.054163] xocl 0000:00:1d.0: xocl_subdev_create_one: Created subdev mb_scheduler.u
[   83.060227] xocl 0000:00:1d.0: xocl_register_subdev: creating subdev icap.u
[   83.065829] xocl 0000:00:1d.0: exec_stop: exec_stop(ffff9c93f93f4018)
[   83.070985] icap.u icap.u.232: icap_unlock_bitstream: proc 0 try to unlock bitstream 00000000-0000-0000-0000-000000000000, ref=0, err=0
[   83.080798] icap.u icap.u.232: icap_probe: successfully initialized FPGA IDCODE 0x0
[   83.086791] xocl 0000:00:1d.0: xocl_subdev_create_one: Created subdev icap.u
[   83.092393] xocl 0000:00:1d.0: xocl_p2p_mem_reserve: reserve p2p mem, bar 4, len 137438953472
[   83.116780] intel_rapl: Found RAPL domain package
[   83.121222] intel_rapl: Found RAPL domain dram
[   83.125074] intel_rapl: DRAM domain energy unit 15300pj
[   83.350305] EDAC sbridge: Seeking for: PCI ID 8086:6fa0
[   83.350311] EDAC sbridge:  Ver: 1.1.1 
[   83.405804] ppdev: user-space parallel port driver
[   84.494157] xocl 0000:00:1d.0: xocl_mb_connect: ch_state 0x0
[   84.498346] [drm] Initialized xocl 2.2.2173 20190627 for 0000:00:1d.0 on minor 1
[   84.504070] piix4_smbus 0000:00:01.3: SMBus base address uninitialized - upgrade BIOS or use force_addr=0xaddr
[   89.235888] type=1305 audit(1595572243.209:4): audit_pid=750 old=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:auditd_t:s0 res=1
[  100.955808] ip6_tables: (C) 2000-2006 Netfilter Core Team
[  101.750523] Ebtables v2.0 registered
[  101.912505] nf_conntrack version 0.5.0 (65536 buckets, 262144 max)
[  102.442242] bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this.
[  102.739113] Netfilter messages via NETLINK v0.30.
[  102.894981] ip_set: protocol 6
[  107.823479] IPv6: ADDRCONF(NETDEV_UP): ens3: link is not ready
[  119.903467] tun: Universal TUN/TAP device driver, 1.6
[  119.908355] tun: (C) 1999-2004 Max Krasnyansky <maxk@qualcomm.com>
[  119.915821] virbr0: port 1(virbr0-nic) entered blocking state
[  119.921337] virbr0: port 1(virbr0-nic) entered disabled state
[  119.926919] device virbr0-nic entered promiscuous mode
[  120.026448] virbr0: port 1(virbr0-nic) entered blocking state
[  120.032011] virbr0: port 1(virbr0-nic) entered listening state
[  120.037483] IPv6: ADDRCONF(NETDEV_UP): virbr0: link is not ready
[  120.426383] virbr0: port 1(virbr0-nic) entered disabled state
[ 2238.562568] icap.u icap.u.232: icap_remove: cleaned up successfully
[ 2238.565576] [drm] /var/lib/dkms/xrt/2.2.2173/build/driver/xclng/drm/xocl/userpf/../subdev/mb_scheduler.c:2552 scheduler thread exits with value 0
[ 2238.574085] [drm] command scheduler removed
[ 2238.582511] rom.u rom.u.232: feature_rom_remove: Remove feature rom
[ 2534.765671] xocl 0000:00:1d.0: xocl_register_subdev: creating subdev rom.u
[ 2534.769488] rom.u rom.u.232: feature_rom_probe: Found AWS VU9P Device without featureROM
[ 2534.773802] rom.u rom.u.232: feature_rom_probe: Enabling AWS dynamic 5.0 DSA
[ 2534.777353] rom.u rom.u.232: feature_rom_probe: ROM magic : \xffffffff\xffffffff\xffffffff\xffffffff
[ 2534.780305] rom.u rom.u.232: feature_rom_probe: VBNV: \xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff\xffffffff



[ 2534.788883] rom.u rom.u.232: feature_rom_probe: DDR channel count : 255
[ 2534.792268] rom.u rom.u.232: feature_rom_probe: DDR channel size: 255 GB
[ 2534.795596] rom.u rom.u.232: feature_rom_probe: Major Version: 255
[ 2534.798818] rom.u rom.u.232: feature_rom_probe: Minor Version: 255
[ 2534.802165] rom.u rom.u.232: feature_rom_probe: IPBuildID: 4294967295
[ 2534.805631] rom.u rom.u.232: feature_rom_probe: TimeSinceEpoch: ffffffffffffffff
[ 2534.809397] rom.u rom.u.232: feature_rom_probe: FeatureBitMap: ffffffffffffffff
[ 2534.813188] xocl 0000:00:1d.0: xocl_subdev_create_one: Created subdev rom.u
[ 2534.816916] xocl 0000:00:1d.0: xocl_register_subdev: creating subdev dma.xdma.u
[ 2534.820694] xocl:xdma_device_open: xocl device 0000:00:1d.0, 0xffff9c947f60f000.
[ 2534.824651] xocl:map_single_bar: map bar 0, len 33554432
[ 2534.827202] xocl:map_single_bar: map bar 1, len 2097152
[ 2534.829852] xocl:map_single_bar: BAR1 at 0x85400000 mapped at 0xffffa9ec4e000000, length=2097152(/2097152)
[ 2534.834809] xocl:map_single_bar: map bar 2, len 65536
[ 2534.837383] xocl:map_single_bar: BAR2 at 0x85600000 mapped at 0xffffa9ec4d1c0000, length=65536(/65536)
[ 2534.841923] xocl:map_bars: config bar 2, pos 1.
[ 2534.844255] xocl:map_single_bar: map bar 3, len 0
[ 2534.846629] xocl:map_single_bar: map bar 4, len 137438953472
[ 2534.849396] xocl:map_single_bar: map bar 5, len 0
[ 2534.851756] xocl:identify_bars: xdev 0xffff9c863c789000, bars 2, config at 1.
[ 2534.855397] xocl:identify_bars: 2 BARs: config 1, user 1, bypass -1.
[ 2535.031662] xocl:pci_keep_intx_enabled: 0000:00:1d.0: clear INTX_DISABLE, 0x406 -> 0x6.
[ 2535.035115] xocl:irq_msix_channel_setup: engine 0-H2C0-MM, irq#115.
[ 2535.037783] xocl:irq_msix_channel_setup: engine 0-H2C1-MM, irq#116.
[ 2535.041547] xocl:irq_msix_channel_setup: engine 0-H2C2-MM, irq#117.
[ 2535.045311] xocl:irq_msix_channel_setup: engine 0-H2C3-MM, irq#118.
[ 2535.049020] xocl:irq_msix_channel_setup: engine 0-C2H0-MM, irq#119.
[ 2535.052716] xocl:irq_msix_channel_setup: engine 0-C2H1-MM, irq#120.
[ 2535.056370] xocl:irq_msix_channel_setup: engine 0-C2H2-MM, irq#121.
[ 2535.059987] xocl:irq_msix_channel_setup: engine 0-C2H3-MM, irq#122.
[ 2535.063609] xocl:irq_msix_user_setup: 0-USR-0, IRQ#123 with 0xffff9c863c7891a8
[ 2535.067718] xocl:irq_msix_user_setup: 0-USR-1, IRQ#124 with 0xffff9c863c7891e0
[ 2535.071762] xocl:irq_msix_user_setup: 0-USR-2, IRQ#125 with 0xffff9c863c789218
[ 2535.075768] xocl:irq_msix_user_setup: 0-USR-3, IRQ#126 with 0xffff9c863c789250
[ 2535.081014] xocl:irq_msix_user_setup: 0-USR-4, IRQ#127 with 0xffff9c863c789288
[ 2535.086723] xocl:irq_msix_user_setup: 0-USR-5, IRQ#128 with 0xffff9c863c7892c0
[ 2535.092514] xocl:irq_msix_user_setup: 0-USR-6, IRQ#129 with 0xffff9c863c7892f8
[ 2535.098131] xocl:irq_msix_user_setup: 0-USR-7, IRQ#130 with 0xffff9c863c789330
[ 2535.102541] xocl:irq_msix_user_setup: 0-USR-8, IRQ#131 with 0xffff9c863c789368
[ 2535.106517] xocl:irq_msix_user_setup: 0-USR-9, IRQ#132 with 0xffff9c863c7893a0
[ 2535.110397] xocl:irq_msix_user_setup: 0-USR-10, IRQ#133 with 0xffff9c863c7893d8
[ 2535.114300] xocl:irq_msix_user_setup: 0-USR-11, IRQ#134 with 0xffff9c863c789410
[ 2535.118135] xocl:irq_msix_user_setup: 0-USR-12, IRQ#135 with 0xffff9c863c789448
[ 2535.121980] xocl:irq_msix_user_setup: 0-USR-13, IRQ#136 with 0xffff9c863c789480
[ 2535.125814] xocl:irq_msix_user_setup: 0-USR-14, IRQ#137 with 0xffff9c863c7894b8
[ 2535.130370] xocl:irq_msix_user_setup: 0-USR-15, IRQ#138 with 0xffff9c863c7894f0
[ 2535.134259] xocl 0000:00:1d.0: xocl_subdev_create_one: Created subdev dma.xdma.u
[ 2535.138000] xocl 0000:00:1d.0: xocl_register_subdev: creating subdev mb_scheduler.u
[ 2535.142155] xocl 0000:00:1d.0: exec_reset: exec_reset(0) cfg(0)
[ 2535.146349] [drm] command scheduler started
[ 2535.149827] xocl 0000:00:1d.0: xocl_subdev_create_one: Created subdev mb_scheduler.u
[ 2535.155625] xocl 0000:00:1d.0: xocl_register_subdev: creating subdev icap.u
[ 2535.160910] xocl 0000:00:1d.0: exec_stop: exec_stop(ffff9c9254f86018)
[ 2535.164511] icap.u icap.u.232: icap_unlock_bitstream: proc 0 try to unlock bitstream 00000000-0000-0000-0000-000000000000, ref=0, err=0
[ 2535.171375] icap.u icap.u.232: icap_probe: successfully initialized FPGA IDCODE 0x0
[ 2535.175391] xocl 0000:00:1d.0: xocl_subdev_create_one: Created subdev icap.u
[ 2535.179192] xocl 0000:00:1d.0: xocl_p2p_mem_reserve: reserve p2p mem, bar 4, len 137438953472
[ 2536.572521] xocl 0000:00:1d.0: xocl_mb_connect: ch_state 0x0
[ 2536.577847] [drm] Initialized xocl 2.2.0 20200619 for 0000:00:1d.0 on minor 1
[ 2536.925065] xclmgmt init()
[ 2612.965634] awsmgmt init()
[ 3395.538400] icap.u icap.u.232: icap_remove: cleaned up successfully
[ 3395.542459] [drm] /var/lib/dkms/xrt/2.2.0/build/driver/xclng/drm/xocl/userpf/../subdev/mb_scheduler.c:2553 scheduler thread exits with value 0
[ 3395.549873] [drm] command scheduler removed
[ 3395.558405] rom.u rom.u.232: feature_rom_remove: Remove feature rom
[ 3398.297897] pci 0000:00:1d.0: [1d0f:f010] type 00 class 0x058000
[ 3398.298581] pci 0000:00:1d.0: reg 0x10: [mem 0x82000000-0x83ffffff]
[ 3398.299150] pci 0000:00:1d.0: reg 0x14: [mem 0x85400000-0x855fffff]
[ 3398.300051] pci 0000:00:1d.0: reg 0x18: [mem 0x85600000-0x8560ffff 64bit pref]
[ 3398.300943] pci 0000:00:1d.0: reg 0x20: [mem 0x2000000000-0x3fffffffff 64bit pref]
[ 3398.304479] cirrus 0000:00:02.0: BAR 6: [??? 0x00000000 flags 0x2] has bogus alignment
[ 3398.309920] pci 0000:00:1d.0: BAR 4: assigned [mem 0x2000000000-0x3fffffffff 64bit pref]
[ 3398.315205] pci 0000:00:1d.0: BAR 0: assigned [mem 0x82000000-0x83ffffff]
[ 3398.319470] pci 0000:00:1d.0: BAR 1: assigned [mem 0x85400000-0x855fffff]
[ 3398.323746] pci 0000:00:1d.0: BAR 2: assigned [mem 0x85600000-0x8560ffff 64bit pref]
[ 3398.331139] xocl 0000:00:1d.0: xocl_register_subdev: creating subdev rom.u
[ 3398.339112] rom.u rom.u.232: feature_rom_probe: Found AWS VU9P Device without featureROM
[ 3398.346390] rom.u rom.u.232: feature_rom_probe: Enabling AWS dynamic 5.0 DSA
[ 3398.354899] rom.u rom.u.232: feature_rom_probe: ROM magic : [ 3398.361195] rom.u rom.u.232: feature_rom_probe: VBNV: 
[ 3398.366632] rom.u rom.u.232: feature_rom_probe: DDR channel count : 0
[ 3398.372997] rom.u rom.u.232: feature_rom_probe: DDR channel size: 0 GB
[ 3398.379334] rom.u rom.u.232: feature_rom_probe: Major Version: 0
[ 3398.385246] rom.u rom.u.232: feature_rom_probe: Minor Version: 0
[ 3398.391019] rom.u rom.u.232: feature_rom_probe: IPBuildID: 0
[ 3398.396471] rom.u rom.u.232: feature_rom_probe: TimeSinceEpoch: 0
[ 3398.403138] rom.u rom.u.232: feature_rom_probe: FeatureBitMap: 0
[ 3398.408976] xocl 0000:00:1d.0: xocl_subdev_create_one: Created subdev rom.u
[ 3398.415464] xocl 0000:00:1d.0: xocl_register_subdev: creating subdev dma.xdma.u
[ 3398.422197] xocl:xdma_device_open: xocl device 0000:00:1d.0, 0xffff9c9404529000.
[ 3398.429612] xocl:map_single_bar: map bar 0, len 33554432
[ 3398.434894] xocl:map_single_bar: map bar 1, len 2097152
[ 3398.440068] xocl:map_single_bar: BAR1 at 0x85400000 mapped at 0xffffa9ec4d400000, length=2097152(/2097152)
[ 3398.448626] xocl:map_single_bar: map bar 2, len 65536
[ 3398.453709] xocl:map_single_bar: BAR2 at 0x85600000 mapped at 0xffffa9ec4d1e0000, length=65536(/65536)
[ 3398.462061] xocl:map_bars: config bar 2, pos 1.
[ 3398.466705] xocl:map_single_bar: map bar 3, len 0
[ 3398.471555] xocl:map_single_bar: map bar 4, len 137438953472
[ 3398.475086] xocl:map_single_bar: map bar 5, len 0
[ 3398.478196] xocl:identify_bars: xdev 0xffff9c940452c000, bars 2, config at 1.
[ 3398.482267] xocl:identify_bars: 2 BARs: config 1, user 1, bypass -1.
[ 3398.491247] xocl:pci_keep_intx_enabled: 0000:00:1d.0: clear INTX_DISABLE, 0x406 -> 0x6.
[ 3398.495798] xocl:irq_msix_channel_setup: engine 0-H2C0-MM, irq#115.
[ 3398.499536] xocl:irq_msix_channel_setup: engine 0-H2C1-MM, irq#116.
[ 3398.503252] xocl:irq_msix_channel_setup: engine 0-H2C2-MM, irq#117.
[ 3398.506926] xocl:irq_msix_channel_setup: engine 0-H2C3-MM, irq#118.
[ 3398.510589] xocl:irq_msix_channel_setup: engine 0-C2H0-MM, irq#119.
[ 3398.514227] xocl:irq_msix_channel_setup: engine 0-C2H1-MM, irq#120.
[ 3398.517896] xocl:irq_msix_channel_setup: engine 0-C2H2-MM, irq#121.
[ 3398.521499] xocl:irq_msix_channel_setup: engine 0-C2H3-MM, irq#122.
[ 3398.525092] xocl:irq_msix_user_setup: 0-USR-0, IRQ#123 with 0xffff9c940452c1a8
[ 3398.529138] xocl:irq_msix_user_setup: 0-USR-1, IRQ#124 with 0xffff9c940452c1e0
[ 3398.533241] xocl:irq_msix_user_setup: 0-USR-2, IRQ#125 with 0xffff9c940452c218
[ 3398.537276] xocl:irq_msix_user_setup: 0-USR-3, IRQ#126 with 0xffff9c940452c250
[ 3398.541261] xocl:irq_msix_user_setup: 0-USR-4, IRQ#127 with 0xffff9c940452c288
[ 3398.545258] xocl:irq_msix_user_setup: 0-USR-5, IRQ#128 with 0xffff9c940452c2c0
[ 3398.549260] xocl:irq_msix_user_setup: 0-USR-6, IRQ#129 with 0xffff9c940452c2f8
[ 3398.553237] xocl:irq_msix_user_setup: 0-USR-7, IRQ#130 with 0xffff9c940452c330
[ 3398.557164] xocl:irq_msix_user_setup: 0-USR-8, IRQ#131 with 0xffff9c940452c368
[ 3398.561055] xocl:irq_msix_user_setup: 0-USR-9, IRQ#132 with 0xffff9c940452c3a0
[ 3398.564812] xocl:irq_msix_user_setup: 0-USR-10, IRQ#133 with 0xffff9c940452c3d8
[ 3398.568693] xocl:irq_msix_user_setup: 0-USR-11, IRQ#134 with 0xffff9c940452c410
[ 3398.572684] xocl:irq_msix_user_setup: 0-USR-12, IRQ#135 with 0xffff9c940452c448
[ 3398.576522] xocl:irq_msix_user_setup: 0-USR-13, IRQ#136 with 0xffff9c940452c480
[ 3398.580366] xocl:irq_msix_user_setup: 0-USR-14, IRQ#137 with 0xffff9c940452c4b8
[ 3398.584165] xocl:irq_msix_user_setup: 0-USR-15, IRQ#138 with 0xffff9c940452c4f0
[ 3398.589736] xocl 0000:00:1d.0: xocl_subdev_create_one: Created subdev dma.xdma.u
[ 3398.596997] xocl 0000:00:1d.0: xocl_register_subdev: creating subdev mb_scheduler.u
[ 3398.604696] xocl 0000:00:1d.0: exec_reset: exec_reset(1) cfg(0)
[ 3398.610829] [drm] command scheduler started
[ 3398.615280] xocl 0000:00:1d.0: xocl_subdev_create_one: Created subdev mb_scheduler.u
[ 3398.622874] xocl 0000:00:1d.0: xocl_register_subdev: creating subdev icap.u
[ 3398.629924] xocl 0000:00:1d.0: exec_stop: exec_stop(ffff9c9404528018)
[ 3398.635377] icap.u icap.u.232: icap_unlock_bitstream: proc 0 try to unlock bitstream 00000000-0000-0000-0000-000000000000, ref=0, err=0
[ 3398.647269] icap.u icap.u.232: icap_probe: successfully initialized FPGA IDCODE 0x0
[ 3398.654322] xocl 0000:00:1d.0: xocl_subdev_create_one: Created subdev icap.u
[ 3398.661258] xocl 0000:00:1d.0: xocl_p2p_mem_reserve: reserve p2p mem, bar 4, len 137438953472
[ 3400.036785] xocl 0000:00:1d.0: xocl_mb_connect: ch_state 0x0
[ 3400.041238] [drm] Initialized xocl 2.2.0 20200619 for 0000:00:1d.0 on minor 1
[ 3400.045615] [drm] creating scheduler client for pid(20569), ret: 0
[ 3400.051577] xocl 0000:00:1d.0: xocl_drvinst_open: OPEN 1
[ 3400.406260] icap.u icap.u.232: icap_read_from_peer: reading from peer
[ 3402.964234] xocl 0000:00:1d.0: xocl_read_axlf_helper: READ_AXLF IOCTL
[ 3402.973072] icap.u icap.u.232: icap_read_from_peer: reading from peer
[ 3402.981549] XOCL: VBNV and TimeStamps matched
[ 3402.987495] XOCL: Marker 5
[ 3402.991448] [drm] Finding MEM_TOPOLOGY section header
[ 3402.997017] [drm] Section MEM_TOPOLOGY details:
[ 3403.003002] [drm]   offset = 0xd10
[ 3403.005219] [drm]   size = 0xa8
[ 3403.009671] icap.u icap.u.232: icap_read_from_peer: reading from peer
[ 3403.017280] icap.u icap.u.232: get_axlf_section_hdr: trying to find section header for axlf section 8
[ 3403.027679] icap.u icap.u.232: get_axlf_section_hdr: saw section header: 0
[ 3403.035520] icap.u icap.u.232: get_axlf_section_hdr: saw section header: 2
[ 3403.043338] icap.u icap.u.232: get_axlf_section_hdr: saw section header: 6
[ 3403.050994] icap.u icap.u.232: get_axlf_section_hdr: saw section header: 7
[ 3403.058614] icap.u icap.u.232: get_axlf_section_hdr: saw section header: 8
[ 3403.066116] icap.u icap.u.232: get_axlf_section_hdr: header offset: 3528, size: 88
[ 3403.074223] icap.u icap.u.232: icap_parse_bitstream_axlf_section: icap_parse_bitstream_axlf_section kind 8, err: 0
[ 3403.080221] icap.u icap.u.232: get_axlf_section_hdr: trying to find section header for axlf section 6
[ 3403.085650] icap.u icap.u.232: get_axlf_section_hdr: saw section header: 0
[ 3403.089778] icap.u icap.u.232: get_axlf_section_hdr: saw section header: 2
[ 3403.093800] icap.u icap.u.232: get_axlf_section_hdr: saw section header: 6
[ 3403.098097] icap.u icap.u.232: get_axlf_section_hdr: header offset: 3344, size: 168
[ 3403.102558] icap.u icap.u.232: icap_parse_bitstream_axlf_section: icap_parse_bitstream_axlf_section kind 6, err: 0
[ 3403.110693] icap.u icap.u.232: get_axlf_section_hdr: trying to find section header for axlf section 7
[ 3403.117998] icap.u icap.u.232: get_axlf_section_hdr: saw section header: 0
[ 3403.123631] icap.u icap.u.232: get_axlf_section_hdr: saw section header: 2
[ 3403.129261] icap.u icap.u.232: get_axlf_section_hdr: saw section header: 6
[ 3403.134964] icap.u icap.u.232: get_axlf_section_hdr: saw section header: 7
[ 3403.140396] icap.u icap.u.232: get_axlf_section_hdr: header offset: 3512, size: 16
[ 3403.146569] icap.u icap.u.232: icap_parse_bitstream_axlf_section: icap_parse_bitstream_axlf_section kind 7, err: 0
[ 3403.154577] icap.u icap.u.232: get_axlf_section_hdr: trying to find section header for axlf section 9
[ 3403.161784] icap.u icap.u.232: get_axlf_section_hdr: saw section header: 0
[ 3403.167375] icap.u icap.u.232: get_axlf_section_hdr: saw section header: 2
[ 3403.173098] icap.u icap.u.232: get_axlf_section_hdr: saw section header: 6
[ 3403.178833] icap.u icap.u.232: get_axlf_section_hdr: saw section header: 7
[ 3403.184402] icap.u icap.u.232: get_axlf_section_hdr: saw section header: 8
[ 3403.190033] icap.u icap.u.232: get_axlf_section_hdr: saw section header: 11
[ 3403.195750] icap.u icap.u.232: get_axlf_section_hdr: could not find section header 9
[ 3403.202056] icap.u icap.u.232: icap_parse_bitstream_axlf_section: icap_parse_bitstream_axlf_section kind 9, err: -22
[ 3403.210203] icap.u icap.u.232: icap_download_bitstream_axlf: icap_download_bitstream_axlf err: 0
[ 3403.217154] icap.u icap.u.232: icap_read_from_peer: reading from peer
[ 3403.222530] xocl 0000:00:1d.0: xocl_init_mem: Topology count = 4, data_length = 160
[ 3403.228809] xocl 0000:00:1d.0: xocl_init_mem:   Memory Bank: bank0
[ 3403.233949] xocl 0000:00:1d.0: xocl_init_mem:   Base Address:0x0
[ 3403.238931] xocl 0000:00:1d.0: xocl_init_mem:   Size:0x400000000
[ 3403.243877] xocl 0000:00:1d.0: xocl_init_mem:   Type:1
[ 3403.248349] xocl 0000:00:1d.0: xocl_init_mem:   Used:1
[ 3403.252693] xocl 0000:00:1d.0: xocl_init_mem:   Memory Bank: bank1
[ 3403.257777] xocl 0000:00:1d.0: xocl_init_mem:   Base Address:0x400000000
[ 3403.263141] xocl 0000:00:1d.0: xocl_init_mem:   Size:0x400000000
[ 3403.268019] xocl 0000:00:1d.0: xocl_init_mem:   Type:1
[ 3403.272357] xocl 0000:00:1d.0: xocl_init_mem:   Used:0
[ 3403.276638] xocl 0000:00:1d.0: xocl_init_mem:   Memory Bank: bank2
[ 3403.281655] xocl 0000:00:1d.0: xocl_init_mem:   Base Address:0x800000000
[ 3403.286944] xocl 0000:00:1d.0: xocl_init_mem:   Size:0x400000000
[ 3403.291859] xocl 0000:00:1d.0: xocl_init_mem:   Type:1
[ 3403.296060] xocl 0000:00:1d.0: xocl_init_mem:   Used:0
[ 3403.300265] xocl 0000:00:1d.0: xocl_init_mem:   Memory Bank: bank3
[ 3403.305141] xocl 0000:00:1d.0: xocl_init_mem:   Base Address:0xc00000000
[ 3403.310379] xocl 0000:00:1d.0: xocl_init_mem:   Size:0x400000000
[ 3403.315186] xocl 0000:00:1d.0: xocl_init_mem:   Type:1
[ 3403.319418] xocl 0000:00:1d.0: xocl_init_mem:   Used:0
[ 3403.323620] xocl 0000:00:1d.0: xocl_init_mem: Allocating Memory Bank: bank0
[ 3403.329193] xocl 0000:00:1d.0: xocl_init_mem:   base_addr:0x0, total size:0x400000000
[ 3403.335262] xocl 0000:00:1d.0: xocl_init_mem: Found a new memory region
[ 3403.340550] xocl 0000:00:1d.0: xocl_init_mem: drm_mm_init called
[ 3403.345306] xocl 0000:00:1d.0: xocl_read_axlf_helper: Loaded xclbin 3d3ef3b1-32c5-4e39-8452-a80cd12b2853
[ 3403.352616] icap.u icap.u.232: icap_lock_bitstream: proc 20569 try to lock bitstream 3d3ef3b1-32c5-4e39-8452-a80cd12b2853, ref=1, err=1
[ 3403.362314] xocl 0000:00:1d.0: exec_stop: exec_stop(ffff9c9404528018)
[ 3403.367464] xocl 0000:00:1d.0: exec_reset: exec_reset(1) cfg(0)
[ 3403.372351] xocl 0000:00:1d.0: exec_reset: exec_reset resets
[ 3403.376947] xocl 0000:00:1d.0: exec_reset: exec->xclbin(00000000-0000-0000-0000-000000000000),xclbin(3d3ef3b1-32c5-4e39-8452-a80cd12b2853)
[ 3403.386938] xocl_mb_sche mb_scheduler.u.232: client_ioctl_ctx: CTX add(3d3ef3b1-32c5-4e39-8452-a80cd12b2853, pid 20569, cu_idx 0xffffffff) = 0, ctx=1
[ 3403.397771] xocl 0000:00:1d.0: exec_cfg_cmd: ert per feature rom = 0
[ 3403.402972] xocl 0000:00:1d.0: exec_cfg_cmd: dsa52 = 0
[ 3403.407165] xocl 0000:00:1d.0: cu_reset: configured cu(0) base@0x0 poll@0x0 control(0)
[ 3403.413389] xocl 0000:00:1d.0: exec_cfg_cmd: configuring penguin scheduler mode
[ 3403.419047] xocl 0000:00:1d.0: exec_cfg_cmd: scheduler config ert(0), dataflow(0), slots(16), cudma(1), cuisr(1), cdma(0), cus(1)
[ 3403.428765] xocl 0000:00:1d.0: exec_stop: exec_stop(ffff9c9404528018)
[ 3403.434175] icap.u icap.u.232: icap_unlock_bitstream: proc 20569 try to unlock bitstream 3d3ef3b1-32c5-4e39-8452-a80cd12b2853, ref=0, err=0
[ 3403.444710] xocl_mb_sche mb_scheduler.u.232: client_ioctl_ctx: CTX del(3d3ef3b1-32c5-4e39-8452-a80cd12b2853, pid 20569, cu_idx 0xffffffff) = 0, ctx=0
[ 3403.475437] icap.u icap.u.232: icap_lock_bitstream: proc 20569 try to lock bitstream 3d3ef3b1-32c5-4e39-8452-a80cd12b2853, ref=1, err=1
[ 3403.486009] xocl 0000:00:1d.0: exec_stop: exec_stop(ffff9c9404528018)
[ 3403.491585] xocl 0000:00:1d.0: exec_reset: exec_reset(1) cfg(1)
[ 3403.496729] xocl_mb_sche mb_scheduler.u.232: client_ioctl_ctx: CTX add(3d3ef3b1-32c5-4e39-8452-a80cd12b2853, pid 20569, cu_idx 0xffffffff) = 0, ctx=1
[ 3403.509603] xocl_mb_sche mb_scheduler.u.232: client_ioctl_ctx: CTX add(3d3ef3b1-32c5-4e39-8452-a80cd12b2853, pid 20569, cu_idx 0x0) = 0, ctx=2
[ 3433.130616] icap.u icap.u.232: icap_read_from_peer: reading from peer
[ 3433.136169] xocl_mb_sche mb_scheduler.u.232: client_ioctl_ctx: CTX del(3d3ef3b1-32c5-4e39-8452-a80cd12b2853, pid 20569, cu_idx 0x0) = 0, ctx=1
[ 3433.147262] xocl 0000:00:1d.0: exec_stop: exec_stop(ffff9c9404528018)
[ 3433.152977] icap.u icap.u.232: icap_unlock_bitstream: proc 20569 try to unlock bitstream 3d3ef3b1-32c5-4e39-8452-a80cd12b2853, ref=0, err=0
[ 3433.164236] xocl_mb_sche mb_scheduler.u.232: client_ioctl_ctx: CTX del(3d3ef3b1-32c5-4e39-8452-a80cd12b2853, pid 20569, cu_idx 0xffffffff) = 0, ctx=0
[ 3433.608052] [drm] client exits pid(20569)
[ 3433.612314] xocl 0000:00:1d.0: xocl_drvinst_close: CLOSE 2
[ 3433.619825] xocl 0000:00:1d.0: xocl_drvinst_close: NOTIFY ffff9c92c661a810
[ 3506.788922] [drm] creating scheduler client for pid(20603), ret: 0
[ 3506.793474] xocl 0000:00:1d.0: xocl_drvinst_open: OPEN 1
[ 3507.771236] icap.u icap.u.232: icap_read_from_peer: reading from peer
[ 3507.776052] [drm] client exits pid(20603)
[ 3507.779578] xocl 0000:00:1d.0: xocl_drvinst_close: CLOSE 2
[ 3507.783720] xocl 0000:00:1d.0: xocl_drvinst_close: NOTIFY ffff9c92c661a810

Edited by: AntonTaranov on Jul 24, 2020 1:38 AM