with some help of kernel dma people i got it solved
@TheHippo1555 can you try if it now works for you too (patch only applied to 5.18-main branch, but you can cherry-pick it to any other)? Still wonder why you have it in 5.15 where it works for me. If there any problems please attach full dmesg