So I decided to try reflowing the ethernet phy to make sure that nothing is shorted.
After doing so the ethernet phy started replying to management commands 🙂
Altough I think that it might have shorted nRST and TX_EN together because the basic status register is always indicating jabber detection, and when i try to manually de-assert TX_EN the LAN8720A resets.
Another problem is that it will only detect a link if I set the switchport to 10Mbit.