ProtocolLib Drops the Server TPS to Around 0.2-0.6

I've installed ProtocolLib on my 1.18.1 PaperMC server. I think the TPS lag is caused by ProtocolLib because if I uninstall it, the TPS goes back to normal. The log for my server is here: https://mclo.gs/WEPf2zg

The plugin also creates errors for other plugins. Also, the ProtocolLib I am currently trying to use is this one: https://www.spigotmc.org/resources/protocollib.1997/

There is another ProtocolLib that doesn't support any versions above 1.15. The other one is here: https://dev.bukkit.org/projects/protocollib

I have provided some screenshots here.

The server IP is One33Seven.aternos.me

Please let me know if there are any solutions WITHOUT deleting ProtocolLib.

Thanks.

Update: I just deleted ProtocolLib right now and the TPS is normal when I join.

I need ProtocolLib because I need to install a vanish plugin that requires it. But everytime I install ProtocolLib even without the vanish plugin, the TPS will drop to below 1.

I don't know which plugins are using ProtocolLib. I have over 15 plugins on the server right now. But if I disable ProtocolLib, the TPS is back to normal.