Is it safe to switch a modpack for a different one?

Bit of a silly question it probably doesnt work, probably been asked before as well but thought it wont hurt to ask; so im running Better MC Fabric, and i was wondering if it was possible to keep the same world and switch modpacks, as opposed to using a vanilla world/vanilla backup. Its a minor thing but itd be cool to not lose my base if i ever wanted to switch modpacks. Of course this is assuming my "base" is made of vanilla materials or materials that are present in both modpacks .