Yo!... I have the same NV 3070 with 8 vram as you I guess (or similar), I have 32 ram thou.
I found it nearly impossible to make it to work with a resonable timelimit of generate a 5,3 sec vid, took forever, tried several ComfYI loadouts with same crap, so I switched to the WanGP (BeebBeep) interface instead wich is kind of an an easier/web-buid interface (this was just before Turbo/ 4 steps was released thou so I didnt tried it out within the ComfYI).... to summarize...
ComfYI is superior for use as a scaled shellbased interface (I use it alot in other AI,s) but if your hardware isnt the top of the line you need drop down a bit...
WanGP gives you an easier kind of way to generate vids (for my card NV3070) up to 10 sec without any problem (720p, about 17-25 min with Turbo, 4-steps, with 15 sec vids about 45-70 minutes), 1080 gets trickier and muuuuuuch longer generations so I dont even try.
You can use the most popular loras due to the regular updates as of (no Civit loras mentioned thou, but you can download and use them as well):
Just choose as you like.
Conclution, if your stuck within the ComfyUI, give WanGP a try, works fine for me and Iam happy considering my hardware
/AK5