Nope. Working in a 1080 timeline for 1080 delivery is perfectly fine.
If you are punching beyond 2x (for 4K sources), are you using SuperScale? It should look fine up to 3x.
If not, what's your source? If they are so-called "4K" from a sensor with 4K photosites and massive compression like H.264 or 265, don't expect miracles. Can you post an example?