Origin stuck on another viewport

My origin seems to be stuck on another viewport, so when I draw a line on my model, it repeats it on the viewport of the origin (which shows two lines as the origin viewport isn't aligned with the model viewport). Anyone know how to delete one viewport and not the whole thing?