No problem stopping your swing on the way up or down.
Problem if you stop, yet break something on the way up or down, that is, you break a root, weeds, or branch, or even knock down some leaves. It constitutes improving the area of your swing if I'm not mistaken. Then there is penalty.
So be careful with practice swings. It's the reason why pros step away when they take a practice swing.