Windy,
I have a clear rationale when I call it. Red is not shooting and green has shot. Red is avoiding contact, green is not coming off a parallel ride, red is clinching and not attacking, green has his down. It has to be more black and white than you describe or your are clearly putting the match in the officials hands not in the wrestlers. It has to be called both ways too. I don't buy "I just felt green was stalling."
By the way, you stop action when stalling is called on the top or offensive wrestler unless both wrestlers are on their feet.