I do believe if you restore from Icloud or factory reset you have to update the watch because it has to be re-paired.
As long as your WatchOS version is supported by your iOS version, you don't need to upgrade even if you unpair and re-pair the watch