Yes this has been so ever since Up Next was made available, if a show is no longer available in the store or available via a third party streaming service then it will not show in Up Next.
Unfortunately even if a show is available via a third party then Up Next will link to the third party rather than your library all the while it’s not available for purchase.
I had the same issue with the Constantine series as that’s not longer available in the UK Store.