Non-Serious Technology

As 9blb says, this is a networking issue. Considering both your Linux and Windows machines cannot print over LAN or WAN, you should start at the switch.

Does the printer's port config match that of the Linux and Windows machines? For simplicity, they need to all be on the same VLAN and be access. For accessing machines within the same network, don't worry about routing traffic to the firewalls or dumping it to the router, that introduces needless complexity on a home network.

If that is true, then check the printer's network settings. The subnet and IP range need to match that of the Linux and Windows machines, allowing access over the same VLAN. While here, also check for duplicate IPs. If the IP range or subnet is wrong, your traffic will either drop at the switch or get dumped to the router/firewall depending on how you set the routes. If you have duplicated IPs, your network is gonna be confused on where to send the packets and kill whichever route it deems to be an imposter.

If that's all matching and you're still getting nowhere, double check your Linux and Windows machines to ensure you have the proper driver's installed.