Working with binary in TCP/IP involves understanding how data, IP addresses, and subnet masks are represented in base-2 (0s and 1s). Binary knowledge is essential for IP addressing, subnetting, and routing, enabling precise network configuration and troubleshooting.