Can you use your router to serve DHCP? Some Linksys routers do that, I think.
Alternately, write up a hosts file on each computer, pointing to the network computers by IP and name.
I have all Linux computers, but the issue still exists. What I do is have my router interact with my ISP (enable NAT), it assigns IP addresses to my LAN (so they are essentially static, internally), and I just put a hosts file on each computer with pointers to my other computers.