I know what it is and how it works, but my router implementation is poor. There is no option to setup the IP address myself. All I can do is select: Always use the same IP address
Then I would say get a new router. Honestly even a cheap $30 router by any of the major brands (Dlink, netgear, etc) will have solid DHCP reservation support these days. Just check the reviews on a networking site before you buy one to make sure it will do what you want it to do.
For example:

Grr.. bitcointalk's image proxy is broke.
Direct link:
http://i.minus.com/jZPw0b7bBMH99.png