How to block ALL SSH traffic except one IP address

So I'm wondering how I go about blocking all SSH traffic except for one (my work IP) ip address? Right now I have it set to let traffic in after 45 seconds (which blocks most script kiddies) but a few still wait. I was wondering how I can either block a range of ip addresses or better yet, block all traffic except for a specific few IP addresses.

Thanks