Take a Kong and duct tape over the small hole.  Invert in a measuring glass and fill with water.   Freeze overnight and give to puppy (in crate!) in the morning. 

With teething pups, I always keep a smorgasbord!  Each time their teeth itch, I offer delectable treats; stuffed frozen Kongs, marrow bones, Goody Ships, Vermont chew toys, Hercules Galileo bones, saturated twisted cloths frozen with chicken bouillon, etc.  The puppy gets to pick every time they need to chew.  The adventure of choosing what to chew and the constant variety seems to hold their interest.  I also give them that treat in their crate so they get used to chewing the crate - a big plus for pups and their sharp itchy teeth!  Once they've made their choice, the other ones go away until the teeth start itching again!

Take a washcloth and soak it in chicken bouillon.  Twist it up and freeze it.  Once frozen, give it to the puppy in its crate.