Is it oka to give my puppy ice cubes ?

i figured since my dog doesnt always drink water i started giving him ice cubes and he licks it and likes to play with it is it good for his teeth he still has baby teeth just the front bottom teeth are new. tell me please