Yes! Joulies are perfectly safe when used properly, and in fact make drinking coffee safer than usual by reducing the risk of burning your mouth. They sink in your coffee to keep them away from your lips, they won’t ever be hotter than 140°F when used properly (meaning they’ll never burn you.)
All the materials used in their construction are food-grade. They contain no plastic and are BPA free.