Why does my boiled water taste funny?

Sounds like you need a new kettle. To be sure try boiling water in a cooking pot and see if you still have the same problem with the pot..