Is it true that we can get sick from the usual water we drink?

Yea that water is probably not very good for you. You need to get some sort of filter. You can get one for just your sink, you can get one for your whole house (but it's probably on the not so cheap side).