What is the white chalky thing on my walls?

It is called or referred to as efflorescence. Efflorescence is mineral deposits left behind when moisture dries and crystallizes. You should be able to clean it with a mixture of vinegar and water.