Never head of the story or know the real reason as to why we wear silver, but I have heard a story of why silver and not gold.
The story goes that a Hmong man went to God and asked him for a symbol to represent his wealth. God instructed him to a road and told him to wait there. God told the man that along the road wil come gold, he is strike gold over the head and take it home with him. The catch is that gold is a rare commodity so he must be patient and for him to not doze of or he will miss gold. The Hmong man hid behind a rock and proceeded to wait for gold. The hours dragged on so he decided to rest his eyes for a second. As soon as he closed them, gold passed him by. All he saw was a gold streak. Gold got away but right behind it was silver so he hit silver over the head and brought it home. Nowadays, no matter how wealthy a Hmong person is, he does not represent his wealth with gold, but rather in silver.