Gold and Silver are pretty difficult instruments for the following reasons:
1. Affected by what happens in the Bond Markets.
2. Strength US Dollar Index
3. Strength of the DJI (and other indices).
They may appear to be correlated with one or more of the above but not a majority of the time.
There are several other factors too but I'm not doing a tutorial. Google is your friend.