http://easygpg2.i2p/egpgtechnical.html
If an attacker has a copy of your secret key, that attacker can use software to automate the search for the passphrase that unlocks it. Once the attacker has that passphrase, the attacker can impersonate you. Even the public keys you have imported reveal whom you may be communicating with.