We're working on a release soon that puts a password on the JSON-RPC interface, but until then, avoid using the -server switch, and don't web browse on the same machine where bitcoind is running.
Update: The JSON-RPC HTTP authentication feature in 0.3.3 solves this problem.