You are partly correct. bitcoind is a "terminate and stay resident program". You communicate with it over a JSON-RPC socket to send payments/poll for received payments.