How would they be able to take Bitcoin from the people when they don't even provide Bitcoin addresses to their users? Paypal users are not allowed to make Bitcoin deposits to their accounts.

Your worries would have some ground if Paypal would allow Bitcoin deposits to their Paypal wallets but not withdrawals, and would settle in fiat all Bitcoin-denominated transactions with partner merchants. For now, it seems there is no actual Bitcoin involved but mere IOUs.