Look, I can tell she is physically attracted to me but I want more than that. Frankly, I don't like it at all. I'd prefer if I had to work for her admiration. I would hate to have a relationship with her just based on that... That's all I am really afraid of.
She wants to hang out with you. That's how people get to know whether more than just a physical attraction exists between them. Maybe you'll just gain a new friend. Maybe you'll develop a romantic relationship. Maybe you'll discover that you don't really have much in common and don't really enjoy each other's company that much.
You have a measure of control here. A relationship based purely on physical attraction can't happen without you letting it happen. She's interested in getting to know you. Maybe she'll come to admire you, maybe she won't. Stop getting ahead of yourself and go hang out with her. Suggest an alternative venue if you feel extremely uncomfortable about hanging out at her house.
Take some risks. Feel the fear and do it anyway.