I've found an article on the forum that I was reading, when I was creating a wallet. Thats a huge leap forward.
It was stated there, that second index in derivation path for Bitcoin is (m/44'/0'/0'/0/0), and for Ethereum is 60 (m/44'/60'/0'/0/0).
I believed it was a common knowledge and changed it to 44, I'm pretty sure.
That still doesn't give me my wallet adress, I guess I changed smth in other indexes too. But much less to bruteforce now.