Keeping that aside, I notice you have an admirer with ulterior motives. "He" claims to be a "she" and hopes to have both neutral tags as he enrols in campaigns. Mine will stay, he is hoping flattering you will equate to you removing the one from you

? No idea what this means, but we can chat privately if you need.
It is an interesting project, however if you are asking for the community to part with money to cover costs for a server that will be a tough proposition.
I agree with you. Adding a responsive search to this forum would uncover a lot of past corruption (from the administration and their staff) so I doubt the whales here will spend a single satoshi making information more available. As a moderator told me a few years ago about working for Theymos - "Ignorance is bliss". But since I've started looking into this I've found much better ways than using a GPU for parsing LLMs. JJ has proven he is talented (and I'm hoping Ninja gets involved as well) so I think they will be able to run a small search on standard shared hosting. It may take them more resources to train the model, but once trained/indexed it can be run easily on free resources from cloud providers. These frameworks include a token purchase/use construct, so the developers can make their money back that way for people using the search for non-casual uses. In other words, this will be a project for the community, and not another tool under admin control.
You'd need to train the model with updated information every few weeks to keep it ready with the latest information. For instance, what scam projects were flagged last week, if asked, the chatbot wouldn't have access to this information.
There is no reason the model cannot be updated in real time; think of the it as an index. The forum only gets a few posts a minute.