If I understand your question correctly, you want to know if a token can have value without having gone through an ICO process or if it's the ICO that gives it it's value?
An ICO serves a couple of purposes for a project;
•It promotes the project
•It is a source of revenue for the developers
•It is also a means of getting investors in and circulating the supply.
An ICO is a way of marketing a product, you explain it's use case and how much you are selling it for (per token), this is the value it is launched with. Note that this price does not indicate how much it would be sold on an exchange.

If you own a functioning website you can create a utility token to be used on it without an ICO and give it a determined value. But if it gets listed on an exchange, investors may avoid such altcoins, as majority of the funds are held by the developers and so it can easily be manipulated.