Ostfriesentee

Are you still bright, BrightCandle?

deleted by creator

Same, a 35B model is running on my gaming rig. It’s good enough for most things, even coding.

Also note Apple’s, AMD’s and NVIDIA’s (Spark) unified memory solutions for local LLMs/agents. AMD advertises 300B and NVIDIA advertises 200B models running locally. The question is whether Anthropic/OpenAI are going to be relevant at all in the future, with local models becoming increasingly capable and affordable. However: There are rumors the Chinese government wants to restrict access to its models. Not set in stone and also not sure whether this is true. Could this entail no more access to new open-source models? Who knows. But even then, energy and resources are going to be a bottleneck. I have not looked into the concrete numbers and this is not my field of expertise, but I find it highly unlikely that they are going to be able to capture the entire market.

Teeth regrow trials are coming up. Probably gonna hit the market in the 2030s.

Isn’t that what Mistral is kinda pivoting towards? I think they now also host third-party models. That’s essentially providing cloud computing for open-source models. Not entirely sure.

I still do that and never did it any differently. Mainly to conserve energy, since my parental household was poor and we actually could not afford to leave appliances running when not in use. This became a habit and now I’ve been incidentally preventing data harvesting for years. I do need to get an old 90s alarm clock though, since I cannot always turn off my phone at night when I have plans in the morning. Also GrapheneOS.

Nor sure if it’s FOSS but HERE WeGo is pretty okay.

Thanks. Why sunday and thursday though?

What keywords are you using?

With continued optimization everyone is eventually gonna host their own LLM locally. Then OpenAI will be irrelevant. You can already host some flagship level LLMs with tools on your humble gaming rig with the right settings.

They still do random carthweels.

This can already be faked.