Make it possible to use different AI providers

SergSinist

The idea arose that not everyone may find ChatGPT convenient or desirable; for instance, some might actually prefer Perplexity. Additionally, some users may be accustomed to LLaMa, Claude, Mistral AI, and others.Is it possible to create an option that allows users to choose other well-known AI assistants instead of ChatGPT when using Nothing headphones? Alternatively, could we utilize APIs for servers with various models?

Example:

One user choose Llama 3.0 and ask something in CMF Buds Pro, another user talk with Perplexity using Ear 2. Third talk with ChatGPT. And all these are happy

hrry

Great idea. What’s your favourite LLM?

I’d submit this as feedback either via Nothing Support or using your Nothing Phone. Settings > system > feedback

SergSinist

Most favourite is ChatGPT, but i like Perplexity for ask some questions. For self host - LLaMA (latest version 3.1)

Ujjawal_02

Actually it’s a rom side feature so manually doing so for system is not possible until nothing OS will do

SergSinist

Ujjawal_02 If it’s inside the phone, then it’s possible, but heavy models will be given to the device with a noticeable delay, and I haven’t seen small models yet. If you use a third-party server (or even give the opportunity to attach your own) or the official API from some providers, then the problem is well solved.

Although qualcomm once launched stable diffusion. I think LM is a bit lighter and doesn’t depend much on the GPU.