Because the main criticism of this class of products is “why in the fuck would I need a device for this? my phone already has a data plan, a microphone, and a camera. Make it an app” and the response is some vague “oh well it’s so advanced (it’s not.) it couldn’t possibly run on a phone”.
The vision is that once TPUs become affordable enough to run these models on-device, you would need a device that has such a TPU and you would go to them. But this is completely overlooking the fact that all snapdragons and the like would also have the same TPUs integrated, and also we’re not there yet, so for as long as you need to send the query to openAI’s API, why is this not an app?
Because the main criticism of this class of products is “why in the fuck would I need a device for this? my phone already has a data plan, a microphone, and a camera. Make it an app” and the response is some vague “oh well it’s so advanced (it’s not.) it couldn’t possibly run on a phone”.
The vision is that once TPUs become affordable enough to run these models on-device, you would need a device that has such a TPU and you would go to them. But this is completely overlooking the fact that all snapdragons and the like would also have the same TPUs integrated, and also we’re not there yet, so for as long as you need to send the query to openAI’s API, why is this not an app?