Recently there's HN discussions on the topic of local AI/LLM being utilized by researchers from IEEE Spectrum magazine, probably worth a look up [1], [2].

[1] Local AI is driving the biggest change in laptops in decades (260 comments):

https://news.ycombinator.com/item?id=46360856

[2] Your Laptop Isn’t Ready for LLMs. That’s About to ChangeLocal AI is driving the biggest change in laptops in decades:

https://spectrum.ieee.org/ai-models-locally