This project combines speech recognition using the Whisper model and Sentis with LLM inference using LLMUnity and the Google Gemma2 2b model, all running on-device in Unity.
It's a great starting template for implementing on-device AI for any Unity project, please check the project link for more information.