Privacy startup Duality says it has developed a private LLM inference framework that uses fully homomorphic encryption to let LLMs answer encrypted prompts (Rina Diane Caballar/IEEE Spectrum)

Rina Diane Caballar / IEEE Spectrum:
Privacy startup Duality says it has developed a private LLM inference framework that uses fully homomorphic encryption to let LLMs answer encrypted prompts  —  Fully homomorphic encryption lets LLMs answer encrypted prompts  —  Your chatbot might be leaky.