Offline Chat: Private AI 1.02

Introducing Offline Chat, the innovative AI ChatBot that functions solely on your device without requiring an Internet connection. Its offline operation ensures data privacy and security, allowing for unrestricted usage in any location.

In addition to general inquiries, Offline Chat enables users to upload private documents for detailed queries on their content, making it a valuable tool for research involving sensitive materials. Currently, PDF and plain text files are supported.

Offline Chat offers three distinct models: Tiny, Small, and Medium. While larger models provide superior responses, they may require more powerful devices and operate at a slower pace. The "Tiny" model is compatible with nearly all devices, while "Small" necessitates iPhone 14 and 15 Pros, and "Medium" is optimized for Macs and high-end iPads.

Despite memory and processing constraints that prevent Offline Chat from achieving the capabilities of top-tier online models, it excels as an engaging and versatile tool. Ideal for fostering creativity and aiding in various tasks like writing, users are encouraged to independently verify facts due to the AI's limitations.

For those interested in the technical aspects, the "Tiny" model is constructed on Microsoft Phi 2 architecture, with "Small" and "Medium" models adopting Mistral 7B 0.2 architecture quantized to 3-bits and 4-bits respectively.