Blog

Charlie Mnemonic – Update 5: Introducing Chain-of-Thought and Integrated Recall System

October 16, 2024

We’re excited to announce the fifth major update to Charlie Mnemonic, your open-source AI assistant with Long-Term Memory. This release brings groundbreaking features, including Chain-of-Thought reasoning and an integrated Recall system that allows you to effortlessly search and reference past information displayed on your desktop, enhancing Charlie’s contextual understanding and response capabilities. Let’s dive into what’s new!

Chain-of-Thought Implementation

One of the most significant additions in this update is the Chain-of-Thought (CoT) Addon. This feature enhances Charlie’s reasoning capabilities by allowing it to break down complex problems into manageable steps. The CoT Addon provides step-by-step explanations, improving transparency and understanding in AI responses.

We’ve integrated expand/collapse functionality for CoT step messages, so you can focus on the big picture or dive into the details as needed. This ensures a seamless and intuitive user experience.

Integrated Recall System: Recall Addon and Charlie Recall App

Introducing our powerful new Recall System, a feature that allows you to search your desktop’s visual history. It combines the Recall Addon in Charlie Mnemonic with the standalone Charlie Recall App to create a seamless experience for capturing, analyzing, and recalling visual information from your desktop.

How It Works:

  • Capturing and Indexing: The Charlie Recall App takes periodic screenshots of your desktop. It then extracts text from these screenshots using GPT-4 and OCR and indexes it, making the content searchable.
  • Searching: You can search your visual history using keywords or phrases. This allows you to quickly find specific information that was displayed on your desktop, even if you don’t remember exactly when you saw it.

Recall Addon and Charlie

  • Integration with Charlie: The Recall Addon in Charlie Mnemonic integrates with the Charlie Recall App. It allows you to search your visual history directly from within a conversation with Charlie.
  • Using the Addon: Simply ask Charlie to search for something in your visual history, and it will use the Recall Addon to access the relevant screenshots and information from the Charlie Recall App. This enhances context and recall capabilities, allowing Charlie to provide more relevant and personalized responses.

User Interface and Experience Improvements

We’ve made significant enhancements to the user interface:

  • Refined Message Handling: Refactored key functions for better clarity and functionality, ensuring a smoother chat experience.
  • Dynamic Message Displays: Enhanced handling of step and chunk messages with specific displays, making it easier to follow along.
  • Expand/Collapse Functionality: Integrated options for CoT step messages, allowing you to control the level of detail you see.
  • New CSS Styles: Implemented new styles for an improved and modern look.

 

New Models and Future Updates

We’ve added new models like o1-mini and o1-preview to our system (not active yet). These additions prepare Charlie for future integrations that will expand its capabilities even further.

 

Looking Ahead

As always, this update is part of our ongoing commitment to make Charlie the best AI assistant possible. We’re continuously working on new features and improvements, driven by your valuable feedback.

 

Get Involved

We invite you to explore these new features and share your thoughts. Join our Discord community to connect with other users and our development team, or follow us on Twitter for the latest updates.

Thank you for being part of the Charlie Mnemonic journey. We can’t wait to see how you’ll use these new features to enhance your productivity and creativity. Here’s to many more exciting updates to come!

 

Changelog

Version 0.6.70 – October 2024

New Features

  • Chain-of-Thought Addon: Implemented chain_of_thought_addon.py for enhanced reasoning capabilities.
  • Integrated Recall System:
    • Recall Addon: Introduced search_visual_history.py to enable Charlie to communicate with the Charlie Recall App via API.
    • Charlie Recall App: A standalone application that captures and analyzes desktop screenshots, providing data to Charlie through the Recall Addon.
  • User Experience Enhancements:
    • Refactored message handling functions for clarity and functionality.
    • Added expand/collapse functionality for CoT step messages.
    • Implemented new CSS styles for an improved interface.
  • New Models Added: Included o1-mini and o1-preview models (not active yet) for future integration.

Bug Fixes and Improvements

  • Updated settings and configuration files for better development experience.
  • Enhanced the addons tab content to include new features.

Leave a comment

Join GoodAI

Are you keen on making a meaningful impact? Interested in joining the GoodAI team?

View open positions