Latest Updates

• Inferencer v1.3 with memory offloading
  

  Token entropy inspector improvements and a new memory offloading feature to allow for inferencing models larger than available memory.

  
  
• Inferencer v1.2 with token inspection
  

  Version 1.2 is now available for download on the Mac App Store. This update introduces major memory savings and improvements to the token inspector.

  
  
• Inferencer v1.1 with markdown rendering
  

  Version 1.1 is now available for download on the Mac App Store. This update introduces markdown rendering support, allowing messages to display tables, headings, and mathematical notation with proper formatting.

  
  
• Inferencer for macOS v1.0 now available
  

  Version 1.0 is now available for download on the Mac App Store. It’s been built with native code and in my testing it’s the fastest inferencer available on Mac, even with the added support for token inspection.