u/svdasein

Unconditionally enabled memory tools?

I'm running 0.10.2 and I'm running into this thing that's really messing me up: it seems to be presenting a list of tools to every single session and with every prompt such that models see:

  • search_notes / view_note / write_note / replace_note_content — for working with saved notes
  • search_knowledge_files / query_knowledge_files / grep_knowledge_files — for searching knowledge bases
  • search_chats / view_chat — for searching previous chat conversations
  • search_calendar_events / create_calendar_event / update_calendar_event / delete_calendar_event — for calendar stuff
  • list_knowledge_bases / search_knowledge_bases / query_knowledge_bases — for listing/searching KBs

The problem is that models seem to feel compelled to actually call at least some of these functions nearly all the time. So lots more tokens with absolutely no benefit.

e.g. I start a conversation about some novel thing I've never engaged a model about before and it immediately starts searching everything I've got (with absolutely zero chance of any relevant data being there)

It used to be the case that you could manually enable memory tools on an as needed basis. Now, it seems, they're enabled by default and you can't disable them? I'm thinking I need to revert. Am I missing something?

reddit.com
u/svdasein — 1 day ago

Upgrade from 2.2 -> 2.4.1 - A1 flow calibration gone?

I just upgraded from 2.2 to 2.4.1 (appimage). I'm finding I can't figure out what's happened to flow calibration. Prior to the upgrade before each print I had the option to check "Flow Calibration" but that options is no longer visible. I've searched all over trying to find an explanation for this but have found nothing. Anyone know what happened? I'm thinking I need to revert to 2.2 cuz print results are not very good now.

reddit.com
u/svdasein — 6 days ago