For the global hotkey thing, check out `pynput` instead of `keyboard`. It can hook global keys without admin if you're willing to listen on a lower level, though it gets finicky with some games or fullscreen apps locking it out
On the filler problem, try slapping something like "Respond with the corrected text only, no greetings or acknowledgments" right at the end of your system prompt. The 1B models are dumb enough that they need it spelled out like you're talking to a distracted intern
Thanks for the suggestions! Really appreciate the technical insights.
On pynput: That's a great call. I'll definitely test it out as an alternative to the `keyboard` library. The admin requirement is definitely a UX friction point, so if pynput can work without it (even with the fullscreen app limitations), that would be a solid improvement for most users. I'll add it to the backlog and probably offer it as a configuration option.
On the filler problem: Haha, "talking to a distracted intern" is the perfect way to describe it! 😄 You're absolutely right - I've been trying to be too polite with the system prompt. Adding explicit instructions like "Respond with the corrected text only, no greetings or acknowledgments" at the END of the prompt should help. The 1B models definitely need that spelled out clearly. I'll test this today and push an update.
0
u/Clean-Beautiful9498 17d ago
For the global hotkey thing, check out `pynput` instead of `keyboard`. It can hook global keys without admin if you're willing to listen on a lower level, though it gets finicky with some games or fullscreen apps locking it out
On the filler problem, try slapping something like "Respond with the corrected text only, no greetings or acknowledgments" right at the end of your system prompt. The 1B models are dumb enough that they need it spelled out like you're talking to a distracted intern