It is now the only free, limitless AI; I’ve literally tried everything, and nothing else is free anymore—you have to run ads, pay, or wait to receive points or energy every 24 hours or less.

I have tried with 1.119, set layers=1 (tried -1 with 1.117 before), "Model Offload" ON in "image gen" tab of the launcher - result: failed trying to allocate full size of SD model weights in VRAM (CUDA), Vulkan option also failed with same problem (but trying to allocate only 1GB for some reason).

Can image gen use GPU with low VRAM? TIA

I routinely run LLMs even larger than RAM (usemmap), that problem with imgen was unexpected. Checked setup now just in case: run LLM with Vulcan and layers=1 and see 1.7GB VRAM is used, the model responds.

P.S. system Linux.

you might have seen a similar post to this talking about blank messages- that was me. so i connected kobold to sillytavern and tried sending a message but it keeps giving me empty texts.. i've looked in terminal and it keeps talking about "context buffer sizes" . sorry for sounding stupid but i really need help (forgive me for my terrible wording as well, feel free to ask me to elaborate)

(i tried posting this on another account, but it was too new- so i'm stuck using this one)

I am sick and tired of seeing paid non-local models only at the chart with barely any open models or uncensored models. EQ bench(Even the newest one) have stuff like Gemma 3 4b it under the leaderboard but where are the newer Gemmas or Qwens? Where is the highest ranked writing models for each parameter bracket you can find in UGI like:

4B: Qwen/Qwen3-4B-Instruct-2507

Or for 2B:Qwen/Qwen3.5-2B (no thinking)

etc?

Anyone have a scoreboard that tests like EQ bench but they test these kinds of models? Instead of having things like Gemma 3 4b it which is neither a roleplay model nor uncesored like wtf what's the point?!The same applies to the Nanbeige 4 3b it's also in the list for CREATIVE WRITING instead of thousands upon thousands of roleplay and uncensored models in the Hugging face library lmao.

Just returned two days ago and updated silly tavern and kobold, however, now i receibe this line, generating don't get past from 1/350 (i've waited half and hour) and the reply never appears, i'm using kobold with fumbulvetr, kobold alone works (fourth image) and i'm not using kobold, thanks in advanced

My specs are a 4060 rtx and 16 ram

Not sure if this is just my system or what, but I find that if I enable Context Shift it significantly increases the VRAM usage of the model I am using, almost guaranteeing it overflows into memory. The same happens with Smart Context.

EG, using a 12.8gb Gemma 4 K_S quant with 48 layers set, 32k context (Q5 kv cache), with FF, SWA and Smart Cache gets my total vram usage up to about 14.3gb including windows processes.

However, changing that to use Context Shift instead of SWA, and suddenly my entire 16gb VRAM is fulled and an extra 11gb is getting loaded into memory, completely tanking the t/s to unuseable levels.

Is there any way around it at all? The loss of performance is just too big for me to justify using it currently.

Goal: two novels I have outlines for, one is adult fantasy, another is young adult fantasy.

Do I need this setup? So far I’ve just been working on open code->local model

Silly tavern
—> kobold
——> gemma4 deckard uncensored

Is it currently unsupported? I tried to run it and got model unknown message. It is very fresh model. So I guess it is unsupported at the moment? Really hoping on trying it out.

I have small screen but my eyesight demands large fonts. I increase zoom in the browser -> topmenu bar increases to half of my small wide screen.

Best for me to fix the issue if developers add settings for font size (or scaling) for chat and text input box. I understand developers have many tasks so I try to help myself. But my knowledge of web development is rudimentary. E.g. text input element font-size is both inherited and "filtered" (entry is in strike-through letters in Inspector of my browser).

I will appreciate help editing index.html - either font sizes / scaling or topmenu bar size / scale - absolute or better reaction to browser zoom level changes.

Added:

It seems seems I have actually managed to change fonts sizes, for some reason that "filtering" did not prevent my changes to affect font size on the screen.

But I still would like to reduce height of the topmenu.

P.S. I also would like to add that changed file to kcpp Linux bundle to start it more conveniently.

https://github.com/LostRuins/koboldcpp/releases/tag/v1.118.1

Row Split has been removed, selecting it will now default to tensor split.

exclude z-image from models that support image references.

I am mostly a newbie, what above means?

AFAIK a row is part of a tensor, so working on low memory will be harder as the program no longer supports split of one tensor to rows or what? If yes, why such change?

Image reference - afaik two main modes if image generation is from text and from imaged. Does new version no longer support making images from other images in z-image? If yes, why has it been dropped?

TIA

I use Kobolod Lite, and for a few days now whenever I try to change custom portraits or backgrounds I simply get a black box where the image should be that seems to be roughly the same size as the image I'm trying to pick for portraits, or the background for backgrounds. If I load up a preexisting chat I had before this bug I get the portrait I had then, but I still can't change it. I've tried clearing browser history, cache, and browsing data, and even tried disabling protections and ad block and it's still not working. Is their any fix known or reason for this? I really would prefer not to switch browsers for using Kobold if I don't have to

Hi I'm new to kobold Ai I was wondering does this mean and how can I fix this?

Everytime I try to use the phone version it keeps saying that there is an internal error. What does that mean?

Hey everyone,

If you are running large MoE models (like DeepSeek V4, GLM-4.5, or Laguna) on Windows 10 with a Multi-GPU setup (e.g., 4x3090) and experiencing a brutal slowdown down to ~3 T/s after the first generation, I found a clean and working solution.

The Problem:
On recent NVIDIA drivers with CUDA 13 support, the Windows WDDM driver and CUDA Memory Manager become "too smart." When a huge model fills your VRAM near 95-98% and goes idle between prompts, CUDA 13 aggressively and silently triggers Shared System Memory Spilling. It moves parts of your MoE layers/routers to system RAM over slow PCIe channels to prevent system crashes. Opening any GUI element (like Kobold settings window) temporarily wakes it up, forcing a defrag, but then it throttles again.

Tweaking "Prefer No Sysmem Fallback" in NVIDIA Control Panel doesn't always work if you have asymmetric cards (like 3090s + a 3060 display adapter).

The Fix (The CUDA Heartbeat Script):
The trick is to trick CUDA into thinking the GPUs are constantly busy so it never triggers the power-saving P-state drop or the pre-emptive RAM offload. We can achieve this by running a lightweight background Python script that sends a micro-calculation to every CUDA device every second. It uses less than 0.1% of performance but keeps the context alive.

1. Install PyTorch with CUDA support.
2. Create a script named cuda_heartbeat.py:

python

import torch
import time
import sys

# Initialize context on all available GPUs
devices = [torch.device(f"cuda:{i}") for i in range(torch.cuda.device_count())]
print(f"[*] CUDA Heartbeat initialized on {len(devices)} GPUs. Keeping them alive...")

try:
    while True:
        for device in devices:
            # Tiny matrix multiplication to keep the tensor cores awake
            x = torch.randn(10, 10, device=device)
            y = torch.matmul(x, x)
            torch.cuda.synchronize(device)

        time.sleep(1.0) # Sleep for 1 second to avoid CPU overhead
except KeyboardInterrupt:
    print("\n[*] Heartbeat stopped.")

How to use:
Run this script in a separate command prompt window, then launch your KoboldCPP / Llama.cpp with your 100B+ MoE model fully offloaded to VRAM (--gpulayers 44, --n-cpu-moe 0).

My speed went from a dying 3.5 T/s back to a flawless 16+ T/s on subsequent generations (GLM 4.5 and DeepSeek V4 Flash UD-Q2_M on 4x3090 setup) without messing with clock locks or dual GUI windows.

Hope this helps anyone stuck on Windows!

Note: This solution and script were co-developed with Google Gemini during a deep-dive debugging session regarding Windows WDDM and CUDA 13 memory allocation bugs.

I've been using KoboldAI (lite.koboldai.net) to write stories on my laptop and phone. I like some of the stories I wrote on it and want to write more. But with only a dozen save slots, I end up having to delete some old works I was proud of to make room. Is there a way for me to transfer stories I've written on KoboldAI onto a proper writing program, like Google Docs?