QLoRA

mainstreamstable

A fine-tuning approach that combines a frozen quantized model with trainable low-rank adapters.

雷达信号

定义

QLoRA reduces adaptation memory by storing the frozen pretrained model in a low-bit representation and training LoRA adapters through it. The paper describes four-bit quantization and techniques for managing memory during training. QLoRA is a training method, not the name of one specific downloadable model.

来源

Research paper first submitted to arXiv on 2023-05-23.

语境

Relevant to fine-tuning under GPU memory constraints. Actual requirements depend on model size, sequence length, batch size, and the implementation. Catalog note: this is a source-verified reference entry, not a measured current-trend signal. No search-volume or growth claim is made.

来源

QLoRA: Efficient Finetuning of Quantized LLMs

Trend score: 0
First seen: 2023-05-23
Last seen: 2026-10-24

看今天的表

专业版打开当天的 prioritize / watch / skip 表，包括这里还不能公开的新名字。