AI Agent Development and Interview Guide: 09-Fine-Tuning, Post-Training and Inference Serving

1. technical system component

🔥 P0 High-Frequency Must-Know: technical system component？
technical system component、technical system component、technical system component RAG/Tool/Schema technical system component、technical system component Eval、technical system component。technical system component，technical system component。

2. SFT technical system component

Supervised Fine-Tuning（technical system component）technical system component—technical system component，technical system component。technical system component：

• technical system component；
• technical system component；
• technical system component；
• technical system component、technical system component；
• technical system component。

technical system component：

{
  "messages": [
    {"role": "system", "content": "technical system component，technical system component JSON。"},
    {"role": "user", "content": "technical system component"},
    {"role": "assistant", "content": "{\"category\":\"duplicate_charge\",\"priority\":\"high\"}"}
  ]
}

technical system component，technical system component、verification、technical system component。

3. technical system component

technical system component：

• technical system component；
• technical system component；
• technical system component；
• technical system component、technical system component；
• technical system component、technical system component；
• technical system component；
• technical system component/technical system component；
• technical system component。

technical system component

technical system component，technical system component。technical system component：

• technical system component；
• MinHash/SimHash technical system component；
• technical system component，technical system component Train/Test；
• technical system component。

🔥 P0 High-Frequency Must-Know: technical system component？
technical system component、technical system component，technical system component。technical system component、technical system component Group Split，technical system component。

4. LoRA technical system component

LoRA technical system component，technical system component，technical system component、technical system component，technical system component。

technical system component：

W' = W + ΔW
ΔW = B × A
rank(A, B) << dimension(W)

technical system component：

• r：technical system component；
• alpha：technical system component；
• target modules：technical system component；
• dropout；
• technical system component、Batch、Epoch；
• technical system component。

r technical system component，technical system component，technical system component。technical system component。

QLoRA

QLoRA technical system componentquantizationtechnical system component LoRA technical system component，technical system component。technical system componentquantizationtechnical system component、technical system component。

5. technical system component

technical system component API technical system component，technical system component，technical system component：

base_model: your-base-model
dataset_version: support-intent-v4
chat_template_version: model-default-v2

method: lora
lora:
  rank: 16
  alpha: 32
  dropout: 0.05
  target_modules: [q_proj, k_proj, v_proj, o_proj]

training:
  learning_rate: 0.0002
  epochs: 2
  max_sequence_length: 2048
  effective_batch_size: 64
  warmup_ratio: 0.03
  seed: 42

evaluation:
  dataset_version: support-hidden-test-v2
  metrics: [macro_f1, schema_pass_rate, safety_violation]

technical system component、Tokenizer、Chat Template、technical system component，technical system component。

6. DPO technical system component

Direct Preference Optimization technical system component：technical system component，technical system component。

{
  "prompt": "technical system component",
  "chosen": "technical system component，technical system component 3–5 technical system component……",
  "rejected": "technical system component，technical system component。"
}

technical system component：technical system component、technical system component、technical system component、technical system component、technical system component。technical system component：

• technical system component；
• technical system component；
• technical system component；
• technical system component；
• chosen/rejected technical system component，technical system component。

⭐ P1：SFT technical system component DPO technical system component？
SFT technical system component“technical system component”；DPO technical system component“technical system component”。technical system component SFT technical system component，technical system component。technical system component Eval technical system component。

7. RLHF / Agentic RL technical system component

RLHF technical system component、technical system component；Agentic RL technical system component、technical system component Agent technical system component。technical system component：

• technical system component；
• technical system component；
• technical system component；
• technical system component；
• technical system component。

technical system component Agent，technical system component、technical system component。technical system component“technical system component”。

8. technical system component

technical system component Loss。technical system component：

• technical system component；
• technical system component；
• Schema/technical system component；
• technical system component；
• technical system component；
• technical system component；
• technical system component、technical system component、technical system component；
• technical system component。

technical system component：

1. technical system component Test；
2. technical system component Regression；
3. technical system component/technical system component Test。

🔥 P0 High-Frequency Must-Know: technical system component Loss technical system component？
technical system component。technical system component、technical system component。technical system component、technical system component，technical system component、technical system component。

9. technical system component

• TTFT：technical system component Token technical system component；
• TPOT：technical system component Token technical system component；
• P50/P95/P99 technical system component；
• Tokens/s；
• concurrencytechnical system component；
• GPU technical system component；
• Batch technical system component；
• technical system component OOM；
• technical system component Token technical system component。

technical system component，technical system component。technical system component，technical system component。

10. KV Cache、Prefix Cache technical system componentquantization

KV Cache

technical system component Key/Value，technical system component Token technical system component。technical system componentconcurrencytechnical system component。

Prefix Cache

technical system component（technical system component Prompt、technical system component）technical system component。Prompt technical system component Tool technical system component。

quantization

technical system component，technical system component FP16/BF16 technical system component INT8/INT4，technical system component，technical system component/Kernel technical system component。technical system component。

🔥 P0 High-Frequency Must-Know: quantizationtechnical system component？
technical system component、technical system component；technical system component、technical system component/technical system component、technical system component。technical system component，technical system component。

11. technical system component

technical system component：

• technical system component；
• technical system component；
• technical system component；
• technical system component/technical system component；
• technical system component；
• technical system component；
• technical system component。

technical system component：

def select_model(task) -> str:
    if task.risk == "high":
        return "high-accuracy-model"
    if task.kind in {"classify", "extract"} and task.context_tokens < 4000:
        return "small-fast-model"
    if task.requires_vision:
        return "vision-model"
    return "balanced-model"

technical system component，technical system component“technical system component”；technical system component。

12. technical system component

technical system component：

base_model_version
adapter_version
quantization_version
tokenizer_version
chat_template_version
serving_engine_version
prompt_version
tool_schema_version

technical system component。technical system component。

13. technical system component

technical system component A：technical system component

technical system component，technical system component Prompt、RAG、Tool technical system component Fine-tuning。technical system component、technical system component、technical system component。

technical system component B：technical system component

technical system component 500 technical system component，technical system component Group Split。technical system component Macro-F1、technical system component、technical system component。

technical system component C：technical system component

technical system componentquantizationtechnical system component：P95、TTFT、technical system component、technical system component、technical system component。

14. technical system component

🔥 P0：LoRA technical system component？

technical system component，technical system component，technical system component。technical system component、technical system component KV technical system component，QLoRA technical system componentquantizationtechnical system component。

🔥 P0：technical system component？

technical system component、technical system component Epoch、technical system component/technical system component、technical system component、technical system component、technical system component。technical system component。

🔥 P0：technical system component？

technical system component；technical system component；technical system component/technical system component；technical system component；technical system component，technical system component。

⭐ P1：technical system component LoRA technical system component？

LoRA technical system component、technical system component、technical system component，technical system component；technical system component，technical system component/technical system component。technical system component。

⭐ P1：vLLM/TGI/SGLang technical system component？

technical system component、technical system component、KV Cache technical system component、concurrencytechnical system component、quantization/parallelismtechnical system component API technical system component。technical system component，technical system component、technical system component、technical system component、technical system component。

15. technical system component

• technical system component Prompt、RAG、Tool technical system component；
• technical system component SFT、LoRA/QLoRA、DPO technical system component RLHF technical system component；
• technical system component、technical system component；
• technical system component、technical system component；
• technical system component KV Cache、quantization、technical system component；
• technical system component。