본문으로 건너뛰기

About Now Projects Blog AI Curator

About Now Projects Blog AI Curator

Tag

decoding

1 posts tagged decoding.

All cpp unilink async-io architecture LLM api-design AI Curator backpressure boost-asio channel concurrency dependency-injection transformer zero-copy abstraction AI alignment astro attention base-model benchmarking buffer builder builder-pattern chat-model cmake communication concepts crtp deadlock debugging decoder decoding design-patterns diagnostics embedding encoder facade factory-pattern fine-tuning framer instruction-tuning latency logit loss markdown memory meta networking next-token-prediction observability open-source ownership packaging pimpl pretraining probability protocol queue realtime release RLHF runtime-stats sampling self-attention softmax stream sveltia tcp temperature testing token tokenizer top-k top-p transport vector vocabulary wrapper

Posts

2026.07.03Study
Decoding
확률 분포에서 token을 선택하는 greedy, sampling, temperature, top-k, top-p 전략 정리