RL4LLM: 2. PPO Algorithm and Implementation Details
This blog post introduces RLHF-PPO algorithm with code implementation.
Large Language Model
RL4LLM: 1. A Brief Talk on DPO
This blog post notes my understanding of Direct Preference Optimization and the math derivation behind it.