Best Practices

This section provides comprehensive guides, best practices, and resources for using LightRFT effectively.

Core Modules & Concepts

• LightRFT Models Design Document
  • Overview
  • Design Philosophy
  • Architecture Components
  • Implementation Details
  • Configuration and Customization
  • Error Handling and Robustness
  • Conclusion
• LightRFT Reward Model Training Best Practices Guide
  • Table of Contents
  • 1. Overview
  • 2. Reward Model Types
  • 3. Environment Preparation
  • 4. Model Training
  • 5. Model Evaluation
  • 6. FAQ
  • 7. Benchmarks & Performance
  • 8. Advanced Topics
  • 9. References
  • Contribution Guidelines
• Strategy Usage Guide
  • Overview
  • Core API Extensions
  • Creating a Strategy
  • Using Strategy in Trainers
  • Using Strategy in Experience Makers
  • Required Arguments
  • Strategy Implementation Details
  • Engine Sleep/Wake Mechanism
  • Configuration Examples
  • Best Practices
  • Advanced Features
  • Troubleshooting
  • API Reference

Design Philosophy

• LightRFT Strategy Design Philosophy
  • Overview
  • Core Design Principles
  • Architecture
  • Usage Patterns
  • Design Benefits
  • Best Practices
  • Conclusion
• Runtime Architecture and Resource Reuse
  • 1. Component responsibilities
  • 2. Native torchrun and SPMD
  • 3. Strategy selection and boundaries
  • 4. Actor, rollout policy, and Reference Model
  • 5. Colocated execution and memory lifecycle
  • 6. Weight synchronization
  • 7. End-to-end iteration
  • 8. Operational checks
  • 9. Source map

Other Resources

• Model Testing Guide
• Frequently Asked Questions (FAQ)
• Troubleshooting Guide
• Contributing to LightRFT