Direct Preference Optimization Beyond Chatbots