Everything about generating datasets and updating LoRA
Creating Character LoRAs manually
Creating a Character LORA Dataset Using Flux Dev
Objective
This SOP outlines the steps to create a character LORA dataset using the Flux Dave model, ensuring high-quality images and effective training for character consistency.
Key Steps:
1. Understanding LORA
LORA stands for Low Rank Adaptation, used to create a small dataset for LLMs. It helps in understanding and evaluating specific information to achieve desired results. 2. Preparing Character Dataset
Navigate to Models and Trainings in Leonardo. Access your created datasets to view existing characters. 3. Image Quality Check
Ensure images are free from noise (e.g., grainy images should be removed). Keep backgrounds as plain as possible for better results. 4. Creating Character Images
Choose a character (e.g., Amelia) and select the Flux Dave model. Download the generated image to use for the LORA dataset. 5. Using ChatGPT for Image Generation
Use ChatGPT to generate a list of images in a specific style. Provide a prompt that includes: Style specifications (e.g., cinematic, photorealistic) Aspect ratio and variety of shots. 6. Generating Images
Run the prompt in ChatGPT to receive a list of 50 shots. Approve each shot and generate images accordingly. 7. Uploading Images to Leonardo
Go to Leonardo, select Models and Trainings, then Datasets. Choose 'Train New Model' and select 'Character'. Name the dataset and upload the generated images. 8. Starting Training
After uploading, click 'Start Training'. Ensure the base model is set to Flux Dave. 9. Using Trigger Words for Generation
Use a trigger word (e.g., alfred_tdmb) to generate images with specific character attributes. 10. Reviewing Generated Images
Assess the generated images for quality and relevance to the character. Note:
Always check for image noise and quality before uploading. Ensure backgrounds are plain to avoid distractions in the dataset. For Efficiency:
Use ChatGPT to quickly generate a variety of shots and expressions. Organize images in a Google Drive for easy access and management during the training process. Keep a consistent naming convention for datasets to avoid confusion.