docs controlnet data prepare

okotaku · Nov 28, 2023 · d07780e · d07780e
1 parent 2888747
commit d07780e
Showing 1 changed file with 47 additions and 3 deletions.
diff --git a/docs/source/user_guides/dataset_prepare.md b/docs/source/user_guides/dataset_prepare.md
@@ -27,8 +27,10 @@ train_dataloader = dict(
     ...
     dataset=dict(
         ...
-        dataset='data/example',
-        image_column='file_name'
+        dataset="data/example",
+        image_column="file_name",
+        csv="metadata.csv",
+        ...
         )
     ...
 )
@@ -56,7 +58,49 @@ train_dataloader = dict(
     ...
     dataset=dict(
         ...
-        dataset='data/example',
+        dataset="data/example",
+        )
+    ...
+)
+```
+
+3. Run training.
+
+## ControlNet
+
+1. Prepare `metadata.csv` and images.
+
+The folder structure is
+
+```
+data/example
+├── images
+|   └──  color.jpg
+├── condition_images
+|   └──  color_keypoint.jpg
+└── metadata.csv
+```
+
+Example of `metadata.csv`.
+
+```
+file_name,conditioning_image,text
+images/color.jpg,condition_images/color_keypoint.jpg,"a dog"
+```
+
+2. Fix dataset config.
+
+```
+train_dataloader = dict(
+    ...
+    dataset=dict(
+        ...
+        dataset="data/example",
+        image_column="file_name",
+        condition_column="conditioning_image",
+        caption_column="text",
+        csv="metadata.csv",
+        ...
         )
     ...
 )