Merge branch 'dygraph' into dyg_db

StyleText/README.md

@@ -22,7 +22,7 @@ English | [简体中文](README_ch.md)
 </div>
 
 
-The Style-Text data synthesis tool is a tool based on Baidu's self-developed text editing algorithm "Editing Text in the Wild" [https://arxiv.org/abs/1908.03047](https://arxiv.org/abs/1908.03047).
+The Style-Text data synthesis tool is a tool based on Baidu and HUST cooperation research work, "Editing Text in the Wild" [https://arxiv.org/abs/1908.03047](https://arxiv.org/abs/1908.03047).
 
 Different from the commonly used GAN-based data synthesis tools, the main framework of Style-Text includes:
 * (1) Text foreground style transfer module.
@@ -69,10 +69,15 @@ fusion_generator:
 1. You can run `tools/synth_image` and generate the demo image, which is saved in the current folder.
 
 ```python
-python3 -m tools.synth_image -c configs/config.yml --style_image examples/style_images/2.jpg --text_corpus PaddleOCR --language en
+python3 tools/synth_image.py -c configs/config.yml --style_image examples/style_images/2.jpg --text_corpus PaddleOCR --language en
 ```
 
-* Note: The language options is correspond to the corpus. Currently, the tool only supports English, Simplified Chinese and Korean.
+* Note 1: The language options is correspond to the corpus. Currently, the tool only supports English, Simplified Chinese and Korean.
+* Note 2: Synth-Text is mainly used to generate images for OCR recognition models.
+  So the height of style images should be around 32 pixels. Images in other sizes may behave poorly.
+* Note 3: You can modify `use_gpu` in `configs/config.yml` to determine whether to use GPU for prediction.
+
+
 
 For example, enter the following image and corpus `PaddleOCR`.
 
@@ -136,9 +141,21 @@ We provide a general dataset containing Chinese, English and Korean (50,000 imag
 2. You can run the following command to start synthesis task:
 
    ``` bash
-   python3 -m tools.synth_dataset.py -c configs/dataset_config.yml
+   python3 tools/synth_dataset.py -c configs/dataset_config.yml
    ```
 
+We also provide example corpus and images in `examples` folder.
+    <div align="center">
+        <img src="examples/style_images/1.jpg" width="300">
+        <img src="examples/style_images/2.jpg" width="300">
+    </div>
+If you run the code above directly, you will get example output data in `output_data` folder.
+You will get synthesis images and labels as below:
+   <div align="center">
+       <img src="doc/images/12.png" width="800">
+   </div>
+There will be some cache under the `label` folder. If the program exit unexpectedly, you can find cached labels there.
+When the program finish normally, you will find all the labels in `label.txt` which give the final results.
 
 <a name="Applications"></a>
 ### Applications

StyleText/README_ch.md

@@ -21,7 +21,7 @@
 </div>
 
 
-Style-Text数据合成工具是基于百度自研的文本编辑算法《Editing Text in the Wild》https://arxiv.org/abs/1908.03047
+Style-Text数据合成工具是基于百度和华科合作研发的文本编辑算法《Editing Text in the Wild》https://arxiv.org/abs/1908.03047
 
 不同于常用的基于GAN的数据合成工具，Style-Text主要框架包括：1.文本前景风格迁移模块 2.背景抽取模块 3.融合模块。经过这样三步，就可以迅速实现图像文本风格迁移。下图是一些该数据合成工具效果图。
 
@@ -61,9 +61,13 @@ fusion_generator:
 输入一张风格图和一段文字语料，运行tools/synth_image，合成单张图片，结果图像保存在当前目录下：
 
 ```python
-python3 -m tools.synth_image -c configs/config.yml --style_image examples/style_images/2.jpg --text_corpus PaddleOCR --language en
+python3 tools/synth_image.py -c configs/config.yml --style_image examples/style_images/2.jpg --text_corpus PaddleOCR --language en
 ```
-* 注意：语言选项和语料相对应，目前该工具只支持英文、简体中文和韩语。
+* 注1：语言选项和语料相对应，目前该工具只支持英文、简体中文和韩语。
+* 注2：Style-Text生成的数据主要应用于OCR识别场景。基于当前PaddleOCR识别模型的设计，我们主要支持高度在32左右的风格图像。
+  如果输入图像尺寸相差过多，效果可能不佳。
+* 注3：可以通过修改配置文件中的`use_gpu`(true或者false)参数来决定是否使用GPU进行预测。
+
 
 例如，输入如下图片和语料"PaddleOCR":
 
@@ -124,8 +128,21 @@ python3 -m tools.synth_image -c configs/config.yml --style_image examples/style_
 2. 运行`tools/synth_dataset`合成数据：
 
    ``` bash
-   python3 -m tools.synth_dataset -c configs/dataset_config.yml
+   python3 tools/synth_dataset.py -c configs/dataset_config.yml
    ```
+   我们在examples目录下提供了样例图片和语料。
+    <div align="center">
+        <img src="examples/style_images/1.jpg" width="300">
+        <img src="examples/style_images/2.jpg" width="300">
+    </div>
+
+   直接运行上述命令，可以在output_data中产生样例输出，包括图片和用于训练识别模型的标注文件：
+   <div align="center">
+       <img src="doc/images/12.png" width="800">
+   </div>
+
+   其中label目录下的标注文件为程序运行过程中产生的缓存，如果程序在中途异常终止，可以使用缓存的标注文件。
+   如果程序正常运行完毕，则会在output_data下生成label.txt，为最终的标注结果。
 
 <a name="应用案例"></a>
 ### 四、应用案例

StyleText/configs/dataset_config.yml

@@ -33,7 +33,7 @@ Predictor:
   - 0.5
   expand_result: false
   bg_generator:
-    pretrain: models/style_text_rec/bg_generator
+    pretrain: style_text_models/bg_generator
     module_name: bg_generator
     generator_type: BgGeneratorWithMask
     encode_dim: 64
@@ -43,7 +43,7 @@ Predictor:
     conv_block_dilation: true
     output_factor: 1.05
   text_generator:
-    pretrain: models/style_text_rec/text_generator
+    pretrain: style_text_models/text_generator
     module_name: text_generator
     generator_type: TextGenerator
     encode_dim: 64
@@ -52,7 +52,7 @@ Predictor:
     conv_block_dropout: false
     conv_block_dilation: true
   fusion_generator:
-    pretrain: models/style_text_rec/fusion_generator
+    pretrain: style_text_models/fusion_generator
     module_name: fusion_generator
     generator_type: FusionGeneratorSimple
     encode_dim: 64

StyleText/engine/predictors.py

@@ -28,6 +28,7 @@ class StyleTextRecPredictor(object):
                              ], "Generator {} not supported.".format(algorithm)
         use_gpu = config["Global"]['use_gpu']
         check_gpu(use_gpu)
+        paddle.set_device('gpu' if use_gpu else 'cpu')
         self.logger = get_logger()
         self.generator = getattr(style_text_rec, algorithm)(config)
         self.height = config["Global"]["image_height"]

StyleText/examples/corpus/example.txt

@@ -1,2 +1,2 @@
-PaddleOCR
+Paddle
 飞桨文字识别

StyleText/tools/synth_dataset.py

@@ -11,6 +11,14 @@
 # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
 # See the License for the specific language governing permissions and
 # limitations under the License.
+
+import os
+import sys
+
+__dir__ = os.path.dirname(os.path.abspath(__file__))
+sys.path.append(__dir__)
+sys.path.append(os.path.abspath(os.path.join(__dir__, '..')))
+
 from engine.synthesisers import DatasetSynthesiser
 
 

StyleText/tools/synth_image.py

@@ -16,13 +16,13 @@ import cv2
 import sys
 import glob
 
-from utils.config import ArgsParser
-from engine.synthesisers import ImageSynthesiser
-
 __dir__ = os.path.dirname(os.path.abspath(__file__))
 sys.path.append(__dir__)
 sys.path.append(os.path.abspath(os.path.join(__dir__, '..')))
 
+from utils.config import ArgsParser
+from engine.synthesisers import ImageSynthesiser
+
 
 def synth_image():
     args = ArgsParser().parse_args()