You've already forked DataMate
6a1eb85e8e
* feature: 增加data-juicer算子 * feat: 支持运行data-juicer算子 * feat: 支持data-juicer任务下发 * feat: 支持data-juicer结果数据集归档 * feat: 支持data-juicer结果数据集归档
8 lines
169 B
Python
8 lines
169 B
Python
from . import data_juicer_wrapper, datamate_wrapper
|
|
|
|
WRAPPERS = {
|
|
"ray": data_juicer_wrapper,
|
|
"default": data_juicer_wrapper,
|
|
"datamate": datamate_wrapper
|
|
}
|