File tree 1 file changed +18
-2
lines changed
Filter options
1 file changed +18
-2
lines changed
Original file line number Diff line number Diff line change 1
1
# codefuseEval: 代码大语言模型的多任务评估基准
2
+ <div align =" center " >
3
+
4
+ <p >
5
+ <a href="https://github.com/codefuse-ai/codefuse-evaluation">
6
+ <img alt="stars" src="https://img.shields.io/github/stars/codefuse-ai/codefuse-evaluation?style=social" />
7
+ </a>
8
+ <a href="https://github.com/codefuse-ai/codefuse-evaluation">
9
+ <img alt="forks" src="https://img.shields.io/github/forks/codefuse-ai/codefuse-evaluation?style=social" />
10
+ </a>
11
+ <a href="https://github.com/codefuse-ai/codefuse-evaluation/issues">
12
+ <img alt="Open Issues" src="https://img.shields.io/github/issues-raw/codefuse-ai/codefuse-evaluation" />
13
+ </a>
14
+ </p >
15
+
16
+ ** 中文** ** |** [ English] ( README.md )
17
+
18
+ </div >
2
19
3
20
codefuseEval在HumanEval-x、MBPP的基准上,结合CodeFuse大模型多任务场景,开发的编程领域多任务的评测基准, 可用于评估模型在代码补全,自然语言生成代码,测试用例生成、跨语言代码翻译,中文指令生成代码等多类任务的性能。
4
21
14
31
bash codefuseEval/script/generation.sh CodeFuse-13B humaneval_python result/test.jsonl python
15
32
```
16
33
17
- 🌐 <a href =" README.md " target =" _blank " >English</a >
18
34
19
35
## 如何使用codefuseEval
20
36
@@ -121,4 +137,4 @@ bash codefuseEval/script/check_dataset.sh humaneval_rust
121
137
bash codefuseEval/script/check_dataset.sh humaneval_go
122
138
123
139
bash codefuseEval/script/check_dataset.sh humaneval_cpp
124
- ```
140
+ ```
You can’t perform that action at this time.
0 commit comments