Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Appearance settings

Commit fa43793

Browse filesBrowse files
authored
Update README.md
1 parent c1afa54 commit fa43793
Copy full SHA for fa43793

File tree

Expand file treeCollapse file tree

1 file changed

+15
-3
lines changed
Filter options
Expand file treeCollapse file tree

1 file changed

+15
-3
lines changed

‎README.md

Copy file name to clipboardExpand all lines: README.md
+15-3Lines changed: 15 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -1,14 +1,26 @@
11
# CodeFuseEval: Multi-tasking Evaluation Benchmark for Code Large Language Model
2-
32
<p align="center">
43
<img src="https://github.com/codefuse-ai/MFTCoder/blob/main/assets/github-codefuse-logo-update.jpg" width="50%" />
54
</p>
5+
<div align="center">
6+
<p>
7+
<a href="README_CN.md" target="_blank">简体中文</a>
8+
</p>
9+
<p>
10+
<img src="https://img.shields.io/github/stars/codefuse-ai/codefuse-evaluation?style=social" alt="GitHub stars"/>
11+
<img src="https://img.shields.io/github/forks/codefuse-ai/codefuse-evaluation?style=social" alt="GitHub forks"/>
12+
<img src="https://img.shields.io/github/issues/codefuse-ai/codefuse-evaluation" alt="GitHub issues"/>
13+
</p>
14+
15+
</div>
16+
617
CodeFuseEval is a Code Generation benchmark that combines the multi-tasking scenarios of CodeFuse Model with the benchmarks of HumanEval-x and MBPP. This benchmark is designed to evaluate the performance of models in various multi-tasking tasks, including code completion, code generation from natural language, test case generation, cross-language code translation, and code generation from Chinese commands, among others.Continuously open, stay tuned !
718

19+
<p>
20+
<img src="./figures/EnglishIntroduction.png" alt="English Introduction"/>
21+
</p>
822

9-
🌐 <a href="README_CN.md" target="_blank">中文</a>
1023

11-
![img](./figures/EnglishIntroduction.png)
1224

1325
## Generation environment:
1426
CodeFuse-13B: Python 3.8 or above,PyTorch 1.12 or above, with a recommendation for 2.0 or above, Transformers 4.24.0 or above ,CUDA 11.4 or above (for GPU users and flash-attention users, this option should be considered).

0 commit comments

Comments
0 (0)
Morty Proxy This is a proxified and sanitized view of the page, visit original site.