| 词条 | Draft:Artifact Evaluation |
| 释义 |
Artifact Evaluation (or AE for short) is a process adopted by a number of academic conferences to reproduce experimental results from published articles.[1][2][3][4] Authors are usually invited to submit the supporting materials (code, data, models, experimental workflows, results) for their papers to the AE process. A special committee then assess how these artifacts support the work described in the papers. Camera-ready papers that successfully go through the AE process receive a set of approval badges[2] and include an Artifact Appendix.[5][6] Conferences and journalsMany leading computer systems and machine learning conferences and journals including PLDI, OOPSLA, PPoPP, SysML, TOMS and Supercomputinguse Artifact Evaluation to promote reproducibility of experimental results and encourage code and data sharing.[3][4] FormalizationThe ACM Task Force on Data, Software, and Reproducibility in Publication was set up in 2015 to formalize Artifact Evaluation[7]. It produced the ACM Artifact Review and Badging Policy now adopted by major computer science conferences and journals sponsored by ACM.[2] [4] References1. ^{{cite journal | first1=Bruce R. | last1=Childers | first2=Grigori | last2=Fursin | first3=Shriram | last3=Krishnamurthi | first4=Andreas | last4=Zeller | title=Artifact Evaluation for Publications (Dagstuhl Perspectives Workshop 15452) | journal=Dagstuhl Perspectives Workshop 15452 | volume=5 | issue=11 | pages=29–35 | doi=10.4230/DagRep.5.11.29 | date=2015 }} 2. ^1 2 {{citation |url=https://www.acm.org/publications/policies/artifact-review-badging |title=ACM Artifact Review and Badging Policy}} 3. ^1 {{citation |url=http://www.artifact-eval.org |title=Artifact evaluation for software conferences}} 4. ^1 2 {{citation |url=http://cTuning.org/ae |title=Artifact Evaluation for computer systems and machine learning conferences}} 5. ^{{citation |url=http://ctuning.org/ae/templates/ae-20180713.tex |title=Artifact Appendix Template}} 6. ^{{citation |url=https://dl.acm.org/citation.cfm?id=3126948 | title=Example of a paper PDF with a set of ACM artifact evaluation badges and an Artifact Appendix}} 7. ^{{citation |url=https://www.acm.org/publications/task-force-on-data-software-and-reproducibility |title=The ACM Task Force on Data, Software, and Reproducibility in Publication}} |
| 随便看 |
|
开放百科全书收录14589846条英语、德语、日语等多语种百科知识，基本涵盖了大多数领域的百科知识，是一部内容自由、开放的电子版国际百科全书。