请输入您要查询的百科知识:

 

词条 Standard Performance Evaluation Corporation
释义

  1. Structure

      The Open Systems Group (OSG)    The High-Performance Group (HPG)    The Graphics and Workstation Performance Group (GWPG)    SPEC Research Group (RG)  

  2. Membership

  3. Membership Levels

  4. SPEC Benchmark Suites

     Cloud   CPU    Handheld    Graphics and Workstation Performance    SPECwpc    SPECapc    High Performance Computing, OpenMP, MPI, OpenACC, OpenCL    OMP    Java Client/Server    JBB    jEnterprise    Mail Servers    Storage    Virtualization    Web Servers  

  5. SPEC Tools

  6. Benchmark Search Program

  7. Retired Benchmarks Have No Successor

  8. Retired Benchmarks No Longer Documented

  9. Portability

  10. Licensing

  11. Culture

  12. References

  13. External links

{{Redirect|SPEC}}{{multiple issues|{{advert|date=October 2016}}{{notability|Companies|date=October 2016}}{{self-published|date=October 2016}}{{technical|date=October 2016}}{{Refimprove|date=April 2011}}
}}{{Infobox organization
| name = Standard Performance Evaluation Corporation
| image = SPEC-logo_reg.png
| image_border =
| size =
| caption =
| abbreviation =
| formation = 1988
| type = Non-profit corporation
| status =
| purpose =
| headquarters = Gainesville, Virginia
| location =
| membership = Hardware & Software Vendors, Universities, Research Centers
| language =
| leader_title =
| leader_name =
| main_organ =
| num_staff = 5
| num_volunteers =
| website = {{URL|www.spec.org}}
}}

The Standard Performance Evaluation Corporation (SPEC) is an American non-profit corporation that aims to "produce, establish, maintain and endorse a standardized set" of performance benchmarks for computers.[1]

SPEC was founded in 1988.[2][3] SPEC benchmarks are widely used to evaluate the performance of computer systems; the test results are published on the SPEC website.

SPEC evolved into an umbrella organization encompassing four diverse groups; Graphics and Workstation Performance Group (GWPG), the High Performance Group (HPG), the Open Systems Group (OSG) and the newest, the Research Group (RG).

Structure

The Open Systems Group (OSG)

The High-Performance Group (HPG)

The Graphics and Workstation Performance Group (GWPG)

SPEC Research Group (RG)

Membership

Membership in SPEC is open to any interested company or entity that is willing to commit to SPEC's standards. It allows:

  • Participation in benchmark development
  • Participation in review of results
  • Complimentary software based on group participation

The list of members is available on SPEC's membership page; .

Membership Levels

  • Sustaining Membership requires dues payment and typically includes hardware or software companies.
  • SPEC "Associates" pay a reduced fee and typically include Universities.
  • SPEC "Supporting Contributors" are invited to participate in development of a single benchmark, and do not pay fees.

SPEC Benchmark Suites

The benchmarks aim to test "real-life" situations. There are several benchmarks testing Java scenarios, from simple computation (SPECjbb) to a full system with Java EE, database, disk, and network (SPECjEnterprise).

The SPEC CPU suites test CPU performance by measuring the run time of several programs such as the compiler GCC, the chemistry program gamess, and the weather program WRF. The various tasks are equally weighted; no attempt is made to weight them based on their perceived importance. An overall score is based on a geometric mean.

Cloud

CPU

  • SPEC CPU2017
  • SPEC CPU2006
    • CINT2006 ("SPECint")
    • CFP2006 ("SPECfp")
  • SPEC CPU2000
  • SPEC CPU95
  • SPEC CPU92
Current SupportedHave been retired
Latest Will be retired

Measuring and comparing combined performance of CPU, memory and compiler.

  • SPEC CPU2006 contains two suites:
    • CINT2006 ("SPECint") - testing integer arithmetic, with programs such as compilers, interpreters, word processors, chess programs etc.
    • CFP2006 ("SPECfp") - testing floating point performance, with physical simulations, 3D graphics, image processing, computational chemistry etc.
  • SPEC CPU 2017 package contains four suites.
    • The SPECspeed 2017 Integer and SPECspeed 2017 Floating Point suites are used for comparing time for a computer to complete single tasks.
    • The SPECrate 2017 Integer and SPECrate 2017 Floating Point suites measure the throughput or work per unit of time.

Handheld

Graphics and Workstation Performance

Measuring performance of an OpenGL 3D graphics system, tested with various rendering tasks from several popluar 3D-intensive real applications on a given system.

Benchmark Suite Current Release Old Releases
SPECviewperf SPECviewperf 13 SPECviewperf 12 |SPECviewperf 11}}
SPECwpc SPECwpc v2.1
SPECapcSM
SPECapcSM for 3ds Max™ SPECapcSM for 3ds Max™ 2015 SPECapc for 3ds Max™ 2011}}
SPECapcSM for Maya SPECapcSM for Maya 2017 SPECapcSM for Maya 2012}}
SPECapcSM for PTC Creo SPECapcSM for PTC Creo 3.0 SPECapcSM for PTC Creo 2.0}}
SPECapcSM for Siemens NX SPECapcSM for Siemens NX 9.0 and 10.0 SPECapcSM for Siemens NX 8.5}}
SPECapcSM for SolidWorks SPECapcSM for SolidWorks 2017 SPECapcSM for SolidWorks 2013}}

SPECwpc

SPECapc

High Performance Computing, OpenMP, MPI, OpenACC, OpenCL

Benchmark Suites Current Supported Have been retired
HPC (none)
  • SPEC HPC2002
  • SPEC HPC96
OMP SPEC OMP2012}}
  • SPEC OMP2001 V3.2
MPI SPEC MPI2007}} (none)
ACCEL SPEC ACCEL}} (none)

OMP

The SPEC OMP (OpenMP) is the first one for evaluating performance based on OpenMP applications, for measuring the performance of SMP (Shared memory Multi-Processor, i.e. UMA) systems.

Java Client/Server

jAppServer jEnterprise SPECjEnterprise2010}} (none)
  • SPECjAppServer2004
  • SPECjAppServer2002
  • SPECjAppServer2001
JBB {{bulleted list |SPECjbb2015}} (none)
  • SPECjbb2013
  • SPECjbb2005
  • SPECjbb2000
JMS {{bulleted list |SPECjms2007}} (none) (none)
JVM {{bulleted list |SPECjvm2008}} (none)
  • SPECjvm98

JBB

evaluates the performance of server side Java by emulating a three-tier client/server system (with emphasis on the middle tier).

jEnterprise

A multi-tier benchmark for measuring the performance of Java 2 Enterprise Edition (J2EE) technology-based application servers.

Mail Servers

Current Supported Have been retired
(none)
  • SPECmail2009
  • SPECmail2008
  • SPECmail2001

Storage

Current Supported Have been retired
SPEC SFS 2014}}
  • SPECsfs2008
  • SPEC SFS97_R1 (3.0)
  • SPEC SFS97 (2.0)
  • SPEC SFS93 (LADDIS)

SPEC SFS is for measuring file server throughput and response time supporting both NFS and SMB protocol access.

Virtualization

  • SPECvirt_sc2013 ("SPECvirt")
  • SPEC virt_sc2010
Current Supported Have been retired

Web Servers

Current Supported Have been retired
(none)
  • SPECweb2009
  • SPECweb2005
  • SPECweb96
  • SPECweb99
  • SPECweb99_SSL

SPEC Tools

  • Server Efficiency Rating Tool (SERT). Intended to measure server efficiency, initially as part of the second generation of the US Environmental Protection Agency (EPA) ENERGY STAR for Computer Servers program.
  • PTDaemon. The SPEC PTDaemon software is used to control power analyzers in benchmarks which contain a power measurement component.

Benchmark Search Program

  • SPEC CPUv6, The CPU Search Program seeks to encourage those outside of SPEC to assist them in locating applications that could be used in the next CPU-intensive benchmark suite, currently designated as SPEC CPUv6. Obsoleted now.

Retired Benchmarks Have No Successor

  • SPEC SDM91
  • SPECsip_infrastructure2011 - the benchmark is still available for purchase but no additional result submissions are being accepted and support is no longer offered.

Retired Benchmarks No Longer Documented

  • SPECapcSM for Lightwave 3D 9.6, performance evaluation software for systems running NewTek LightWave 3D v9.6 software.
  • SPEC 2001
  • SPEC CPU89

Portability

SPEC benchmarks are written in a portable programming language (usually C, C#, Java or Fortran), and the interested parties may compile the code using whatever compiler they prefer for their platform, but may not change the code. Manufacturers have been known to optimize their compilers to improve performance of the various SPEC benchmarks. SPEC has rules that attempt to limit such optimizations.

Licensing

In order to use a benchmark, a license has to be purchased from SPEC; the costs vary from test to test with a typical range from several hundred to several thousand dollars. This pay-for-license model might seem to be in violation of the GPL as the benchmarks include software such as GCC that is licensed by the GPL. However, the GPL does not require software to be distributed for free, only that recipients be allowed to redistribute any GPLed software that they receive; the license agreement for SPEC specifically exempts items that are under "licenses that require free distribution", and the files themselves are placed in a separate part of the overall software package.

Culture

SPEC attempts to create an environment where arguments are settled by appeal to notions of technical credibility, representativeness, or the "level playing field". SPEC representatives are typically engineers with expertise in the areas being benchmarked. Benchmarks include "run rules", which describe the conditions of measurement and documentation requirements. Results that are published on SPEC's website undergo a peer review by members' performance engineers.

References

1. ^{{cite web|url=http://www.spec.org/spec/faq/#01SPEC.General.10whatis|accessdate=15 March 2010|title=SPEC Frequently Asked Questions}}
2. ^{{cite web|url=http://www.spec.org/spec/|accessdate=15 March 2010|title=The SPEC Organization}}
3. ^{{cite web|url=http://www.spec.org/spec/membership.html|accessdate=15 March 2010|title=SPEC Membership}}
  • {{Cite book |title=Introduction to Computer System Performance Evaluation |last=Kant |first=Krishna |year=1992 |publisher=McGraw-Hill Inc. |location=New York |isbn=0-07-033586-9 |pages=16–17}}

External links

  • {{Official website}}
  • Official List of SPEC Benchmarks
{{Use dmy dates|date=April 2011}}{{Benchmark}}

4 : Computer performance|Evaluation of computers|Companies established in 1988|Companies based in Virginia

随便看

 

开放百科全书收录14589846条英语、德语、日语等多语种百科知识,基本涵盖了大多数领域的百科知识,是一部内容自由、开放的电子版国际百科全书。

 

Copyright © 2023 OENC.NET All Rights Reserved
京ICP备2021023879号 更新时间:2024/9/21 21:41:28