Communications Suite:

     The Communications Suite also runs primarily in the background, and covers testing of Anti-Virus, encryption, web page rendering, as well as a little audio encoding. 

Communications Suite includes the following tests:

Communications 1

• Three simultaneous threads

• Data encryption: CNG AES CBC

• Data compression

• Web page rendering: graphics content, 1024x768, windowed

Communications 2

• Three simultaneous threads

• Web page rendering: open various news pages from IE 7 Favorites in separate tabs, close them one by one

• Data decryption: CNG AES CBC

• HDD: Windows Defender

Communications 3

• Windows Mail: Search

Communications 4

Productivity Suite:

     The Productivity Suite tests a lot of "random" loads, such as text editing, application loading, web rendering, and e-mail tasks.  This suite stresses CPU and Hard Drive. 

Productivity Suite includes the following tests:

Productivity 1

• Two simultaneous threads

• Text editing

• HDD: application loading

Productivity 2

• Two simultaneous threads

• Windows Contacts: search

• HDD: Windows Defender

Productivity 3

• HDD: Windows Vista start-up

Productivity 4

• Three simultaneous threads

• Windows Contacts: search

• Windows Mail: Run Message Rules

• Web page rendering: simultaneously open various pages from IE7 Favorites in separate tabs, close them one by one

HDD Suite:

     The HDD Suite focuses solely on what is typically the bottleneck in any given system: the hard drive.  The HDD Suite uses a variety of real world tests to emulate various tasks, such as virus scanning, application loading, importing files, and media editing.

HDD Suite includes the following tests:

HDD 1

• HDD: Windows Defender

HDD 2

• HDD: game HDD

HDD 3

• HDD: importing pictures

HDD 4

• HDD: Windows Vista start-up

HDD 5

• HDD: video editing

HDD 6

• HDD: Media Center

HDD 7

• HDD: Adding music to Windows Media Player

HDD 8

• HDD: application loading

Results:

     The test system includes the following:

     The test suite was run after a hard drive defrag, with all running processes disabled, and after a fresh reboot.  The following score is the highest out of three runs.  The scores from the three runs ranged from 6565 to 6658, a delta of less than 100 points. 

     This same system scores 11166 in PCMark05, take that as you will, though in all reality, I do not feel that the old PCMark scores will be a very good comparison for the new PCMark, as the test methodologies are very different.  Under the Detailed Results are the numbers that give credence in scores,  typically measured in throughput or iterations per second depending on the test. 

     The above graph shows what kind of CPU usage Vantage is capable of applying.  Some of the tests are two threads only, while others can fully utilize an overclocked quad core processor. 

Conclusion:

     Futuremark's testing philosophy has always been an interesting one.  The idea that you can assign some kind of calculated number to measure a systems relative performance has always been the subject of intense debate.  In order to have the most fair rating system, the method of determining this number must be perfectly fair.   Of course, this is impossible, because each user has a different definition of an ideal system.  So, in response, PCMark Vantage separates all the tests into different "User Scenarios", so that the end user can determine for themselves what suites are important and which ones are not.  Want to build an HTPC?  Then judge your system by the TV and Movies Suite.  How about a gaming rig?  Then go by the Gaming Suite. 

     Of course, the number that will be thrown around the web will be the PCMark Suite, as this is what is available in the free version, and represents the "well-rounded" score. 

     With any benchmark, the most important thing for the user is to know what the benchmark means, as well as what it doesn't mean.  By no means is any benchmark the be-all end-all authority as to which system is the right system for anyone, they are only a tool to arm the user with information. 

     So where does that place the new PCMark Vantage?  The strength of Futuremark's new baby is as an excellent test of overall system performance, as well a good way to tell if your system is good at certain tasks.   The fact that Vantage actually performs tasks like HD Video encoding with simultaneous playback shows exactly what to expect when you perform similar tasks yourself.  What it is not good at is comparing specific components against each other.   For this, it is still best to use specialized benchmarks that provide detailed empirical data, such as SuperPi, Sandra and Everest. 

     Overall, the new PCMark Vantage is a quality affordable tool worthy of any enthusiast's toolbox.

Note: Club Overclocker is now using a new rating system based on a score of 1 to 5.
Please go to our rating system page for more information.

Performance:	5 out of 5
Innovation:	5 out of 5
Quality:	5 out of 5
Stability:	5 out of 5
Aesthetics:	5 out of 5
Software/Drivers Pack:	N/A
Overclocking:	N/A
Value:	4 out of 5
Project Skill Level (5 being most difficult)	1 out of 5