Comprehensive ATI Driver Review

Posts: 2723 · Posted: Wed May 05, 2004 6:46 pm Post subject: Comprehensive ATI Driver Review

Introduction:
We had many requests for a more comprehensive version of our first ATI driver review article, so we decided to more comprehensive testing. This time we have included nine different driver versions. We selected ATI's Catalyst versions 3.7, 3.8, 3.9, 4.1, 4.2, 4.3, and 4.4 along with Omega's 2.4.60 (based on the Catalyst 3.5 driver), 2.4.78a (based on the Catalyst 3.7 driver), 2.5.22 (based on the Catalyst 4.2 Driver), 2.5.30 (based on the Catalyst 4.3 driver), and 2.5.36b (based on the Catalyst 4.4 driver). Our benchmark selection this time around was also enhanced to include 3DMark2001 SE (build 330), 3DMark03 (build 340), AquaMark3, Codecreatures Benchmark Pro, and Gun Metal Benchmark 2 (version 1.20s). After completing the benchmark set, we did some simple game play testing in the Unreal Tournament 2004 Demo and Warcraft III: The Frozen Throne. We also had requests to set a restore point and revert to the restore point in between driver installs. This should clear up any concern that driver installations are affecting each other. We learned a lot from this test and have some solid information to share with you!

Update (June 7, 2004): We have posted a review of the new Catalyst 4.5, Catalyst 4.6 beta, Omega 4.5, and DNA 4.5 Drivers here.

Test System Specs (same as first ATI driver test):

Processor: AMD XP2700+ cooled with Thermaltake Volcano 11+
Memory: 512M DDR PC2700
Motherboard: MSI KT4V with onboard 10/100LAN + AC '97 Audio
Sound Card: Creative Labs Audigy 2 ZS
Power Supply: Antec 400 Watts "SL400"
Primary Monitor: Dell UltraSharp 1800FP 18" LCD
Secondary Monitor: Mag Innovision 986FS 19" CRT (disabled for these tests)
Speakers: Logitech 400Watt 4.1
Video Card: 128MB ATI Radeon 9800 AGP 8x by Sapphire Tech (Directx9.0b)
Hard Drive 1: Maxtor 60 GB w/2MB Cache (for Windows only)
Hard Drive 2: Seagate 160 GB w/8MB Cache (for everything else)
DVD-ROM: 16x
CD-RW: 52x24x52x
Operating System: Updated Windows XP Professional w/SP1

Method:
We did our best to select a logical, scientific approach to our benchmark test. We started by using the defrag program that is built into Windows XP Professional twice on both the C and D drive to make sure our drives were clean and in good order before continuing the experiment.

Next, we created a system restore point (visit http://www.microsoft.com/windowsxp/pro/using/howto/gethelp/systemrestore.asp for more information on system restore points).

Next we installed our first driver and ran the five benchmarks: 3DMark2001 SE, 3DMark03, AquaMark3, Code Creatures, and Gun Metal Benchmark 2 respectively. Then we reverted back to our system restore point and benchmarked the next driver. The drivers were tested in the following order: ATI's Catalyst version 3.7, 3.8, 3.9, 4.1, 4.2, 4.3, 4.4, Omega's 2.4.60 (based on the Catalyst 3.5 driver), 2.4.78a (based on the Catalyst 3.7 driver), 2.5.22 (based on the Catalyst 4.2 Driver), 2.5.30 (based on the Catalyst 4.3 driver), and finally the 2.5.36b (based on the Catalyst 4.4 driver). After completing the benchmark set, we did some simple game play testing in the Unreal Tournament 2004 Demo and Warcraft III: The Frozen Throne. After 12 straight hours of benchmarking and restoring, our screenshots were compiled and results were tabulated.
[page]
Benchmark Information:
3DMark2001 SE (build 330)
http://www.futuremark.com/

Settings

7 of 7 Game Tests
6 of 6 Theoretical Tests
4 of 4 Directx 8 Feature Tests
Demo Looping Disabled
Demo Sounds Disabled
Game Sound Effects Disabled
Game Music Disabled
Detail Level High
Resolution 1024x768x32 bit color, compressed textures
D3D Pure Hardware T&L (Textures and Lighting)
No Antialiasing

3DMark03 (build 340)
http://www.futuremark.com

Settings

All 4 Game Tests
2 of 2 CPU Tests
5 of 5 Feature Tests
3 of 3 Sound Tests
1024x768x32 bit color
No Pixel Processing
Optimal Texture Filtering
4 Max Anisotropy
Optimal Vertex Shaders
No Repeated Tests
No Fixed Framerates

AquaMark3
http://www.aquamark3.com

Settings

Default Settings Used
1024x768x32 bit color
No FSAA
4x Anisotropy
Very High Detail

Codecreatures Benchmark Pro (version 1.0.0)
http://downloads.guru3d.com/download.php?det=359

Settings

Official Benchmark
1280x1024 resolution
No Anti- Aliasing
Music Playback Disabled

Gun Metal BenchMark 2 (version 1.20s)
http://www.yetistudios.com/

Settings

Benchmark 1

[page]
Published Driver Information:
ATI Catalyst Version 3.5 Release Notes
http://www2.ati.com/drivers/Catalyst_35_Release_Notes.html

ATI Catalyst Version 3.7 Release Notes
http://www2.ati.com/drivers/Catalyst_37_Release_Notes.html

ATI Catalyst Version 3.8 Release Notes
http://www2.ati.com/drivers/Catalyst_38_Release_Notes.html

ATI Catalyst Version 3.9 Release Notes
http://www2.ati.com/drivers/Catalyst_39_Release_Notes.html

ATI Catalyst Version 4.1 Release Notes
http://www2.ati.com/drivers/Catalyst_41_Release_Notes.html

ATI Catalyst Version 4.2 Release Notes
http://www2.ati.com/drivers/Catalyst_42_Release_Notes.html

ATI Catalyst Version 4.3 Release Notes
http://www2.ati.com/drivers/Catalyst_43_Release_Notes.html

ATI Catalyst Version 4.4 Release Notes
http://www2.ati.com/drivers/Catalyst_44_Release_Notes.html

Omega 2.4.60 (based on Catalyst 3.5 drivers)
(publish information unavailable)

Omega 2.4.78a (based on Catalyst 3.7 drivers)
(publish information unavailable)

Omega 2.5.22 (based on Catalyst 4.2 drivers)
(publish information unavailable)

Omega 2.5.30 (based on Catalyst 4.3 drivers)
(publish information unavailable)

Omega 2.5.36b (based on Catalyst 4.4 drivers)
http://www.omegacorner.com
[page]
Benchmark Screenshots:
3DMark2001 SE (build 330)
ATI Catalyst 3.5

ATI Catalyst 3.7

ATI Catalyst 3.8

ATI Catalyst 3.9

ATI Catalyst 4.1

ATI Catalyst 4.2

ATI Catalyst 4.3

ATI Catalyst 4.4

Omega 2.4.60 (Based on the Catalyst 3.5)

Omega 2.4.78a (Based on the Catalyst 3.7)

Omega 2.5.22 (Based on the Catalyst 4.2)

Omega 2.5.30 (Based on the Catalyst 4.3)

Omega 2.5.36b (Based on the Catalyst 4.4)

[page]
3DMark03 (build 340)
ATI Catalyst 3.5

ATI Catalyst 3.7

ATI Catalyst 3.8

ATI Catalyst 3.9

ATI Catalyst 4.1

ATI Catalyst 4.2

ATI Catalyst 4.3

ATI Catalyst 4.4

Omega 2.4.60 (Based on the Catalyst 3.5)

Omega 2.4.78a (Based on the Catalyst 3.7)

Omega 2.5.22 (Based on the Catalyst 4.2)

Omega 2.5.30 (Based on the Catalyst 4.3)

Omega 2.5.36b (Based on the Catalyst 4.4)

[page]
Results:
A higher score is better for all benchmark applications.

Key
Blue = First place in the given benchmark.
Red = Second place in the given benchmark.
Gold = Third place in the given benchmark.
Pink = Warning! Low Performance!

Graphs:

Unfortunately, in many cases Codecreatures did not produce a significant performance difference.

Analysis:
The data and the graphs show that there are two drivers that stand out from the rest. ATI's Catalyst version 3.5 and Omega's driver version 2.5.36b (based on the Catalyst 4.4) are both in close contention for first place. However, while Omega's 2.5.36b took a solid first place in 3dMark03 and a slight first in AquaMark3, the Catalyst 3.5 had an astounding lead in both the 3dMark01 and Gun Metal Benchmark 2. It only performed slightly worse in both the 3DMark03 and Aquamark benchmark programs. Our results also showed that the Catalyst 4.4 was the poorest performing driver of the thirteen different tested drivers. Note that all of the drivers were able to run Unreal Tournament 2004 Demo and Warcraft III: The Frozen Throne simple game tests.

Conclusions:
If you're looking to increase your Directx 8 gaming performance, then the ATI Catalyst 3.5 is the best choice for your ATI driver. Omega's 2.5.36b (based on the Catalyst 4.4) ranks closely behind the Catalyst 3.5, and would make a good choice for people interested in the extra features available with Omega drivers (see www.omegacorner.com for more information about the added features). We reccomend staying away from the Catalyst 4.4 drivers if you primarily play Directx 8 or earlier based games due to their disappointing performance in both the 3dMark2001 SE and Gun Metal Benchmark 2 tests. However, if you currently play, or wish to play the latest Directx 9 based games, then the Catalyst 4.4 or the Omega 4.4 would be a good choice. The difference in performance most likely reflects ATI's shift in focus from Directx 8 to Directx 9 based applications.

Update (5/11/04): I have had multiple comments from people who have read the article. I thought it appropriate to make their comments public. The most common comment was the fact that although the Catalyst 3.5 Drivers benched the best, you are sacrificing some compatability with more recent games. If you find your game doesn't perform well on the Catalyst 3.5's (slow, or looks bad) you might want to switch up to the Omega 4.4's or Catalyst 4.4's for support for newer games (FarCry, etc).

Links:
www.ati.com for more information about ATI graphics cards and Catalyst drivers.
www.omegacorner.com for more information about the Omega drivers.
www.futuremark.com for the 3dMark2001 SE and 3dMark03 benchmarks.
www.aquamark3.com for the AquaMark3 benchmark.
http://downloads.guru3d.com/download.php?det=359 For the Codecreatures Benchmark Pro.
www.yetistudios.com for the Gun Metal Benchmark 2.