Discuss Hwbot evaluation & new features in the Benchmarking Tools forum on Dev Hardware. Hwbot evaluation & new features Benchmarking Tools forum discussing benchmarks such as FutureMark's 3D Mark and PC Mark, SuperPi, Sisoft Sandra, Science Mark, CPU-Z and Memtest86. Learn tricks to raise your score, and compare your score to forum members'.
ASP Free and Iron Speed Designer are giving away $5,500+ in FREE licenses. Iron Speed's RAD CASE toolset can save up to 80% of your coding time. One free license per week, one perpetual license per month!
Receive the tools necessary to be the rock star of your field. Our 12-month program teaches you the evolving world of multi-channel marketing as well as the complex issues and opportunities found in the industry.
The ASP Free website provides in-depth information on the latest developer tools available from Microsoft. Our cadre of writers, highly experienced industry experts, reveals the best ways to use established technologies as well as new and emerging technologies. Our coverage of Microsoft's development and administration technologies is among the most respected in the IT industry today. .
Posts: 21
Time spent in forums: 6 h 13 m 18 sec
Reputation Power: 0
Hwbot evaluation & new features
Hi all,
I asume you guys are happy with the hwbots who maintain the rankings, as you're still using them. Some feedback would help me a lot to get a finished product though, so if there is anything that annoyes you, now is the time to spill your guts!
example requests to make the bot rankings easier:
- wizard for setting up a new bot (planned)
- mail notification to moderators when bot fails (planned)
- better faq (planned)
- ranking in first post customizable
- ...
For those who haven't kept an eye on hwbot development, these are some new feats implemented the past 2 months:
Community based benchmark charts
Quote:
Originally Posted by myself
Community based benchmark charts have the drawback of not being done in a controlled environment on 1 testsystem by 1 user, but once you get enough results in the deviation get's really small and the data gets equally as reliable imho. As all results get charted, a 'fake' result gets spotted quickly and can be removed from the db by one of our result moderators.
But, I see 2 huge benefits these community based benchmarks will have that charts made for a review will never be able to offer:
- overclockability. If a reviewer gets his hands on a cpu/gpu and can overclock it to xxx mhz, it means very little. I can be cherry picked, or a bad sample, or... While overclockability charts based on hundreds of submissions give you a very clear insight on the overclockability of the hw piece.
- 'live' charts. As the charts aren't the result of a handmade excel/calc sheet, but based on live data in the database, the charts will always be up to date, whether you visit them today or within a year.
What's your opinion on this? Do you think community based benchmark charts have a future, or do you think they will suffer too much from vandalism (cfr. wikipedia) to be reliable?
Posts: 3,512
Time spent in forums: 1 Month 3 Weeks 6 Days 19 h 4 m 24 sec
Reputation Power: 11311
For the rankings, I'd quite like a way to search for a name (probably usually your own) and see what rank they have... At the moment it's quite difficult to find anyone if they're out of the top 5.
Also, I think listing members of a team should also include a category of people who have submitted benchmarks in that forum, but aren't a member of hwbot. Right now the list is just of people who have signed up... (I'm talking about this list )
It's already very good though, beats ORB into the ground!
Posts: 21
Time spent in forums: 6 h 13 m 18 sec
Reputation Power: 0
Quote:
Originally Posted by Snod Blatter
For the rankings, I'd quite like a way to search for a name (probably usually your own) and see what rank they have... At the moment it's quite difficult to find anyone if they're out of the top 5.
If the member registered, you can also use the 'quick search' box on the left at hwbot.org.
Quote:
Originally Posted by Snod Blatter
Also, I think listing members of a team should also include a category of people who have submitted benchmarks in that forum, but aren't a member of hwbot. Right now the list is just of people who have signed up... (I'm talking about this list )
True, but I don't think I will ever change this, because:
a) registering has been made real easy, it takes 20sec max
b) it would be wrong to consider the nicknames as unique. User 'gamer' may be a whole other user on forum x as on forum y.
Quote:
Originally Posted by Snod Blatter
It's already very good though, beats ORB into the ground!
True, but I don't think I will ever change this, because:
a) registering has been made real easy, it takes 20sec max
b) it would be wrong to consider the nicknames as unique. User 'gamer' may be a whole other user on forum x as on forum y.
But for part b) the nicknames don't need to be unique, do they? As long as they posted in the forum, they could be listed...
I agree that signing up is easy, but there are a few people here already who haven't bothered to do so, from what I can see. mrps2man, jlewis_02 and ManaVampire have all posted results, but not signed up. Still, it's not a "problem" as such... I guess it's up to them.
EDIT: Oh, and a little more choice of Pentium 3's would be grand! Right now the only Celeron is "P3 Celeon 1GHz" or something... a bit limited. Not too important in todays world, though!
Last edited by Snod Blatter : August 9th, 2006 at 11:05 AM.
Posts: 5,872
Time spent in forums: 1 Month 2 Weeks 53 m 14 sec
Reputation Power: 12620
I've been very pleased so far with hwbot. It seems to be working perfectly as promised. Very cool. As for new features, I can't really think of anything off the top of my head. I'm pretty pleased as is.
__________________ Don't like me? Click it.
Scripting problems? Windows questions? Ask the Windows Guru!
Posts: 21
Time spent in forums: 6 h 13 m 18 sec
Reputation Power: 0
Quote:
Originally Posted by Snod Blatter
I didn't know about that
But for part b) the nicknames don't need to be unique, do they? As long as they posted in the forum, they could be listed...
I agree that signing up is easy, but there are a few people here already who haven't bothered to do so, from what I can see. mrps2man, jlewis_02 and ManaVampire have all posted results, but not signed up. Still, it's not a "problem" as such... I guess it's up to them.
As I see it that if you don't bother to register (which is the case for about 70% of the hwbot users), you probably don't care about getting hwbot awards either. Not that I blame them, I don't like registering either. : )
LOADING INFUSIONSOFTLOADING INFUSIONSOFT 1debug:overlay status: OFF overlay not displayed
overlay cookie defined: TI_CAMPAIGN_1012_D
OVERLAY COOKIE set:
status off
Del.icio.us
Digg
Google
Spurl
Blink
Furl
Simpy
Y! MyWeb
Some feedback would help me a lot to get a finished product though, so if there is anything that annoyes you, now is the time to spill your guts!
)
Linear Mode
