Jump to content


Photo

HowTo: Adding to the games database


  • Please log in to reply
36 replies to this topic

#16 skeezix

skeezix

    Mega GP Mania

  • GP Guru
  • 5088 posts
  • Gender:Male
  • Interests:Blog: http://www.rjmitchell.ca/~jeff/blog2009/

Posted 10 May 2003 - 09:34 PM

Just posted database 1.4; includes Cynix, and first 100 disks of SuperGAU; I'll take a look at A600's just posted SuperGAU (or when it comes into my inbox there) and see if theres any new CRCs for the first 100 -- you coudl both have simiale but different images, so might be good to have both to verify. I'll take disks 101-959 raw from A600.

Thanks; thats quite a pile.. how'd you do it all? :)

jeff

#17 A600

A600

    GP Mania

  • GP Guru
  • 366 posts

Posted 10 May 2003 - 10:10 PM

The link should work now :)

thats quite a pile.. how'd you do it all?


A mix of automatic (thanks to mighty Borland Delphi) and manual work :)

#18 skeezix

skeezix

    Mega GP Mania

  • GP Guru
  • 5088 posts
  • Gender:Male
  • Interests:Blog: http://www.rjmitchell.ca/~jeff/blog2009/

Posted 10 May 2003 - 11:35 PM

EVERYONE.. hold off on using my batch tool; I think Windows introduced a bug into the code. Stupid stupid windows :/

I'll check it though and report back, but mothers day will hold me up!

jeff

#19 skeezix

skeezix

    Mega GP Mania

  • GP Guru
  • 5088 posts
  • Gender:Male
  • Interests:Blog: http://www.rjmitchell.ca/~jeff/blog2009/

Posted 11 May 2003 - 03:48 AM

OKay, I rebuilt the CRC32 generator on my site; the old ones were screwy due to some bugs in Windows I found. The smallest little utility found some bughs. Howabout that?!

Damned annoying.

loic -- your GAU 1-100 -- I'll redo them, and the rest too, for you. KMy bug, I'll fix 'em. Also, I think I can script it.. I've got half the GAU disks downloaded. Once I get the other half, I can automate it, since I'll have them.

A600's GAU CRC32 are for the .ST versions; the Joe's versions are MSA.. so the two are complimentary, and not in collision. Will be good to have both.

Anyone else.. if you're using the old CRC32 from my site.. toss it, no good.. some of your numebrs will be bad :( Sorry about that. Stupid Windows :/

Jeff

Iv'e got submissions for Cunix (good), SuperGau (all, good, .ST version), Pompey (not sure yet, I'll check them), and SuperGAU 1-100 (bad, sadly, but I'll redo them)

#20 ldaneels

ldaneels

    GP32 Hardcore

  • GP32 Hardcore
  • PipPipPipPip
  • 128 posts

Posted 11 May 2003 - 03:58 AM

Hi,
I will start on the Medway Boys.
Should be done by monday.
Hopefully we will not have aduplicate this time :)

Loic

#21 skeezix

skeezix

    Mega GP Mania

  • GP Guru
  • 5088 posts
  • Gender:Male
  • Interests:Blog: http://www.rjmitchell.ca/~jeff/blog2009/

Posted 11 May 2003 - 02:17 PM

Wow, and got MEdway alreayd sent to me.. nice one ldaneels :)

Lets see.. I already had Flame of Finland...

Hmm. We're getting pretty complete :)

DBug has the games list already in the database, but no CRC32's. Anyone want to tackle them?

I'll post a new database tonight with all the changes and updates merged in. Should be quite spectacular, and I'll start on the by-game game listing mode.

jeff

#22 skeezix

skeezix

    Mega GP Mania

  • GP Guru
  • 5088 posts
  • Gender:Male
  • Interests:Blog: http://www.rjmitchell.ca/~jeff/blog2009/

Posted 11 May 2003 - 11:40 PM

Just uploaded version 1.6 of the games database. Wow, we've really come far fast!

Over the last few days, we've managed to add about 3000 entries to it or more :)

(approx 1000 super gau .ST, approx 1000 supergau .MSA, approx 1000 original disks, approx 112 Pompey, 8 Cynix, and what.. 50 or 80 Medway? Not to mention others I've forgotten :)

Take a look in the latest database for things like "::" which should locate disks and groups that have entries, but no CRCs. Also take a look for groups that are missing.. I think we've covered the major groups (like Automation, SuperGau, MEdway, DBug, etc), but theres a lot of smaller groups. Make sure we've filled in all the DBug, etc.

Maybe try CRC32'ing your own collection.. maybe we've got ST or MSA, and you've got the others so we could dobule up to make good and sure.

But I think this is a big success! Congrats all! Lots more to do, but we've come a very long way!

Grab 1.6 (or latest) here:

http://www.codejedi....wplan/gp32.html

jeff

#23 EvilDragon

EvilDragon

    There can't be enough evil in this world!

  • Admin
  • PipPipPipPipPipPip
  • 7819 posts
  • Location:Ingolstadt, Germany... somewhere near Munich

Posted 12 May 2003 - 01:16 AM

I have some problems with the database...
I just CRC32ed all my files (mostly single game disks), and gave proper names.
Trying the database, the Castaway correctly identified the images by their checksums, but spit
out a game name like "%§§$&§"

Here's a copy of the first lines of the database:

OR:1:1f6f315c:Buggy Boy
OR:1:bcfda601:Double Dragon
OR:1:4bd90ba:International Karate
OR:1:8bb66721:Klax
OR:1:ffad215b:Impossamole; E-Motion
OR:1:269d8e3d:Great Giana Sisters
OR:1:f975338c:Fire and Ice - Disk 1
OR:1:8db2b221:KULT
OR:1:ddbf2cd9:Arkanoid - Revenge of Doh
OR:1:c75a3bf:Nebulus; Mouse Trap

I copied ALL my files onto the SMC and tried the database line by line.
The first few entries were correct, but when I got to the Nebulus entry, Castaway told me
there was
Nebulus
Nebulus
Nebulus
on that disk... I don't know why.

Okay, I thought for myself, I'd just kill that faulty Nebulus-entry and everything worked fine.
But after deleting, also the first few lines, which were working correctly until that time, spit out unreadable
names... so I think it's something else.
Any ideas what this could be?
I'm using the latest Batch CRC32. And I'm always deleting the STCACHE1.TXT before trying again...

#24 stickofjoy

stickofjoy

    Mega GP Mania

  • GP32 Hardcore
  • PipPipPipPipPipPip
  • 542 posts

Posted 12 May 2003 - 09:01 AM

could it be something to do with the EOF? Perhaps you need an extra carriage return in there?

edit: I was also thinking about contacting Joe who runs the FTP site and asking him if he'd be interested in doing a btach CRC of all the discs on his server? All we'd have to dio then is collate. :ph34r:

http://www.freelists...ullthread4.html

matt

#25 skeezix

skeezix

    Mega GP Mania

  • GP Guru
  • 5088 posts
  • Gender:Male
  • Interests:Blog: http://www.rjmitchell.ca/~jeff/blog2009/

Posted 12 May 2003 - 12:11 PM

Strange.. looks good. Checking the code .. it looks good, too. What it does essentially...

Calculate CRC or pick it up from Cache.
Look for CRC in the database.
Search for newline so it knows where end of line is.. it never goes past end of line.
Search for semicolon and newline; whichever comes first is gamename.
If it was semicolon, repeat the above test.

When it has a game name, it dupes it into a return list; perhaps the GP32 is failinfg to get memory for the return list, though that should be fine and I've never had a problem myself.

The fact it can vary though is odd.. items work, then next time do not.

I need to see that occuring :/ If I coudl see it, I could fix it asap :/

So hang on.. I'll see it eventually :)

jeff

#26 stickofjoy

stickofjoy

    Mega GP Mania

  • GP32 Hardcore
  • PipPipPipPipPipPip
  • 542 posts

Posted 15 May 2003 - 01:24 PM

Have people stopped doing CRCs? Come on folks, there's tons more discs to do!

:rolleyes:

#27 skeezix

skeezix

    Mega GP Mania

  • GP Guru
  • 5088 posts
  • Gender:Male
  • Interests:Blog: http://www.rjmitchell.ca/~jeff/blog2009/

Posted 15 May 2003 - 03:35 PM

Yep; grab the current stgames##.txt file off the site (just click on it) and search for "::" and usually you'll find disks that are known and all type din but need CRCs. Those are easy to fill out.. I've aslready got all the game names in for you :)

Theres also groups missing.. like Zuul, etc, and the megademos and such are all missing..

jeff

#28 stickofjoy

stickofjoy

    Mega GP Mania

  • GP32 Hardcore
  • PipPipPipPipPipPip
  • 542 posts

Posted 15 May 2003 - 03:41 PM

I'll do ZUUL, as many as I can.

edit: 1 to 58 inclusive (37 discs from JOE'S FTP) DONE

I don't have them but I may as well abuse the work T1 connection to get them. ;) I'll do MSA and ST CRCs and take the data home to format. :D

COME ON PEOPLE! Give as well as taking!

#29 stickofjoy

stickofjoy

    Mega GP Mania

  • GP32 Hardcore
  • PipPipPipPipPipPip
  • 542 posts

Posted 16 May 2003 - 04:40 PM

ZULL 60 to 170 (inclusive, 60 files from JOE'S FTP) completed

#30 Bonks

Bonks

    GP Mania

  • GP32 Hardcore
  • PipPipPipPipPip
  • 417 posts

Posted 04 June 2003 - 03:15 PM

Correct me if im wrong but i take it doing single disks (not compilations) is required here too?

If so, is anyone doing the 'Atari ST Pirate Gold' set? if not, ill do them, these are single disks but would be nice to see them in the new list in 12.1

little confused on this but ill give it a shot tomorrow