Testing emulators using z80test-1.0. Quck results

Struggling with Fuse or trying to find an emulator with a specific feature. Ask your questions here.
User avatar
druellan
Microbot
Posts: 116
Joined: Tue Apr 03, 2018 6:19 pm
Location: Argentina
Contact:

Testing emulators using z80test-1.0. Quck results

Post by druellan » Tue May 22, 2018 3:03 am

A friend shared with me this little tool designed by Patrik Rak for testing Z80 instructions on emulated environments.
Download: https://www.dropbox.com/s/33he0chzu6v7x ... 0.zip?dl=0

The full set consists of 152 individual tests, that I decided to run on several of the emulators I have at hand. I captured only the end result, but the tool provides a concise list of both passed and failed tests.

SpecEmu v3.1 build 16/03/18
Image
Result: all tests passed (!)

Retro Virtual Machine 2.00 Alpha
Image
Result: 001 of 152 tests failed.

FUSE 1.5.3
Image
Result: 002 of 152 tests failed.

ZXSpin 0.7
Image
Result: 004 of 152 tests failed.

Spud 0.250
Image
Result: 005 of 152 tests failed.

ZERO 0.7.1
Image
Result: 005 of 152 tests failed.

ZEsarUX 6.1-RC
Image
Result: 008 of 152 tests failed.

UnrealSpeccy 0.38.2
Image
Result: 010 of 152 tests failed.

EightyOne 1.9
Image
Result: 014 of 152 tests failed.

EmuZWin 2.7
Image
Result: 015 of 152 tests failed.

Speccy 4.6
Image
Result: 088 of 152 tests failed.

And some DOS ones, thanks @Equinoxe for the testing!

X128
Image
Result: 013 of 152 tests failed.

R80 0.30
Image
Result: 013 of 152 tests failed.

RealSpec
Image
Result: 019 of 152 tests failed.
1 x

zx81
Berk
Posts: 39
Joined: Sat Feb 17, 2018 9:33 pm

Re: Testing emulators using z80test-1.0. Quck results

Post by zx81 » Tue May 22, 2018 8:16 am

You has forget to test JSpeccy... ;)
0 x

User avatar
djnzx48
Microbot
Posts: 112
Joined: Wed Dec 06, 2017 2:13 am
Location: New Zealand

Re: Testing emulators using z80test-1.0. Quck results

Post by djnzx48 » Tue May 22, 2018 9:15 am

Interesting results!
I tried this out with Spectaculator, and it gave exactly the same results as Fuse: only the SCF and CCF tests failed, and with identical CRC values too.
Image
1 x

User avatar
Ast A. Moore
Manic Miner
Posts: 522
Joined: Mon Nov 13, 2017 3:16 pm

Re: Testing emulators using z80test-1.0. Quck results

Post by Ast A. Moore » Tue May 22, 2018 9:56 am

Well, this one is not exactly a be-all and end-all test—and it only tests the CPU, not Spectrum emulation itself—but, yes, SpecEmu is a very accurate emulator. I’m curious, though, how’d you come across the alpha version of Retro Virtual Machine? Could you share a link, perhaps?
0 x
Every man should plant a tree, build a house, and write a ZX Spectrum game.

Author of A Yankee in Iraq, a 50 fps shoot-’em-up—the first game to utilize the floating bus on the +2A/+3,
and zasm Z80 Assembler syntax highlighter.

User avatar
druellan
Microbot
Posts: 116
Joined: Tue Apr 03, 2018 6:19 pm
Location: Argentina
Contact:

Re: Testing emulators using z80test-1.0. Quck results

Post by druellan » Tue May 22, 2018 12:35 pm

Fix: X128 screen was missing:

X128
Image
Result: 086 of 152 tests failed.
0 x

User avatar
druellan
Microbot
Posts: 116
Joined: Tue Apr 03, 2018 6:19 pm
Location: Argentina
Contact:

Re: Testing emulators using z80test-1.0. Quck results

Post by druellan » Tue May 22, 2018 1:21 pm

zx81 wrote:
Tue May 22, 2018 8:16 am
You has forget to test JSpeccy... ;)
JSpeccy 0.93.1
Image
Result: all tests passed.

My respects!
1 x

User avatar
druellan
Microbot
Posts: 116
Joined: Tue Apr 03, 2018 6:19 pm
Location: Argentina
Contact:

Re: Testing emulators using z80test-1.0. Quck results

Post by druellan » Tue May 22, 2018 1:41 pm

Ast A. Moore wrote:
Tue May 22, 2018 9:56 am
Well, this one is not exactly a be-all and end-all test—and it only tests the CPU, not Spectrum emulation itself—but, yes, SpecEmu is a very accurate emulator.
I agree. The CPU is a very important part of the package, but the emulator still needs to translate that to the screen, provide tools and interpreters for the different snaps and file formats, manage expansions and interfaces and other enhancements. I rather use a no-so-perfect CPU emulation with extra stuff that a perfect one that is barebone.

So, it is interesting to know how the different emulators compare using the same test tool, but if one emulator is better than another, that is really a personal opinion based on many factors.
Ast A. Moore wrote:
Tue May 22, 2018 9:56 am
I’m curious, though, how’d you come across the alpha version of Retro Virtual Machine? Could you share a link, perhaps?
Ah! That was a test version I have, and was provided by the author and is not for distribution (sorry). To be fair I was not supposed to post that screenshot here, but the results are so good that I thought it only shows how good that emulator is going to be.
Last edited by druellan on Tue May 22, 2018 1:55 pm, edited 1 time in total.
0 x

User avatar
Ast A. Moore
Manic Miner
Posts: 522
Joined: Mon Nov 13, 2017 3:16 pm

Re: Testing emulators using z80test-1.0. Quck results

Post by Ast A. Moore » Tue May 22, 2018 1:52 pm

druellan wrote:
Tue May 22, 2018 1:41 pm
That was a test version I have, and was provided by the author and not for distribution (sorry).
No biggie, man. I understand.
0 x
Every man should plant a tree, build a house, and write a ZX Spectrum game.

Author of A Yankee in Iraq, a 50 fps shoot-’em-up—the first game to utilize the floating bus on the +2A/+3,
and zasm Z80 Assembler syntax highlighter.

User avatar
druellan
Microbot
Posts: 116
Joined: Tue Apr 03, 2018 6:19 pm
Location: Argentina
Contact:

Re: Testing emulators using z80test-1.0. Quck results

Post by druellan » Tue May 22, 2018 1:54 pm

+F Spectrum Emulator
Image
Q parameter error, 20

Qaop
Image
Result: 002 of 152 tests failed.
Impressive!
0 x

User avatar
RMartins
Manic Miner
Posts: 323
Joined: Thu Nov 16, 2017 3:26 pm

Re: Testing emulators using z80test-1.0. Quck results

Post by RMartins » Tue May 22, 2018 2:07 pm

The description of Zero 0.7.1 says 005 but the image states only 3 errors.
Last edited by RMartins on Tue May 22, 2018 2:33 pm, edited 3 times in total.
0 x

Post Reply