Testing emulators using z80test-1.0. Quick results

Struggling with Fuse or trying to find an emulator with a specific feature. Ask your questions here.
cthutu
Drutt
Posts: 14
Joined: Wed May 30, 2018 6:18 pm

Re: Testing emulators using z80test-1.0. Quck results

Post by cthutu »

zx81 wrote: Wed May 30, 2018 4:27 pm
djnzx48 wrote: Wed May 30, 2018 4:05 pm Wow, I'm definitely surprised that the Next failed so many tests! Are there any major revisions expected in the future?
If I remember correctly, the Next uses the ZX-Uno Spectrum core, modified and not published the sources. So, the last ZX-Uno sources aren't published, until the Next team publish his modifications. A really dirty behaviour.

Modify a VHDL synthetisation is harder than modify a C, C++ or Java sources. So, the ZX-Uno Spectrum differs from the original at some points. Nothing serious, but isn't perfect. At this moment, I guess that software emulators are more precise than FPGAs synthetisations. That can change in the future, of course.

P.D.: I have a ZX-Uno v4.2 too...
The ZX Spectrum Next doesn't use any part of ZX-Uno at all. This is very inaccurate statement that is, unfortunately, being spread around by misinformed people. There are aspects of the Next FPGA code that is based on open cores (like the T80), but none from ZX-Uno.
zx81
Microbot
Posts: 138
Joined: Sat Feb 17, 2018 9:33 pm

Re: Testing emulators using z80test-1.0. Quck results

Post by zx81 »

cthutu wrote: Wed May 30, 2018 6:32 pm
zx81 wrote: Wed May 30, 2018 4:27 pm If I remember correctly, the Next uses the ZX-Uno Spectrum core, modified and not published the sources. So, the last ZX-Uno sources aren't published, until the Next team publish his modifications. A really dirty behaviour.

Modify a VHDL synthetisation is harder than modify a C, C++ or Java sources. So, the ZX-Uno Spectrum differs from the original at some points. Nothing serious, but isn't perfect. At this moment, I guess that software emulators are more precise than FPGAs synthetisations. That can change in the future, of course.

P.D.: I have a ZX-Uno v4.2 too...
The ZX Spectrum Next doesn't use any part of ZX-Uno at all. This is very inaccurate statement that is, unfortunately, being spread around by misinformed people. There are aspects of the Next FPGA code that is based on open cores (like the T80), but none from ZX-Uno.
I can't say anything by myself. These "misinformed people" are some ZX-Uno members. Probably, they have some reason to claim such thing.
cthutu
Drutt
Posts: 14
Joined: Wed May 30, 2018 6:18 pm

Re: Testing emulators using z80test-1.0. Quck results

Post by cthutu »

zx81 wrote: Wed May 30, 2018 6:44 pm
cthutu wrote: Wed May 30, 2018 6:32 pm The ZX Spectrum Next doesn't use any part of ZX-Uno at all. This is very inaccurate statement that is, unfortunately, being spread around by misinformed people. There are aspects of the Next FPGA code that is based on open cores (like the T80), but none from ZX-Uno.
I can't say anything by myself. These "misinformed people" are some ZX-Uno members. Probably, they have some reason to claim such thing.
Unfortunately, they have no reason. Some of them have asserted, incorrectly, that some of the code has been copied from ZX-Uno. I think this started when ULANext was added, which is similar to ULAplus. But no code was copied. None of the members have seen the code used on the Next, and I talk daily with people that do see the code.

I will also add that the sources have not been published since the final machine has not been released. All sources will be published when that happens. This is to stop lots of Next forks occurring before the KS backers get their hands on one.
Hernan
Drutt
Posts: 27
Joined: Wed May 30, 2018 3:45 pm

Re: Testing emulators using z80test-1.0. Quck results

Post by Hernan »

zx81 wrote: Wed May 30, 2018 5:33 pm What Z80 CPU model have your Issue 6A?
It's a SGS made one:

Image
cthutu
Drutt
Posts: 14
Joined: Wed May 30, 2018 6:18 pm

Re: Testing emulators using z80test-1.0. Quck results

Post by cthutu »

Thanks for this thread! After testing, I decided to fix my Z80. I added the flag 3/5 behaviour for SCF and CCF, and fixed the flags bug in my RLA instruction. I now have this result:

Image
User avatar
druellan
Dynamite Dan
Posts: 1466
Joined: Tue Apr 03, 2018 7:19 pm

Re: Testing emulators using z80test-1.0. Quck results

Post by druellan »

Hernan wrote: Wed May 30, 2018 7:56 pm It's a SGS made one:
SCF/CCF flags seems to be a little nightmare on CPUs that are not genuine Zilog.

I've found the original Patrik Rak thread 2012, where he was experimenting with this tests: https://www.worldofspectrum.org/forums/ ... ent/669314
User avatar
Ast A. Moore
Rick Dangerous
Posts: 2640
Joined: Mon Nov 13, 2017 3:16 pm

Re: Testing emulators using z80test-1.0. Quck results

Post by Ast A. Moore »

Hernan wrote: Wed May 30, 2018 7:56 pm
zx81 wrote: Wed May 30, 2018 5:33 pm What Z80 CPU model have your Issue 6A?
It's a SGS made one:

Image
AB1 is an NMOS chip, as far as I know.

Could you run this little test on your Spectrum and tell us the color of the border you see? (If you have several Spectrums, even better!)
Every man should plant a tree, build a house, and write a ZX Spectrum game.

Author of A Yankee in Iraq, a 50 fps shoot-’em-up—the first game to utilize the floating bus on the +2A/+3,
and zasm Z80 Assembler syntax highlighter.
Hernan
Drutt
Posts: 27
Joined: Wed May 30, 2018 3:45 pm

Re: Testing emulators using z80test-1.0. Quck results

Post by Hernan »

Ast A. Moore wrote: Thu May 31, 2018 12:34 am Could you run this little test on your Spectrum and tell us the color of the border you see? (If you have several Spectrums, even better!)
Didn't take a picture, but it was a black border.
User avatar
Ast A. Moore
Rick Dangerous
Posts: 2640
Joined: Mon Nov 13, 2017 3:16 pm

Re: Testing emulators using z80test-1.0. Quck results

Post by Ast A. Moore »

Hernan wrote: Thu May 31, 2018 3:43 am
Ast A. Moore wrote: Thu May 31, 2018 12:34 am Could you run this little test on your Spectrum and tell us the color of the border you see? (If you have several Spectrums, even better!)
Didn't take a picture, but it was a black border.
It’s an NMOS Z80 then.
Every man should plant a tree, build a house, and write a ZX Spectrum game.

Author of A Yankee in Iraq, a 50 fps shoot-’em-up—the first game to utilize the floating bus on the +2A/+3,
and zasm Z80 Assembler syntax highlighter.
User avatar
RMartins
Manic Miner
Posts: 776
Joined: Thu Nov 16, 2017 3:26 pm

Re: Testing emulators using z80test-1.0. Quck results

Post by RMartins »

Hernan wrote: Wed May 30, 2018 4:58 pm BTW, to have a "control subject" I've run the tests on my real Issue 6A 48K Speccy, and fails 1 test (001 SCF)
...
Which specific Z80 CPU brand is in your 48K computer ?

Also,which tests have you run ?
Only the full ?
wht about the other tests ?
User avatar
Ast A. Moore
Rick Dangerous
Posts: 2640
Joined: Mon Nov 13, 2017 3:16 pm

Re: Testing emulators using z80test-1.0. Quck results

Post by Ast A. Moore »

RMartins wrote: Thu May 31, 2018 10:11 am
Hernan wrote: Wed May 30, 2018 4:58 pm BTW, to have a "control subject" I've run the tests on my real Issue 6A 48K Speccy, and fails 1 test (001 SCF)
...
Which specific Z80 CPU brand is in your 48K computer ?
Flip back a page: viewtopic.php?f=23&t=752&start=40#p11051
Every man should plant a tree, build a house, and write a ZX Spectrum game.

Author of A Yankee in Iraq, a 50 fps shoot-’em-up—the first game to utilize the floating bus on the +2A/+3,
and zasm Z80 Assembler syntax highlighter.
Hernan
Drutt
Posts: 27
Joined: Wed May 30, 2018 3:45 pm

Re: Testing emulators using z80test-1.0. Quck results

Post by Hernan »

RMartins wrote: Thu May 31, 2018 10:11 am Which specific Z80 CPU brand is in your 48K computer ?

Also,which tests have you run ?
Only the full ?
wht about the other tests ?
Just ran the full test. It's a NMOS Z80 made by SGS.
User avatar
Seven.FFF
Manic Miner
Posts: 735
Joined: Sat Nov 25, 2017 10:50 pm
Location: USA

Re: Testing emulators using z80test-1.0. Quck results

Post by Seven.FFF »

RMartins wrote: Tue May 22, 2018 3:43 pm and I see that instruction INC RR an INC XY (apparently they are different things (could it be second is for iX and iY ?) are returned as OK.
But these return as errors, when running `Z80ccf.tap`
The answer is in that long but fascinating 2012 WoS thread.

Z80ccf runs CCF after each opcode. If an instruction modifies the flags, the immediately following CCF (or SCF) moves bits 5+3 from A to F, whereas if an instruction doesn't modify the flags, the SCF/CCF ORs bits 5+3 from A to F.

If SCF/CCF isn't emulated the expected way, any opcode modifying flags may fail Z80ccf. I guess it's more of a sanity crosscheck than anything else.
Robin Verhagen-Guest
SevenFFF / Threetwosevensixseven / colonel32
NXtel NXTP ESP Update ESP Reset CSpect Plugins
User avatar
druellan
Dynamite Dan
Posts: 1466
Joined: Tue Apr 03, 2018 7:19 pm

Re: Testing emulators using z80test-1.0. Quck results

Post by druellan »

ZX-Uno running Kyp's core. All tests OK but SCF y CCF. SCF+CCF and CCF+SCF seems to work fine.

Image
Result: 002 of 152 tests failed.

Pretty nice!
User avatar
druellan
Dynamite Dan
Posts: 1466
Joined: Tue Apr 03, 2018 7:19 pm

Re: Testing emulators using z80test-1.0. Quck results

Post by druellan »

FUSE 1.5.6 changelog says:
Z80 flags register is now correct after SCF and CCF (Sergio Baldoví).
So, I decided to rerun the tests, and:

Image
Result: all tests passed
User avatar
druellan
Dynamite Dan
Posts: 1466
Joined: Tue Apr 03, 2018 7:19 pm

Re: Testing emulators using z80test-1.0. Quick results

Post by druellan »

ZXMAK2 V2.9.3.8

Image
Result: 006 of 152 tests failed
User avatar
Lethargeek
Manic Miner
Posts: 734
Joined: Wed Dec 11, 2019 6:47 am

Re: Testing emulators using z80test-1.0. Quick results

Post by Lethargeek »

could someone re-run these tests on the current Next?
i'm interested if the results improved since the last time

to be specific - z80full, z80ccf and z80memptr
User avatar
druellan
Dynamite Dan
Posts: 1466
Joined: Tue Apr 03, 2018 7:19 pm

Re: Testing emulators using z80test-1.0. Quick results

Post by druellan »

ZX Spectrum Next Firmware 1.21 Core 3.01.00

Image

Image

Image

Image

Image

Result: 022 of 152 tests failed.
User avatar
Pegaz
Dynamite Dan
Posts: 1209
Joined: Mon Nov 13, 2017 1:44 pm

Re: Testing emulators using z80test-1.0. Quick results

Post by Pegaz »

It surprised me, that the SpecIde emulator was not mentioned here yet, because it passed all the tests I tried.
https://github.com/MartianGirl/SpecIde
I think this is certainly among the top five Spectrum emulators, in terms of precision.
For now it lacks some decent GUI, especially any file browser but nonetheless, this is an excellent emulator.
Congratulations to Marta, impressive work for now.
Here are the results for z80 tests:

Image
Last edited by Pegaz on Wed Apr 29, 2020 9:27 pm, edited 1 time in total.
User avatar
PeterJ
Site Admin
Posts: 6855
Joined: Thu Nov 09, 2017 7:19 pm
Location: Surrey, UK

Re: Testing emulators using z80test-1.0. Quick results

Post by PeterJ »

Thanks for adding the link [mention]Pegaz[/mention]

I deleted my post asking for the link, and your post saying you had added it. Thank you.

Its probably because nobody else had heard of it. Thanks for mentioning it. They also have a version build into Visual Studio which looks neat!

Has anyone tried it?

https://dotneteer.github.io/spectnetide/
User avatar
PeterJ
Site Admin
Posts: 6855
Joined: Thu Nov 09, 2017 7:19 pm
Location: Surrey, UK

Re: Testing emulators using z80test-1.0. Quick results

Post by PeterJ »

I missed this first time round [mention]druellan[/mention]. Excellent work!
User avatar
PeterJ
Site Admin
Posts: 6855
Joined: Thu Nov 09, 2017 7:19 pm
Location: Surrey, UK

Re: Testing emulators using z80test-1.0. Quick results

Post by PeterJ »

Do you have time to test it on ZXBaremulator [mention]Pegaz[/mention]?
User avatar
Pegaz
Dynamite Dan
Posts: 1209
Joined: Mon Nov 13, 2017 1:44 pm

Re: Testing emulators using z80test-1.0. Quick results

Post by Pegaz »

PeterJ wrote: Wed Apr 29, 2020 9:28 pm Thanks for adding the link @Pegaz

I deleted my post asking for the link, and your post saying you had added it. Thank you.

Its probably because nobody else had heard of it. Thanks for mentioning it. They also have a version build into Visual Studio which looks neat!

Has anyone tried it?

https://dotneteer.github.io/spectnetide/
I think they are from different authors.
The author of SpecIde is Marta Sevillano Mancilla.
As far as I can see, the author of this second emulator is Istvan Novak.
PeterJ wrote: Wed Apr 29, 2020 9:34 pm Do you have time to test it on ZXBaremulator [mention]Pegaz[/mention]?
Sure, no problem, Baremulator goes through all the tests, but I think zx81 already mentioned it...
User avatar
PeterJ
Site Admin
Posts: 6855
Joined: Thu Nov 09, 2017 7:19 pm
Location: Surrey, UK

Re: Testing emulators using z80test-1.0. Quick results

Post by PeterJ »

Interesting, it's all under the same GitHub subdomain. Assume they are working together as a group. All good stuff.

Great that ZXBaremulator passes all tests as well as the latest Fuse.
User avatar
Pegaz
Dynamite Dan
Posts: 1209
Joined: Mon Nov 13, 2017 1:44 pm

Re: Testing emulators using z80test-1.0. Quick results

Post by Pegaz »

In fact, [mention]MonkZy[/mention] has already tested the Baremulator, here:

viewtopic.php?f=23&t=752&start=20
Post Reply