2019-12-13 12:43:13 (edited by devinprater 2019-12-13 22:25:05)

Hey y'all, I guess I'm an accessibility activist now. A few weeks ago, I made an issue on the Retroarch Github about having accessibility on the Retroarch menus. Within a few weeks, it was done, on Windows, Mac, and Linux. It already had the ability to grab game screen shots, send them to a translation service, and speak the translation, effectively acting like NVDA's OCR ability.

It's already on Twitter and Reddit, but here's a link to the official retroarch blog post about it, which has a link to a video showing it off. Note that I did indeed buy the game I was playing, from the Playstation Network so no piracy was going on here. Just saying. Also, if this actually belongs in new releases, since we were not able to use Retroarch before... although it is a gaming utility, not a game... feel free to move it. Link is below:

https://www.libretro.com/index.php/retr … nd-people/

Retroarch is like an emulation system. It allows one to play video games, called "Content", on emulators, "cores". You don't have to download the cores from their websites, just get them from the online updater. Retroarch does not come with video games, although it does have an implementation of Doom, and Cave Story, and probably other actual games that one can download. Oh yeah, it even has a game music player, too.

The great thing about it is that, since it is an entire system on its own, not only can it be used on a Raspberry Pi, it handles game controllers all in a singular way, and while configuring them can be a little interesting, once done it'll be the same mapping throughout all cores. For mapping your controller, think of the face buttons as in the direction they're at, like triangle, or Y, being at the top, or Up, rather than whatever letters there are on that line of the game pad configuration screen. There's also an automatic configuration button which will probably work too, I've actually not tried that on my Xbox 1X controller, I just did it manually. But hey, that's a lot better than Dolphin's way of doing It, which I had to spend quite a while on getting working, and they don't even, to my knowledge, offer automatic mapping of non-Gamecube and Wii controllers.

Now, some cores, like Dolphin and PPSSPP, require other stuff, like assets from PPSSPP's Github repository, to be placed into the system folder of Retroarch, so I recommend that, if you have trouble loading games, search for, for example, PPSSPP Retroarch on Google or other search engines, to see if there's anything you need to do to use that core.

Devin Prater
My Blog
Follow me

2019-12-13 12:53:08

Shows what they know, I've defeated lavos in chrono trigger at least a hundred times. Granted this was with a save file with everything opened up, but still.

Take care, it's a desert out there.

2019-12-13 12:56:25

well this sounds cool. can i play play station games or PSP games on this emulator if it even is an emulator if i am not wrong?

best regards
never give up on what ever you are doing.

2019-12-13 12:57:35

In all seriousness though, this is super cool. Looking forward to checking this out.

Take care, it's a desert out there.

2019-12-13 13:00:32

The cores (or emulators) are free to get from the online updater in Retroarch. The roms you'll have to find on your own.  I'm hoping he uses Tolk as maybe that'd get rid of the lag with powershell sending sapi speech, but I'm not sure if that can be used across all platforms.

2019-12-13 13:12:46

Hi, am I the only one who doesn't know wha this is? Can someone please post some info about it?

I used to be a knee like you, then I took an adventurer in the arrow.

2019-12-13 13:45:24

hello
devinprater, thank you that you have inspired the developers to make these accessibility improvements

let's rock!

2019-12-13 14:08:28

Wow! Sounds really nice. Can someone give me some insight on how to turn it on? I tryed to follow the steps listed on the post, but got no results.
Best regards, Haramir.

The true blind is the one who refuses to see.

2019-12-13 14:11:57

hello
@8, i think that version that includes this accessibility is not released

let's rock!

2019-12-13 14:31:12 (edited by Dekyo-NEC2608 2020-05-28 13:00:41)

RetroArch is now accessible, that means... Genesis Plus GX, with the super-awesome, cycle-accurate Yamaha YM3438 (and YM2612) OPN2C/OPN2 LLE core by Nuke.YKT? YEAH!

Yamaha YM2608

YOU
SAY! - Sonic the Hedgehog CD (Dec 4, 1992 prototype)

2019-12-13 15:11:49

Hey Devin, given I'm on Ubuntu, should I grab the nightly PPA to test this out since 1.8.1's the last stable version

Warning: Grumpy post above
Also on Linux natively

Jace's EA PGA Tour guide for blind golfers

2019-12-13 15:46:05

So having played around with this...it's awesome. Cloned it from git, got it talking.

Just one problem. How would I make the espeak volume on Linux louder? It's very, very quiet. I'm assuming that's not spech-dispatcher.conf since it never mentions that

Warning: Grumpy post above
Also on Linux natively

Jace's EA PGA Tour guide for blind golfers

2019-12-13 15:54:55 (edited by devinprater 2019-12-13 16:08:55)

#11: Yeah, grab the nightly version.

@stirlock: How in the world do you play Chrono Trigger? I guess I should know that first before we get into how you beat Lavos, which is probably OCR'ing the battle screens. Lol, post a video of that to Reddit's r/emulation sub and you'll be a god for sure.

Everyone else: I'm surprised that this thread grew so quickly. To anyone wanting to try this right meow, you'll need to download the nightly build, not the release version. 1.8.2 will be released in a few days, hopefully, if you'd rather wait for that.

To the person, post 6 I think, wanting to know what Retroarch is, it is basically a program that gives one access to many emulators, but in a unified way. For example, your library of games is one library, but opens using the emulators, or cores, that the type of game works with. So, Dissidia Final Fantasy will open with PPSSPP, and Mortal Kombat Gold will work with the Sega Dreamcast core. But you don't have to have those programs on your computer, you download the cores from Retroarch. Also, a great thing about it being a unified system is that you don't have to map your Xbox 1X controller to 20 different emulators, which will have 20 different interfaces to do so, with 20 different levels of accessibility. Granted, the mapping interface on Retroarch is a bit weird, just listen for up, down, left, and right when dealing with the face buttons, and map direction wise, not letter wise (A, B, Y, and X). But once that's mapped right, it'll work the same across all cores.

Another thing is that, while for now we have OCR, hopefully in the future, we'll have sort of game packs for accessibility, containing not just text from the game, but information about things nearby the character, which I hope will be short sounds, not text, information about health bars in fighting games, ledges so that I don't fall into stage traps so much in Dissidia, and, perhaps, even descriptions of stages and characters if we really want to wish hard, and of course menus which speak as one moves the cursor. All that is quite a ways off, but I'm sure that if we all work together with the Retroarch team, this will definitely be only one small step to video game accessibility, and I'll be able to enjoy games like Zelda, Final Fantasy, and plenty others. After all, if we can get this far, with a whole user interface accessible, and OCR in games as a supported accessibility tool, why not dream even bigger. I say, let's break our limits! Uh, like, limit breaks in Final Fantasy...

Devin Prater
My Blog
Follow me

2019-12-13 16:27:38

hello
i installed nightly version, i enabled accessibility and narrator just said accessibility onn and thats all. what i can do?

let's rock!

2019-12-13 16:36:58

wait. does this mean I should actually get a raspberry pi now? Lol

Much less active on this forum than in the past.

Check out my live streams: http://lerven.me
follow me on Twitter: http://twitter.com/liamerven

2019-12-13 16:40:47

Liam, I've not tried Retroarch on a Raspberry Pi, but if it works on Linux, it should work on the Pi. That reminds me, I should let the Linux blind community know about this too.

Devin Prater
My Blog
Follow me

2019-12-13 17:50:48 (edited by arturminyazev 2019-12-13 17:51:10)

can someone explane how to use this in windows?
i'm launching retroarch and narrator saying accessibility on ain menu load core, and i can't understand how to navigate through the menus and etc

let's rock!

2019-12-13 17:53:34

You use the arrows to navigate.

Set up your input, and other settings.

Then load core

Then load game

It (should) work fine.

Now....can I do savestates in this?

Warning: Grumpy post above
Also on Linux natively

Jace's EA PGA Tour guide for blind golfers

2019-12-13 17:59:41

hello
@18, when i pressing arows, after some seconds narrator reading something strange rrrssoufofosrrr and something like that

let's rock!

2019-12-13 18:14:26

Thank you 13 for this one, how do I get the games? What emulators are included? I’m looking for “Nintendo, play station, Sega genesis and the dream cast” I hope they have them!

2019-12-13 18:37:36

Hi. You are on your own when it comes to getting games. Please see rule 3 for more on why we don't allow that.

Much less active on this forum than in the past.

Check out my live streams: http://lerven.me
follow me on Twitter: http://twitter.com/liamerven

2019-12-13 18:55:23

Is the “dream cast” emulator accessible for the blind too? Also what version of windows?

2019-12-13 18:56:32

#18: Yes, you can do save states. You can map them to keys or game controller buttons, or map the Menu hotkey, in "hotkey binds".

@blindangel: all those are available.

Devin Prater
My Blog
Follow me

2019-12-13 18:59:31

There's a vid on YT suggesting what cores to use, I'm going by that and having a blast.

Question though. So I want to enable the AI service. Let's say I'm in a shop in FF7, firsr game that springs to mind. Can I have it read the menu to me, buy something, and have the AI read the changed menu, or what I'm highlightin, or should I go and open an issue for that? Not played around with it...and totally blanked on the hotkeys after I just did the basics. Oops

Warning: Grumpy post above
Also on Linux natively

Jace's EA PGA Tour guide for blind golfers

2019-12-13 19:14:58

3Are games for this emulator easy to get?