2019-03-14 17:43:06

Hi everyone!

I've made an NVDA add-on called "Image describer" that takes the current navigator object and then says what it contains by looking at it visually. Kind of like the Facebook auto alt text, but this works anywhere.

The shortcut to interpret an image is NVDA+Control+I.

The add on can be downloaded at http://www.screenreader.ai/

I'm a sighted machine learning researcher that recently have caught an eye on the field of web accessibilit

Websites are primarily designed to be interacted with visually which is hard to do if you have a visual impairment. Here I think there's big potential for AI to help and look at the web page visually and then give correct and helpful information to the visually impaired or blind user.

I'm looking towards making much more than this, please contact me or reply to this thread if you want to get help with something accessibility wise or have any kind of feedback.

Thumbs up +5

2019-03-14 17:55:13

awesome! I will give this a try
there was something similar but I guess it really never took off

Thumbs up +1

2019-03-14 18:00:24

wow, cool!
it would be more awesome if you removed iran from the blocklist, it gives me access denied.

you can't run from the darkness. we are everywhere.

2019-03-14 18:21:48

Sounds cool, downloaded it!

Thumbs up +1

2019-03-14 18:26:51 (edited by MasterOfDeath 2019-03-14 18:27:16)

Sorry for doubleposting. Would be good if it didn't say only text, but the text itself, too...

Thumbs up +1

2019-03-14 18:38:50

will this be on the NVDA-addons site?

Thumbs up +1

2019-03-14 18:42:08

It will in the future. Right now it is under review, as can be seen on the NVDA addons mailing list.

Thumbs up +1

2019-03-14 18:49:17 (edited by kianoosh 2019-03-14 18:55:58)

Yeah. It doesn't give me access to the website just cause i'm from iran. I can get the add on someway, but If that's gonna use an api on your website I can't use it unless I always keep a vpn connection on.
Edit: After getting the add on I see that it is using a website that blocked iran since I get the error 403. This is an unfortunate thing.

Add me on skype: kianoosh.shakeri2
Or follow me on twitter @kianoosh shakeri

2019-03-14 19:11:09

Well now this is nearly useless because it doesn't tell more than text, screen and stuff like that. Even facebook tells more. But i hope it'll improve and i'll keep an eye on it. Keep up the good work.

Thumbs up

2019-03-14 20:20:13

well is it safe? no viruses?

my old skype has bin destroyed for this forky forks. So if you want add me, here is my skype info:
live:714c254697acebf6

Thumbs up

2019-03-14 20:56:09

Of course it's safe. I understand your concern, but such things can often discourage developers. The review is related to other things, not only security.

Thumbs up +1

2019-03-14 21:12:41

this would be useful for video editting.

watch my brother's twitch stream here:
https://www.twitch.tv/sylvrexe

2019-03-14 22:34:11

UltraLeetJ wrote:

awesome! I will give this a try
there was something similar but I guess it really never took off

Cool, that's awesome! Do you know remember name of that add-on?

Thumbs up

2019-03-14 22:38:13

AlirezaNosrati wrote:

wow, cool!
it would be more awesome if you removed iran from the blocklist, it gives me access denied.

Hi! I'm sorry that you can't use it but right now it's out of my control, most major cloud providers forces you to block Iran because of US sanctions. If you want, send me an email at [email protected] and I can work something out for you.

Thumbs up

2019-03-14 22:41:21

MasterOfDeath wrote:

Sorry for doubleposting. Would be good if it didn't say only text, but the text itself, too...

Right now the add-on is aimed to describe natural scene photographs taken from the real world, the thought is that when encountering text you would use the OCR add-on. If there is need I could definitely also add OCR capability if it detects text in the image. Or have I missed something?

I'm sighted and don't use a screen reader on a daily basis like most here do, your feedback is extremely valuable.

Thumbs up +1

2019-03-14 22:43:49

ammericandad2005 wrote:

this would be useful for video editting.

Cool, didn't think about that. Would love to know more about applying this for video editing, if you want and have the time, send me an email at [email protected], your feedback is very valuable for me since I have regular sight.

Thumbs up +1

2019-03-14 23:49:59

oliver.edholm wrote:

Cool, that's awesome! Do you know remember name of that add-on?

I think it was called "describeIt"
there is info on that link. I think that one does OCR

Thumbs up +1

2019-03-15 02:21:57 (edited by MasterOfDeath 2019-03-15 02:24:22)

Well, you could add that of course, and that would be really useful for many of us. OCR is sometimes not that accurate and if you could also implement that somehow, maybe it would improve, together with the image recognising feature. But as a starting, it's absolutely good, and if you keep developing it, we'll appreciate it. smile

Thumbs up +1

2019-03-15 02:58:47

grate !. I can use in facebook!. especially when there are ! pictures  NVDA can tell what the picture is

[follow me on twitter!]
[subscribe me on YouTube!]
pneumonoultramicroscopicsilicovolcanoconiosis

Thumbs up +1

2019-03-15 06:42:26

@14 i don't need the add-on since i can see, but there are many iranians who need it.

you can't run from the darkness. we are everywhere.

2019-03-15 08:54:27

oh very good addon!
if you are gonna continue developing, we will really happy and good luck!

my old skype has bin destroyed for this forky forks. So if you want add me, here is my skype info:
live:714c254697acebf6

Thumbs up +1

2019-03-15 11:57:42

Hi again. So I found a solution to this, If you agree with it oliver. If that's not a problem for you and if you own the api, You can send it to me in any way you like and I can set it up on our website which is not blocked by iran, nor it blocks iran. Please let me know if you agree with it so we can find a way to transfer the api. Thanks.

Add me on skype: kianoosh.shakeri2
Or follow me on twitter @kianoosh shakeri

2019-03-15 13:52:45

UltraLeetJ wrote:
oliver.edholm wrote:

Cool, that's awesome! Do you know remember name of that add-on?

I think it was called "describeIt"
there is info on that link. I think that one does OCR

Cool thanks for telling! I took a look, it required you to provide an API key to some cloud provider though, I guess that was too troublesome and because of that never took off hmm

Thumbs up

2019-03-15 13:54:20

MasterOfDeath wrote:

Well, you could add that of course, and that would be really useful for many of us. OCR is sometimes not that accurate and if you could also implement that somehow, maybe it would improve, together with the image recognising feature. But as a starting, it's absolutely good, and if you keep developing it, we'll appreciate it. smile

Ok, OCR will definitely be added at some point. Right now I'm working on a CAPTCHA solving add-on which seems to be in a very dire need?

Thumbs up

2019-03-15 13:55:25

baby wrote:

grate !. I can use in facebook!. especially when there are ! pictures  NVDA can tell what the picture is

Awesome! smile

Thumbs up