April 2024 - Data Science - lists.blindcoders.com

Re: OCR Tools

by Patrick Smyth

Sounds like you got things working to your satisfaction. On Linux I use something called ocrmypdf, and I think it requires -i and -o (for input and output) flags. I do OCR PDFs a lot, even if they have been OCRd before it's often low quality OCR for some reason. There's a website called Library Genesis you can use to find PDFs of practically anything. I won't link to it but a little research should turn it up, or email me directly with a request for a URL. I don't feel bad about using it as a blind person, as many regular library resources and specialized databases are not open to us, and in some cases copyright has been waived for us to access resources. Patrick On Sat, Apr 20, 2024, at 1:02 AM, Nikhil Vohra wrote: > I actually found a software called OCRmyPDF that can be installed through PIP, and it uses Tesseract as a dependency (as well as Ghostscript): > > https://ocrmypdf.readthedocs.io/en/latest/introduction.html > > Since I already had Anaconda installed, I only had to download and install Ghostscript <https://ghostscript.com/releases/gsdnld.html> and Tesseract <https://github.com/UB-Mannheim/tesseract/wiki> before running > >> pip install ocrmypdf > > I was successfully able to run > >> ocrmypdf input.pdf output.pdf > > and I now have a local setup for running OCR on PDFs! > > Best, > Nikhil > > On Fri, Apr 19, 2024 at 11:58 PM Nikhil Vohra <nikhil.vohra(a)stonybrook.edu> wrote: >> Thanks! >> >> I just installed it on Windows, but I get the following error: >> >>> Error in pixReadStream: Pdf reading is not supported >> >> Most of the full-length documents that I would need to convert to screen-reader-accessible text are in the form of PDFs. For simple pictures, I could just use NVDA. Do you know of any workaround? >> >> I used the command >> >>> tesseract my_file.pdf my_output.txt >> >> Is there some other command or flag to use for PDFs? >> >> Best, >> Nikhil >> >> On Fri, Apr 19, 2024 at 5:39 PM Patrick Smyth <patrick(a)iotaschool.com> wrote: >>> __ >>> I use OCR pretty extensively. On Linux, I've written a short script that lets me draw boxes on the screen, and the contents get screenshotted and sent to tessaract, then to espeak. I can also do the current window, etc, and I write a little script to constantly scan and read the screen for trying to play some games, though I don't use it that often. >>> >>> On Windows, I combined a utility called Capture2Text with a tool that scans the clipboard, TextAloud, to do something similar. I just set up TextAloud to read aloud any clipboard updates, and set Capture2Text to dump the results of OCR to the clipboard, and the tools work very well together. I got through a number of games such as Disco Elysium with this technique. I do have some limited low vision, though, that lets me draw boxes around blobs on the screen. >>> >>> I've been working more with neural networks lately and I think they might have some applications for OCR, since they might be able to do the part where the block of text is identified. I've noticed that OCR tends to fail if the box isn't drawn tightly around the text before being sent to tessaract. >>> >>> In case it's useful to anyone, here's a link to the short script to OCR text on Linux. You need tessaract, espeak, and gnome-screenshot on your path. >>> >>> http://dccccc.cc/files/ocr.txt >>> >>> >>> >>> _______________________________________________ >>> Data Science mailing list -- datascience(a)blindcoders.com >>> To unsubscribe send an email to datascience-leave(a)blindcoders.com

April 20, 2024

Re: OCR Tools

by Nikhil Vohra

I actually found a software called OCRmyPDF that can be installed through PIP, and it uses Tesseract as a dependency (as well as Ghostscript): https://ocrmypdf.readthedocs.io/en/latest/introduction.html Since I already had Anaconda installed, I only had to download and install Ghostscript <https://ghostscript.com/releases/gsdnld.html> and Tesseract <https://github.com/UB-Mannheim/tesseract/wiki> before running pip install ocrmypdf I was successfully able to run ocrmypdf input.pdf output.pdf > and I now have a local setup for running OCR on PDFs! Best, Nikhil On Fri, Apr 19, 2024 at 11:58 PM Nikhil Vohra <nikhil.vohra(a)stonybrook.edu> wrote: > Thanks! > > I just installed it on Windows, but I get the following error: > > Error in pixReadStream: Pdf reading is not supported > > > Most of the full-length documents that I would need to convert to > screen-reader-accessible text are in the form of PDFs. For simple pictures, > I could just use NVDA. Do you know of any workaround? > > I used the command > > tesseract my_file.pdf my_output.txt > > > Is there some other command or flag to use for PDFs? > > Best, > Nikhil > > On Fri, Apr 19, 2024 at 5:39 PM Patrick Smyth <patrick(a)iotaschool.com> > wrote: > >> I use OCR pretty extensively. On Linux, I've written a short script that >> lets me draw boxes on the screen, and the contents get screenshotted and >> sent to tessaract, then to espeak. I can also do the current window, etc, >> and I write a little script to constantly scan and read the screen for >> trying to play some games, though I don't use it that often. >> >> On Windows, I combined a utility called Capture2Text with a tool that >> scans the clipboard, TextAloud, to do something similar. I just set up >> TextAloud to read aloud any clipboard updates, and set Capture2Text to dump >> the results of OCR to the clipboard, and the tools work very well together. >> I got through a number of games such as Disco Elysium with this technique. >> I do have some limited low vision, though, that lets me draw boxes around >> blobs on the screen. >> >> I've been working more with neural networks lately and I think they might >> have some applications for OCR, since they might be able to do the part >> where the block of text is identified. I've noticed that OCR tends to fail >> if the box isn't drawn tightly around the text before being sent to >> tessaract. >> >> In case it's useful to anyone, here's a link to the short script to OCR >> text on Linux. You need tessaract, espeak, and gnome-screenshot on your >> path. >> >> http://dccccc.cc/files/ocr.txt >> >> >> >> _______________________________________________ >> Data Science mailing list -- datascience(a)blindcoders.com >> To unsubscribe send an email to datascience-leave(a)blindcoders.com >> >

April 20, 2024

Re: OCR Tools

by Nikhil Vohra

Thanks! I just installed it on Windows, but I get the following error: Error in pixReadStream: Pdf reading is not supported Most of the full-length documents that I would need to convert to screen-reader-accessible text are in the form of PDFs. For simple pictures, I could just use NVDA. Do you know of any workaround? I used the command tesseract my_file.pdf my_output.txt Is there some other command or flag to use for PDFs? Best, Nikhil On Fri, Apr 19, 2024 at 5:39 PM Patrick Smyth <patrick(a)iotaschool.com> wrote: > I use OCR pretty extensively. On Linux, I've written a short script that > lets me draw boxes on the screen, and the contents get screenshotted and > sent to tessaract, then to espeak. I can also do the current window, etc, > and I write a little script to constantly scan and read the screen for > trying to play some games, though I don't use it that often. > > On Windows, I combined a utility called Capture2Text with a tool that > scans the clipboard, TextAloud, to do something similar. I just set up > TextAloud to read aloud any clipboard updates, and set Capture2Text to dump > the results of OCR to the clipboard, and the tools work very well together. > I got through a number of games such as Disco Elysium with this technique. > I do have some limited low vision, though, that lets me draw boxes around > blobs on the screen. > > I've been working more with neural networks lately and I think they might > have some applications for OCR, since they might be able to do the part > where the block of text is identified. I've noticed that OCR tends to fail > if the box isn't drawn tightly around the text before being sent to > tessaract. > > In case it's useful to anyone, here's a link to the short script to OCR > text on Linux. You need tessaract, espeak, and gnome-screenshot on your > path. > > http://dccccc.cc/files/ocr.txt > > > > _______________________________________________ > Data Science mailing list -- datascience(a)blindcoders.com > To unsubscribe send an email to datascience-leave(a)blindcoders.com >

April 20, 2024

Re: OCR Tools

by Patrick Smyth

I use OCR pretty extensively. On Linux, I've written a short script that lets me draw boxes on the screen, and the contents get screenshotted and sent to tessaract, then to espeak. I can also do the current window, etc, and I write a little script to constantly scan and read the screen for trying to play some games, though I don't use it that often. On Windows, I combined a utility called Capture2Text with a tool that scans the clipboard, TextAloud, to do something similar. I just set up TextAloud to read aloud any clipboard updates, and set Capture2Text to dump the results of OCR to the clipboard, and the tools work very well together. I got through a number of games such as Disco Elysium with this technique. I do have some limited low vision, though, that lets me draw boxes around blobs on the screen. I've been working more with neural networks lately and I think they might have some applications for OCR, since they might be able to do the part where the block of text is identified. I've noticed that OCR tends to fail if the box isn't drawn tightly around the text before being sent to tessaract. In case it's useful to anyone, here's a link to the short script to OCR text on Linux. You need tessaract, espeak, and gnome-screenshot on your path. http://dccccc.cc/files/ocr.txt

April 19, 2024

OCR Tools

by Nikhil Vohra

Dear all, I am trying to find a simple OCR tool to run locally. I came across Tesseract <https://tesseract-ocr.github.io/>, and I was wondering if anyone has experience using it, thoughts about it, or suggestions for OCR in general. Note: NVDA has built-in OCR (triggered with NVDA+R), but this only works for the current navigator object; I am trying to find a tool that works for entire documents. Thanks, Nikhil

April 19, 2024

Re: Inquiry on Weka Accessibility for VI Data Scientists

by Khalid K

Hi Nikhil, Thanks for the info. I tried using Orange on Anaconda a few weeks ago and found it mostly unusable with screen-readers. I tested it with both JAWS and NVDA without much success. Cheers, Khalid From: Nikhil Vohra <nikhil.vohra(a)stonybrook.edu> Sent: Monday, April 15, 2024 9:25 PM To: Pietro Sanchini <pietro.sanchini(a)gmail.com> Cc: Khalid K <kaak42(a)outlook.com>; datascience(a)blindcoders.com Subject: Re: [data-science]Re: Inquiry on Weka Accessibility for VI Data Scientists I have also never used Weka, but I found the following links that might be helpful; the first is a link to using Weka through Python, the second is a list of top alternatives to Weka (where Orange is listed as the top alternative), and the third is a link to getting started with Orange through Python: 1. https://waikato.github.io/weka-wiki/faqs/can_i_use_weka_from_python/ 2. https://alternativeto.net/software/weka/ 3. https://orange3.readthedocs.io/projects/orange-data-mining-library/en/lates… Best, Nikhil On Mon, Apr 15, 2024 at 11:37 AM Pietro Sanchini <pietro.sanchini(a)gmail.com<mailto:pietro.sanchini@gmail.com>> wrote: I've never used Weka, as I've always relied on Python and its libraries for my data science work. I'm currently interested in learning Rust to further develop my programming skills, particularly in creating Python libraries similar to Polars. regards, Pietro Em seg., 15 de abr. de 2024 às 10:32, Khalid K <kaak42(a)outlook.com<mailto:kaak42@outlook.com>> escreveu: Hi Data Scientists, I'd like to inquire about the accessibility of Weka (https://ml.cms.waikato.ac.nz/weka/) when using a screen reader. Does anyone have experience with its usability? Additionally, I’m curious to know whether it's essential to use Weka, or if similar productivity could be achieved using Python and libraries like Pandas, Seaborn, and scikit-learn. I look forward to any ideas or suggestions you have for enhancing productivity for data science with screen-readers. Kind regards, Khalid _______________________________________________ Data Science mailing list -- datascience(a)blindcoders.com<mailto:datascience@blindcoders.com> To unsubscribe send an email to datascience-leave(a)blindcoders.com<mailto:datascience-leave@blindcoders.com> _______________________________________________ Data Science mailing list -- datascience(a)blindcoders.com<mailto:datascience@blindcoders.com> To unsubscribe send an email to datascience-leave(a)blindcoders.com<mailto:datascience-leave@blindcoders.com>

April 15, 2024

Re: Inquiry on Weka Accessibility for VI Data Scientists

by Nikhil Vohra

I have also never used Weka, but I found the following links that might be helpful; the first is a link to using Weka through Python, the second is a list of top alternatives to Weka (where Orange is listed as the top alternative), and the third is a link to getting started with Orange through Python: 1. https://waikato.github.io/weka-wiki/faqs/can_i_use_weka_from_python/ 2. https://alternativeto.net/software/weka/ 3. https://orange3.readthedocs.io/projects/orange-data-mining-library/en/lates… Best, Nikhil On Mon, Apr 15, 2024 at 11:37 AM Pietro Sanchini <pietro.sanchini(a)gmail.com> wrote: > I've never used Weka, as I've always relied on Python and its libraries > for my data science work. I'm currently interested in learning Rust to > further develop my programming skills, particularly in creating Python > libraries similar to Polars. > > regards, > Pietro > > > > > > Em seg., 15 de abr. de 2024 às 10:32, Khalid K <kaak42(a)outlook.com> > escreveu: > >> Hi Data Scientists, >> >> >> >> I'd like to inquire about the accessibility of Weka ( >> https://ml.cms.waikato.ac.nz/weka/) when using a screen reader. Does >> anyone have experience with its usability? Additionally, I’m curious to >> know whether it's essential to use Weka, or if similar productivity could >> be achieved using Python and libraries like Pandas, Seaborn, and >> scikit-learn. >> >> >> >> I look forward to any ideas or suggestions you have for enhancing >> productivity for data science with screen-readers. >> >> >> >> Kind regards, >> >> Khalid >> >> >> _______________________________________________ >> Data Science mailing list -- datascience(a)blindcoders.com >> To unsubscribe send an email to datascience-leave(a)blindcoders.com >> > _______________________________________________ > Data Science mailing list -- datascience(a)blindcoders.com > To unsubscribe send an email to datascience-leave(a)blindcoders.com >

April 15, 2024

Re: Inquiry on Weka Accessibility for VI Data Scientists

by Pietro Sanchini

I've never used Weka, as I've always relied on Python and its libraries for my data science work. I'm currently interested in learning Rust to further develop my programming skills, particularly in creating Python libraries similar to Polars. regards, Pietro Em seg., 15 de abr. de 2024 às 10:32, Khalid K <kaak42(a)outlook.com> escreveu: > Hi Data Scientists, > > > > I'd like to inquire about the accessibility of Weka ( > https://ml.cms.waikato.ac.nz/weka/) when using a screen reader. Does > anyone have experience with its usability? Additionally, I’m curious to > know whether it's essential to use Weka, or if similar productivity could > be achieved using Python and libraries like Pandas, Seaborn, and > scikit-learn. > > > > I look forward to any ideas or suggestions you have for enhancing > productivity for data science with screen-readers. > > > > Kind regards, > > Khalid > > > _______________________________________________ > Data Science mailing list -- datascience(a)blindcoders.com > To unsubscribe send an email to datascience-leave(a)blindcoders.com >

April 15, 2024

Inquiry on Weka Accessibility for VI Data Scientists

by Khalid K

Hi Data Scientists, I'd like to inquire about the accessibility of Weka (https://ml.cms.waikato.ac.nz/weka/) when using a screen reader. Does anyone have experience with its usability? Additionally, I'm curious to know whether it's essential to use Weka, or if similar productivity could be achieved using Python and libraries like Pandas, Seaborn, and scikit-learn. I look forward to any ideas or suggestions you have for enhancing productivity for data science with screen-readers. Kind regards, Khalid

April 15, 2024

Re: Sonification.

by Patrick Smyth

Hey Pietro, I'll both agree and disagree with you here. I agree in the sense that the tools I find most useful are working closely in the REPL by applying specific filters and transformations and looking at the text outputs. I think I am less excited about LLM interpretation, but it's certainly increasingly useful. If you're trying to get something done, it's probably usually best to get smart with textual outputs. That said, there's a gap in that stack that I think sonification fills. The gap is making a case to others. When you want to get your point across on social edia or to your boss, a fancy visualization goes a long way. While sonification is kind of not really there yet as a toolset, I think sonification can fill the role of something that can be shared with others to make them understand some point you're making. Sonification does well on social media, and while it's probably not going to dominate boardroom reports like a pie chart, I could see sending a file to your boss here and there in specific situations. I do think the technology needs to get a lot easier to use, and to work on a wider variety of hardware. Best, -- Patrick Smyth, PhD Chief Learner Iota School <https://iotaschool.com/> GitHub <https://github.com/smythp> | Twitter <https://twitter.com/psmyth01> | LinkedIn <https://www.linkedin.com/in/smythp> On Sun, Mar 31, 2024, at 10:19 AM, Pietro Sanchini wrote: > Hi Gabriele, > > I followed the course with Sarah, but I confess that I am still not convinced of the usefulness of this type of tool in the daily life of a blind data scientist. Sometimes we have data with a lot of noise, biases, and important details that will be difficult or, in my opinion, impossible to capture completely with sonifications. > > It can be useful and even somewhat playful for astronomy, but as a data scientist who works in industry analyzing and applying predictive models in big data and business problems, I don't see much use for it. > > That's why I believe that it is much better to invest in two fronts: LLMs for graph description and statistical tools for data analysis - hypothesis testing, in-depth study of linear algebra and probability, study of numerical analysis, etc. I have been investing in the second front for four years now and although I still have a lot to learn, I feel increasingly confident in working with data without using graphs. > > Again, this is just my personal opinion and there may be those who disagree. > > Kind regards, > Pietro > > Em sex., 29 de mar. de 2024 às 12:01, Gabriele Battaglia <iz4apu(a)libero.it> escreveu: >> Hi guys. >> >> My first question has to do with a subject I care a lot, sonification. >> >> >> I tried astronify but I'm not very happy with it. In my opinion it lacks >> many things like stereo capability, using different waveforms, sonify >> more than 1 serie of data at the same time and a usless complex grammar. >> >> >> I would like to try something more complete and maybe easier to use. >> >> >> Do you know something like that, to import as a python library? >> >> >> Thanks. >> >> >> Gabe. >> >> -- >> Gabriele Battaglia (IZ4APU) >> --... ...-- -.. . .. --.. ....- .- .--. ..- - ..- . . >> Sent from my Giant Desktop PC >> >> _______________________________________________ >> Data Science mailing list -- datascience(a)blindcoders.com >> To unsubscribe send an email to datascience-leave(a)blindcoders.com > _______________________________________________ > Data Science mailing list -- datascience(a)blindcoders.com > To unsubscribe send an email to datascience-leave(a)blindcoders.com >

April 8, 2024