Open Access Open Access  Restricted Access Subscription or Fee Access

Comparison of Extracting Data Using End-User Visual Tools and Traditional Methods

Atef Raslan, Ahmed N. Abdelbaset, Al-Hussein A. Galal, Mohamed A. Abdelaziz

Abstract


End users including technical and non-technical are facing many problems regarding extracting big amount of data through public websites. Our aim here is that we try to provide a way or solution to extract needed data faster, more accurate, with no code and easy to be used for technical users and nun-technical users as well.

Keywords


Visual Web Scraping Tool, RPA, UiPath, data extraction, Web crawling, Dynamic Websites, Robots

Full Text:

PDF

References


Legaspi Xurxo, “Scraping de sitios web dinámicos para datos económicos,” 2016.

Joel Willers, “Methods for extracting data from the Internet,” pp. 9–25, 2019.

N. R. Haddaway, “The use of web-scraping software in searching for grey literature,” Grey J., vol. 11, no. February, pp. 186–190, 2016.

A. Extract, I. Business-, and C. W. Data, “Robotic Process Automation for Web Data Extraction”.

“December 2021,” J. Ubiquitous Comput. Commun. Technol., vol. 3, no. 4, 2021, doi: 10.36548/jucct.2021.4.

I. Dongo et al., “A qualitative and quantitative comparison between Web scraping and API methods for Twitter credibility analysis,” Int. J. Web Inf. Syst., vol. 17, no. 6, pp. 580–606, 2021, doi: 10.1108/IJWIS-03-2021-0037.

M. A. Khder, “Web scraping or web crawling: State of art, techniques, approaches and application,” Int. J. Adv. Soft Comput. its Appl., vol. 13, no. 3, pp. 144–168, 2021, doi: 10.15849/ijasca.211128.11.

J. Kharade and I. Technology, “DATA COLLECTION USING WEB SCRAPPING WITH ROBOTIC PROCESS DATA COLLECTION USING WEB SCRAPPING WITH ROBOTIC,” no. August, 2022.

D. Glez-Peña, A. Lourenço, H. López-Fernández, M. Reboiro-Jato, and F. Fdez-Riverola, “Web scraping technologies in an API world,” Brief. Bioinform., vol. 15, no. 5, pp. 788–797, 2013, doi: 10.1093/bib/bbt026.

N. Levine, “How to Copy and Select Text on Websites that Don’t Allow It,” 2022. https://www.wikihow.com/Copy-Text-That-Cannot-Be-Copied

F. Polidoro, R. Giannini, R. Lo Conte, S. Mosca, and F. Rossetti, “Web scraping techniques to collect data on consumer electronics and airfares for Italian HICP compilation,” Stat. J. IAOS, vol. 31, no. 2, pp. 165–176, 2015, doi: 10.3233/sji-150901.

CFI Team, “Stock Keeping Unit (SKU),” 2021. https://corporatefinanceinstitute.com/resources/knowledge/other/stock-keeping-unit-sku/


Refbacks

  • There are currently no refbacks.


Creative Commons License
This work is licensed under a Creative Commons Attribution 3.0 License.