A summary of research on web data acquisition methods based on distributed crawler

X Ren, H Wang, D Dai - 2020 IEEE 6th International …, 2020 - ieeexplore.ieee.org
Under the background of big data, data mining and full utilization have become necessary
ways for enterprises to improve their competitiveness. How to quickly and accurately obtain …

Implementation of efficient distributed crawler through stepwise crawling node allocation

H Kim, J Byun, Y Na, Y Jung - Journal of Advanced Information …, 2020 - dbpia.co.kr
Various websites have been created due to the increased use of the Internet, and the
number of documents distributed through these websites has increased proportionally …

Criação de uma base de valores imobiliários geo-referenciados a partir da extração de dados da internet

MA da Silva Roberto, A Koscianski - Revista de Tecnologia Aplicada, 2021 - cc.faccamp.br
Estão disponíveis na Internet muitas informações de interesse financeiro, porém na maioria
dos casos são apresentadas de maneira não adequada para processamento digital. Um …

Data extraction based on web scrapy

R Alshammari, R Alrashed, A Almutiri… - Innovations in Bio …, 2021 - Springer
In recent years, with the growth of big data the information on the Internet is increasing
rapidly, it has become important to have technologies that help the user to obtain the …

Hakurobottien suunnitteluperiaatteiden soveltaminen Scrapylla

J Rauhala - 2020 - trepo.tuni.fi
Hakurobotti on yksi internetin valtavan tietomäärän hallintaan kehitetyistä työkaluista. Se on
ohjelma, joka lähettää palvelimille pyyntöjä ja jäsentää vastauksena saamansa datan …