Log in
Login
Password
Forgot password? Register



A-Parser – professional-grade multi-thread parser

15.06.2018

A-Parser - is a multi-thread parser of search engines, sites, keywords, content including various parsers, like:



  • Search engines parsers: SE::Google Google, SE::Yandex Yandex, SE::AOL AOL, SE::Bing Bing, SE::Baidu Baidu, SE::DuckDuckGo DuckDuckGo, SE::MailRu Mail.Ru, SE::QIP QIP, SE::Yahoo Yahoo, SE::Seznam Seznam, SE::YouTube YouTube, SE::Ask Ask, SE::Comcast Comcast

  • Search engine prompts parsers: SE::AOL::Suggest AOL, SE::Google::Suggest Google, SE::Yandex::Suggest Yandex, SE::Bing::Suggest Bing, SE::Yahoo::Suggest Yahoo

  • Parsers and analysis of keywords: keywords and frequency bySE::Yandex::WordStat Yandex.WordStat including dates and regions; frequency by SE::Yandex::Direct::Frequency Yandex.Direct; SE::Google::Trends Google Trends

  • Account registration: SE::Yandex::Register Yandex

  • Site and domain setting parsers: ranks in search enginesSE::Google::position Google, SE::Yandex::position Yandex, SE::MailRu::position Mail.Ru, SE::QIP::position QIP; параметры сайтов SE::Google::pR PageRank, SE::Google::TrustCheck TrustRank, SE::Google::Compromised Compromised, SE::Google::SafeBrowsing SafeBrowsing, HTML::TextExtractor::LangDetect LangDetect, SE::Bing::LangDetect LangDetect через Bing, SE::Yandex::TIC тИЦ, Net::Whois Whois, Net::DNS DNS, Rank::CMS CMS, Rank::Ahrefs Ahrefs, Rank::Alexa Alexa, Rank::Category Category, Rank::DMOZ DMOZ, Rank::Linkpad Linkpad, Rank::MajesticSEO MajesticSEO, Rank::OpenSiteExplorer OpenSiteExplorer, Rank::SEMrush SEMrush, Rank::Mustat Mustat

  • Various services parsers: SE::Bing::Translator Bing Translator, SE::Google::Maps Google Images, SE::Bing::Images Bing Images, SE::Google::Maps Google Maps, SE::Yandex::Direct Yandex.Direct, SE::Yandex::Catalog Yandex.Catalog, Util::AntiGate AntiGate, SEO::ping Ping

  • Content parsers: HTML::TextExtractor TextExtractor, HTML::LinkExtractor LinkExtractor, Check::BackLink BackLink, Net::HTTP HTTP parser for creation of random parsers



In this article, we’ll examine the addition and check of proxy on the example of our service, as well as the start of a task in A-Parser with proxy.

After the start of A-Parser, go to Настройки (Settings) and open Настройки потоков (Thread setting) tab:



Select the number of threads as 100 - as shown on a screenshot;
it's not recommended to use more than 100

Now open Настройки проверки прокси (Proxy check settings) tab (1)
Add a new preset and click Add new (2)
Name it. In my example, it's “no check1”
Press Ok (3)



Open the section you’ve installed A-Parser, in and find
aparser folder. Then open files folder and go to proxy folder.
You’ll see your preset here:



Let’s open it and look at its content:



sites.txt your link to proxy,
proxy.txt proxy list from the link,
alive.txt list of proxy which were live at parser operation;

Now go to https://awmproxy.com/edituser.php


Here you can see your IP (you’ll have your own one)). Enter it in the field as shown on the screenshot and press Сохранить (Save).
We’ve bound proxy to our IP address, which is essential for proxy functioning.

Now go to your profile - https://awmproxy.com/cabinet.php



Copy the link to proxy. Then open your profile with a preset. Open the section you’ve installed A-Parser to and find aparser folder. Then open files folder. Thereupon open proxy folder.
Open sites.txt


And paste your copied link. Then press Close.
Now go back to Proxy check settings tab

Check url: paste your link to proxy
No check proxies: tick this field, it means we’ve disabled proxy validity check. Our service sells only valid proxy, we check it independently; so there is no need to perform the check on your side; all proxy will work. The other settings can be left by default.
Press Сохранить (Save) button.
Open Проверка проксей (Proxy check) tab

You’ll see the following -

As we can see our proxy have been uploaded 8811 and are ready to work. You’ll see another proxy quantity, depending on purchased tariff. Now open Редактор заданий (Task editor) (1) on the basis of Google search results

Конфиг потоков (Thread configuration) (2) - select 100 threads
Парсер (Parser): (3) - select SE::Google
Формат результата (Result format): (4) - $pl.preset
Выберите файл (Select a file): (5) - subs/english_top1000.txt (we use 1000 inquiries in Google as an inquiry)
Имя файла (File name): (6) - $datefile.format().txt
Сохранить (Save) (7)

Go to Очередь заданий (Task order). You’ll see your work card.
Our task has already started to run, proxy have been uploaded, and the parsing is being performed.
You can also see detailed statistics and banned proxy here.
After a while, when the parser stops the work card will be sent to Завершенные (Completed).

We can download the result -


As you can see, our links have been successfully parsed and saved to a file.

<<< Back to articles