turnkey tasks » Bing Search Engine Scraper

extract search results from the Bing search engine

  Bing Search Engine Scraper

searchEngineBing

Turnkey task searchEngineBing extracts search results from Bing.com search engine.
It will extract URL, title, text and determine if the search result is paid or organic.
The extracted data is saved into the database with option to be classified under category and subcategory.

Features:

  • lists Bing search engine results by entering a specific search term
  • search a specific website by defining site: search operator
  • generic search results from All type (web results)
  • clicks the "Next Page" button automatically and extracts data from every page
  • classifies the extracted data under category and subcategory
  • saves the extracted data in NoSQL database as JSON document
  • track results in real-time by DEX8 Echo mesages

Usage examples:

  • SERP - search engine result page
  • SEO - search engine optimisation
  • Aggregated Search Engine - presents search results from different information sources
  • detect position of a web page and monitor its competition
  • determine if search result is organic or paid result
  • access Bing search results via DEX8 API
  • schedule this task and execute periodically

Input parameters:

name type description example
site string get search result from the web site www.adsuu.com
search_term string search term laptop
mo_uri string mongoDB URI with credentials mongodb://dex8_freeuser:xyz@5.189.161.70:27017/dex8-dev-pool-free01
mo_coll string mongoDB collection adverts_Bing
category string defines under which category the data will be saved IT
subcategory string defines under which sub category the data will be saved computers

Input File

The example of input file (input_default.js):
module.exports = {
  site: '',
  search_term: 'forex broker',
  mo_uri: 'mongodb://dex8_freeuser:xxx@63.33.211.64:27017/freeA',
  mo_coll: 'bing_finance',
  category: 'forex',
  subcategory: 'broker'
};

Output Result

A document stored in the MongoDB database:
{
    "_id" : ObjectId("5ea6ae101a5d820624e3f432"),
    "user_id" : null,
    "robot_id" : null,
    "task_id" : null,
    "url" : "https://admiralmarkets.com/",
    "title" : "Admiral Markets - Trade Forex, CFDs, metals & more with ...",
    "text" : "Admiral Markets UK Ltd. is authorised and regulated by the Financial Conduct Authority. As a leading Forex broker we provide our clients with the top level of financial confidence and investment protection. Deposit and withdrawal methods. The Award Winning Broker. DKI Customer's Choice 2019. Best CFD Broker 2016, 2018, 2019. Onlinebroker-Portal.de.",
    "category" : "forex",
    "subcategory" : "broker",
    "is_paid" : false,
    "se" : "bing",
    "site" : "",
    "search_term" : "forex broker",
    "created_at" : ISODate("2020-04-27T10:04:00.117+0000"),
    "updated_at" : ISODate("2020-04-27T10:04:00.117+0000"),
    "__v" : 0
}

PRICE: 30.00 EUR /month

To buy this product you need to sign up for a free account and login .