DEX8-SDK

Build robot tasks with ease
DEX8-SDK is a library which helps developers to build complex automation scripts so called DEX8 Tasks.

The library is divided into two parts:
   1. CLI - Command Line Interface
   2. Helpers - a set of helper libraries which makes task creation easier

Content

  • CLI - Command Line Interface

    - initiate, delete, start, upload and download tasks from command line
  • Helpers

    - a collection of rich helper libraries
    1. Echo - a library for sending messages to web panel or log it to console
    2. FunctionFlow - a library for controlling the execution flow of JS functions
    3. HttpClient - a HTTP/HTTPS Client with promises and 301 redirection
    4. Mongo - methods to save, list, update, delete MongoDB documents
    5. Rand - generate stohastic numbers, shuffle array elements, ...etc
    6. RobotsTxt - fetch and parse the robots.txt file
    7. CSV - parse (rad & write) the CSV files



Quickstart

1. Installation
$ npm install -g dex8-sdk
Now you can use DEX8-SDK CLI commands.
2. Start a new project (task)
$ dex8 init <taskName> - creates the minimum files needed for task development
$ cd <taskName>
3. Develop task
Uses DEX8-SDK helpers to develop crawler, spider, scraper, data extraction or any automation tool.
4. Test a task
$ dex8 start -i input.js -s - test task on your localhost (local computer)
5. Login to Web Panel
$ dex8 login - login with the same username and password which you use to login into Web Panel
6. Upload a task
If everything is ok with your task upload it to Web Panel:
$ dex8 upload