DEX8-SDK is free and open source library which helps developers to build complex automation scripts so called DEX8 Tasks.
The code is on the Github: https://github.com/smikodanic/dex8-sdk .
The library is divided into two parts:
1. CLI - Command Line Interface (use commands from the OS terminal)
2. Helpers - a set of helper libraries which makes the DEX8 task creation easier
Now you can use DEX8-SDK CLI commands.
The library is divided into two parts:
1. CLI - Command Line Interface (use commands from the OS terminal)
2. Helpers - a set of helper libraries which makes the DEX8 task creation easier
Content
-
CLI - Command Line Interface
- initiate, delete, start, upload and download tasks from command line -
Helpers
- a collection of rich helper libraries
- Echo - a library for sending messages to web panel or log it to console
- FunctionFlow - a library for controlling the execution flow of JS functions
- HttpClient - a HTTP/HTTPS Client with promises and 301 redirection
- Mongo - methods to save, list, update, delete MongoDB documents
- Rand - generate stohastic numbers, shuffle array elements, ...etc
- RobotsTxt - fetch and parse the robots.txt file
- CSV - parse (rad & write) the CSV files
Quickstart
1. Installation
$ npm install -g dex8-sdk
Now you can use DEX8-SDK CLI commands.
2. Start a new project (task)
$ dex8 init <taskName>
- creates the minimum files needed for task development
$ cd <taskName>
3. Develop task
Uses DEX8-SDK helpers to develop crawler, spider, scraper, data extraction or any automation tool.4. Test a task
$ dex8 start -i input.js -s
- test task on your localhost (local computer)
5. Login to Web Panel
$ dex8 login
- login with the same username and password which you use to login into Web Panel
6. Upload a task
If everything is ok with your task upload it to Web Panel:$ dex8 upload