SpiderBot

What Does SpiderBot Do?

SpiderBot is a powerful Discord bot designed specifically for web crawling and scraping tasks. It enables users to seamlessly collect data from websites, take screenshots, and manage content in various formats. Here are some of the core features of SpiderBot:

• Crawling: Retrieve content from multiple pages of a website.
• Scraping: Extract specific data from websites.
• Screenshotting: Capture screenshots of web pages.
• Authentication: Connect to the spider.cloud service.
• Purchasing Credits: Buy credits to use the system.

Slash Commands

Here is a list of available slash commands that you can use with SpiderBot:

#### 1. Crawling Commands

• /crawl: Crawls content from a website.

- Options: - url (required): The URL of the website to scrape. - limit (required): The limit of pages to collect (1-40). - return_format (optional): The format for the scraped content (raw, markdown, commonmark, bytes). - readability (optional): Clean up content for large language models (LLMs) using readability.

#### 2. Scraping Commands

• /scrape: Scrapes specific data from a website.

- Options: - url (required): The URL of the website to scrape. - return_format (optional): The format for the scraped content (raw, markdown, commonmark, bytes). - readability (optional): Clean up content for large language models (LLMs).

#### 3. Screenshot Commands

• /screenshot: Takes a screenshot of a web page.

- Options: - url (required): The URL of the website to screenshot. - limit (required): The limit of pages to collect (1-40). - wait_duration (optional): Duration to wait for render (1-6 seconds).

#### 4. Authentication Commands

• /authenticate: Authenticate to spider.cloud.

#### 5. Purchasing Credits

• /purchase_credits: Purchase credits to use the system.

- Options: - amount (required): The amount of credits to purchase (1-100000).

Getting Started

To get started with SpiderBot, simply invite it to your server using the bot invite link. Once it’s in your server, you can start using the slash commands by typing / in the chat and selecting from the available options.

Support

Contact support@spider.cloud for any issues.