Docs

Guides

Scheduling

Run any scraper automatically on a cron schedule.

Overview

Any scraper can run on a schedule. Schedules use standard 5-field cron expressions evaluated in the timezone you pick.

Creating a schedule

  1. Go to Console → Schedules → New schedule.
  2. Pick a scraper and fill in its input — exactly as you would for a manual run.
  3. Choose a cron expression (or a preset like Every hour).
  4. Save. The next run time is computed and shown.

Cron expressions

Five fields: minute hour day-of-month month day-of-week.

Expression Meaning
*/15 * * * * Every 15 minutes
0 * * * * Every hour
0 9 * * 1-5 09:00 on weekdays
0 0 * * 1 Midnight every Monday

How it runs

A scheduler checks for due schedules every minute. When a schedule is due, it launches a run (marked with origin SCHEDULE) and computes the next run time. Pair scheduling with a webhook to build a fully automated pipeline — for example, a daily price check that posts to your Slack when something changes.