Apify

Apify platform provider. Exposes GitHub repository scraping plus the shared async-run plumbing (run status and dataset retrieval) used by the brand-specific Apify scrapers such as Zillow, Amazon, and Booking. This is not a general scraper bucket; the social and company scrapers are their own brand providers (x, crunchbase, reddit, tiktok, instagram, linkedin, pitchbook). 3 endpoints available through Lava’s AI Gateway. See the Apify API docs for full documentation.

Supports both managed (Lava’s API keys) and unmanaged (bring your own credentials) mode.

Endpoints

POST https://api.apify.com/v2/acts/muscular_quadruplet~github-scraper/run-sync-get-dataset-items — $0.00025 / request

SDK
cURL

const data = await lava.gateway('https://api.apify.com/v2/acts/muscular_quadruplet~github-scraper/run-sync-get-dataset-items', {
  body: {
"mode": "search",
"searchQuery": "machine learning",
"maxItems": 25
},
});

curl -X POST "https://api.lava.so/v1/forward?u=https%3A%2F%2Fapi.apify.com%2Fv2%2Facts%2Fmuscular_quadruplet~github-scraper%2Frun-sync-get-dataset-items" \
  -H "Authorization: Bearer $LAVA_SECRET_KEY" \
  -H "Content-Type: application/json" \
  -d '{"mode":"search","searchQuery":"machine learning","maxItems":25}'

Check the status of an async Apify actor run by run id (the `id` from the start response). Returns the run object, including `status` once it reaches SUCCEEDED. Free.

GET https://api.apify.com/v2/actor-runs/RUN_ID — Free / request

SDK
cURL

const data = await lava.gateway('https://api.apify.com/v2/actor-runs/RUN_ID', { method: 'GET' });

curl "https://api.lava.so/v1/forward?u=https%3A%2F%2Fapi.apify.com%2Fv2%2Factor-runs%2FRUN_ID" \
  -H "Authorization: Bearer $LAVA_SECRET_KEY"

Fetch the scraped rows from a finished Apify run, by run id: GET /v2/actor-runs/{runId}/dataset/items. Free, the scrape was billed once on the run completion.

GET https://api.apify.com/v2/actor-runs/RUN_ID/dataset/items — Free / request

SDK
cURL

const data = await lava.gateway('https://api.apify.com/v2/actor-runs/RUN_ID/dataset/items', { method: 'GET' });

curl "https://api.lava.so/v1/forward?u=https%3A%2F%2Fapi.apify.com%2Fv2%2Factor-runs%2FRUN_ID%2Fdataset%2Fitems" \
  -H "Authorization: Bearer $LAVA_SECRET_KEY"

Endpoints

Check the status of an async Apify actor run by run id (the `id` from the start response). Returns the run object, including `status` once it reaches SUCCEEDED. Free.

Fetch the scraped rows from a finished Apify run, by run id: GET /v2/actor-runs/{runId}/dataset/items. Free, the scrape was billed once on the run completion.

Next Steps

All Providers

Forward Proxy

​Endpoints

​Search GitHub repositories by keyword, get all repos from a user/org, or discover trending repos. Supports full GitHub search syntax (stars:>1000, language:python, user:facebook). Returns stars, forks, watchers, topics, license, language, and optionally README content. $0.01 per 1,000 results.

​Check the status of an async Apify actor run by run id (the id from the start response). Returns the run object, including status once it reaches SUCCEEDED. Free.

​Fetch the scraped rows from a finished Apify run, by run id: GET /v2/actor-runs/{runId}/dataset/items. Free, the scrape was billed once on the run completion.

​Next Steps

All Providers

Forward Proxy

Endpoints

Search GitHub repositories by keyword, get all repos from a user/org, or discover trending repos. Supports full GitHub search syntax (stars:>1000, language:python, user:facebook). Returns stars, forks, watchers, topics, license, language, and optionally README content. $0.01 per 1,000 results.

Check the status of an async Apify actor run by run id (the `id` from the start response). Returns the run object, including `status` once it reaches SUCCEEDED. Free.

Fetch the scraped rows from a finished Apify run, by run id: GET /v2/actor-runs/{runId}/dataset/items. Free, the scrape was billed once on the run completion.

Next Steps