Skip to content
Forjed Crawler

Search. Always.

The new independent index, by Forjed.

Live — indexing now

5

Countries

Features

A crawler that make sense

Forjed Crawler offers unique features that allow you to better understand websites through a blend of entertaining and technical insights, as well as collaborative efforts to enrich the index, all while prioritizing privacy.

Hosted on green energy

The crawler is proudly hosted on servers powered by renewable energy.

Carbon.txt detection

Curious to know if a website is hosted on a green server? The crawler automatically detects websites with a carbon.txt file from the Green Web Foundation, indicating that the website runs on green hosting.

API requests are not logged

As Forjed is committed to protecting privacy, the API does not log the requests it receives and IP addresses. See our Privacy Policy

Wondering how much third-party the site is loading?

Every page is stored with the number of external domains it loads.

Always fresh

Every pages are recrawled every 2 week (14 days) to ensure the freshness of the results. Done with outdated results.

Crawled together

Volunteers can host a worker on their own computer/server to contribute to the index. See here

API

Get your API key

Forjed Crawler API is only on request for now. Please contact Forjed if you would like to get access.

Coverage

The countries we cover

More countries to be added soon!

United Kingdom

English

en-GB

Australia

English

en-AU

Canada

English, French

en-CA · fr-CA

Belgium

French

fr-BE

France

French

fr-FR

For site owners

The crawler identifies itself as ForjedBot and respects robots.txt and nofollow. It waits at least 1.5 seconds between two pages of the same site, longer if your robots.txt asks for it.

User agent

ForjedBot/1.0 (+https://forjed.xyz/crawler)

robots.txt

User-agent: ForjedBot
Disallow: /

Build on an independent index.

Ask for an API key and send your first request.