Typorithm · medium

Specialized Search Engines

specialized-enginesosintshodancensyswayback

Saved on this device

Full lesson · 8 learning steps Open any exercise for focused practice

Step 1 of 8 · intro card

Learn Specialized Search Engines

Search & Discovery

Beyond a web search engine, Shodan and Censys index internet-connected devices and exposed services, the Wayback Machine recovers old or deleted pages, and crt.sh lists issued certificates. Each reveals a different slice of an organization's footprint for an authorized exposure assessment.

A web search engine indexes pages, but it does not map exposed infrastructure. Shodan and Censys scan the internet directly and index the devices and services answering on it — letting you query by software, port, country, or other fields.

The Wayback Machine archives snapshots of pages over time, so content that was edited or removed from the live site is still recoverable. crt.sh queries certificate transparency logs, which publicly record every certificate issued for a domain.

Each engine reveals a different slice of an organization's footprint: Shodan and Censys show what services are reachable, certificate logs often expose forgotten subdomains, and archives surface history. Together they make a thorough self-assessment possible.

Shodan and Censys index reachable devices and services.

The Wayback Machine recovers old or deleted pages.

crt.sh lists certificates, often revealing subdomains.

shodan search "apache" country:US
censys search services.port=443
# Wayback Machine: archived pages
# crt.sh: certificate transparency

Read the implementation

Connect each part of the code to the concept before you type.

1. Index devices

Shodan indexes internet-connected hosts; this query finds devices serving Apache in the US, revealing exposed servers.

shodan search "apache" country:US

2. Query services

Censys scans the internet and lets you query exposed services by field — here, hosts with an open port 443.

censys search services.port=443

3. Old pages

The Wayback Machine stores historical snapshots, recovering pages that were changed or deleted from the live site.

# Wayback Machine: archived pages

4. Certificates

crt.sh queries certificate transparency logs, listing certificates issued for a domain — often exposing forgotten subdomains.

# crt.sh: certificate transparency

A complete learning loop

Understand

Read the concept map and follow the code breakdown.

Reconstruct

Type the implementation, repair mistakes and work through every recall exercise.

Verify

Use the final check without hints; revisit weak concepts in short practice sessions.