Ragex.URLAnalyzer.WebFetcher (Ragex v0.32.1)

View Source

Fetches and parses web pages, documentation, raw code files, and API specifications.

Summary

Functions

Fetches a web page or file, parses its content, extracts metadata, headings, code snippets, and converts HTML to clean markdown/text.

Functions

fetch_and_parse(url_string, opts \\ [])

@spec fetch_and_parse(
  String.t(),
  keyword()
) :: {:ok, map()} | {:error, term()}

Fetches a web page or file, parses its content, extracts metadata, headings, code snippets, and converts HTML to clean markdown/text.