Ragex.URLAnalyzer.WebFetcher (Ragex v0.32.0)

Fetches and parses web pages, documentation, raw code files, and API specifications.

Summary

Fetches a web page or file, parses its content, extracts metadata, headings, code snippets, and converts HTML to clean markdown/text.

@spec fetch_and_parse(
  String.t(),
  keyword()
) :: {:ok, map()} | {:error, term()}

Fetches a web page or file, parses its content, extracts metadata, headings, code snippets, and converts HTML to clean markdown/text.