Overview
Manually hunting down PDF and HTML links in sitemap XMLs is tedious and error-prone. This workflow automates fetching, parsing, and filtering up to 50 URLs from sitemap.xml files, pinpointing only PDF or HTML links. It slashes manual effort and speeds up your document or page collection process.
The Impact
- Slash manual URL extraction. Automate sitemap parsing to avoid tedious manual searches.
- Filter precisely. Grab only PDF and HTML links relevant for your tasks.
- Limit overload. Cap extraction at 50 URLs to keep data manageable.
- Streamline records. Log filtered links for easy follow-up or storage.
Who This Is For
- Operations Teams Automate internal document link collection for indexing or backup.
- Compliance Officers Quickly locate PDF reports and HTML pages for audits or archiving.
- Developers & Product Managers Generate pre-migration checklists of crucial HTML/PDF links to avoid omissions.
- Content Managers Efficiently gather page URLs for content audits or updates.
How It Works
- Fetch Sitemap XML
- Send a GET request to the provided SitemapUrl to retrieve raw sitemap XML content.
- Parse Sitemap XML
- Extract up to 50 URLs by matching <loc> tags from the fetched XML content.
- Iterate URLs
- Loop through each extracted URL for processing.
- Filter PDF or HTML
- Check if the URL contains ".pdf" or ".html" and flag for recording.
- Log Matches
- Record and output filtered URLs for downstream use or storage.
What You'll Need
Before using this template, make sure you have:
- A valid URL pointing to an accessible sitemap XML file that returns standard sitemap content.
How to Use
- Step 1. Prepare Sitemap URL
- Step 2. Configure Parameter
- Step 3. Run the Workflow
- Step 4. Review Results
- Step 5. Verify Execution
Obtain the URL of the sitemap XML (e.g., https://example.com/sitemap.xml) that you want to extract URLs from.
Paste the sitemap URL into the SitemapUrl parameter of the workflow.
Execute the workflow to fetch, parse, and filter URLs automatically.
Check the logged output for PDF and HTML URLs extracted and filtered from the sitemap.
Confirm that the workflow processed up to 50 URLs and that all relevant PDF and HTML links have been captured correctly.