Overview
Manually tracking new RSS or Atom feed articles with images is tedious and error-prone. This automation fetches your specified feed, filters out already processed items, extracts embedded images, and returns only fresh articles with photos—saving time and eliminating duplicate content handling.
The Impact
- Skip duplicates. Automatically ignore previously processed articles to focus only on fresh content.
- Extract images. Pull out all images from article content, highlighting the primary image for quick reference.
- Streamline curation. Deliver a ready-to-use list of new articles with photos, speeding up editorial or social media workflows.
- Enable incremental updates. Maintain state with processed IDs for continuous feed monitoring without redundant processing.
Who This Is For
- Media Editors needing automated collection of new articles with images for content recommendations.
- Social Media Managers seeking to push only image-rich posts to their channels efficiently.
- Subscription Service Operators building incremental content delivery pipelines that avoid duplicate notifications.
- Content Aggregators who require clean, deduplicated feeds with image assets extracted upfront.
How It Works
- Fetch RSS Feed
- Perform an HTTP GET request on the specified RSS/Atom URL to retrieve the raw feed data.
- Parse and Deduplicate
- Parse feed XML, extract article metadata, and filter out articles already processed based on stored IDs.
- Extract Images
- Loop through new articles, extract all image URLs from HTML content, identify the primary image and count total images.
- Aggregate Results
- Merge extracted image data into a collection of articles ready for output.
- Format Output
- Return a structured list of new articles with images, count of new articles, and updated processed IDs for next runs.
What You'll Need
Before using this template, make sure you have:
- Access to the URL of the RSS or Atom feed you want to monitor (e.g., http://www.theverge.com/rss/full.xml).
- A method to store and provide the comma-separated list of processed article IDs to enable incremental processing.
- No special authentication or credentials are required for public RSS/Atom feeds.
How to Use
- Step 1. Set the RSS feed URL
- Step 2. Initialize processed IDs
- Step 3. Run the workflow
- Step 4. Save the output processedIds
- Step 5. Verify results
Input the full RSS or Atom feed URL you want to monitor in the RssUrl parameter.
For the first run, leave the ProcessedIds parameter empty to process all available articles.
Execute the workflow to fetch, parse, and extract new articles containing images.
Store the processedIds output for use in subsequent runs to avoid duplicate processing.
Check the newArticles output to confirm fresh articles with images were captured correctly.