Scrape and summarize posts of a news site without RSS feed using
The News Site from Colt, a telecom company, does not offer an RSS feed, therefore web scraping is the choice to extract and process the news. The goal is to ...
🔌 Nodes & Integrations Used (5)
📖 Implementation & Setup Guide
The [News Site](https://www.colt.net/resources/type/news/) from Colt, a telecom company, does not offer an RSS feed, therefore web scraping is the choice to extract and process the news.
The goal is to get only the newest posts, a summary of each post and their respective (technical) keywords.
Note that the news site offers the links to each news post, but not the individual news. We collect first the links and dates of each post before extracting the newest ones.
The result is sent to a SQL database, in this case a NocoDB database.
This process happens each week thru a cron job.
**Requirements**: - Basic understanding of CSS selectors and how to get them via browser (usually: right click → inspect) - ChatGPT API account - normal account is not sufficient - A NocoDB database - of course you may choose any type of output target
**Assumptions**: - CSS selectors work on the news site - The post has a date with own CSS selector - meaning date is not part of the news content
**"Warnings"** - Not every site likes to be scraped, especially not in high frequency - Each website is structured in different ways, the workflow may then need several adaptations.
⚡ How to import this workflow into n8n:
- Click the Direct Download JSON button above to save
Scrape_and_summarize_posts_of_a_news_site_without_RSS_feed_using.json. - Log in to your n8n Cloud or self-hosted n8n instance.
- In your workflow canvas, click the menu in top-right and select Import from File (or paste the JSON directly).
- Configure your credentials (e.g. API keys, database URLs) in the corresponding node settings.
- Click Execute Workflow to test and switch to Active!
Related Social Media & Content Workflows
View All in Social Media & Content →AI Auto-Tagging for WordPress Posts
Production-ready n8n automation template for AI Auto-Tagging for WordPress Posts built by AhiXLight. Seamlessly connects Lm Chat Open Ai, Output Parser Autofixing, Output Parser Structured with 32 configured nodes.
AI Auto-Tagging for WordPress Posts
Production-ready n8n automation template for AI Auto-Tagging for WordPress Posts built by AhiXLight. Seamlessly connects Lm Chat Open Ai, Output Parser Autofixing, Output Parser Structured with 32 configured nodes.
AI Image Caption Generator Overlay
Production-ready n8n automation template for AI Image Caption Generator Overlay built by AhiXLight. Seamlessly connects Lm Chat Google Gemini, Output Parser Structured, Edit Image with 16 configured nodes.
AI Image Caption Generator with Overlay
Production-ready n8n automation template for AI Image Caption Generator with Overlay built by AhiXLight. Seamlessly connects Lm Chat Google Gemini, Output Parser Structured, Edit Image with 16 configured nodes.