FM
FlowMarket
RAG & Vector DB Advanced ⚡ 36 n8n Nodes

Community insights using Qdrant Python and Information Extracto

This n8n template is one of a 3-part series exploring use-cases for clustering vector embeddings: Survey Insights Customer Insights Community Insights This t...

🔌 Nodes & Integrations Used (10)

Hacker News Vector Store Qdrant Embeddings Open Ai Document Default Data Loader Text Splitter Recursive Character Text Splitter HTTP Request Lm Chat Open Ai Google Sheets Execute Workflow Trigger Information Extractor

📖 Implementation & Setup Guide

This n8n template is one of a 3-part series exploring use-cases for clustering vector embeddings: * Survey Insights * Customer Insights * Community Insights

This template demonstrates the Community Insights scenario where HN commments can be quickly grouped by similarity and an AI agent can generate insights on those groupings.

With this workflow, Researchers or HN users can quickly breakdown community consensus on a particular topic and identify frequently mentioned positives and negatives.

Sample Output: https://docs.google.com/spreadsheets/d/e/2PACX-1vQXaQU9XxsxnUIIeqmmf1PuYRuYtwviVXTv6Mz9Vo6_a4ty-XaJHSeZsptjWXS3wGGDG8Z4u16rvE7l/pubhtml

How it works * HN comments are imported via the Hacknews API node. * Comments are then inserted into a Qdrant collection carefully tagged with the Hackernews API metadata. * Comments are then fetched and are put through a clustering algorithm using the Python Code node. The Qdrant points are returned in clustered groups. * Each group is looped to fetch the payloads of the points and feed them to the AI agent to summarise and generate insights for. * The resulting insights and raw responses are then saved to the Google Spreadsheet for further analysis by the researcher or the HN user.

Requirements * Works best with lots of comments! * Qdrant Vectorstore for storing embeddings. * OpenAI account for embeddings and LLM.

Customising the Template * Adjust clustering parameters which make sense for your data. * Adjust sentimentality setting if comments are overwhelmingly negative at times.

⚡ How to import this workflow into n8n:

  1. Click the Direct Download JSON button above to save Community_insights_using_Qdrant_Python_and_Information_Extracto.json.
  2. Log in to your n8n Cloud or self-hosted n8n instance.
  3. In your workflow canvas, click the menu in top-right and select Import from File (or paste the JSON directly).
  4. Configure your credentials (e.g. API keys, database URLs) in the corresponding node settings.
  5. Click Execute Workflow to test and switch to Active!

Related RAG & Vector DB Workflows

View All in RAG & Vector DB →