FM
FlowMarket
HR & Recruitment Intermediate ⚡ 13 n8n Nodes

Cv resume PDF parsing with multimodal vision AI

This n8n workflow demonstrates how we can use Multimodal LLMs to parse and extract from PDF documents in n8n. In this particular scenario, we're passing a ca...

🔌 Nodes & Integrations Used (6)

Output Parser Structured Google Drive HTTP Request Edit Image Lm Chat Google Gemini Chain Llm

📖 Implementation & Setup Guide

This n8n workflow demonstrates how we can use Multimodal LLMs to parse and extract from PDF documents in n8n.

In this particular scenario, we're passing a candidate's CV/resume to an AI which filters out unqualified applications. However, this sneaky candidate has added in hidden prompt to bypass our bot! Whatever will we do? No fret, using AI Vision is one approach to solve this problem... read on!

How it works

* Our candidate's CV/Resume is a PDF downloaded via Google Drive for this demonstration. * The PDF is then converted into an image PNG using a tool called [Stirling PDF](https://stirlingpdf.io). Since the hidden prompt has a white font color, it is is invisible in the converted image. * The image is then forwarded to a Basic LLM node to process using our multimodal model - in this example, we'll use Google's Gemini 1.5 Pro. * In the Basic LLM node, we'll need to set a User Message with the type of Binary. This allows us to directly send the image file in our request. * The LLM is now immune to the hidden prompt and its response is has expected.

The example CV/Resume with hidden prompt can be found here: [https://drive.google.com/file/d/1MORAdeev6cMcTJBV2EYALAwll8gCDRav/view?usp=sharing](https://drive.google.com/file/d/1MORAdeev6cMcTJBV2EYALAwll8gCDRav/view?usp=sharing)

Requirements

* Google Gemini API Key. Alternatively, GPT4 will also work for this use-case. * Stirling PDF or another service which can convert PDFs into images. Note for data privacy, this example uses a public API and it is recommended that you self-host and use a private instance of Stirling PDF instead.

Customising the workflow

* Swap out the manual trigger for another trigger such as a webhook to integrate into your existing services. * This example demonstrates a validation use-case ie. "does the candidate look qualified?". You can try additionally extracting data points instead such as years of experiences, previous companies etc.

⚡ How to import this workflow into n8n:

  1. Click the Direct Download JSON button above to save Cv resume PDF parsing with multimodal vision AI.json.
  2. Log in to your n8n Cloud or self-hosted n8n instance.
  3. In your workflow canvas, click the menu in top-right and select Import from File (or paste the JSON directly).
  4. Configure your credentials (e.g. API keys, database URLs) in the corresponding node settings.
  5. Click Execute Workflow to test and switch to Active!

Related HR & Recruitment Workflows

View All in HR & Recruitment →