We've also added new features to our platform: • Value History Tracking - instantly see what changed between extractions • List/Detail Extraction Modes - guide the LLM for more accurate results • Email Notifications - choose exactly which updates matter to you If you're

🎉 We've open-sourced lightfeed-extract, our LLM-powered web data extraction library that's processed over 10M records in production! 💻 We built lightfeed-extract to solve real challenges: invalid JSON and broken links in LLM outputs. It provides clean HTML conversion, JSON

Here is the full blog post:

We're thrilled to launch our new Lightfeed API along with official TypeScript and Python SDKs, now available on GitHub: https://t.co/9iQDILmXjQ ⚡️ Instant data retrieval through simple API calls: eliminating the wait times and costs associated with traditional crawl and scrape

We're excited to announce Lightfeed Extraction, our solution for web data extraction and management at scale. ⚡️ Extraction with Just a Prompt: Getting structured data from websites using simple natural language prompts - no coding required. Just describe what you need, and let

We also supported analyzing PDFs, more robust scrapers and more readable workflow emails. Read more in our December change log here

You can now track user or company activity on LinkedIn and Google search results.

Adding websites is now 10x easier and customizable, and you can directly ask AI what to extract.

⚡️We just launched AI workflows - to automate search and analysis on websites at scale. Run powerful AI hybrid search and use LLM agents to analyze thousands of websites every hour. Here is a 3min walkthrough 👇

We also released API-based pricing, onboarding and dozen of other new features. All that and more on our first changelog here https://t.co/Xin6qA4q4v

We also improved data visibility into dashboard by adding filters, table view and export to CSV.

Define the data format you need per each website. Lightfeed will extract, deduplicate and index data into the knowledge base continuously. Lightfeed uses AI to reason about the entire page. It can extract relevant content from anywhere on the page and is robust to site changes.

Introducing knowledge base in Lightfeed! It is your custom database to extract website data at scale. We've been improving it for the last two months - making it able to extract any public website at the frequency you choose.

New Docs and step-by-step tutorial📣 💡 How to robustly extract websites at scale using LLM 🔎 Create a search alert on contents you need using embeddings We use LLM to understand semantic meaning in order to extract, index and search. https://t.co/hhVB9tKUeL

🏗️No-code workflow editor is out - this makes it straightforward to configure a workflow - which is a sequence of runnable nodes: Trigger workflow to run by new contents indexed. Use semantic search to query by LLM embeddings. Send results to email or publish to RSS.

We just released a new UI for dashboard! On the left - you still have the workflow results (here I have several search workflows). What is new is on the right - you can see the latest contents from websites that got indexed into your knowledge base.

We just launched RSS export to https://t.co/d6PvZmwlaC - so that workflow results can be fetched from any RSS readers - or alternatively use it like an API and convert xml to JSON in your client #lightfeed #knowledgeAPI #llm

@CollisionHQ is a blast! First time with @lightfeed_ai and what I can say: - Super friendly to early startups. Lots of events for showcasing - Nice pool of startups and SMBs for lead gen - Great to connect with likely-minded founders Excited that it is coming to Vancouver 2025