MELVIN GEORGE

πŸš€ New Features in PulpMiner: Dynamic URL Variables & Scraper Selection!

Hey everyone! πŸ‘‹

We’re excited to announce two powerful new features in PulpMiner that make API creation from webpages even more flexible and accurate.

Check them out below πŸ‘‡


🧩 1. Dynamic URL Variables


Now you can create dynamic APIs from a single webpage URL by converting static URL parts into variables.

πŸ”§ How it works:

  1. Choose any segment in your URL (like a product ID or slug).

  2. Replace it with a dynamic variable (e.g., {{ PRODUCT_ID }}).

  3. Get an API endpoint that accepts dynamic inputs in real-time.

➑️ Example:

https://www.amazon.com/dp/B0CMDL3H3P β†’

https://www.amazon.com/dp/{{ PRODUCT_ID }}

Perfect for scraping pages with the same structure but different data. πŸ’―

πŸ› οΈ 2. Dual Scraper Selection


You can now choose from 2 powerful scrapers when generating JSON from webpages. Each scraper is optimized for different page structures and content types.

Bonus: There's also a toggle to enable JavaScript rendering for pages that require it.

🎯 Use the best scraper for each use case and get more accurate structured data with zero code.

πŸ§ͺ Why This Matters

These updates give you:

  • More control over how URLs are used as API inputs.

  • More reliability in data extraction from different webpage formats.

  • Faster workflows with less manual intervention.



πŸ”— Ready to try them out?

Head to your dashboard and play around with the new options!

Got feedback? Drop it below πŸ‘‡ or DM us β€” we’d love to hear what you build with this!

β€” Team PulpMiner πŸ§ƒπŸ› οΈ

181 views

Add a comment

Replies

Best
Cristian Stoian Urzica
That's a cool feature! Good job! 😁
MELVIN GEORGE

@cristian_stoian_urzica Thank you, Cristian.

The dynamic URL feature looks super helpful. I have been hacking together scripts to monitor blogs and this might finally simplify things. Any plans to add scheduled fetches?

MELVIN GEORGE

@hamza_afzal_butt Thank you, Hamza. Yes fetching latest content and storing in cache on a scheduled basis so that data will be updated. This feature is in roadmap. πŸ˜ƒ

Matt Carroll

looks cool! tbh i don't understand this testimonal on your pricing page

MELVIN GEORGE

@catt_marroll Yes we use Cloudflare workers infrastructure to host the apis and the data is served from the edge functions. I hope this clears any confusion.