
π New Features in PulpMiner: Dynamic URL Variables & Scraper Selection!
Hey everyone! π
Weβre excited to announce two powerful new features in PulpMiner that make API creation from webpages even more flexible and accurate.
Check them out below π
π§© 1. Dynamic URL Variables

Now you can create dynamic APIs from a single webpage URL by converting static URL parts into variables.
π§ How it works:
Choose any segment in your URL (like a product ID or slug).
Replace it with a dynamic variable (e.g., {{ PRODUCT_ID }}).
Get an API endpoint that accepts dynamic inputs in real-time.
β‘οΈ Example:
https://www.amazon.com/dp/B0CMDL3H3P β
https://www.amazon.com/dp/{{ PRODUCT_ID }}
Perfect for scraping pages with the same structure but different data. π―
π οΈ 2. Dual Scraper Selection

You can now choose from 2 powerful scrapers when generating JSON from webpages. Each scraper is optimized for different page structures and content types.
Bonus: There's also a toggle to enable JavaScript rendering for pages that require it.
π― Use the best scraper for each use case and get more accurate structured data with zero code.
π§ͺ Why This Matters
These updates give you:
More control over how URLs are used as API inputs.
More reliability in data extraction from different webpage formats.
Faster workflows with less manual intervention.
π Ready to try them out?
Head to your dashboard and play around with the new options!
Got feedback? Drop it below π or DM us β weβd love to hear what you build with this!
β Team PulpMiner π§π οΈ
Replies
PulpMiner
@cristian_stoian_urzica Thank you, Cristian.
The dynamic URL feature looks super helpful. I have been hacking together scripts to monitor blogs and this might finally simplify things. Any plans to add scheduled fetches?
PulpMiner
@hamza_afzal_butt Thank you, Hamza. Yes fetching latest content and storing in cache on a scheduled basis so that data will be updated. This feature is in roadmap. π
Purposeful Poop
looks cool! tbh i don't understand this testimonal on your pricing page
PulpMiner
@catt_marroll Yes we use Cloudflare workers infrastructure to host the apis and the data is served from the edge functions. I hope this clears any confusion.