← Previous: Building an App | Home | Next: Context Engineering Template →
Now we've covered the basics I'm going to give you some insight into WHAT third party API's I use to basically create projects and sell them.
Jina is by far and away the best AI scraper that there is. Especially for price. It's stupid cheap and stupid easy to play around with completely for free.
It's a SERP scraper as well as a normal page scraper - and it scrapes pages in a special way that gives you markdown but a token friendly markdown of the page. Including links etc - meaning you can easily extract information out of this.
Think of Jina as a way to GET the information - then you could (if you wanted to) read it yourself, and extract information manually from it - or you could feed it all to a prompt and extract information that way.
The way I do it is I scrape the page with Jina (r.jina.ai/example.com - go to this site to understand what I'm talking about) - and then feed the output to a cheap model like GPT 4o Mini - but give it a predetermined JSON object respond with JSON.
The reason you use JSON is because you can easily then display or use that information in a certain way. For example, you could output title, description, meta title, meta description - and then these fields could be plugged directly into (for example) the Shopify API to update a Shopify Product's SEO
OR - YOU CAN DISPLAY THE JSON DATA, or feed the JSON data to another prompt to then write with. The opportunities here are endless.
But how do you FIND the URLs? That's where s.jina.ai comes in
Just a quick note: you can use search operators inside Jina. For example, if you are trying to find guest posts for SEO, you can do "write for us" <generated_niche_words> on Google/Jina and get guest post ideas back - this is important to know
Go to jina.ai - you don't even need an account just follow my instructions
Click API
← Previous: Building an App | Home | Next: Context Engineering Template →