Write From URL
Generate articles based off of your competitors' URLs
First, you'll have to input one or more competitor URLs into the input box at the top of the screen.
The URLs that work best are ones for factual, informational articles. URLs with non-standard heading structures (i.e. review sites, news articles, product signup pages) are likely to perform poorly, and may not lead to any usable output.
Soon you'll be able to insert links to competitor sitemaps as an alternative to URLs, and have Byword scrape their links for you!
Once you've entered your URLs, and checked that the number of URLs lines in the interface lines up with what you were expecting, hit the Scrape URLs button, and Byword will begin processing the URLs.
This will usually take at least 60 seconds, and can take longer for larger lists of URLs.
Once the above has completed, Byword will then display the results of its scraping. It will tell you how many URLs were successfully scraped, and how many errors there were.
At this point, you can either press Generate to send your articles to the Batch Generator, or you can scroll down the page to look at the headings Byword has prepared.
For all articles that Byword was able to successfully scrape, you'll see rows that look like this.
The three icons on the right hand side of each row are (in order):
- Edit - Click this if you'd like to manually edit the headings that Byword has prepared.
- Delete - Click this if you'd like to delete the article. Note that this can't be reversed.
- Expand - Click this if you'd like to see the subheadings that Byword has prepared.
Clicking on the last of these (Expand) will open up a list of the subheadings for that article.
Should you wish to remove any headings, you can click the icon next to that heading.
Below the list of articles that Byword was able to successfully scrape, you may find a list of URLs that Byword wasn't able to scrape.
Errors typically occur when either:
- A site has specific access rules which prevent Byword from scraping that site (meaning some sites are highly likely to cause Byword to error).
- The URL provided doesn't have a heading structure that can easily be mapped onto Byword's style of SEO-optimised headings.
Re-running the scrape is unlikely to fix the error (though may in some rare cases).
Byword uses a queue system to process scrape requests. This means that, at times of high demand, it may take longer to process your job. Byword should be able to scrape 10 URLs per minute, but this may take longer in cases of high demand.
It's also worth noting that Byword throttles requests to the URLs you provide, as some sites will start rejecting requests from Byword if it notices too many of them within a short period of time.
Usually this is because you inputted a URL with weird subheadings. Write From URL is an experimental feature, and won't be able to scrape every URL perfectly. Some sites will have HTML structures that are much more amenable to scraping and re-working than others, and so it may take a bit of trial and error to find a competitor's site that works well with this feature.