These days we received some feedback from our users and some of them have troubles moving forward with Octoparse for issues happened occasionally.Ĭan octoparse pick up from where it stopped Therefore, my post here is to share my experience with you about using Octoparse, in hope that they’ll help guide you move forward and deal with more difficult and complex websites. Manually Check the Rule in the Workflow Designer. Since Octoparse doesn’t signal an error for you to trace the problem when configuring a rule, you would usually have no ideas when some problems arose like missing data or failing to click the item or open the page. To avoid such errors or to find out whether the rule configured works, you’d better manually check the rule in the Workflow before running the task. By doing this, you could see which steps don’t work in the visual built-in browser and data field.
#Octoparse text entry not working how to
#CAN OCTOPARSE PICK UP FROM WHERE IT STOPPED HOW TO#Ĭheck the tutorial below to learn how to do that.Ĭheck The Extraction Rule When Errors Occur Thus once you find something wrong, you could modify the rule accordingly. Sometimes you would find that even you configured the right rule and could get the data when manually checking the rule in the Workflow Designer, data records often missed when you initiated extraction. The easiest method is to set longer AJAX timeout under the action of “Go to page”, “Click item” and “Click to paginate”. Also, you could set waiting time before execution under different actions in the Workflow Designer so that you could ensure the data you want is loaded. Some contents are not displayed unless you scroll down, so you may miss some data by forgetting setting the scroll times. Choose the scroll down ways and set proper scroll times. It’s also important to the results you get.īut before executing the steps above, you should remember that all the steps should be taken after the page is fully loaded if not, even though you change the rule, the rule would still not work.īesides, we don’t recommend you to choose “Open the link in new tab” and “Load the page with AJAX” in parallel unless Octoparse still failed to open some websites like LinkedIn. The correct use of XPath is the key to extract data in Octoparse. Steps like pagination, missing data and irregular value fields involve the change of XPath at most times.
So I strongly suggest you learn some knowledge about XPath.
Just a little know of XPath could help you solve a lot of problems in using Octoparse. The tutorials or FAQs below could help you pick up XPath quickly. You would find that you couldn’t get all the data records you want even though you ensure the configuration rule is right. Issues happened occasionally especially in the steps of “Click item” or “Click to paginate” because of the the amount of data or the complexity of the website itself. #CAN OCTOPARSE PICK UP FROM WHERE IT STOPPED HOW TO#Įven, if you don’t use cloud extraction with paid versions, you would find that you have to restart if the Internet cut off or the computer went to sleep.
0 kommentar(er)
