To make pagination setting simple, NDS has 6 built-in pagination modes which can fit for most of pagination scenario, and with the help of Element Finder, there is no need to write any codes. If no further list to scrape, then we can check 'No Pagination' and go to next step directly. the pagination works correctly from page 1 to page 2, from page 2 to page 3, so on and so forth. Does the pagination work well on all following pages? i.e.Is the next button/link located correctly.Is the pagiantion mode selected correctly.To make sure that pagination works fine on all following pages, there are four things we need to check: Here we define pagination to load more lists to scrape. Step 5: click 'Next' wizard button on the bottom of the editor to go to 'Pages' tab If dump is not checked, the field's value will be extracted from the page, but will not be output to the data table.Īfter block and fields elements declared correctly, you can click the 'Preview' button ( ) to preview the extract result from the current page, and click it again to close the preview window. declare if dump the field to output data table.If no target element is declared for the field, then the default value will be return as the value of the field. tranform the extracted value as you want (via clicking icon ).download the image if the target element is an image and attribute to extract is image Src.Except the built-in attributes, you can also type in specific attribute name directly define attribute to extract from the target element.specify actions to impose on the target element before extraction (via clicking icon ). NDS will update all highlighted elements automatically once you select/unselect another element manually. If the similar elements in some blocks are not selected, you can move mouse to these elements and click them (or pressing Shift key). Now move mouse to the page and select one element in a block, NDS will try to figure out all similar elements in other blocks. Once Field's Element Finder dialog is opened, all blocks are highlighted to tell that only elements in these blocks are selectable. Step 4: use Element Finder to locate elements in the block for each field. Here the Element Finder dialog shows that there are 33 blocks in the current page. More detail on how to use Element Finder to select multiple elements, please see Element Finder guide Step 3: for List node, we have to declare Block elements, and at least one field in the block.Īll repeating fields declared here must be covered in the block. More details on List node please see What is node? List1: a List node with an empty field(Field1) in default.Start : a Transit node with an openURL action in default.NDS will generate a recipe automatically with 2 nodes: Step 2: start NDS, click 'Pro Scrape' on the popup window, and select the second template, "click 'Next' to scrape more pages". We would like to scrape each item's attributes listed on the top 5 pages. On the bottom of the list, there is an obvious Next pagination button. There is a list with multiple items, and each item has similar structure. Step 1: open the page and decide the content to scrape. This section we will show how to locate and extract value from repeating elements on such list page via visual recipe creator. However, there are some special list page that AI creator cannot generate recipe suitable for our needs. In the AI creator section, we also show how to scrape list page quickly. The previous section shows how to define recipe to scrape a detail page, where we locate one element for one field, and extract one attribute or content from the element as the value of the field. Recipe development via visual recipe creator
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |