You’re offline. This is a read only version of the page.
Hi Everyone,
I'm trying to extract social media comments to Excel. I also added steps to scroll down to load more comments. I have two concerns.
1. When Excel results are out, the results are incomplete. The most I got was approximately 10-15 rows. While the comments are more than that. What can I do so I can get all the comments.
2. How can I include replies to the comments to the extraction?
Thanks Everyone! 🙂
Hello @Richter .
From your description, I consider that the comments are loaded dynamically while scrolling - something like being organized in pages which open with the scrolling. Probably the page number is part of the selector for the comments, meaning that every x comments (number of comments per page), the selector is changing. Therefore, you should check the selectors for each case (first comment, 20th comment, 100th comment) and compare them. Then you should create a dynamic, robust selector with the use of variable(s) and a loop.
Example:
Selector for first 10 comments: html > body > div:eq(0) > div > div:eq(1)
Selector for second 10 comments: html > body > div:eq(1) > div > div:eq(1)
Selector for third 10 comments: html > body > div:eq(2) > div > div:eq(1)
For your second question, you could capture the replies and perform the necessary manual editing as you did for comments (use of 'extract data from web page' action).
Share
Report
All responses (
Answers (
632
