批量抓取评论 | RPA&ETSY
亚马逊的很多选品和设计灵感,我都参考ETSY
亚马逊的很多选品和设计灵感,我都参考ETSY,这是一个比较小众的美国本土电商网站,需要科学上网,不过已经有非常多亚马逊卖家在研究它了。
AMZ已经有非常成熟的工具了,包括评论,价格,销量等各类曲线图等等都有。
我本来打算结合AMZ和RPA多研究出几种自动化的机器人,但是目前看来那些都比较复杂。
有些ERP也挺便宜的,感觉没必要自造工具,重复发明轮子了。
RPA是个挺好的工具,入门很简单,深入研究就发现还是挺高门槛的。
这里就贴一下我刚简单写了的代码,基础的配置就不讲了,有需要可以看付费文章。
复制下方代码到UIBOT当中即可。
不同产品链接,记得要更换这几处的网址,你多看几次就明白了。
出来的数据结果是这样的,还没有进行多次优化,即rating用户没有留下内容,这里尚未做匹配,但是也能看了。
还有其他插件也可以抓取数据,比如INSTANT DATA SCRAPPER,但是数据结构可能是混乱的,另外我测试了WEB SCRAPPER,这个目前不支持该网站。
Dim hWeb,objDatatable,arrayData,objExcelWorkBook,dTime,bRet,sRet,iRethWeb = WebBrowser.Create("chrome","https://www.etsy.com/listing/1038872051/patriotic-stars-red-white-and-blue-with?click_key=1b4a22d0f6a2c6ae76281ba9808fc01c880a72af%3A1038872051&click_sum=5fffa511&ref=hp_signed_out_opfy-5&sts=1",30000,{"bContinueOnError":false,"iDelayAfter":300,"iDelayBefore":200,"sBrowserPath":"","sStartArgs":""})hWeb = WebBrowser.BindBrowser("chrome",10000,{"bContinueOnError":false,"iDelayAfter":300,"iDelayBefore":200})objExcelWorkBook = Excel.OpenExcel('''C:\Users\LiuHuiShen\Documents\review share.xlsx''',true,"Excel","","")Excel.ActiveSheet(objExcelWorkBook,"Sheet1")Excel.WriteCell(objExcelWorkBook,"Sheet1","A1","当前获取评论时间",false)Excel.SetRangeColor(objExcelWorkBook,"Sheet1","A1:C1",[91, 233, 203],false)dTime = Time.Date()sRet = Time.Format(dTime,"yyyy-mm-dd hh:mm:ss")Excel.WriteCell(objExcelWorkBook,"Sheet1","B1",sRet,false)arrayData = UiElement.DataScrap({"wnd":[{"cls":"Chrome_WidgetWin_1","title":"*","app":"chrome"},{"cls":"Chrome_RenderWidgetHostHWND","title":"Chrome Legacy Window"}],"html":[{"tag":"DIV","id":"same-listing-reviews-panel"}]},{"ExtractTable":0,"Columns":[{"selecors":[{"tag":"div","index":0,"className":"wt-grid wt-grid--block wt-mb-xs-0","value":"div.wt-grid.wt-grid--block.wt-mb-xs-0","prefix":""},{"tag":"div","value":"div","index":0,"prefix":">"},{"tag":"div","index":0,"className":"wt-display-flex-xs wt-align-items-center wt-mb-xs-1","value":"div.wt-display-flex-xs.wt-align-items-center.wt-mb-xs-1","prefix":">"},{"tag":"p","index":0,"className":"wt-text-caption wt-text-gray","value":"p.wt-text-caption.wt-text-gray","prefix":">"}],"props":["text"]}]},{"objNextLinkElement":{"wnd":[{"cls":"Chrome_WidgetWin_1","title":"*","app":"chrome"},{"cls":"Chrome_RenderWidgetHostHWND","title":"Chrome Legacy Window"}],"html":[{"tag":"svg","parentid":"reviews","aaname":" ","css-selector":"body>main>div>div>div>div>div>div>div>div>div>div>div>div>nav>ul>li>a>span>svg","idx":1}]},"iMaxNumberOfPage":9,"iMaxNumberOfResult":-1,"iDelayBetweenMS":1000,"bContinueOnError":False})Excel.WriteRange(objExcelWorkBook,"Sheet1","A2",arrayData,true)WebBrowser.Close(hWeb,{"bContinueOnError":false,"iDelayAfter":300,"iDelayBefore":200})App.Kill(hWeb)hWeb = WebBrowser.Create("chrome","https://www.etsy.com/listing/1038872051/patriotic-stars-red-white-and-blue-with?click_key=1b4a22d0f6a2c6ae76281ba9808fc01c880a72af%3A1038872051&click_sum=5fffa511&ref=hp_signed_out_opfy-5&sts=1",30000,{"bContinueOnError":false,"iDelayAfter":300,"iDelayBefore":200,"sBrowserPath":"","sStartArgs":""})hWeb = WebBrowser.BindBrowser("chrome",10000,{"bContinueOnError":false,"iDelayAfter":300,"iDelayBefore":200})arrayData = UiElement.DataScrap({"wnd":[{"cls":"Chrome_WidgetWin_1","title":"*","app":"chrome"},{"cls":"Chrome_RenderWidgetHostHWND","title":"Chrome Legacy Window"}],"html":[{"tag":"DIV","id":"same-listing-reviews-panel"}]},{"ExtractTable":0,"Columns":[{"selecors":[{"tag":"div","index":0,"className":"wt-grid wt-grid--block wt-mb-xs-0","value":"div.wt-grid.wt-grid--block.wt-mb-xs-0","prefix":""},{"tag":"div","value":"div","index":0,"prefix":">"},{"tag":"div","index":0,"className":"wt-pl-xs-8","value":"div.wt-pl-xs-8","prefix":">"},{"tag":"div","index":0,"className":"wt-mb-xs-3 wt-mb-md-1 wt-display-flex-md","value":"div.wt-mb-xs-3.wt-mb-md-1.wt-display-flex-md","prefix":">"},{"tag":"div","index":0,"className":"wt-flex-md-3 wt-max-width-full wt-mr-md-8 wt-flex-md-auto","value":"div.wt-flex-md-3.wt-max-width-full.wt-mr-md-8.wt-flex-md-auto","prefix":">"},{"tag":"div","index":2,"className":"","value":"div:nth-child(2)","prefix":">"},{"tag":"ul","index":0,"className":"wt-list-unstyled wt-overflow-hidden","value":"ul.wt-list-unstyled.wt-overflow-hidden","prefix":">"},{"tag":"li","index":0,"className":"variation-info wt-mr-xs-2","value":"li.variation-info.wt-mr-xs-2","prefix":">"},{"tag":"p","index":0,"className":"wt-text-caption wt-display-inline","value":"p.wt-text-caption.wt-display-inline","prefix":">"}],"props":["text"]}]},{"objNextLinkElement":{"wnd":[{"cls":"Chrome_WidgetWin_1","title":"*","app":"chrome"},{"cls":"Chrome_RenderWidgetHostHWND","title":"Chrome Legacy Window"}],"html":[{"tag":"path","parentid":"reviews","css-selector":"body>main>div>div>div>div>div>div>div>div>div>div>div>div>nav>ul>li>a>span>svg>path","idx":1}]},"iMaxNumberOfPage":9,"iMaxNumberOfResult":-1,"iDelayBetweenMS":1000,"bContinueOnError":False})Excel.WriteRange(objExcelWorkBook,"Sheet1","B2",arrayData,true)WebBrowser.Close(hWeb,{"bContinueOnError":false,"iDelayAfter":300,"iDelayBefore":200})App.Kill(hWeb)hWeb = WebBrowser.Create("chrome","https://www.etsy.com/listing/1038872051/patriotic-stars-red-white-and-blue-with?click_key=1b4a22d0f6a2c6ae76281ba9808fc01c880a72af%3A1038872051&click_sum=5fffa511&ref=hp_signed_out_opfy-5&sts=1",30000,{"bContinueOnError":false,"iDelayAfter":300,"iDelayBefore":200,"sBrowserPath":"","sStartArgs":""})hWeb = WebBrowser.BindBrowser("chrome",10000,{"bContinueOnError":false,"iDelayAfter":300,"iDelayBefore":200})arrayData = UiElement.DataScrap({"wnd":[{"cls":"Chrome_WidgetWin_1","title":"*","app":"chrome"},{"cls":"Chrome_RenderWidgetHostHWND","title":"Chrome Legacy Window"}],"html":[{"tag":"DIV","id":"same-listing-reviews-panel"}]},{"ExtractTable":0,"Columns":[{"selecors":[{"tag":"div","index":0,"className":"wt-grid wt-grid--block wt-mb-xs-0","value":"div.wt-grid.wt-grid--block.wt-mb-xs-0","prefix":""},{"tag":"div","value":"div","index":0,"prefix":">"},{"tag":"div","index":0,"className":"wt-pl-xs-8","value":"div.wt-pl-xs-8","prefix":">"},{"tag":"div","index":0,"className":"wt-mb-xs-3 wt-mb-md-1 wt-display-flex-md","value":"div.wt-mb-xs-3.wt-mb-md-1.wt-display-flex-md","prefix":">"},{"tag":"div","index":0,"className":"wt-flex-md-3 wt-max-width-full wt-mr-md-8 wt-flex-md-auto","value":"div.wt-flex-md-3.wt-max-width-full.wt-mr-md-8.wt-flex-md-auto","prefix":">"},{"tag":"div","index":0,"className":"wt-text-body-01 wt-line-height-tight wt-mb-xs-2","value":"div.wt-text-body-01.wt-line-height-tight.wt-mb-xs-2","prefix":">"},{"tag":"div","index":0,"className":"max-height-review max-height-text-container is-long","value":"div.max-height-review.max-height-text-container.is-long","prefix":">"},{"tag":"div","index":0,"className":"","value":"div","prefix":">"},{"tag":"div","index":0,"className":"wt-content-toggle--truncated-inline-multi wt-text-body-01 wt-break-word","value":"div.wt-content-toggle--truncated-inline-multi.wt-text-body-01.wt-break-word","prefix":">"},{"tag":"p","index":0,"className":"wt-text-truncate--multi-line","value":"p.wt-text-truncate--multi-line","prefix":">"}],"props":["text"]}]},{"objNextLinkElement":{"wnd":[{"cls":"Chrome_WidgetWin_1","title":"*","app":"chrome"},{"cls":"Chrome_RenderWidgetHostHWND","title":"Chrome Legacy Window"}],"html":[{"tag":"svg","parentid":"reviews","aaname":" ","css-selector":"body>main>div>div>div>div>div>div>div>div>div>div>div>div>nav>ul>li>a>span>svg","idx":1}]},"iMaxNumberOfPage":9,"iMaxNumberOfResult":-1,"iDelayBetweenMS":1000,"bContinueOnError":False})Excel.WriteRange(objExcelWorkBook,"Sheet1","C2",arrayData,true)WebBrowser.Close(hWeb,{"bContinueOnError":false,"iDelayAfter":300,"iDelayBefore":200})App.Kill(hWeb)Excel.CloseExcel(objExcelWorkBook,true)
以上!
多研究感兴趣的东西。
愿你富足(:
上篇文章: 29 法人视频面试流程-账号注册 |亚马逊专栏
推荐阅读: 壹,店铺批量自动发POST | AMZ与RPA