x-crawlx-crawl鏄竴涓伒娲荤殑nodejs鐖櫕搴撱€傚彲浠ユ壒閲忔姄鍙栭〉闈€佹壒閲忕綉缁滆姹傘€佹壒閲忎笅杞芥枃浠惰祫婧愩€佽疆璇㈡姄鍙栫瓑銆傛敮鎸佸紓姝?鍚屾妯″紡鎶撳彇銆傝繍琛屽湪nodejs涓婏紝浣跨敤鐏垫椿绠€鍗曪紝瀵笿S/TS寮€鍙戣€呭弸濂姐€傚鏋滆寰椾笉閿欙紝鍙互缁檟-crawl浠撳簱涓€涓猄tar鏀寔锛屼綘鐨凷tar浼氭槸鎴戞洿鏂扮殑鍔ㄥ姏銆侳eatures馃敟Asynchronous/Synchronous-鏀寔寮傛/鍚屾妯″紡鎵归噺鎶撳彇銆傗殭锔忓绉嶅姛鑳解€斺€斿彲浠ユ壒閲忔姄鍙栭〉闈€佹壒閲忕綉缁滆姹傘€佹壒閲忎笅杞芥枃浠惰祫婧愩€佽疆璇㈢埇鍙栫瓑銆傪煐嬶笍鐏垫椿鐨勫啓娉曗€斺€斿绉嶇埇鍙栭厤缃拰鍐欐硶鑾峰彇鐖彇缁撴灉銆傗彵锔忓尯闂寸埇鍙栤€斺€旀棤鍖洪棿/鍥哄畾鍖洪棿/闅忔満鍖洪棿锛屽彲浠ヤ娇鐢?閬垮厤楂樺苟鍙戠埇鍙栥€傗榿锔忔姄鍙朣PA-鎵归噺鎶撳彇SPA锛堝崟椤靛簲鐢ㄧ▼搴忥級浠ョ敓鎴愰娓叉煋鍐呭锛堝張鍚嶁€淪SR鈥濓紙鏈嶅姟鍣ㄧ娓叉煋锛夛級銆傗殥锔忔帶鍒堕〉闈⑩€斺€旀棤澶存祻瑙堝櫒鍙互鎻愪氦琛ㄥ崟銆佸嚮閿€佷簨浠跺姩浣溿€佺敓鎴愰〉闈㈡埅鍥剧瓑銆傪煣炬姄鍙栬褰曗€斺€旀姄鍙栧苟璁板綍鐖彇鐨勭粨鏋滐紝骞堕珮浜彁閱掋€傪煢綯ypeScript-鑷繁鐨勭被鍨嬶紝閫氳繃娉涘瀷瀹炵幇瀹屾暣鐨勭被鍨嬨€傜ず渚嬫瘡澶╄嚜鍔ㄨ幏鍙朾ilibili鍥芥极棣栭〉鐨勮疆鎾浘鐗囦负渚嬶細1.importmoduleES/CJSimportxCrawlfrom'x-crawl'//2.鍒涘缓鐖櫕瀹炰緥constmyXCrawl=xCrawl({timeout:10000,//RequesttimeoutintervalTime:{max:3000,min:2000}//鎶撳彇闂撮殧鏃堕棿})//3.璁剧疆鎶撳彇浠诲姟//璋冪敤startPolling鎺ュ彛鍚姩杞鍑芥暟锛屾瘡闅斾竴澶╄皟鐢ㄥ洖璋冨嚱鏁癿yXCrawl銆俿tartPolling({d:1},async(count,stopPolling)=>{//璋冪敤crawlPageAPI鐖彇Pageconst{page}=awaitmyXCrawl.crawlPage('https://www.bilibili.com/guochuang/')//璁剧疆璇锋眰閰嶇疆鑾峰彇杞挱鍥剧墖鐨刄RLconstrequestConfig=awaitpage.$$eval('.chief-recom-itemimg',(imgEls)=>imgEls.map((item)=>item.src))//璋冪敤crawlFile鎺ュ彛鎶撳彇鍥剧墖myXCrawl.crawlFile({requestConfig,fileConfig:{storeDir:'./upload'}})//鍏抽棴椤甸潰page.close()})杩愯鏁堟灉锛氭敞锛欴o涓嶆槸闅忎究鎶撳彇鐨勶紝鎶撳彇鍓嶅彲浠ユ煡鐪嬩竴涓媟obots.txt鍗忚銆傝繖鍙槸涓轰簡婕旂ず濡備綍浣跨敤x-crawl銆傛洿璇︾粏鐨勬枃妗ｈ鏌ョ湅锛歨ttps://github.com/coder-hxl/x-crawl
