鍦ㄥ叕鍙稿姞鐝埌鍏偣锛岃繖鏄儗鏅€傚姞鐝殑鍘熷洜鏄笂绾匡紝瑙e喅绾夸笂鏁版嵁搴撻噸澶嶆暟鎹殑闂锛屾壘涓▼搴廱ug锛屽ソ瑙e喅銆傚鏋滄湁闂锛屽湪绾挎洿姝i噸澶嶆暟鎹€傜綉搴撲腑鏈?寮犺〃鏈夐噸澶嶆暟鎹紝鍏朵腑2寮犳瘮杈冨ぇ锛屼竴寮?6涓?锛屼竴寮?0涓?銆傚洜涓轰箣鍓嶅鐞嗚繃鍚屾牱鐨勯棶棰橈紝鐩存帴鐢ㄤ笂娆$殑Python鍘婚噸鑴氭湰锛岃剼鏈緢绠€鍗曪紝杩炴帴鏁版嵁搴擄紝鎵惧嚭閲嶅鏁版嵁锛屽惊鐜垹闄ゅ嵆鍙€俥mmmmm锛屼笉杩囪繖涓晥鐜囧疄鍦ㄦ槸澶綆浜嗭紝姣忕涓€鏉★紝澶ф20000+閲嶅鏁版嵁锛屼及璁℃椂闂?灏忔椂宸﹀彸銆?.涓嶄负鑷繁鐫€鎯筹紝涓€鍛充緷璧栧墠浜虹殑涓滆タ鏄湁闂鐨勶紒鑰佹兂鐫€浠ュ墠鎬庝箞鍙兘锛屼负浠€涔堢幇鍦ㄤ笉琛屼簡锛岃繖涔熸槸涓棶棰橈紒鏈€杩戝彂鐜扮姸鎬佺湡鐨勪笉瀵癸紝澶卞幓浜嗘帰绱㈡眰鐭ョ殑娆叉湜锛屼粖澶╂槸涓€璁拌閽燂紝鎰熻杩烽€斿綊鏉ヤ簡銆傝█褰掓浼狅紝涓嬮潰璇︾粏浠嬬粛鍘婚噸姝ラ銆侰REATETABLE`animal`(`id`int(11)NOTNULLAUTO_INCREMENT,`name`varchar(20)DEFAULTNULL,`age`int(11)DEFAULTNULL,PRIMARYKEY(`id`))ENGINE=InnoDBAUTO_INCREMENT=1DEFAULTCHARSET=utf8COLLATE=utf8_bin;INSERTINTO`pilipa_dds`.`student`(`id`,`name`,`age`)VALUES('1','cat','12');鎻掑叆`pilipa_dds`.`student`(`id`,`name`,`age`)VALUES('2','dog','13');鎻掑叆`pilipa_dds`.`student`(`id`,`name`,`age`)VALUES('3','camel','25');INSERTINTO`pilipa_dds`.`student`(`id`,`name`,`age`)VALUES('4','cat','32');INSERTINTO`pilipa_dds`.`student`(`id`,`name`,`age`)VALUES('5','dog','42');鐩爣锛氭垜浠鍘绘帀name鐩稿悓鐨勬暟鎹€傚厛鐪嬪摢浜涙暟鎹噸澶峉ELECTname,count(1)FROMstudentGROUPBYNAMEHAVINGcount(1)>1;output:namecount(1)cat2dog2name鏄痗at鍜宒ogrepeated鐨勬暟鎹紝姣忎釜repeated鏈変袱鏉℃暟鎹紱Select*FromtableWhererepeatedfieldIn(SelectrepeatedfieldFromtableGroupByrepeatedfieldHavingCount(1)>1)鍒犻櫎鎵€鏈夐噸澶嶇殑鏁版嵁锛屽鏋滄病鏈夌暀涓嬬洿鎺ュ垹闄や細鎶ラ敊DELETEFROMstudentWHERENAMEIN(SELECTNAMEFROMstudentGROUPBYNAMEHAVINGcount(1)>1)閿欒锛?093-鎮ㄤ笉鑳藉湪FROM瀛愬彞涓寚瀹氳鏇存柊鐨勭洰鏍囪〃'student'锛屾椂闂达細0.016000s鍘熷洜鏄細鏇存柊姝よ〃鏃秖ueryingThistable锛屽悓鏃秖ueryingthistable鍜寀pdatethistable锛屽彲浠ョ悊瑙d负姝婚攣銆俶ysql涓嶆敮鎸佽繖绉嶆洿鏂版煡璇㈠悓涓€寮犺〃鐨勬搷浣溿€傝В鍐虫柟娉曪細灏嗛渶瑕佹洿鏂扮殑鏁版嵁鍒楁煡璇负绗笁鏂硅〃锛岀劧鍚庤繃婊ゆ洿鏂般€侱ELETEFROMstudentWHERENAMEIN(SELECTt.NAMEFROM(SELECTNAMEFROMstudentGROUPBYNAMEHAVINGcount(1)>1)t)鍒犻櫎鍒犻櫎琛ㄤ腑閲嶅鐨勬暟鎹紝鍙繚鐣欎竴鏉°€傚湪鍒犻櫎涔嬪墠锛屾垜浠彲浠ュ厛鏌ョ湅涓€涓嬶紝鎴戜滑瑕佸垹闄ょ殑閲嶅鏁版嵁鏄粈涔堬紵SELECT*FROMstudentWHEREidNOTIN(SELECTt.idFROM(SELECTMIN(id)ASidFROMstudentGROUPBY`name`)t)鍒嗙粍锛屾壘鍑篿d鏈€灏忕殑鏁版嵁銆傝繖浜涙暟鎹氨鏄垜浠淇濈暀鐨刱indling锛岀劧鍚庡彂鐜癷d涓嶅湪閲岄潰锛屽氨鏄垜浠鍒犻櫎鐨勯噸澶嶆暟鎹€傚紑濮嬪垹闄ら噸澶嶆暟鎹紝鍙暀涓€鏉″緢绠€鍗曪紝鐩存帴鎶妔elect鎹㈡垚deleteDELETEFROMstudentWHEREidNOTIN(SELECTt.idFROM(SELECTMIN(id)ASidFROMstudentGROUPBY`name`)t)900,000+琛ㄧ殑鎵ц閫熷害瓒呭揩銆傚叏閮ㄦ悶瀹氿煈忦煈忦煈忦煈忦煈弤锛堟劅璋㈤槄璇伙紝甯屾湜瀵瑰ぇ瀹舵湁鎵€甯姪锛夋潵婧愶細telami.cn/2019/mysql-removes-duplicate-data-and-keeping-only-one/
