当前位置: 首页 > 后端技术 > Python

Finetuner0.7.1发布!支持在之前模型的基础上进行fine-tuning,增加了SphereFace损失函数!

时间:2023-03-26 10:54:49 Python

Finetuner[1]鏄竴涓熀浜庝簯鐨勭缁忔悳绱㈢粨鏋滆皟鏁村钩鍙般€侳inetuner绠€鍖栦簡宸ヤ綔娴佺▼骞跺鐞嗕簡浜戠殑澶嶆潅鎬у拰鍩虹璁炬柦瑕佹眰锛屼娇绁炵粡缃戠粶鐨勫井璋冩洿瀹规槗銆佹洿蹇€佹洿楂樻晥銆傚€熷姪Finetuner锛屾偍鍙互杞绘澗鎻愰珮棰勮缁冩ā鍨嬬殑鎬ц兘骞跺皢鍏舵姇鍏ョ敓浜э紝鑰屾棤闇€澶ч噺鏍囩鎴栨槀璐电殑纭欢銆傪煂烥itHub锛歨ttps://github.com/finetuner馃鈥嶐煠濃€嶐煣戝叏鐞冪ぞ鍖猴細https://slack.jina.ai馃摉瀹樻柟鏂囨。锛歨ttps://finetuner.jina.ai/鏈鍙戝竷娑电洊浜咶inetuner鐨勭増鏈?.7.0锛屽寘鎷緷璧栭」finetuner-api0.4.10鍜宖inetuner-core0.12.3銆傛鐗堟湰鍖呭惈2涓柊鍔熻兘銆?涓噸鏋勩€?涓敊璇慨澶嶅拰4涓枃妗f敼杩涖€傛柊鐗规€ю焼曟敮鎸丼phereFace鎹熷け鍑芥暟锛?664锛塖phereFace鎹熷け鍑芥暟鏈€鍒濇槸涓鸿绠楁満瑙嗚棰嗗煙鐨勪汉鑴歌瘑鍒换鍔¤€岃璁$殑锛岃€孎inetuner鏀寔瀹冪殑涓や釜鍙樹綋ArcFaceLoss鍜孋osFaceLoss銆係phereFace鎹熷け鍑芥暟閫氳繃姣旇緝姣忎釜鏍锋湰涓庢瘡涓被鍒祵鍏ョ殑涓績鐐逛及璁℃潵鎻愰珮缃戠粶瑙掑害鐗瑰緛鐨勫垽鍒兘鍔涳紝鑰屼笉鏄紶缁熺殑鏈€灏忓寲姝f牱鏈涔嬮棿鐨勮窛绂诲拰鏈€澶у寲璐熸牱鏈殑鏂瑰紡銆傝绠楀涔嬮棿鐨勮窛绂汇€備娇鐢‵inetuner鏃讹紝鍙互鐩存帴鍦╢it鍑芥暟鐨刲oss灞炴€т腑鎸囧畾鎹熷け鍑芥暟鐨勫悕绉帮紝濡備娇鐢ˋrcFaceLoss锛歳un=finetuner.fit(...,loss='ArcFaceLoss',...)椤哄簭涓轰簡璺熻釜鍜屾敼杩涜法鎵规鐨勭被涓績鐐逛及璁★紝SphereFaceloss闇€瑕佸湪璁粌鏃堕澶栧鍔犱竴涓紭鍖栧櫒銆傞粯璁ゆ儏鍐典笅锛屾坊鍔犵殑浼樺寲鍣ㄤ笌妯″瀷鏈韩浣跨敤鐨勪紭鍖栧櫒鐩稿悓锛屼絾鎮ㄥ彲浠ヤ娇鐢╨oss_optimizer鍙傛暟鎸囧畾涓嶅悓鐨勪紭鍖栧櫒銆俽un=finetuner.fit(...,loss='ArcFaceLoss',+loss_optimizer='Adam',+loss_optimizer_options={'weight_decay':0.01})馃啎鏀寔鍦ㄤ箣鍓嶇殑璁粌缁撴灉涓婄户缁缁?#668)model_artifact瑕佷娇鐢ㄨ繖涓嚱鏁帮紝闇€瑕侀€氳繃fit鍑芥暟鐨勫弬鏁拌缃ā鍨嬬殑宸ヤ欢ID鎵嶈兘缁х画璁粌锛氬鏋滅敤鎴锋兂鍦ㄤ笂娆¤繍琛岀殑鍩虹涓婂妯″瀷杩涜寰皟锛屾垨鑰呮兂鍦ㄦ柊鐨勪笂娆$户缁缁冩坊鍔犳暟鎹紝璇曡瘯Finetuner锛屽彧闇€瑕侀€氳繃fit鍑芥暟鐨刴odel_artifact鍙傛暟璁剧疆妯″瀷鐨刟rtifactid:train_data='path/to/another/data.csv'new_run=finetuner.fit(model='efficientnet_b0',train_data=train_data,model_artifact=previous_run.artifact_id,)鈿欙笍Refactoringremovedresnet-basedCLIPmodel(#662)鐢变簬鍩轰簬ResNet鐨凜LIP妯″瀷鐨勪娇鐢ㄧ巼杈冧綆锛屾垜浠湪Finetuner0.7.1涓皢鍏跺垹闄ゃ€傛坊鍔燛fficientNetB7妯″瀷(#662)瀵逛簬鍥惧儚鍒板浘鍍忕殑鎼滅储浠诲姟锛孎inetuner0.7.1鐜板湪鏀寔EfficientNetB7浣滀负瑙嗚楠ㄥ共妯″瀷銆傚鍔燾loud.jina.ai鐨凜SV鏂囦欢涓婁紶澶у皬瀵逛簬WebUI鐢ㄦ埛锛孎inetuner0.7.1灏嗕笂浼犳枃浠跺ぇ灏忎粠1MB澧炲姞鍒?2MB銆傚浜嶱ython瀹㈡埛绔敤鎴凤紝鎮ㄥ缁堣兘澶熶笂浼犳洿澶х殑鏁版嵁闆嗚€屼笉鍙楁鏇存敼鐨勫奖鍝嶃€傪煇炰慨澶岯ug锛岃В鍐矼LFlow鍥炶皟渚濊禆闂鏈€鏂扮増鏈殑SQLAlchemy瀵艰嚧MLFlow鍥炶皟鍦ㄦ煇浜涙儏鍐典笅浼氭姤閿欙紝Finetuner0.7.1淇浜嗚闂銆傞槻姝㈤敊璇殑num_items_per_class鍙傛暟瀵艰嚧鐨勯敊璇湪鏌愪簺鎯呭喌涓嬶紝鎮ㄥ彲鑳戒互涓庡叾浣欓厤缃笉鍏煎鐨勬柟寮忚缃畁um_items_per_class鍙傛暟锛屽鑷碏inetuner澶辫触锛屽洜涓烘煇浜涙崯澶卞嚱鏁颁笉闇€瑕佹鍙傛暟銆傜幇鍦紝num_items_per_class鍙傛暟鍙湁鍦ㄥ疄闄呬娇鐢ㄦ椂鎵嶄細琚獙璇侊紝涓嶉渶瑕佸畠鐨勬崯澶卞嚱鏁颁細绠€鍗曞湴蹇界暐瀹冦€傝В鍐矹upyterNotebooks鐧诲綍鍔熻兘闂(#672)鏈夋椂鍦↗upyternotebook涓皟鐢╢inetuner.login()鏃讹紝铏界劧鐧诲綍鎴愬姛锛屼絾Finetuner鍙兘鏃犳硶姝e父杩愯銆傚湪涔嬪墠鐨勭増鏈腑锛岀敤鎴峰繀椤昏皟鐢╢inetuner.login(force=True)鏉ョ‘淇濇纭櫥褰曘€傜幇鍦ㄤ粬浠彲浠ョ洿鎺ヤ娇鐢╢inetuner.login()锛屼笉鐢ㄥ己鍒朵篃鍙互姝e父浣跨敤銆傪煋楁枃妗f敼杩涙坊鍔犱簡鎹熷け鍑芥暟鍜屾睜鍖栫殑鏂囨。椤甸潰锛?664锛夋垜浠湪鏂囨。涓坊鍔犱簡涓€涓柊椤甸潰锛屾洿璇︾粏鍦拌В閲婁簡鍑犱釜鎹熷け鍑芥暟鍜屾睜鍖栭€夐」銆傛坊鍔犱簡璇︾粏璇存槑鎹熷け鍑芥暟鍜屾睜鍖栭€夐」鐨勬枃妗i〉闈€傛坊鍔燜inetuner鏂囩珷閮ㄥ垎(#669)鎴戜滑鍦≧EADME涓坊鍔犱簡涓€绯诲垪鏂囩珷锛岃繖浜涙枃绔犱粙缁嶄簡鏈夊叧Finetuner鐨勮瑙o紝骞舵彁渚涗簡鍦ㄥ疄璺典腑浣跨敤Finetuner鐨勫疄璺电粡楠屻€傛坊鍔犵ず渚婥SV鏂囦欢鐨勬枃浠跺す(#663)鎮ㄥ彲浠ヤ娇鐢╣ithub.com/jina-ai/finetuner涓殑绀轰緥璁粌鏁版嵁闆嗘潵璁粌鎴戜滑鍑嗗鐨勬暟鎹€傛牎瀵规暣涓枃妗d互淇鎷煎啓閿欒鍜屾崯鍧忕殑閾炬帴锛?661銆?666锛変慨澶岶inetuner鏂囨。涓崯鍧忕殑閾炬帴鍜屾嫾鍐欓敊璇€傪煠熻础鐚€呮垜浠鎰熻阿姝ょ増鏈殑鎵€鏈夎础鐚€咃紒鐜嬪崥(@bwanglzu)LouisMilliken(@LMMmilliken)MichaelG眉nther(@guenthermi)CatStark(@CatStark)GeorgeMastrapas(@gmastrapas)ScottMartens(@scott-martens)鍙傝€冭祫鏂橻1]Finetuner:https://rebrand.ly/jina-ai-fi...