È˹¤ÖÇÄÜÓ¦ÓÃÔÚ×Ô¶¯¼ÝÊ»¡¢Öǻ۽»Í¨¡¢ÖÇ»ÛÁãÊ۵ȳ¡¾°µÄʱ¼ä£¬£¬£¬£¬£¬£¬ÍùÍùÐèҪʶ±ðºÍ¸ú×Ù¶¯Ì¬µÄÈË»òÎïÌå¡£¡£¡£¡£¡£¡£¡£ÓÉÓÚ±£´æÕÚµ²¡¢¹âÕÕת±ä¡¢±ê׼ת±äµÈһϵÁÐÎÊÌ⣬£¬£¬£¬£¬£¬Ä¿µÄ¸ú×Ù(Object Tracking)Ò»Ö±¶¼±£´æ½Ï´óÌôÕ½¡£¡£¡£¡£¡£¡£¡£

¿ËÈÕ£¬£¬£¬£¬£¬£¬ÉÌÌÀÄ¿µÄ¸ú×ÙSiamRPNϵÁÐËã·¨µÄSiamRPN++ÓÖ»ñµÃÐÂÍ»ÆÆ£¬£¬£¬£¬£¬£¬ÈëÑ¡ÁËCVPR 2019 (Oral)£¬£¬£¬£¬£¬£¬ÔÚ¶à¸öÊý¾Ý¼¯É϶¼Íê³ÉÁË10%ÒÔÉϵÄÓâÔ½£¬£¬£¬£¬£¬£¬²¢ÇÒÊÇSOTA(Ч¹û×îºÃµÄ)Ëã·¨¡£¡£¡£¡£¡£¡£¡£

ÒÔÉ϶¯Í¼ÖУ¬£¬£¬£¬£¬£¬ºìÉ«¿òÊÇSiamRPN++µÄ¸ú×ÙЧ¹û£¬£¬£¬£¬£¬£¬À¶É«¿òÊÇECCV 2018ÉϵÄUPDTµÄЧ¹û£¬£¬£¬£¬£¬£¬¿ÉÒÔ¿´³öSiamRPN++µÄЧ¹û¸ü¼Ñ£¬£¬£¬£¬£¬£¬¸ú×ÙЧ¹û¸üÎȹÌ£¬£¬£¬£¬£¬£¬¿òÒ²¸ü×¼¡£¡£¡£¡£¡£¡£¡£´ÓÕâ¸öͼҲ¿ÉÒÔ¿´³ö¸ú×ÙµÄһЩÌôÕ½£º¹âÕÕ¼±¾çת±ä£¬£¬£¬£¬£¬£¬ÐÎ×´¡¢¾Þϸת±äµÈ¡£¡£¡£¡£¡£¡£¡£

Ä¿µÄ¸ú×ÙÓÐÒ»¸ö¡°ÌØÊâ´óÄÔ¡±¡ª¡ªÂÏÉúÍøÂç(Siamese Network)£¬£¬£¬£¬£¬£¬¼òÆÓÀ´Ëµ£¬£¬£¬£¬£¬£¬¾ÍÊÇ×óÓÒÁ½¸öÉñ¾­ÍøÂçµÄȨÖØÒ»Ñù£¬£¬£¬£¬£¬£¬ÌáÈ¡µÄÌØÕ÷ÏàËÆ¡£¡£¡£¡£¡£¡£¡£ÈçÏÂͼËùʾ£º

Àú¾­ÊýÄ꣬£¬£¬£¬£¬£¬ÉÌÌÀÖÇÄÜÊÓƵÍŶÓΧÈÆ×ÅÂÏÉúÍøÂçµÄÄ¿µÄ¸ú×ÙËã·¨ÊÖÒÕDZÐÄÑо¿£¬£¬£¬£¬£¬£¬²¢½«Ñо¿Ð§¹û×ܽá½ÒÏþÁËÈýƪϵÁÐÂÛÎÄ£¬£¬£¬£¬£¬£¬¾ù±»¹ú¼Ê×ÅÃûÅÌËã»úÊÓ¾õ¾Û»áÈÎÃü¡£¡£¡£¡£¡£¡£¡£ÕâÈýƪÂÛÎÄ»®·ÖΪÈëÑ¡CVPR 2018µÄSiamRPN£¬£¬£¬£¬£¬£¬»ñµÃECCV2018µÄVOT Workshop¹Ú¾üµÄDaSiamRPN£¬£¬£¬£¬£¬£¬ÒÔ¼°¸Õ¸ÕÓÖÈëÑ¡CVPR 2019 (Oral)µÄSiamRPN++¡£¡£¡£¡£¡£¡£¡£

ÏëÏàʶĿµÄ¸ú×ÙSOTAËã·¨ÊÇÔõÑùÁ¶³ÉµÄÂð?ÉÌÌÀ¾ý³ÊÉÏÈýƪϵÁÐÂÛÎĽâ¶Á£¬£¬£¬£¬£¬£¬ÓÉdzÈëÉîΪÄúÖðÒ»µÀÀ´¡£¡£¡£¡£¡£¡£¡£

µÚһƪÂÛÎÄSiamRPN£º½«¼ì²âËã·¨ÒýÈëµ½¸ú×Ù

Ä¿µÄ¸ú×ÙÊÇÖ¸ÔÚÊÓƵÖпò¶¨µÚÒ»Ö¡ÖÐÄ¿µÄµÄλÖò¢ÔÚºóÐøÖ¡ÖоÙÐиú×Ù¡£¡£¡£¡£¡£¡£¡£ËäÈ»ÂÏÉúÍøÂçÄܶÔÄ¿µÄ¿ìËÙ¶¨Î»£¬£¬£¬£¬£¬£¬µ«²»¿É¶ÔÄ¿µÄ¿ò×÷³öµ÷½â£¬£¬£¬£¬£¬£¬ÎÞ·¨¶Ô¸ú×ÙÄ¿µÄµÄÐÎ×´¾ÙÐе÷Àí¡£¡£¡£¡£¡£¡£¡£¸ú×Ù²»µ«ÊǶ¨Î»ºÍ±È¶Ô£¬£¬£¬£¬£¬£¬Ëü¶ÔÄ¿µÄ¿ò(¿ÉÃ÷ȷΪĿµÄ¹æÄ£)µÄ»Ø¹éÕ¹ÍûÒ»ÑùÖ÷Òª¡£¡£¡£¡£¡£¡£¡£

SiamRPN½«¼ì²âÖеÄÇøÓòÍƼöÍøÂçÒýÈëµ½¸ú×ÙÖеÄÂÏÉúÍøÂ磺ÂÏÉúÍøÂç¿ÉÒÔʹÓñ»¸ú×ÙÄ¿µÄµÄÐÅÏ¢;ÇøÓòÍƼöÍøÂç¿ÉÒÔ¶ÔÄ¿µÄλÖþÙÐиü¾«×¼µÄÕ¹Íû¡£¡£¡£¡£¡£¡£¡£Í¨¹ýÁ½ÕßµÄ͎ᣬ£¬£¬£¬£¬£¬SiamRPN¿ÉÒÔ¾ÙÐж˵½¶ËµÄѵÁ·£¬£¬£¬£¬£¬£¬Èøú×ٵĿò±äµÄÔ½·¢¾«×¼¡£¡£¡£¡£¡£¡£¡£

³ýÁËËã·¨ÉϵÄÁ¢Ò죬£¬£¬£¬£¬£¬SiamRPN»¹ÔÚÊý¾ÝÉÏ·¢Á¦£¬£¬£¬£¬£¬£¬½ÓÄÉÁ×Æü´ó¹æÄ£µÄÊý¾ÝѵÁ·¼¯Youtube-BB(ԼĪÊÇVIDµÄ50±¶)£¬£¬£¬£¬£¬£¬½øÒ»²½ÌáÉýÁ˸ú×ÙµÄÐÔÄÜ¡£¡£¡£¡£¡£¡£¡£

ÍŽáÒÔÉÏÁ½µãÁ¢Ò죬£¬£¬£¬£¬£¬ÔÚ»ùÏßËã·¨SiamFC(¾í»ýÂÏÉúÍøÂç)µÄ»ù´¡ÉÏ£¬£¬£¬£¬£¬£¬SiamRPNʵÏÖÁËÎå¸öµãÒÔÉϵÄÌáÉý(OTB100£¬£¬£¬£¬£¬£¬VOT15/16/17Êý¾Ý¼¯)£¬£¬£¬£¬£¬£¬Í¬Ê±»¹µÖ´ïÁ˸ü¿ìµÄËÙÂÊ(160fps)£¬£¬£¬£¬£¬£¬¸üºÃµØʵÏÖÁ˾«¶ÈÓëËÙÂʵÄƽºâ¡£¡£¡£¡£¡£¡£¡£SiamRPNÂÛÎı»CVPR 2018(Spotlight)ÈÎÃü¡£¡£¡£¡£¡£¡£¡£

µÚ¶þƪÂÛÎÄDaSiamRPN£ºË¢ÐÂѵÁ·Êý¾Ý¼¯£¬£¬£¬£¬£¬£¬ÔöÇ¿ÅбðÄÜÁ¦

SiamRPNËäȻȡµÃÁ˺ÜÊǺõÄÐÔÄÜ£¬£¬£¬£¬£¬£¬µ«ËüµÄѵÁ·¼¯Ö÷ÒªÀ´×ÔVIDºÍYoutbeBB£¬£¬£¬£¬£¬£¬ÎïÌåÖÖ±ðºÜÊÇÉÙ£¬£¬£¬£¬£¬£¬½ö¶þÈýÊ®À࣬£¬£¬£¬£¬£¬ÄÑÒÔÖª×ãÄ¿µÄ¸ú×ÙµÄͨÓÃÀà±ðµÄÐèÇó£¬£¬£¬£¬£¬£¬Ö»¡°ÊìϤ¡±¼¸Ê®ÖÖÀà±ðµÄͼÏñ¿É²»¿É¡£¡£¡£¡£¡£¡£¡£

ÄÇôÔõÑù½â¾öÊý¾ÝÖÖ±ðȱ·¦µÄÎÊÌâÄØ?

ÎÒÃÇÖªµÀ£¬£¬£¬£¬£¬£¬COCOºÍImageNet DetµÄ¼ì²âÊý¾Ý¼¯»®·ÖÓаËÊ®ÀàºÍÁ½°ÙÀ࣬£¬£¬£¬£¬£¬ÒÔÊÇÉÌÌÀÖÇÄÜÊÓƵÍŶÓʵÑ齫ÕâÁ½¸ö¼ì²âÊý¾Ý¼¯ÒýÈë½øÀ´¡£¡£¡£¡£¡£¡£¡£ÂÏÉúÍøÂçµÄѵÁ·Ö»ÐèҪͼÏñ¶Ô£¬£¬£¬£¬£¬£¬¶ø²¢·ÇÍêÕûµÄÊÓƵ£¬£¬£¬£¬£¬£¬ÒÔÊǼì²âͼƬҲ¿ÉÒÔ±»À©Õ¹Îª¸ú×ÙѵÁ·Êý¾Ý¡£¡£¡£¡£¡£¡£¡£

µ«½«¼ì²âÊý¾Ý¼¯ÒýÈë¸ú×ÙÖ®ºó£¬£¬£¬£¬£¬£¬ÓÖ·¢Ã÷Ò»¸öеÄÎÊÌ⣺Õâ¸öÍøÂç»á¶ÔËùÓÐÓÐÓïÒåµÄÑù±¾¾ÙÐÐÏìÓ¦£¬£¬£¬£¬£¬£¬¶ø²»Êǽö½ö¶ÔÄ¿µÄÎïÌå¾ÙÐÐÏìÓ¦¡£¡£¡£¡£¡£¡£¡£ºÃ±ÈÈÃËü¸ú×ÙһСÎÒ˽¼Ò£¬£¬£¬£¬£¬£¬µ«ËüÓöµ½Ò»¸öÒÎ×ÓÒ²»áÓкܸßÏìÓ¦¡£¡£¡£¡£¡£¡£¡£ÓÉÓÚÔÚ֮ǰµÄѵÁ··½·¨ÖУ¬£¬£¬£¬£¬£¬¸ºÑù±¾(ºÍÄ¿µÄÎ޹صÄÑù±¾)Ö»ÓÐÅä¾°ÐÅÏ¢£¬£¬£¬£¬£¬£¬ÕâÒ»¶¨Ë®Æ½ÉÏÏÞÖÆÁËÍøÂçµÄÅбðÄÜÁ¦¡£¡£¡£¡£¡£¡£¡£

Ñо¿¾ÍÊÇÒ»Ö±Óöµ½ÎÊÌâ½â¾öÎÊÌâµÄÀú³Ì£¬£¬£¬£¬£¬£¬Ñо¿Ö°Ô±ÔÚDaSiamRPNÖÐÓÖË¢ÐÂÁËÒªÁ졪¡ªÔöÌíÁËһЩÓÐÓïÒâµÄ¸ºÑù±¾¶ÔÀ´ÔöÇ¿¸ú×ÙÆ÷µÄÅбðÄÜÁ¦£¬£¬£¬£¬£¬£¬¼´ÑµÁ·Àú³ÌÖв»ÔÙÈÃÄ£°åºÍËÑË÷ÇøÓòÊÇÏàͬĿµÄ;¶øÊÇÈÃÍøÂçѧϰÅбðÄÜÁ¦£¬£¬£¬£¬£¬£¬È¥Ñ°ÕÒËÑË÷ÇøÓòÖкÍÄ£°æ¸üÏàËƵÄÎïÌ壬£¬£¬£¬£¬£¬¶ø²¢·ÇÒ»¸ö¼òÆÓµÄÓÐÓïÒåµÄÎïÌå¡£¡£¡£¡£¡£¡£¡£

¾­ÓÉÉÏÊöµÄˢУ¬£¬£¬£¬£¬£¬ÍøÂçµÄÅбðÄÜÁ¦±äµÃ¸üÇ¿£¬£¬£¬£¬£¬£¬¼ì²â·ÖÊýÒ²±äµÃ¸üÓÐÇø·ÖÁ¦£¬£¬£¬£¬£¬£¬ÕâÑù¾Í¿ÉÒÔƾ֤¼ì²â·ÖÊýÅжÏÄ¿µÄÊÇ·ñÏûÊÅ¡£¡£¡£¡£¡£¡£¡£»£»£»£»£»£»£»ùÓÚ´Ë£¬£¬£¬£¬£¬£¬DaSiamRPN¿ÉÒÔ½«¶Ìʱ¸ú×ÙÍØÕ¹µ½³¤Ê±¸ú×Ù£¬£¬£¬£¬£¬£¬²¢ÇÒÔÚUAV20LÊý¾Ý¼¯ÉϱÈ֮ǰ×îºÃµÄÒªÁìÌá¸ßÁË6¸öµã¡£¡£¡£¡£¡£¡£¡£

DaSiamRPNÒ²±» ECCV 2018 ÊÕ¼£¬£¬£¬£¬£¬£¬²¢ÇÒÔÚECCV 2018µÄVOT workshopÉÏÃ棬£¬£¬£¬£¬£¬DaSiamRPNÈ¡µÃÁËʵʱ½ÇÖðµÄ¹Ú¾ü£¬£¬£¬£¬£¬£¬Ïà±ÈÈ¥ÄêµÄ¹Ú¾üÓÐÁË80%µÄÌáÉý¡£¡£¡£¡£¡£¡£¡£

µÚÈýƪÂÛÎÄSiamRPN++£º¶ÔÂÏÉúÍøÂç×Ô¼º¡°Ïµ¶×Ó¡±£¬£¬£¬£¬£¬£¬Ê¹ÓÃÉîÍøÂç

ÒÔÉÏÂÏÉúÍøÂçÔÚËã·¨ºÍѵÁ·Êý¾Ý¼¯É϶¼×öÁËˢУ¬£¬£¬£¬£¬£¬Ó¦¸ÃûÓÐʲô¿ÉÒÔÔÙˢеĵط½ÁË°É?

NO!ÉÐÓÐ!ÉÌÌÀÖÇÄÜÊÓƵÍŶӵÄÑо¿Ö°Ô±»¹¶ÔÂÏÉúÍøÂç×Ô¼º¡°Ïµ¶×Ó¡±¡£¡£¡£¡£¡£¡£¡£Ö®Ç°µÄÂÏÉúÍøÂ綼ÊÇ»ùÓÚ½ÏÁ¿Ç³µÄ¾í»ýÍøÂç(ÈçAlexNet)£¬£¬£¬£¬£¬£¬ÎÞ·¨Ê¹ÓÃÉîÍøÂçΪ¸ú×ÙËã·¨ÌáÉý¾«¶È¡£¡£¡£¡£¡£¡£¡£

µ«ÉîÍøÂç²»¿ÉÖ±½ÓÒýÈ룬£¬£¬£¬£¬£¬²»È»»áÓз´×÷Ó᪡ªÐÔÄÜ´ó·ùË¥¼õ¡£¡£¡£¡£¡£¡£¡£

ÒýÈëÉîÍøÂç֮ǰÐèÒªÏÈ»º½âλÖÃ˽¼ûÎÊÌ⣬£¬£¬£¬£¬£¬Ñо¿Ö°Ô±Í¨¹ýÌá³öÔÚѵÁ·Àú³ÌÖмÓÈ롰λÖÃƽºâµÄ²ÉÑùÕ½ÂÔ¡±À´»º½âÕâÒ»ÎÊÌ⣬£¬£¬£¬£¬£¬ÈÃÉîÍøÂçÄܹ»Ê©Õ¹³öÓ¦ÓеÄЧ¹û¡£¡£¡£¡£¡£¡£¡£

ÔÚ»º½âÁËÕâÒ»ÎÊÌâºó£¬£¬£¬£¬£¬£¬ÉîÍøÂçÄܹ»ÓÃÔÚÂÏÉúÍøÂçÖУ¬£¬£¬£¬£¬£¬²»µ«¿ÉÒÔ¸ú×Ù¸ü¶àϸ½ÚÐÅÏ¢(dz²ãÍøÂçÌØÕ÷)£¬£¬£¬£¬£¬£¬²¢ÇÒÄܸú×Ù¸ü¶àÓïÒåÐÅÏ¢(Éî²ãÍøÂçÌØÕ÷)£¬£¬£¬£¬£¬£¬Ê¹Óöà²ãÈÚºÏÐÅÏ¢½øÒ»²½ÌáÉýÐÔÄÜ¡£¡£¡£¡£¡£¡£¡£

ͬʱ£¬£¬£¬£¬£¬£¬ÂÛÎÄ»¹Ìá³öÁËеÄÅþÁ¬²¿¼þ£¬£¬£¬£¬£¬£¬Éî¶È¿ÉÊèÉ¢Ïà¹Ø²ã(Depthwise Correlation£¬£¬£¬£¬£¬£¬ºóÐø¼òдΪDW)¡£¡£¡£¡£¡£¡£¡£Ïà±ÈÓÚ֮ǰµÄÉýάÏà¹Ø²ã(UpChannel correlation£¬£¬£¬£¬£¬£¬ºóÐø¼òдΪUP)£¬£¬£¬£¬£¬£¬DW¿ÉÒÔ¼«´óµØ¼ò»¯²ÎÊýÄ¿£¬£¬£¬£¬£¬£¬Æ½ºâÁ½Ö§µÄ²ÎÊýÄ¿£¬£¬£¬£¬£¬£¬Í¬Ê±ÈÃѵÁ·Ô½·¢ÎȹÌ£¬£¬£¬£¬£¬£¬Ò²ÄܸüºÃµÄÊÕÁ²¡£¡£¡£¡£¡£¡£¡£

ΪÁËÑéÖ¤ÒÔÉÏÌá³öµÄÄÚÈÝ£¬£¬£¬£¬£¬£¬Ñо¿Ö°Ô±×öÁËÏêϸµÄ±ÈÕÕʵÑé¡£¡£¡£¡£¡£¡£¡£ÔÚ½ÏÁ¿³£ÓõÄVOTºÍOTBÊý¾Ý¼¯ÉÏ£¬£¬£¬£¬£¬£¬SiamRPN++È¡µÃÁËSOTAµÄЧ¹û¡£¡£¡£¡£¡£¡£¡£

ÔÚVOT18µÄ³¤Ê±¸ú×Ù£¬£¬£¬£¬£¬£¬ÒÔ¼°×î½üгöµÄһЩ´ó¹æÄ£Êý¾Ý¼¯ÉÏ£¬£¬£¬£¬£¬£¬ÈçLaSOT£¬£¬£¬£¬£¬£¬TrackingNet£¬£¬£¬£¬£¬£¬SiamRPN++Ò²¶¼È¡µÃÁËSOTAµÄЧ¹û¡£¡£¡£¡£¡£¡£¡£

SiamRPN++ÂÛÎÄÒ²ÒѾ­±»CVPR 2019 OralÈÎÃü£¬£¬£¬£¬£¬£¬ÏêÇé¿ÉÉó²éÂÛÎÄ¡¶SiamRPN++: Evolution of Siamese Visual Tracking with Very Deep Networks¡·¡£¡£¡£¡£¡£¡£¡£

https://arxiv.org/abs/1812.11703

ÁíÍ⣬£¬£¬£¬£¬£¬ÉÌÌÀ¿Æ¼¼ÖÇÄÜÊÓƵÍŶÓÒ²Ê״οªÔ´ÁËÄ¿µÄ¸ú×ÙÑо¿Æ½Ì¨PySOT£¬£¬£¬£¬£¬£¬°üÀ¨Ä¿µÄ¸ú×ÙSOTAËã·¨SiamRPN++ºÍSiamMaskµÈËã·¨¡£¡£¡£¡£¡£¡£¡£¿£¿£¿£¿£¿ªÔ´µØµã¿É»á¼û https://github.com/STVIR/pysot£¬£¬£¬£¬£¬£¬»òµã»÷×óϽǡ°ÔĶÁÔ­ÎÄ¡±¡£¡£¡£¡£¡£¡£¡£

²Î¿¼ÎÄÏ×:

1. Bo Li, Wei Wu, Qiang Wang, Fangyi Zhang, Junliang Xing, Junjie Yan, "SiamRPN++: Evolution of Siamese Visual Tracking with Very Deep Networks" (Oral) in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2019.

2. Zheng Zhu, Qiang Wang, Bo Li, Wei Wu, Junjie Yan, "Distractor-aware Siamese Networks for Visual Object Tracking" European Conference on Computer Vision (ECCV) 2018.

3. Bo Li, Junjie Yan, Wei Wu, Zheng Zhu, Xiaolin Hu, "High Performance Visual Tracking with Siamese Region Proposal Network" (Spotlight) in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2018.

4. Luca Bertinetto, Jack Valmadre, Jo?o F. Henriques, Andrea Vedaldi, Philip H. S. Torr

"Fully-Convolutional Siamese Networks for Object Tracking" in ECCV Workshop 2016.

5. Goutam Bhat, Joakim Johnander, Martin Danelljan, Fahad Shahbaz Khan, Michael Felsberg."Unveiling the Power of Deep Tracking" European Conference on Computer Vision (ECCV) 2018.