·µ»Ø- ½¹µãÊÖÒÕ
- ÒÔÔ´´ÊÖÒÕϵͳΪ»ù±¾£¬ £¬£¬£¬£¬SenseCoreÉÌÌÀAI´ó×°ÖÃΪ½¹µã»ù×ù£¬ £¬£¬£¬£¬½á¹¹¶àÁìÓò¡¢¶àÆ«ÏòÇ°ÑØÑо¿£¬ £¬£¬£¬£¬
¿ìËÙÂòͨAIÔÚ¸÷¸ö±ÊÖ±³¡¾°ÖеÄÓ¦Ó㬠£¬£¬£¬£¬ÏòÐÐÒµ¸³ÄÜ¡£¡£¡£¡£¡£¡£¡£¡£
ÈëÑ¡AAAI 2020£¬ £¬£¬£¬£¬È«ÐÂÊÓƵÓïÒåÖ§½âºÍ¹âÁ÷ÍŽáѧϰËã·¨ÎÊÊÀ
¸ôÀëÒßÇé²»¸ôÀëѧϰ£¬ £¬£¬£¬£¬¶ÁÂÛÎÄÒ²ÊǺܺõÄÔÚ¼Ò¡°³äµç¡±·½·¨Ö®Ò»¡£¡£¡£¡£¡£¡£¡£¡£
½ñÈÕ£¬ £¬£¬£¬£¬µÚ34½ìÈ˹¤ÖÇÄܶ¥¼¶¾Û»áAAAI 2020Õýʽ¿ªÄ»(2ÔÂ7ÈÕ-2ÔÂ12ÈÕÔÚÃÀ¹úŦԼ¾ÙÐÐ)¡£¡£¡£¡£¡£¡£¡£¡£AAAI(Association for the Advance of Artificial Intelligence¡ª¡ªÃÀ¹úÈ˹¤ÖÇÄÜлá)ÊÇÈ˹¤ÖÇÄÜÁìÓòµÄÖ÷ҪѧÊõ×éÖ¯Ö®Ò»£¬ £¬£¬£¬£¬ÆäÄê»áÿÄ궼ÎüÒýÁË´ó×ÚÀ´×ÔѧÊõ½çºÍ¹¤Òµ½çµÄÑо¿Ô±¡¢¿ª·¢ÕßͶ¸å£¬ £¬£¬£¬£¬²Î»á¡£¡£¡£¡£¡£¡£¡£¡£
ÉÌÌÀ¿Æ¼¼Ñо¿ÍŶӽÒÏþÂÛÎÄ¡¶Every Frame Counts: Joint Learning of Video Segmentation and Optical Flow¡·£¬ £¬£¬£¬£¬Á¢ÒìÐԵؽ«ÊÓƵÓïÒåÖ§½âºÍ¹âÁ÷ÒªÁìÈںϣ¬ £¬£¬£¬£¬¼«´óÌáÉýÁËÊÓƵ֧½âµÄ׼ȷÂʺÍЧÂÊ£¬ £¬£¬£¬£¬¸ÃÂÛÎÄÒ²±»AAAI 2020ÈÎÃü¡£¡£¡£¡£¡£¡£¡£¡£ÕâÖÖÒªÁìÔÚ×Ô¶¯¼ÝÊ»¡¢»úеÈË¡¢ÈËÌå×Ë̬ʶ±ð¡¢ARÌØЧµÈÖî¶à³¡¾°¾ùÓÐÆÕ±éÓ¦ÓÃÔ¶¾°¡£¡£¡£¡£¡£¡£¡£¡£
ÄÇôÕâƪÂÛÎľ¿¾¹ÓÐÄÄЩÁ¢ÒìÄØ?ÏÂÃæÖðÒ»½â¶Á¡£¡£¡£¡£¡£¡£¡£¡£
¨†Í»ÆÆÏÖÓÐÒªÁì¾ÖÏÞ
ÏÖÓеÄÊÓƵÓïÒåÖ§½âÒªÁ죬 £¬£¬£¬£¬ÊÇʹÓÃÇ°ºóÖ¡µÄÓïÒåÐÅÏ¢Õ¹ÍûÔ˶¯¹ì¼£À´Ö§½â£¬ £¬£¬£¬£¬ÕâÖÖÒªÁìÃæÁÙÁ½´óÌôÕ½£º
׼ȷÂʵ͡£¡£¡£¡£¡£¡£¡£¡£ÊÓƵ±ê×¢²»ÈçͼÏñ±ê×¢ÄÇÑùÿһ֡¶¼»á±ê×¢£¬ £¬£¬£¬£¬Ò»¸öÊÓƵƬ¶ÏÍùÍùÖ»±ê×¢Ò»Ö¡£¬ £¬£¬£¬£¬ÏÖÓÐÒªÁìÄÑÒÔʹÓÃËùÓеÄÊý¾Ý£¬ £¬£¬£¬£¬µ¼ÖÂÖ§½âµÄ׼ȷÂʽϵ͡£¡£¡£¡£¡£¡£¡£¡£
ЧÂʵ͡£¡£¡£¡£¡£¡£¡£¡£ÓÉÓÚ¶ÔÇ°ºóÖ¡Ö®¼ä¾ÙÐÐÐÅÏ¢½»»¥ÍùÍùΪģ×ÓÒýÈëÌØÁíÍâÄ£¿£¿£¿£¿£¿£¿£¿é£¬ £¬£¬£¬£¬µ¼ÖÂÊÓƵ֧½âЧÂʵ͡£¡£¡£¡£¡£¡£¡£¡£
ÉÌÌÀÔÚÑо¿ÖÐË¢ÐÂÁËÕâЩȱ·¦£¬ £¬£¬£¬£¬Ìá³öÁËÒ»¸ö¹âÁ÷ºÍÓïÒåÖ§½âÍŽáѧϰµÄ¿ò¼Ü¡£¡£¡£¡£¡£¡£¡£¡£
ͼ1£ºÏÖÓÐÒªÁìºÍÉÌÌÀËã·¨½ÏÁ¿
ÏÖÓÐÒªÁìÍùÍùʹÓÃFeature aggregation½«¶àÖ¡ÐÅÏ¢Èںϵ½Ò»Æ𣬠£¬£¬£¬£¬È»¶øÕâÖּƻ®½ö½öʹÓÃÁ˱ê×¢Ö¡ÖÜΧµÄÉÙÊýÖ¡(t, t-1, t+1)²¢ÇÒ¼«´óÔöÌíÁËÍøÂçµÄÅÌËãʱ¼ä¡£¡£¡£¡£¡£¡£¡£¡£
±¾ÎĵÄÒªÁìʹÓÃTemporal consistent constraint(ʱÐòÒ»ÖÂÐÔÔ¼Êø)Ϊ¶àÖ¡µÄÌØÕ÷Ö®¼äÌí¼ÓÒþʽԼÊø£¬ £¬£¬£¬£¬ÔÚ²»ÔöÌíºÄʱµÄÌõ¼þÏÂʹÓøü´ó¶¼¾Ýѧϰµ½¸ü³°ôµÄÌØÕ÷¡£¡£¡£¡£¡£¡£¡£¡£
±¾ÎÄÌá³öµÄÍŽáѧϰ¿ò¼Ü(Èçͼ2)£¬ £¬£¬£¬£¬ÊäÈëͼƬ¾Óɹ²Ïí±àÂëÆ÷ºó·ÖΪÁ½¸ö·ÖÖ§£¬ £¬£¬£¬£¬Éϰ벿·ÖÊǹâÁ÷·ÖÖ§£¬ £¬£¬£¬£¬Ï°벿·ÖÊÇÖ§½â·ÖÖ§£¬ £¬£¬£¬£¬ÒÔʵʱÐòÒ»ÖÂÐÔÄ£¿£¿£¿£¿£¿£¿£¿é(»ÆÉ«)ºÍÕÚµ²Ô¤¼ÆÄ£¿£¿£¿£¿£¿£¿£¿é(»ÒÉ«)¡£¡£¡£¡£¡£¡£¡£¡£
ͼ2£º¹âÁ÷ºÍÓïÒåÖ§½âÍŽáѧϰ¿ò¼Ü
¨†ÓïÒåÖ§½âºÍ¹âÁ÷ÏศÏà³É
±¾ÂÛÎĵÄÓïÒåÖ§½âºÍ¹âÁ÷ÊÇÏศÏà³ÉµÄ£¬ £¬£¬£¬£¬ÓïÒåÖ§½âΪ¹âÁ÷ºÍÕÚµ²Ô¤¼ÆÌṩÁ˸ü¸»ºñµÄÓïÒåÐÅÏ¢£¬ £¬£¬£¬£¬¶ø·ÇÕÚµ²µÄ¹âÁ÷°ü¹ÜÁËÓïÒåÖ§½âµÄÏñËؼ¶±ðµÄʱÐòÒ»ÖÂÐÔ¡£¡£¡£¡£¡£¡£¡£¡£
ÖµµÃÒ»ÌáµÄÊÇ£¬ £¬£¬£¬£¬Í¨¹ý¹âÁ÷Ê©¼ÓµÄÔ¼Êø²¢Ã»ÓÐÏÔʽµÄÌØÕ÷Èںϣ¬ £¬£¬£¬£¬¶øÊÇÒþʽԼÊø¡£¡£¡£¡£¡£¡£¡£¡£ÔÚѵÁ·ÍøÂçÄ£×ÓʱÐèÒªÖ§½âºÍ¹âÁ÷£¬ £¬£¬£¬£¬µ«ÏÖʵ²âÊÔ¡¢Ó¦ÓõÄʱ¼äÖ»ÐèÒªÖ§½â¡£¡£¡£¡£¡£¡£¡£¡£
ÕâÖÖÒªÁì¿É×ÊÖúʹÓÃÊý¾Ý¼¯ÖеÄËùÓÐÊý¾Ý²¢Ñ§µ½¸ü³°ôµÄÖ§½âÌØÕ÷ÒÔÌá¸ßÖ§½â׼ȷÂÊ£¬ £¬£¬£¬£¬²¢ÇÒ²»»áÔÚ²âÊԽ׶ÎÔöÌíÌØÁíÍâÅÌËãÁ¿¡£¡£¡£¡£¡£¡£¡£¡£
¿ÉÊÇ£¬ £¬£¬£¬£¬Ê¹ÓùâÁ÷ÒªÁìÒ²»á±¬·¢ÐµÄÎÊÌ⣺ÕÚµ²¡£¡£¡£¡£¡£¡£¡£¡£ÈçÏÂͼ£¬ £¬£¬£¬£¬ÐÐÈ˹ýÂí·ʱ°ÑºóÃæµÄÊ÷¸Çס¡£¡£¡£¡£¡£¡£¡£¡£ÄÇôÔõÑù¸ü׼ȷԤ¹ÀÕÚµ²²¿·ÖÅɾ°ÄØ?
±¾ÎÄʹÓÃÎÞ¼àÊӵķ½·¨Ñ§Ï°ÕÚµ²ÇøÓò£¬ £¬£¬£¬£¬Í¨¹ý·´Ïò¹âÁ÷ÍƲâ³ö¿ÉÄÜÎÞ·¨¶ÔÆëµÄÏñËØλÖÃO(¼´ÕÚµ²ÇøÓò)£¬ £¬£¬£¬£¬Ä£×Óƾ֤´Ëѧϰ»ñµÃO_{est};Á½Ö¡µÄÖ§½âЧ¹ûͨ¹ý¹âÁ÷warp·×ÆçÖµÄÇøÓòÉèΪO_{seg}£¬ £¬£¬£¬£¬O_{seg}Ó¦°üÀ¨ÕÚµ²ÇøÓòºÍ¹âÁ÷Ô¤¼Æ¹ýʧµÄÇøÓò£¬ £¬£¬£¬£¬Òò´ËO_{error} = O_{seg}-O_{est}ӦΪ¹âÁ÷Ô¤¼ÆµÄÖصãÇøÓò¡£¡£¡£¡£¡£¡£¡£¡£
ÔÚÅÌËã¹âÁ÷Ô¤¼ÆµÄËðʧº¯Êýʱ£¬ £¬£¬£¬£¬×÷Õß²»Ë¼Á¿ÕÚµ²ÇøÓò(O_{est})µÄËðʧ£¬ £¬£¬£¬£¬¶ø¼Ó´óÖصãÇøÓò(O_{error})µÄȨÖØ¡£¡£¡£¡£¡£¡£¡£¡£
¨†¶à¸öÊý¾Ý¼¯²âÊÔЧ¹ûÅÅÃûÇ°Ïß
ÕâÖÖÒªÁìµÄЧ¹û¾¿¾¹ÔõÑùÄØ?
×÷Õß»®·ÖÔÚCityscapes¡¢CamVidºÍKITTIÊý¾Ý¼¯ÉϾÙÐÐÁ˲âÊÔ£¬ £¬£¬£¬£¬¾ùÅÅÃûÇ°Ïß¡£¡£¡£¡£¡£¡£¡£¡£ÔÚ²»Ê¹ÓÃÌØÊâÊý¾Ý¼¯µÄÇéÐÎÏ£¬ £¬£¬£¬£¬¾ùÅÅÃûµÚÒ»£¬ £¬£¬£¬£¬ÏêϸÈçÏÂ±í£º
±í1£ºCityscapesÊý¾Ý¼¯ÉϵÄÖ§½âЧ¹û£º±¾ÎÄËã·¨ÅÅÃûµÚ¶þ£¬ £¬£¬£¬£¬ÅÅÃûµÚÒ»µÄÒªÁìVPLRÌìÉúÁËÌØÁíÍâÊý¾Ý
±í2£ºCamVidÊý¾Ý¼¯ÉϵÄÖ§½âЧ¹û£º±¾ÎÄËã·¨ÅÅÃûµÚÒ»
±í3£ºKITTIÊý¾Ý¼¯ÉϵĹâÁ÷Ô¤¼ÆЧ¹û£º±¾ÎÄËã·¨ÅÅÃûµÚÈý£¬ £¬£¬£¬£¬ÅÅÃûµÚÒ»ºÍµÚ¶þ¾ùʹÓÃÁËÌØÊâÊý¾Ý¼¯
ÔÙÀ´¿´Ï¿ÉÊÓ»¯Ð§¹û±ÈÕÕ¡£¡£¡£¡£¡£¡£¡£¡£
ͼ4£ºCityScapesÑéÖ¤¼¯Í¼Æ¬¿ÉÊÓ»¯Ð§¹û¡£¡£¡£¡£¡£¡£¡£¡£´ÓÉÏÖÁÏ»®·ÖΪÔͼ£¬ £¬£¬£¬£¬±¾ÎÄËã·¨Ö§½âЧ¹û£¬ £¬£¬£¬£¬PSPNetÖ§½âЧ¹ûºÍGT(±ê׼Ч¹û)
´Óͼ4¿ÉÒÔ¿´³ö£¬ £¬£¬£¬£¬±¾ÎÄËã·¨¶ÔÒƶ¯Ä¿µÄ(Æû³µ£¬ £¬£¬£¬£¬×ÔÐгµ)ºÍ·ºÆðƵ´Î½ÏÉÙÄ¿µÄ(ºáÏò¿¨³µ)Ö§½âЧ¹û½ÏºÃ¡£¡£¡£¡£¡£¡£¡£¡£
ÒÔͼÖеڶþÁеĿ¨³µÊ¶±ðΪÀý£¬ £¬£¬£¬£¬±¾ÎÄËã·¨ÄܸüÍêÕûµÄʶ±ð¿¨³µÐÎ×´£¬ £¬£¬£¬£¬ÇÒͼÖÐÑÕÉ«½ÏÉÙ(Ò»ÖÖÑÕÉ«´ú±íÒ»ÖÖÎïÌå)£¬ £¬£¬£¬£¬»ù±¾ÄÜ׼ȷʶ±ð¿¨³µ¡£¡£¡£¡£¡£¡£¡£¡£¶øPSPNetÖ§½âÒªÁìʶ±ðµÄ¿¨³µÑÕÉ«½Ï¶à£¬ £¬£¬£¬£¬¼´Ê¶±ð³É¶àÖÖÎïÌ壬 £¬£¬£¬£¬¶Ô¿¨³µµÄʶ±ð²»·ó׼ȷ¡£¡£¡£¡£¡£¡£¡£¡£
²¢ÇÒ£¬ £¬£¬£¬£¬ÊµÑéЧ¹ûµÄÊÓƵÖÐPSPNetÖ§½âÒªÁì¶ÔÒƶ¯µÄ¿¨³µÊ¶±ðЧ¹ûΪ¶àÖÖÑÕÉ«£¬ £¬£¬£¬£¬¼´Ê¶±ð³ÉÁ˶àÖÖÎïÌå¡£¡£¡£¡£¡£¡£¡£¡£Ïà±È֮ϣ¬ £¬£¬£¬£¬±¾ÎÄËã·¨¸üÎȹ̡£¡£¡£¡£¡£¡£¡£¡£
±¾ÎĵĹâÁ÷Ô¤¼ÆЧ¹ûÒ²ÁìÏÈÐÐÒµ¡£¡£¡£¡£¡£¡£¡£¡£Í¼ÎåÊÇKITTIÊý¾Ý¼¯ÉϹâÁ÷Ô¤¼ÆЧ¹û£¬ £¬£¬£¬£¬´ÓÉÏÖÁÏ»®·ÖΪÔͼ£¬ £¬£¬£¬£¬±¾ÎÄËã·¨Ô¤¼ÆЧ¹û£¬ £¬£¬£¬£¬GeoNetÔ¤¼ÆЧ¹ûºÍGT¡£¡£¡£¡£¡£¡£¡£¡£¿£¿£¿£¿£¿£¿£¿ÉÒÔ¿´³ö±¾ÎÄËã·¨¶ÔÒƶ¯Ä¿µÄµÄ±ßÑØÔ¤¼Æ¸üΪ׼ȷ¡£¡£¡£¡£¡£¡£¡£¡£
ͼ5£ºKITTI Êý¾Ý¼¯¹âÁ÷Ô¤¼Æ¿ÉÊÓ»¯Ð§¹û
GeoNetÔ¤¼ÆµÄʵÑéЧ¹û£¬ £¬£¬£¬£¬ÔÚ×óÒ»ÁÐʶ±ðÆû³µÎ»ÖÃÆ«Àë±ê׼Ч¹û£¬ £¬£¬£¬£¬ÔÚ×ó¶þ¡¢ÈýÁÐʶ±ðÆû³µ½ÏÄ£ºý£¬ £¬£¬£¬£¬Óë±ê׼Ч¹ûÏà²î½Ï´ó¡£¡£¡£¡£¡£¡£¡£¡£Ïà±È֮ϣ¬ £¬£¬£¬£¬±¾ÎÄËã·¨¸ü¿¿½ü±ê׼Ч¹û¡£¡£¡£¡£¡£¡£¡£¡£
ÂÛÎÄ×÷ÕߣºMingyu Ding, Zhe Wang, Bolei Zhou, Jianping Shi, Zhiwu Lu, Ping Luo
ÂÛÎĵص㣺https://arxiv.org/pdf/1911.12739.pdf
