The International Joint Conference on Artificial Intelligence (IJCAI) 2024 has officially started, with OPPO AI Center’s latest research paper selected for the event. The center showcased its cutting-edge AI innovations, including the Zero-Shot Framework revolutionizing text-to-image video generation. The paper “Zero-shot High-fidelity and Pose-controllable Character Animation” showcased OPPO’s extensive tech expertise and continuous advancement in the AI field. The conference aims to showcase OPPO’s commitment to AI innovation.
Currently, the most common issues in the I2V (Image-to-Video) domain are inconsistent character appearances and poor detail retention, requiring vast amounts of video data for training and consuming significant computational resources. To address these challenges, OPPO AI Center introduced PoseAnimate, an innovative zero-shot I2V framework. PoseAnimate leverages pose information to control the animation’s movements while maintaining scene content consistency. This framework achieves its goals through three key modules:
- Pose-Aware Control Module (PACM): Integrates various pose signals into text embeddings to retain content irrelevant to the character and ensure precise alignment of movements.
- Dual Consistency Attention Module (DCAM): Enhances temporal consistency, preserving character identity and intricate background details.
- Mask-Guided Decoupling Module (MGDM): Improves the fidelity of generated videos by decoupling characters from the background.
The OPPO team also proposed the Pose Alignment Transition Algorithm (PATA) to ensure alignment and smooth character pose transitions. Experimental results demonstrate that PoseAnimate significantly outperforms existing advanced training methods in character consistency and detail fidelity, maintaining high temporal consistency throughout the generated animations.
Additionally, Dr. Yang Zhenyu from OPPO AI Center was invited to present at the IJCAI 2024 conference on “Generative AI for smartphone: Challenges, Opportunities and Practices of OPPO.” He shared OPPO’s practical experiences with AI industry partners and academia, contributing to the global exploration of how the next generation of smartphones can responsibly and efficiently integrate AI technology.
With the rapid development of generative AI technology, the smartphone industry is entering a new era of AI phones. As a global leader, OPPO is dedicated to integrating cutting-edge AI technology into its products, delivering users a more innovative and convenient mobile life experience.
This year, OPPO launched the Find X7 Series and the Reno12 Series 5G AI phones, showcasing OPPO’s profound prowess in the mobile AI field. At the same time, OPPO is accelerating the global democratization of AI phones, aiming to bring generative AI features across its entire smartphone lineup for around 50 million users within the year.
OPPO firmly believes that a true AI smartphone is not only about hardware enhancement but also a revolutionary breakthrough in user experience. To achieve this goal, OPPO has established a robust AI Center and engaged in deep collaborations with leading global tech companies like Google, Microsoft, and MediaTek. OPPO is committed to exploring hybrid (on-device and cloud) mobile AI technologies, driving innovative applications of AI on mobile devices.
Moreover, OPPO frequently participates in top-tier international AI conferences, sharing its latest AI research findings, maintaining close communication with the AI academic community, and continuously leading the industry’s development direction. Looking ahead, OPPO will continue to prioritize user-driven, persistently exploring innovative applications of AI technology to provide users with the ultimate AI phone experience.
