Does it feel that the mobile phone artificial intelligence assistant is smart? Can not be separated from the inner strong | 'core'

'It’s raining, what should I do?'

The mother said with concern: 'Remember to bring an umbrella, be careful not to catch cold, if the rain is too big, take a taxi.'

The boss said arrogantly: 'Come on the company, don't be late.'

'It’s raining, it’s raining!' Faced with this answer, you should doubt which kind of good friend is pranking? But the answer is not the real person, but the virtual artificial intelligence (AI) in the mobile phone. voice assistant.

Earlier, intelligent assistants could only understand simple voice commands, such as searching for keywords, querying the weather, launching applications, etc., and the strength played the role of ' IQ is questioned'. In the face of common sense questions, or complex instructions often finish 'Can't understand', just dive, not to mention 'this, that' and so on. It is an unknown pronoun that can be called an artificial intelligence disaster. But in the past two years, the AI ​​voice assistant has improved significantly, which can help you find a certain day of the year. Take a photo, you can also call the car in one sentence, make a red envelope, start to navigate, and even 'pick up' with you.

After the AI ​​voice assistant is strengthened, more users can replace the multi-step touch operation through 'one-stop' voice interaction, which has become an important driving force for the industry chain related enterprises to improve the voice interactive experience of mobile phones and other terminal products. But want to shape The virtual AI assistant on the terminal side is not easy. It needs to improve the accuracy of speech recognition and shorten the sense of interaction delay. The 'cultivation' virtual assistant conforms to the user's personal attributes. In this regard, the solution provided by Qualcomm is: Let the terminal such as smart phone use the core 'Understand the user.

In 2007, Qualcomm Research launched the first personal intelligence project. By 2015, the Snapdragon 820 mobile platform was released. It is also the first Qualcomm artificial intelligence of Qualcomm to officially debut and empower the mobile phone to reach the users. Continue to invest in R&D in the field of artificial intelligence. Strengthening the frontier research in the field of artificial intelligence, providing a full technical accumulation for Qualcomm to build a strong 'core'. In 2017, Qualcomm released the Snapdragon 845 mobile platform equipped with the third generation of artificial intelligence. The combination of mobile phone and AI began to enter the honeymoon period. Thousand yuan machine, the flagship machine has been labeled with AI. Today, Snapdragon 600 and the 700 series products debuted this year also have Qualcomm AIE (artificial intelligence engine) blessing. So, today equipped with Snapdragon platform, support Qualcomm AIE The mobile phone has been able to provide users with a more convenient, intelligent and user-friendly experience in AI shooting, smart scene recognition, AI facial recognition and virtual artificial intelligence assistants. Let's look at the development of virtual artificial intelligence assistants. Strong 'core' How to make the phone more 'smart', how to 'read' users.

Free hands, energy-efficient virtual artificial intelligence assistants lead interactive change

Compared with other interaction methods, voice has an important advantage - liberating the hands! When the alarm clock wakes up and the mind is blank, but the phone can not be found anyway, the voice assistant can only turn off the alarm clock by moving the mouth, and the beauty sleeps back. When the kitchen is busy preparing dinner, use the voice assistant to tell the family on the road to buy the missing ingredients; when you can't leave the computer keyboard with your hands, you want to click BGM. You can also play your favorite with a voice assistant. Music...

Compared with the voice interaction supported by traditional cloud AI, terminal-side processing has more unique advantages, such as faster response speed, higher reliability and better privacy protection. Voice interaction drives terminal-side interactive transformation. To enhance the interactive experience and make the virtual artificial intelligence assistant mature, but behind the scenes, the terminal equipment needs to have high precision for voice commands and semantic recognition, so as to avoid the ambiguous result of 'fighting and sloppy'. To achieve end-to-end The voice interaction experience is a complex process. Generally speaking, the voice interaction with the terminal requires multiple component support to implement the following processes: microphone to collect voice signals, next voice preprocessing, voice activation, speech recognition and natural language Understand, in the end, the terminal responds to the user by means of speech synthesis.

In order to ensure the user experience, the virtual artificial intelligence assistant needs to be turned on in real time on the terminal side. However, the portable terminal device 'end of life' such as smart phones is a valuable resource, so controlling power consumption and heat dissipation is very important. The energy efficiency is Qualcomm AI Research. The core research area is equipped with advanced audio and power management modules in the Snapdragon platform. In addition, Qualcomm Voice Activation (VA) is at the top level in terms of performance and power balance. This provides a copy of the device 'Long Standby'. Guaranteed, but in addition to controlling power consumption also requires high recognition accuracy, so voice noise reduction is also a key problem for Qualcomm.

In a moving car, in a noisy work room, the use of voice assistants requires the elimination of environmental noise, otherwise the terminal recognition, understanding of the voice signal will be biased, the interaction becomes a communication of 'lip lips and no mouth'. Qualcomm artificial intelligence Hou Jilei, research project leader and senior director of engineering technology, once said: The addition of machine learning has improved the accuracy of terminal speech recognition. Qualcomm trains deep learning-based noise reduction models with a large amount of speech noise data, which can be used in challenging interference and noise scenarios. Staying robust, and the model has significant performance improvements over traditional methods, even under the very limited processing power, power consumption and heat dissipation of hearing aids.

It can be understood that after the noise reduction, the terminal analyzes the voice command, and the key information in the transmitted signal is more clear, so the accuracy is greatly improved. During the CES in 2018, Qualcomm demonstrated the end-to-end voice interaction experience in the smart home, adapting After the accent and environment, the instruction set for a specific domain can already achieve more than 95% intent to understand the accuracy.

Virtual artificial intelligence assistant for AI application is not only limited to noise reduction, but also includes 'self-education'. Vivo NEX equipped with Qualcomm AIE's Snapdragon 710 mobile platform, with Jovi voice assistant. To use Jovi to give designated contacts Send WeChat information as an example to see how the virtual artificial intelligence assistant completes self-learning.

The order is 'to tell Xiaohong with WeChat, don't forget to have a meeting at 10 o'clock in the morning.' The phone will follow the previous 'experience'. The default conversation involves the contact as 'Xiaohong' (convert the voice to text), and if there is no corresponding link in the directory. The person 'Little Red' will be converted to Pinyin 'xiao hong', and the contact confirmation message will be sent to the contact confirmation of 'Xiaohong' to send the message. The next time you send the instruction to 'Xiaohong', the virtual artificial intelligence assistant According to the previous learning results, you will search for 'Xiaohong' directly.

Therefore, the virtual artificial intelligence assistant with the support of Xiaolong 'core' not only improves the initial 'intelligence', but also deepens the user's behavior and habits with the user's use, and becomes more personalized. ' stand up.

User-friendly virtual artificial intelligence assistant, let the terminal know you better

Our ultimate expectation for virtual artificial intelligence assistants is to hope that it can be like a 'living person or partner', so in addition to helping us to complete the control of the terminal device, we need to be 'active' and 'humanized'. Just like the article. At the beginning, let's go to the voice assistant of 'Raining Rain'. Although this answer is mostly a joke, it is more close to the dialogue between people. One of the great advantages of enhancing personalization is that it can promote the personal assistant to further develop and respond. Sex and initiative. Real personal assistants not only provide personalized answers when users ask questions, but also make self-determined and silent conversations based on situational analysis. In daily life, the main reason we need 'helper' help is - I can't make up my mind, such as 'What to eat for lunch', 'This dress looks good'... Now the virtual artificial intelligence assistant receives these questions 'inner heart' should be broken, but the future is not necessarily.

If the terminal can be equipped with more sensors (such as iris recognition, temperature), a more powerful core 'core' platform, more stable and fast connection (5G) and more advanced deep learning capabilities, the terminal is guaranteed to be private and secure. Then virtual artificial intelligence assistants will have more distinct 'private attributes'. Now Qualcomm's exploration of terminal-side artificial intelligence, virtual artificial intelligence assistants is working towards 'humanization'. Qualcomm artificial intelligence research project leader and senior director of engineering technology Hou Jilei It is believed that the real personal assistant is responsive and proactive, not only can complete the user's instructions, but also can analyze the user's potential needs based on the situation, and actively start the 'conversation', like a real friend.

In order to shape the humanization, Qualcomm adds 'AI agent' to the virtual artificial intelligence assistant to achieve intuitive response with more detailed user data and behavior analysis, such as adding emotional classification, context-based fusion and learning, etc. This requires the mobile phone to be smarter. Build a 'private database' for the user, such as identity, age, usage habits, etc. Currently, Qualcomm AIE-enabled smartphones are equipped with some related functions, such as AI facial recognition to determine gender age; smart scene analysis will recommend corresponding based on usage habits Content, application; or just a voice assistant who has just mentioned evolutionary upgrades.

The Qualcomm AIE-enabled terminal device not only gives the virtual artificial intelligence assistant a sensitive 'auditory' but also 'visual'. Still using the "Nov" of vivo NEX as an example, the intelligent text can not only analyze the text information in the picture, but also Image information analysis for the user 'science' or provide purchase information.

That is to say, more and more functions are integrated through virtual artificial intelligence assistants. Qualcomm is supported by a strong 'core' and leading algorithm, making our mobile phones more and more 'smart'. Qualcomm AIE, Snapdragon' Advanced research results such as Core's will also cover the Internet of Things, Internet of Vehicles, smart homes, smart cities and other fields. Because of the era of Internet of Everything, humans' natural interaction with terminals is not limited to smartphones, but also includes intelligence. Speakers, extended reality (XR) devices, cars, etc., such as 'conversation with the car', can adjust the navigation line more timely and accurately; dialogue with the extended reality (XR) device can reduce the threshold of experience, enhance the interaction immersion, accuracy; 'Dialogue' with smart home products such as smart speakers is an important part of the 'smart family' we have been looking forward to.

Looking forward to the future, the humanized virtual artificial intelligence assistant not only serves as the intelligent housekeeper in the home, the guide of wisdom in the car, the secretary of the 'smart' in the mobile phone, but also may become the 'digital projection' of everyone.

2016 GoodChinaBrand | ICP: 12011751 | China Exports