Generative AI, Arm throws AI software and hardware to accelerate the whole family bucket.

Author | Yun Peng

Edit | Desert Shadow

With the advent of the "Gen-AI" era, key mobile devices such as AI mobile phones and AI PC are rapidly combining with generative AI, and more and more new AI functions are emerging, which has a profound impact on our lives and work.

Demand has become diversified, and the scene has become more complex. Generative AI brings new computing challenges and storage challenges, and accelerates a series of technical iterations in hardware, software, algorithms and ecology.

As the "foundation" provider of all mobile computing, Arm is also actively exploring new solutions and bringing new solutions to the industry.

In recent years, Arm has gone beyond providing IP, from architecture, hardware and software to ecology. Arm has transformed into a computing platform company, providing complete computing solutions for the industry.

For cloud data centers and automotive applications, Arm has successively launched corresponding computing subsystems (CSS). Just last week, Arm released the first terminal computing subsystem (CSS) for the terminal equipment market, combining the characteristics of the latest Armv9 architecture, in which both CPU and GPU have greatly improved their performance in AI. In addition, Arm also tailored the development tool Kleidi for developers.

This year, Arm has been upgraded from TCS to CSS. The main difference between them is that Arm provides physical implementation of CPU and GPU for the first time, which makes it easier to build and deploy solutions based on Arm architecture. Obviously, this change is precisely to enable ecological partners to quickly grasp new opportunities in AI and accelerate the process of product listing.

It can be said that this is undoubtedly a key force for Arm to face the AI era. This series of heavy technologies and new products of Arm are aimed at the end-side AI.

James McNiven, vice president of product management of Arm Terminal Division of Zhixi Dialogue, made a deep exploration of the key breakthrough behind it and discussed the layout and in-depth thinking of Arm in the era of generative AI.

We can clearly see that Arm is making its partners’ products quickly combine with AI and bring them to market through a complete solution spanning architecture, hardware, software and ecology, so as to achieve landing and create an "AI treasure chest" for the industry.

01.

The wave of mobile-generated AI surges, and Arm goes deep into the bottom.

From architecture to software and hardware empowerment

In today’s smart terminal industry, AI mobile phone and AI PC have undoubtedly become the focus of the industry, and the integration of generative AI in these two fields is also the fastest. The tasks that terminal devices can handle are becoming more and more complex, and generative AI has brought brand-new technical challenges in perception, understanding and interaction, and more computing requirements have emerged.

The industry needs to rethink: what is a computing platform suitable for the generative AI era?

Nowadays, the operation of all mobile generative AI is almost inseparable from the CPU and GPU of Arm. It is understood that 70% of the third-party Android ML workloads are running on the CPU, so the CPU is still the core of computing in the AI ​ ​ era.

In this context, Arm, as the provider of the underlying key technologies, has undoubtedly become a key variable in this AI revolution.

1. Behind the significant improvement of AI capability, Arm’s "DNA" fits with generative AI.

Why is it so critical? The AI era has brought many challenges, the most obvious of which is that the importance of high performance and energy efficiency has been placed at an unprecedented height, and energy efficiency is precisely the DNA of Arm.

The new terminal CSS is based on the latest Armv9, and its computing and graphics performance is improved by more than 30%, while its AI reasoning speed is increased by 59%. These improvements are very important for handling more demanding Android practical use cases and AI, ML and computational vision workloads.

The main frequency of the new Arm Cortex-X925 with 3nm technology soared to 3.8GHz. With the improvement of micro-architecture, compared with the 4nm SoC adopted by the flagship smartphone in 2023, its single-thread performance improved by 36%.

In terms of AI performance, the first response time of Cortex-X925 token is improved by 41%, which can improve the response ability of end-side generative AI such as large language model.

McNiven revealed that in order to improve the computing power of AI, Arm has adopted the widest decoding and vector micro-architecture design so far, achieving a 50% increase in TOPS number.

On the GPU side, the new Arm Immortalis-G925 GPU has achieved 37% performance improvement in various head mobile game applications and 34% performance improvement in multiple AI and ML networks.

It is worth mentioning that the Arm terminal CSS also has the physical realization of CPU and GPU based on 3nm process.

It is understood that the physical realization, including the design and wiring of transistors, can significantly help Arm partners to save chip development time and optimize chip performance and energy efficiency.

2. Create a "key" for developers to unlock stronger performance.

In addition to architecture and hardware design, in terms of tools and software libraries, Arm also released Arm Kleidi for the first time, including KleidiAI for AI workload and KleidiCV for computer vision applications.

The core purpose of Arm as Kleidi is to ensure that developers can quickly obtain the performance, tools and software libraries needed to develop generative AI applications.

Simply understood, KleidiAI is a set of computing cores for AI framework developers. Popular AI frameworks such as PyTorch, Tensorflow and MediaPipe have been integrated into KleidiAI, which is very important for accelerating the mainstream AI model.

It is worth mentioning that, in Arm’s view, CPU is the only computing engine that can ensure the running of the future network, so Kleidi, which can unlock the highest performance of Arm CPU, is undoubtedly the best weapon for developers to unlock AI applications.

Generally speaking, the excellent architecture upgrade, performance and energy efficiency improvement of the Arm terminal CSS pave the way for more functional, stronger and smarter terminal devices, and expand the possibilities and capabilities of mobile devices. At the same time, Arm’s software development tools and platforms allow developers to quickly put these technical advantages of Arm into applications and products. It can be said that Arm has created a "treasure chest" for mobile AI.

02.

The popularity of AI PC accelerates the ecological growth of WoA

Mobile AI ecosystem Arm takes the lead

As mentioned above, Arm provides not only a single point technology or product, but a complete solution. Behind this, the ecological advantages based on architecture, hardware and software are also one of Arm’s hardest cards.

With the rapid development of AI mobile phones and AI PC, the Arm ecosystem has ushered in a new round of growth climax. With the strong promotion of mobile AI PC by Microsoft and other manufacturers, and the accelerated integration of Windows and Arm ecology, we will expect to see more and more PC terminal giants launch AI PCs based on Arm architecture processors.

At this week’s Taipei International Computer Show, the CEO of Arm shouted that the PC with Arm architecture will grab 50% market share in five years. A large part of this strong self-confidence comes from the explosive growth of "Arm Native".

McNiven specifically mentioned that this year has been a fruitful year for the WoA ecosystem. In addition to Microsoft Office, Dropbox, Zoom and Adobe suite, more and more applications are becoming native applications of Arm, especially head applications such as Baidu, Bili Bili, Chrome browser, iQiyi, sogou and Tencent QQ Music.

In addition, there are many open source tools for creators, such as recently added Audacity, Blender and OBS Studio, which integrate a large number of open source libraries and developer tools.

Arm cooperates with Microsoft to develop the ecosystem by funding open source and publishing the Arm performance library for Windows. It is understood that for most users, they spend most of their time running Arm native applications on AI PC based on Arm CPU.

Satya Nadella, CEO of Microsoft, said at the Build conference that 87% of the existing Arm PC applications are native Arm versions, and this number is still growing.

It can be predicted that with the addition of more and more Arm native applications, the experience of Arm PC and WoA ecology will be more perfect.

It is understood that there are now more than 1,000 technical partners of Arm, and Arm undoubtedly has the "strongest circle of friends" in the chip field, and this circle of friends, more intuitively, is the Arm ecosystem-more devices are based on Arm, and more applications are based on Arm, and the AI experience of mobile terminals cannot be separated from Arm.

Ecology is one of the hardest trump cards of Arm, and Arm has also become the "behind-the-scenes king" of the mobile intelligent terminal industry.

Today’s Arm is improving the ability of enterprises and developers to quickly use AI in products, use it correctly, use it well, and achieve landing, and truly create a treasure chest of mobile chips in the era of generative AI.

03.

Conclusion: From IP to Computing Subsystem

Arm becomes the invisible king of mobile AI ecology

It can be seen that Arm is combining cutting-edge CPU and GPU technology, production-ready physical realization and continuous software optimization, and the combination of terminal computing subsystem (CSS) and Kleidi software also makes it an excellent example of a new AI computing platform in the field of chip design.

Today, Arm low-power processor design and software platform have been applied to more than 280 billion chips, from sensors to smart phones and even supercomputers. In the future when AI becomes ubiquitous, Arm will also be ubiquitous. It can be said that the Arm architecture is the cornerstone of the future, and the Arm ecosystem will continue to accelerate its growth.

Facing the future of generative AI, more innovations will inevitably emerge in the mobile intelligent terminal industry. We will wait and see how Arm will maintain its core competitiveness and continuously expand its ecology through technological innovation.

(This article is the original content of the signing account of Netease News Netease Special Content Incentive Plan [Zhizhi]. It is forbidden to reprint it at will without the authorization of the account. )

Original title: "AI mobile phone PC explosion, Arm from software and hardware to ecological efforts, to create an industry AI treasure chest"

Read the original text

　　In physical education class, because they forgot to wear sports shoes, they were "punished" by the physical education teacher, telling them to take off their shoes and run on the hot plastic track. Results Among all the students who were "corporal punishment", more than 10 people were injured in the soles of their feet to varying degrees, and some of them were not seriously injured, which made people feel sad.

　　"Look at the scalded soles of your feet. This teacher has gone too far. At such a high temperature yesterday, she told the baby to run barefoot, and the baby is still so small … …” On June 21, Ms. Yao, a citizen, told the reporter of Huaxi City that her child Xiaolong (a pseudonym) didn’t wear sports shoes when she went to physical education class in Xiaer Primary School in Nanjiang County, Bazhong City, and the teacher asked Xiaolong and a dozen classmates to run barefoot. Causing burns, blisters, redness and inflammation of the soles of the feet, and is currently being hospitalized. In response to this matter, the school responded that the teacher is still young and only joined the work last year. The lack of teaching experience will give parents a reasonable explanation.

　　Student: Those who wear sandals should take off their shoes and run.

　　At 11: 00 am on June 20th, 48 students from Class 4, Grade 1 were preparing to go to physical education class. When the young PE teacher lined up, he found that some children in the class were wearing sandals and leather shoes. According to the regulations, physical education class must wear sports shoes, and it is easy to twist his feet when he wears sandals with loops. For safety reasons, the teacher asked the children with "substandard" shoes to take off their shoes and jog on the plastic track for 2 laps with the whole class. More than 10 students were injured in the soles of their feet to varying degrees, and some of them were not seriously injured. The most serious four students were hospitalized.

　　On the morning of June 21, the reporter went to the central hospital of the next two towns to see the four hospitalized children. Xiaomin (pseudonym) is the most severely burned child among several hospitalized children. His feet and soles are red, swollen and festering, with blisters and yellow liquid flowing out. "Those who wear sandals must take off their shoes to run, and those who don’t wear them don’t have to take off … …” According to Xiao Min’s description, at 11: 00 am on June 21st, Mr. Pan asked him to take off his shoes and ran barefoot on the plastic track twice. "There were many students wearing sandals that day, and we felt that the floor was very hot, but we didn’t dare to tell the teacher."

　　Xiaoyan (pseudonym) also had obvious burns on her feet, saying, "We were taken to the hospital by the teacher at noon yesterday because we couldn’t walk after running. I feel that my feet are very hot. " Xiaoyan and several other students said that they would never forget to wear sports shoes when they went to physical education class.

　　Parents: distressed children also forgive teachers.

　　Ms. Yao told reporters that at 4 o’clock in the afternoon yesterday, she went to the school gate as usual to wait for her grandson to leave school. I found Xiaolong a little lame when he came out. "I was thinking at that time, did I fight with someone again? He told me that his foot hurts, and I found a big blister."

　　"Now that the child is hurt like this, we are really distressed." Ms. Xu whimpered that the temperature was so high that adults couldn’t stand it, not to mention children. The teacher actually told them to run barefoot.

　　Teacher: I didn’t consider the ground temperature.

　　On the morning of June 21st, I met Pan Xiao (a pseudonym), a teacher in Upper physical education class, in the next two central hospitals. She said that she had traveled from hospital to school many times in the past few days. I never imagined that if such a thing happened, I would never make such a "low-level mistake" if I knew it would burn students.

　　"I took a football class and majored in football. I just graduated from work for less than a year. When this happens, I am also very scared and I am sorry for the children and let them suffer. " Pan Xiao said that the temperature was very high that day, but it was physical education class, so I wanted to jog for two laps, but I found that many children were wearing sandals, and I have mentioned it many times. "I am afraid that the sandals will slip and the children will trip. For safety reasons, I will ask them to take off their shoes and jog for two laps. Ignore the problem of ground temperature. "

　　After running for two laps, a child reported to the teacher that his feet hurt. Hearing the students complaining, Pan Xiao hurried forward to check. "I saw that my baby’s feet were red. I immediately got cold water and handled it in time. When I was eating at noon, I was sent to the hospital seriously. When the situation was slight, I went to the hospital to get medicine. The temperature of the plastic runway will be higher than the ground temperature, but I really didn’t expect to burn the child. "

　　According to the information released by Bazhong Meteorological Observatory, the highest temperature in Bazhong was 37 degrees Celsius that day. At the time of the incident, the plastic runway was exposed to sunlight, and the temperature could be imagined. Pan Xiao sent these children to the hospital and reported the matter to the school.

　　School: We will actively deal with problems and give parents satisfactory answers.

　　Subsequently, the reporter contacted Kevin·Z, the vice principal of the primary schools in the next two towns. "After the incident, Pan Xiao went to the hospital to visit the children, sincerely apologized to the children and parents, and paid the medical expenses in advance." Kevin·Z told reporters that according to Pan Xiao’s statement, before this, Pan Xiao emphasized many times not to wear sports shoes, for fear of children tripping and spraining.

　　"The teacher is good for the children and doesn’t want to have a safety accident. However, the education method adopted by the teacher is indeed overdone. Next, the school will criticize and educate the teacher and take this as an example to carry out education and training in the school. " Kevin·Z said that Pan Xiao is a very dedicated teacher, but the way of educating students needs to be improved. Will also actively deal with problems and give parents a satisfactory answer.

　　Hospital: The burns are not serious.

　　The attending doctor who scalded the child said that the children were scalded and had blisters, but they did not break the skin. "If you want to recover, it will definitely take some time."

　　The reporter asked the experts that the principle of scald treatment is: firstly, remove the heat source, and immediately immerse the scalded part in clean cold water by means of water immersion or water shower. If you are separated by clothes, you’d better cut them with scissors quickly. The soaking time in cold water should generally last for more than half an hour, and timely heat dissipation can reduce the degree of pain and burns. If the burn is not serious (refers to the first-degree burn in which the burned epidermis is red and does not blister), the wound surface can be washed with cold boiled water and coated with scald cream. If there are blisters or even black dry scars on the wound, it means that the scald is quite serious. Don’t break the blisters or dry scars at this time, and go to the hospital for treatment and treatment as soon as possible.

　　[Pacific Auto Network New Car Channel] Challenger Xeon version SRT Demon finally released the first full-scale official map, and the real car is expected to start at the upcoming new york Auto Show on April 14th.

　　The hood of the front of the car is raised and the air inlet is treated, which is a high-performance logo element of the American system. The overall appearance of Challenger SRT Demon is not too grandiose, and the only thing that shows the identity is the "devil’s head" logo everywhere in the car body.

Challenger SRT Demon preview

　　As one of the masters of Hua Dan, the top performance version of Challenger was SRT Hellcat. A 6.2SC V8 was stuffed into the fuselage, reaching a horrible 525kW(717PS), rising to 880Nm, and with 8 speeds, the car only needed 11 seconds for a 400m-meter sprint, and the top speed easily exceeded 300km/h, even reaching the speed of Mars of 328.3 km/h.

Challenger SRT Hellcat

　　The newly launched Challenger SRT Demon has a power output above this, which is expected to reach 557kW(757PS). What is even more frightening is that Demon will lose 200 pounds (about 90.7 kg) compared with Hellcat. In addition, it will also upgrade the wheels, steering, suspension and other components.

　　Demon first appeared on the Dodge Dart launched in 1971. Both the name (Demon literally translates as devil) and the hideous LOGO show its evil and powerful nature. The tiger’s ass is still untouchable. If you meet this one, you can hide as far as you can. (Text: Pacific Auto Network Yang Li)

　

CCTV News:Driving a luxury car and living in a spacious house, who would have thought that behind a glamorous family, the price was a woman’s miserable life for nine years. Recently, Chongqing police found a domestic violence case and rescued a woman who was illegally detained by her husband.

An alarm message reveals her husband’s evil deeds.

On March 16, 2017, the duty room of Shapingba police station suddenly received a short message alarm from the command center of the municipal bureau. The content of the short message was very strange: help me, I am now under control and coerced to engage in fraud, involving hundreds of thousands of dollars.

The police initially thought it was a pyramid scheme. The policeman indicated his detailed address at the end of the message, and the police quickly rushed to the incident site. What the police didn’t expect, however, was that this incident was worse than illegal detention through pyramid schemes — — What appeared in front of the police was a girl handcuffed to the computer.

The woman was pale, her left foot was locked by anklets, and she dared not speak. There are many QQ and WeChat chat interfaces on the computer screen.

There was also a man at the scene. He said that he and the girl were husband and wife. Because they quarreled, they were afraid that she would run, so they locked them on the stool.

In front of the police, the man took out the ankle key and opened the lock for the woman. The woman looked very scared and told the police in a low voice that she was abused.

Police:Hit you with this stick?

Woman:Hmm.

Police:He hit it with this stick. Is it hurt?

Woman:Yes.

In the victim’s home, the police also found handcuffs, anklets and other items. The police brought the two back to the police station for further investigation.

The woman was imprisoned by her husband for 9 years and coerced to cheat online.

In the police station, the alarm woman told the whole story with tears, and a sensational story gradually surfaced.

In 2008, 20-year-old Zhang Xue (a pseudonym) went to work in Shanghai from her hometown of Zhongxian, and met Chen Hua (a pseudonym). They soon became boyfriend and girlfriend. After a period of contact, Zhang Xue found that Chen Hua had a bad temper and was very selfish, so she broke up. But Chen Hua didn’t agree, and several people rushed to her rental house to beat her.

In desperation, Zhang Xue chose to endure, but did not expect that this endurance was a dark life for 9 years. Soon, Zhang Xue became pregnant, and under the coercion of Chen Hua, they got married. Zhang Xueben thought that Chen Hua’s temper would be restrained when she had a child. Unexpectedly, he intensified and dragged her onto the road of telecom fraud.

Zhang Xue:He asked me to cheat others on the Internet. At first, I didn’t know how to chat with others. He was chatting and typing, and the video was pointed at me. Later, he taught me how to chat. At first, I was very nervous. As soon as I said something wrong, he called me with a fist.

"Deception indicators" can’t be beaten by husbands.

Chen Hua, who has no job, gives Zhang Xue "business indicators" every day. If he can’t cheat the specified amount every day, he will be beaten. In order to force Zhang Xue to complete his "performance", Chen Hua’s violence also began to escalate, using various tools.

Zhang Xue:Hit with clothes hangers, wires, baseball bats, wooden sticks, screwdrivers and vises, whatever you can.

Chen Hua stipulates that he must cheat 4,000 to 5,000 every day. One day, Zhang Xue didn’t cheat money, but he took a knife and cut off her little finger.

Reporter:The direct knife was cut off?

Zhang Xue:Yes, there’s only one skin left, and now I’m unconscious in front.

Reporter:Besides this kind of injury, what other injuries are there?

Zhang Xue:This hand was also cut by him with a knife, and so was this place. After knowing him, I was hurt all over my body.

Unable to stand the beating, Zhang Xue began to cheat money online according to Chen Hua’s request, from one or two hundred yuan at the beginning to thousands later.

In order to prevent his telecom fraud from being exposed, in 2016, Chen Hua moved to Chongqing with Zhang Xue and her daughter, and installed a camera at home to monitor Zhang Xue’s every move with her mobile phone.

Zhang Xue:My record of transferring money to him on WeChat is at least 500,000, and he said that he played games with the money. I don’t want to lie to others.

Reporter:Does your child know every time he hits you?

Zhang Xue:The child is here, and the child says, mom, you are so poor. She can’t tell lies, but only do things. She said, mom, you’d better go and do something. I don’t want dad to hit you.

The wife couldn’t bear to call the police and the husband was detained.

The victim thought that her forbearance could make her husband change, but she didn’t expect her husband to treat her more severely, which made her finally summon up the courage to call the police.

In February of this year, Chen Hua bought handcuffs and anklets to lock Zhang Xue in order to let Zhang Xue continue to cheat him. This lock is a month, and it has also become the fuse for Zhang Xue to decide to resist Chen Hua. Zhang Xue quietly collected evidence of Chen Hua’s illegal detention and forcing her to commit telecom fraud through mobile phone camera and recording. On March 16th, Zhang Xue finally got up the courage and sent the alarm message. At present, Chen Qiang is criminally detained by the police on suspicion of illegal detention and telecom fraud, while Zhang Xue is a coerced crime. The police will make a decision on how to deal with her after further investigation.

The Anti-Domestic Violence Law has been implemented for one year: the success rate of personal safety protection orders is 98%

The police who handled the above-mentioned cases told the reporter that the police station often encountered domestic violence cases when receiving the police, but because the violence cases occurred at home, it was often difficult for the police to handle them because of insufficient evidence. The ignorance of violence will only make the perpetrators more unscrupulous. Zhang Xue is a living example.

From March 1, 2016 to now, China’s Anti-Domestic Violence Law has been implemented for one year. As the first anti-domestic violence law in China, it clearly stipulates that "physical and mental violations committed by family members in the form of beating, binding, mutilation, restriction of personal freedom, frequent abuse and intimidation" belong to domestic violence.

In the more than one year since the implementation of the Anti-Domestic Violence Law, there is a data worthy of attention, which has more enlightenment significance for this case. According to the statistics of the Supreme People’s Court, from March 1, 2016 to the end of December, 2016, the national courts issued a total of more than 680 personal safety protection orders, with a success rate of 98%, ranking first in the implementation rate of civil rulings in China. For Zhang Xue in this case, if she can apply for this protection order earlier during her nine-year imprisonment, the tragedy may be avoided to some extent.

How can a victim of domestic violence apply for a personal safety protection order?

When can I apply?

Suffering from domestic violence or facing the real danger of domestic violence. Domestic violence includes physical and mental violations such as beating, binding, mutilation, restriction of personal freedom, frequent abuse and intimidation. Unmarried cohabitation can also be applied.

How to apply for a personal safety protection order?

Written application, if you have difficulty, you can apply orally. If the party concerned is a person with no (limited) capacity for civil conduct, or cannot apply for it due to coercion, intimidation and other reasons, close relatives, public security organs, women’s federations, neighborhood committees, village committees and relief management agencies may apply for it on their behalf. There is no need to pay legal fees and provide guarantee for the application.

How long can I get a reply after applying?

After accepting the application, the court makes a decision within 72 hours; In case of emergency, it should be decided within 24 hours.

How long is the personal safety protection order valid?

No more than 6 months from the date of making the decision.

How does the personal safety protection order protect the applicant?

Prohibit the respondent from committing domestic violence; Prohibit the respondent from harassing, stalking or contacting the applicant and its related close relatives; Ordering the respondent to move out of the applicant’s residence for protection; Other measures for the personal safety of the applicant.

The personal safety protection order shall be executed by the court, and the public security organs, residents’ committees and villagers’ committees shall assist in the execution.

What should the respondent do if he violates the habeas corpus?

If it constitutes a crime, criminal responsibility shall be investigated according to law; If it does not constitute a crime, it shall be fined up to 1000 yuan and detained up to 15 days according to the seriousness of the case.