Generative AI, Arm throws AI software and hardware to accelerate the whole family bucket.

Author | Yun Peng

Edit | Desert Shadow

With the advent of the "Gen-AI" era, key mobile devices such as AI mobile phones and AI PC are rapidly combining with generative AI, and more and more new AI functions are emerging, which has a profound impact on our lives and work.

Demand has become diversified, and the scene has become more complex. Generative AI brings new computing challenges and storage challenges, and accelerates a series of technical iterations in hardware, software, algorithms and ecology.

As the "foundation" provider of all mobile computing, Arm is also actively exploring new solutions and bringing new solutions to the industry.

In recent years, Arm has gone beyond providing IP, from architecture, hardware and software to ecology. Arm has transformed into a computing platform company, providing complete computing solutions for the industry.

For cloud data centers and automotive applications, Arm has successively launched corresponding computing subsystems (CSS). Just last week, Arm released the first terminal computing subsystem (CSS) for the terminal equipment market, combining the characteristics of the latest Armv9 architecture, in which both CPU and GPU have greatly improved their performance in AI. In addition, Arm also tailored the development tool Kleidi for developers.

This year, Arm has been upgraded from TCS to CSS. The main difference between them is that Arm provides physical implementation of CPU and GPU for the first time, which makes it easier to build and deploy solutions based on Arm architecture. Obviously, this change is precisely to enable ecological partners to quickly grasp new opportunities in AI and accelerate the process of product listing.

It can be said that this is undoubtedly a key force for Arm to face the AI era. This series of heavy technologies and new products of Arm are aimed at the end-side AI.

James McNiven, vice president of product management of Arm Terminal Division of Zhixi Dialogue, made a deep exploration of the key breakthrough behind it and discussed the layout and in-depth thinking of Arm in the era of generative AI.

We can clearly see that Arm is making its partners’ products quickly combine with AI and bring them to market through a complete solution spanning architecture, hardware, software and ecology, so as to achieve landing and create an "AI treasure chest" for the industry.

01.

The wave of mobile-generated AI surges, and Arm goes deep into the bottom.

From architecture to software and hardware empowerment

In today’s smart terminal industry, AI mobile phone and AI PC have undoubtedly become the focus of the industry, and the integration of generative AI in these two fields is also the fastest. The tasks that terminal devices can handle are becoming more and more complex, and generative AI has brought brand-new technical challenges in perception, understanding and interaction, and more computing requirements have emerged.

The industry needs to rethink: what is a computing platform suitable for the generative AI era?

Nowadays, the operation of all mobile generative AI is almost inseparable from the CPU and GPU of Arm. It is understood that 70% of the third-party Android ML workloads are running on the CPU, so the CPU is still the core of computing in the AI ​ ​ era.

In this context, Arm, as the provider of the underlying key technologies, has undoubtedly become a key variable in this AI revolution.

1. Behind the significant improvement of AI capability, Arm’s "DNA" fits with generative AI.

Why is it so critical? The AI era has brought many challenges, the most obvious of which is that the importance of high performance and energy efficiency has been placed at an unprecedented height, and energy efficiency is precisely the DNA of Arm.

The new terminal CSS is based on the latest Armv9, and its computing and graphics performance is improved by more than 30%, while its AI reasoning speed is increased by 59%. These improvements are very important for handling more demanding Android practical use cases and AI, ML and computational vision workloads.

The main frequency of the new Arm Cortex-X925 with 3nm technology soared to 3.8GHz. With the improvement of micro-architecture, compared with the 4nm SoC adopted by the flagship smartphone in 2023, its single-thread performance improved by 36%.

In terms of AI performance, the first response time of Cortex-X925 token is improved by 41%, which can improve the response ability of end-side generative AI such as large language model.

McNiven revealed that in order to improve the computing power of AI, Arm has adopted the widest decoding and vector micro-architecture design so far, achieving a 50% increase in TOPS number.

On the GPU side, the new Arm Immortalis-G925 GPU has achieved 37% performance improvement in various head mobile game applications and 34% performance improvement in multiple AI and ML networks.

It is worth mentioning that the Arm terminal CSS also has the physical realization of CPU and GPU based on 3nm process.

It is understood that the physical realization, including the design and wiring of transistors, can significantly help Arm partners to save chip development time and optimize chip performance and energy efficiency.

2. Create a "key" for developers to unlock stronger performance.

In addition to architecture and hardware design, in terms of tools and software libraries, Arm also released Arm Kleidi for the first time, including KleidiAI for AI workload and KleidiCV for computer vision applications.

The core purpose of Arm as Kleidi is to ensure that developers can quickly obtain the performance, tools and software libraries needed to develop generative AI applications.

Simply understood, KleidiAI is a set of computing cores for AI framework developers. Popular AI frameworks such as PyTorch, Tensorflow and MediaPipe have been integrated into KleidiAI, which is very important for accelerating the mainstream AI model.

It is worth mentioning that, in Arm’s view, CPU is the only computing engine that can ensure the running of the future network, so Kleidi, which can unlock the highest performance of Arm CPU, is undoubtedly the best weapon for developers to unlock AI applications.

Generally speaking, the excellent architecture upgrade, performance and energy efficiency improvement of the Arm terminal CSS pave the way for more functional, stronger and smarter terminal devices, and expand the possibilities and capabilities of mobile devices. At the same time, Arm’s software development tools and platforms allow developers to quickly put these technical advantages of Arm into applications and products. It can be said that Arm has created a "treasure chest" for mobile AI.

02.

The popularity of AI PC accelerates the ecological growth of WoA

Mobile AI ecosystem Arm takes the lead

As mentioned above, Arm provides not only a single point technology or product, but a complete solution. Behind this, the ecological advantages based on architecture, hardware and software are also one of Arm’s hardest cards.

With the rapid development of AI mobile phones and AI PC, the Arm ecosystem has ushered in a new round of growth climax. With the strong promotion of mobile AI PC by Microsoft and other manufacturers, and the accelerated integration of Windows and Arm ecology, we will expect to see more and more PC terminal giants launch AI PCs based on Arm architecture processors.

At this week’s Taipei International Computer Show, the CEO of Arm shouted that the PC with Arm architecture will grab 50% market share in five years. A large part of this strong self-confidence comes from the explosive growth of "Arm Native".

McNiven specifically mentioned that this year has been a fruitful year for the WoA ecosystem. In addition to Microsoft Office, Dropbox, Zoom and Adobe suite, more and more applications are becoming native applications of Arm, especially head applications such as Baidu, Bili Bili, Chrome browser, iQiyi, sogou and Tencent QQ Music.

In addition, there are many open source tools for creators, such as recently added Audacity, Blender and OBS Studio, which integrate a large number of open source libraries and developer tools.

Arm cooperates with Microsoft to develop the ecosystem by funding open source and publishing the Arm performance library for Windows. It is understood that for most users, they spend most of their time running Arm native applications on AI PC based on Arm CPU.

Satya Nadella, CEO of Microsoft, said at the Build conference that 87% of the existing Arm PC applications are native Arm versions, and this number is still growing.

It can be predicted that with the addition of more and more Arm native applications, the experience of Arm PC and WoA ecology will be more perfect.

It is understood that there are now more than 1,000 technical partners of Arm, and Arm undoubtedly has the "strongest circle of friends" in the chip field, and this circle of friends, more intuitively, is the Arm ecosystem-more devices are based on Arm, and more applications are based on Arm, and the AI experience of mobile terminals cannot be separated from Arm.

Ecology is one of the hardest trump cards of Arm, and Arm has also become the "behind-the-scenes king" of the mobile intelligent terminal industry.

Today’s Arm is improving the ability of enterprises and developers to quickly use AI in products, use it correctly, use it well, and achieve landing, and truly create a treasure chest of mobile chips in the era of generative AI.

03.

Conclusion: From IP to Computing Subsystem

Arm becomes the invisible king of mobile AI ecology

It can be seen that Arm is combining cutting-edge CPU and GPU technology, production-ready physical realization and continuous software optimization, and the combination of terminal computing subsystem (CSS) and Kleidi software also makes it an excellent example of a new AI computing platform in the field of chip design.

Today, Arm low-power processor design and software platform have been applied to more than 280 billion chips, from sensors to smart phones and even supercomputers. In the future when AI becomes ubiquitous, Arm will also be ubiquitous. It can be said that the Arm architecture is the cornerstone of the future, and the Arm ecosystem will continue to accelerate its growth.

Facing the future of generative AI, more innovations will inevitably emerge in the mobile intelligent terminal industry. We will wait and see how Arm will maintain its core competitiveness and continuously expand its ecology through technological innovation.

(This article is the original content of the signing account of Netease News Netease Special Content Incentive Plan [Zhizhi]. It is forbidden to reprint it at will without the authorization of the account. )

Original title: "AI mobile phone PC explosion, Arm from software and hardware to ecological efforts, to create an industry AI treasure chest"

Read the original text

CCTV News:China’s economic "report card" released by the National Bureau of Statistics on October 15th shows that, despite the impact of epidemic and other shocks, the employment situation is generally stable, structural adjustment has been solidly promoted, people’s livelihood has been continuously improved, and the economic operation is generally stable and continues to recover, showing resilience and vitality.

In October, the year-on-year growth rate of China’s main economic indicators rose and fell, but from the two-year average growth rate, most indicators were accelerated.

In the first 10 months, the added value of industrial enterprises above designated size increased by 10.9% year-on-year, the total retail sales of social consumer goods increased by 14.9%, and the total import and export of goods increased by 22.2%; The national urban survey unemployment rate averaged 5.1%, and the national consumer price index (CPI) rose by 0.7% year-on-year, both lower than the expected target of annual macro-control.

Despite the impact of adverse factors such as epidemic situation and flood, China’s agricultural production remained stable, and its industry and service industry withstood the impact, showing an improvement trend, and its development resilience continued to show. In particular, the market has achieved positive results in ensuring supply. In October, the year-on-year growth rate of raw coal production in China changed from last month to 4%, and the production of metal containers and integrated circuits, which are in short supply in the market, increased by 76.2% and 22.2% respectively.　

Positive changes have taken place in industrial production. In October, the growth rate of 22 of 41 major industries rebounded, and the output growth rate of 288 of 590 industrial products rebounded, and the areas of industrial production improvement increased significantly.　

Fu Linghui, spokesperson of the National Bureau of Statistics and Director of the National Economic Comprehensive Statistics Department:Positive changes in industrial production will provide strong support for economic recovery. In the medium and long term, China’s economy is improving for a long time, the integration of industrialization and informatization is accelerating, the digital transformation of manufacturing industry continues to advance, the innovation drive is constantly enhanced, and the industrial economy has broad prospects for development.

In the first 10 months of this year, the online retail sales of physical goods increased by 14.6% year-on-year, accounting for 23.7% of the total retail sales of social consumer goods.

Fu Linghui, spokesperson of the National Bureau of Statistics:These conditions show that the resilience of China’s consumer market is sufficient, the consumption scale is expanded, the consumption structure is upgraded, and the development trend of consumption pattern innovation has not changed. With the economic recovery, the expansion of employment, the increase of residents’ income and the gradual improvement of social security, consumption growth still has good support.

Fu Linghui said that China’s sustained economic recovery has not changed, and positive factors are accumulating. However, we must also see that there are still many uncertainties in international instability and constraints on domestic economic recovery. It is worth noting that in October, the national industrial producer price index (PPI) rose by 13.5% year-on-year, and the "scissors difference" with CPI was as high as 12 percentage points. The cost of enterprises continued to rise, and there was some pressure on ensuring supply and stabilizing prices.

Fu Linghui said, looking at the fourth quarter and the beginning of next year, the risk challenges faced by China’s economy are still complex and severe. Despite some risk challenges, overall, the economic operation is stable and the development quality is expected to be gradually improved.

How to calculate the yield of Yu ‘ebao?

　　Yu ‘ebao is a popular investment and financial management method at present. Many people invest in Yu ‘ebao but don’t know it.How to calculate the income of Yu ‘ebao?The premise of calculating the income of Yu ‘ebao is to check the yield of Yu ‘ebao. According to different yields of Yu ‘ebao, you can calculate your Yu ‘ebao income according to the formula "Yu ‘ebao income = (your actual capital × income per 10,000 shares) ÷10000, or Yu ‘ebao income = income per 10,000 shares × your actual capital".

　　Since Alipay, the largest third payment platform in China, launched a balance appreciation service in June 2013, Yu ‘ebao has been highly concerned by people who like financial management. There are rumors that there is a bubble period of funds in the country this year, so Alipay has opened this value-added service, so that more people can deposit their money in Yu ‘ebao, and then everyone’s money will be gathered together and then invested. In the process of this investment, the income generated will be calculated according to a certain proportion of your principal, and the interest will be converted. Is Yu ‘ebao’s income really as good as it says? How to calculate the yield of Yu ‘ebao?

　　Calculation method of Yu ‘ebao’s income: seven-day total income /10000 (based on ten thousand yuan) * seven-day annualized rate of return per ten thousand copies = income (income/day).

　　For example, the total income of seven days is 200 yuan /10000*2.056% (every ten thousand income announced by the fund company on that day) =0.009 yuan (income on that day).

　　Calculation rules of Yu ‘ebao’s income:

　　Step 1: You must have an Alipay (or Yu ‘ebao) account. Transfer the deposit in Alipay to Yu ‘ebao.

　　Step 2: After the funds are transferred to Yu ‘ebao before 15 o’clock on the same day, it needs to be confirmed by the fund company for one day (not confirmed on weekends and national legal holidays).

　　Step 3: The fund company is internally divided by Yu ‘ebao, which mainly collects the funds of all users of Yu ‘ebao and then invests them.

　　Step 4: The daily income per 10,000 shares is announced by the fund company. Its origin is that the fund company invests your principal, and then the income of that day accounts for the proportion of the principal. For example, if you invest 10,000 yuan and the income is 100 yuan, then the yield is 1% (100/10,000 = 1%).

　　Check the seven-day annualized rate of return per 10,000 copies of "Yu ‘ebao" (this is the rate of return launched by Yu ‘ebao). Baidu searches for "Yu ‘ebao" and clicks on the link of Yu ‘ebao.

　　Step 5: Enter the balance treasure income broadcast page, which is the platform of "seven-day annualized rate of return per 10,000 shares" specially announced by fund companies. (The annual rate of return of Yu ‘ebao is the proportion of the income of seven days to the whole year. If the rate of return changes every seven days, your income will also change with it.

Postscript

　　I believe everyone knows how to calculate the yield of Yu ‘ebao, right? Compared with ordinary bank deposits, the interest rate is much higher, but at the same time there are certain risks, so Xiaobian suggests that you can spread the amount when managing money to ensure the maximum income and the highest security. For more questions about Yu ‘ebao, Xiaobian recommended it in related reading, hoping to bring help to netizens.

　

　　Last March was a big policy aimed at regulating the property market and stabilizing expectations, and this March was an intimate little detail involving market transactions. Following the release of the official version of the second-hand housing contract between buyers and sellers, the Beijing Municipal Commission of Housing and Urban-Rural Development issued three documents concerning housing agencies last night, aiming at regulating the second-hand housing market, clarifying for the first time the relationship between the sale of stock houses and the brokerage services, and clarifying the rights and obligations of real estate brokers and buyers and sellers.

　　All three documents will be implemented on April 15th. According to the contents of the document, the charging standard of second-hand housing intermediary service is determined by the entrusting party and the entrusted party through consultation based on the service content, service cost, service quality and market supply and demand; There is no clear requirement for who will pay the service fee, and it is also agreed by the parties to the transaction themselves.

　　The charging standard of agency fee shall be settled through negotiation.

　　In addition to the Notice on Strengthening the Administration of Filing and Publicity of Business Sites of Beijing Real Estate Brokerage Agencies, this time, the model texts of Beijing Stock House Sale Brokerage Service Contract and Beijing Stock House Purchase Brokerage Service Contract were also released.

　　"Sale contract" refers to the contract signed by the second-hand house seller and the housing agency, while "off-take contract" refers to the contract signed by the buyer and the housing agency. That is to say, starting from April 15th, buyers and sellers of second-hand houses in Beijing will sign contracts with intermediaries separately.

　　The reporter learned from a number of intermediaries that there have been practices in which intermediaries have signed contracts or agreements with buyers and sellers before. However, it is found that the official version is more comprehensive and standardized in content.

　　Especially on the issue of agency fees. Both the sale contract and the off-take contract are marked with a "service fee". Does this mean that there will be a new attempt to collect agency fees? Previously, an intermediary in Tianjin has tried to share the burden between buyers and sellers. Will Beijing follow up? How to determine the charging standard?

　　Judging from the current market trading habits, the brokerage service fee is mainly borne by the buyer. "There is no clear requirement for who will pay the brokerage service fee, which is agreed by the parties to the transaction." Li Wenjie, president of the Beijing Real Estate Agency Industry Association, explained that according to the Measures for the Administration of Real Estate Brokers, the same real estate brokerage business can only be charged according to one business, and no additional fees can be charged to the clients. Therefore, brokerage institutions sign sales and off-take contracts with clients respectively. No matter whether the brokerage service fees are paid by both parties or by one of them, brokerage institutions cannot increase the fees.

　　As for the charging standard, Li Wenjie said that the state and Beijing Municipality stipulate that the real estate brokerage service fee shall be subject to market-regulated price management, and the charging standard shall be determined by the entrusting party and the entrusted party through consultation according to the service content, service cost, service quality and market supply and demand. Therefore, in the model contract, there is no definite standard, but it is left to negotiation in the transaction.

　　Buyers and sellers also have to pay intermediary fees for "string orders"

　　What needs to be reminded to buyers and sellers is that even if no transaction is finally reached with the intermediary after entrustment, they may have to pay the corresponding intermediary fee, which is listed in the contract model through "liability for breach of contract".

　　For buyers, they have given up the right to entrust other intermediaries to buy a house at the same time (exclusively entrusted to an intermediary), but they bought a house through other intermediaries during the entrustment period; The buyer refuses to sign a transaction contract with the seller introduced by the entrusted intermediary, but makes a transaction with the seller within the agreed time after the expiration of the entrustment period; The buyer refuses to sign a contract with the seller introduced by the entrusted intermediary, but after the expiration of the entrusted period, he has to pay the intermediary fee to the entrusted intermediary in accordance with the contract.

　　For the seller, he has given up the right to entrust other intermediaries to sell the house (exclusively entrusted to an intermediary), but sold the house through other intermediaries during the entrustment period; Has given up the right to sell by itself, but sells the house by itself within the entrustment period; Has refused to sign a transaction contract with the buyer introduced by the entrusted intermediary, but has made a transaction with the buyer within the agreed time after the expiration of the entrusted period; We have refused to sign a transaction contract with the buyer introduced by the entrusting intermediary, but within the agreed time after the expiration of the entrustment period, we have made a transaction with the buyer through other intermediaries. If the entrusting intermediary has evidence to prove that there is a direct causal relationship between the transaction of the house and the brokerage service for the sale of the existing house, we need to pay the intermediary fee to the entrusting intermediary in accordance with the contract.

　　The contract can be terminated if it is infringed by false information.

　　According to the liabilities for breach of contract listed in the two contracts, if the intermediary entrusted by the buyer or the seller infringes on the interests of the buyer or the seller by concealing or fabricating information, the intermediary shall refund the collected real estate brokerage service fee and bear the liability for compensation according to law, and the buyer and the seller also have the right to unilaterally terminate the contract.

　　However, if the buyer or seller provides false housing information and materials, the intermediary also has the right to unilaterally terminate the contract.

　　In addition, the model contract also makes it clear that if the contract cannot be performed as agreed due to force majeure, the liability may be exempted in part or in whole according to the influence of force majeure, but the party that fails to perform the contract as agreed due to force majeure shall inform the other party in time.

　　The model text of the stock house sale and off-take brokerage service contract will be promoted and implemented together with the model text of the Stock House Sales Contract released in the early stage, and will be officially put into use from April 15, 2018.

　　The person in charge of the Municipal Commission of Housing and Urban-Rural Development previously introduced that since March last year, a total of 532 intermediaries operating in violation of regulations have been cancelled for the record, 351 intermediary stores operating in violation of regulations have been shut down, and 240 stores have shut down by themselves, which has formed a powerful shock to market violations.

　　"If last year was ‘ Law enforcement supervision year ’ , then this year will become ‘ Year of system construction ’ The service supervision of government departments on the real estate brokerage industry will continue to advance in the direction of deepening, refinement and long-term. " Yin Fei, dean of the School of Law of the Central University of Finance and Economics, said that the policy documents issued by the Municipal Housing Construction Committee and relevant departments this year have comprehensively strengthened the management of intermediaries by improving policies and regulations, strengthening institutional mechanisms, and guiding the use of contract model texts.