Why Japan is lagging behind in generative A.I. — and how it can create its own large language models
Japan is known for its futuristic technology. But the nation is lagging behind in the generative AI race and is trying to create its own large language models.
Mr.cole_photographer | Moment | Getty Images
Countries are racing to develop their own generative artificial intelligence algorithms, but high tech Japan is already behind.
Generative AI has been the trendiest topic in tech since OpenAI made waves with its chatbot ChatGPT. Breakthroughs in generative AI possess the potential to fuel a 7% increase in global GDP, or almost $7 trillion, over the next decade, according to Goldman Sachs research.
Key to generative AI development are large language models which underpin the likes of ChatGPT and Baidu’s Ernie Bot, capable of processing vast data sets to generate text and other content. But Japan is currently trailing behind the U.S., China and the EU in developing these algorithms, said Noriyuki Kojima, co-founder of Japanese LLM startup Kotoba Technology.
Chinese organizations, including tech giants Alibaba and Tencent, have launched at least 79 LLMs domestically over the past three years, Reuters reported in May citing research from a consortium of state-run institutes. U.S. corporate powerhouses such as OpenAI, Microsoft, Google and Meta play a significant role in propelling the country’s LLM advancements, said Kojima.
Japan lagging behind in generative AI
Japan, however, lags behind the U.S., China and Europe in the scale and speed of its LLM development.
“Japan’s trailing position in the field of generative AI largely stems from its comparative shortcomings in deep learning and more extensive software development,” said Kojima.
Deep learning requires a “robust community of software engineers” to develop necessary infrastructure and applications, Kojima added. Japan, however, will face a deficit of 789,000 software engineers by 2030, according to the Ministry of Economy Trade and Industry. The nation is now ranked 28th out of 63 countries in terms of technological knowledge, according to the IMD World Digital Competitiveness Ranking.
Japan also faces hardware challenges as LLMs need to be trained using AI supercomputers like IBM’s Vela and Microsoft’s Azure-hosted system. But no private company in Japan possesses its own “world-class machine” with those capabilities, Nikkei Asia reported.
Government-controlled supercomputers like Fugaku therefore “hold the key” to Japan’s pursuit of LLMs, Kojima explained.
“Access to such large-scale supercomputers forms the backbone of LLM development, as it has traditionally been the most significant bottleneck in the process,” he said.
How Japan’s supercomputers can help
Tokyo Institute of Technology and Tohoku University plan to use Fugaku to develop LLMs based primarily on Japanese data in collaboration with the supercomputer’s developers Fujitsu and Riken, Fujitsu announced in May.
The organizations plan to publish their research results in 2024 to help other Japanese researchers and engineers develop LLMs, Fujitsu added.
The Japanese government will also invest 6.8 billion yen ($48.2 million), about half the total cost, to build a new supercomputer in Hokkaido that will begin service as early as next year, Nikkei Asia reported. The supercomputer will specialize in LLM training to promote Japan’s development of generative AI, said Nikkei Asia.
In April, Japanese Prime Minister Fumio Kishida said the country supports the industrial use of generative AI technology. Kishida’s remarks followed his meeting with OpenAI CEO Sam Altman, who said the company is looking to open an office in Japan.
Japanese companies pursuing generative AI
Big Tech players have also joined the fray to boost Japan’s standing in generative AI. In June, SoftBank’s mobile arm said it plans to develop its own generative AI platform, reported local media. This was underscored by SoftBank CEO Masayoshi Son’s announcement that the investment firm plans to shift from “defense mode” to “offense mode” and intensify its focus on AI.
“We would like to be [in] the leading position for the AI revolution,” Son said during a shareholders’ annual general meeting.
SoftBank Group sold its 85% stake in SB Energy to Toyota Tsusho in April and recently agreed to sell its 90% stake in U.S. investment manager Fortress Investment Group, Nikkei Asia reported. Trimming these other investments helps SoftBank free up cash, allowing it to focus largely on AI through its Vision Fund venture capital investment unit.
SoftBank-owned chip design company Arm is also set to pursue a U.S. IPO listing later in the year. “It will be by far the biggest IPO that’s hit the world,” said Amir Anvarzadeh, Japan equity market strategist at Asymmetric Advisors.
The IPO will provide a hefty sum to boost funds at SoftBank, which reported a record 4.3 trillion yen loss at Vision Fund for its fiscal year ending March 31.
Arm originally sought to raise between $8 billion and $10 billion. But with demand for semiconductor chips “through the roof,” Anvarzadeh suggested Arm could raise as much as $50 billion to $60 billion — or “85% of SoftBank’s market cap.”
He said SoftBank’s share price will likely rise, although this does not guarantee the success of its AI efforts.
“Fundamentally, I don’t think SoftBank is going to change Japan’s landscape … they are no savior of Japan’s AI,” he said.
Japanese telecommunications company NTT also announced plans to develop its own LLM this fiscal year, aiming to create a “lightweight and efficient” service for corporations. NTT said it will funnel 8 trillion yen over the next five years into growth areas like data centers and AI, a 50% increase from its previous level of investment.
Local media reported that digital ad company CyberAgent released an LLM in May that enables companies to create AI chatbot tools. The company said it is one of few “models specialized in the Japanese language and culture.”
While it has yet to catch up in the generative AI space, Japan is making its first stride with these private sector efforts. Once a “robust infrastructure” is established, the remaining technical challenges are likely to be “significantly mitigated” by using open-sourced software and data from previous pioneers, Kojima said. Bloom, Falcon and RedPajama are all open-sourced LLMs trained on vast amounts of data that can be downloaded and studied.
However, companies venturing into this field should anticipate competition spanning a “relatively longer timeframe,” Kojima said. Developing LLMs requires substantial capital investment and a workforce highly skilled in natural language processing and high-performance computing, he explained.
“SoftBank and NTT, joining this competition, will not change the AI landscape in the short-term.”
AI regulation in Japan
Japanese tech companies’ increased participation in generative AI development coincides with a positive stance on AI adoption in other sectors. Over 60% of companies in Japan have a positive attitude toward using generative AI in their operations, while 9.1% are already doing so, a survey by Teikoku Databank found.
Hitachi has established a generative AI center to promote employee’s safe and effective use of the technology, it said in May. With the expertise of data scientists, AI researchers and relevant specialists, the center will formulate guidelines to mitigate the risks of generative AI, the conglomerate said.
Japan will even consider government adoption of AI technology like ChatGPT, provided that cybersecurity and privacy concerns are resolved, said Chief Cabinet Secretary Hirokazu Matsuno.
As Japan becomes more open to the use of generative AI, the government should formulate and facilitate soft guidelines regarding its use, while assessing the need for hard regulation based on specific risks, said Hiroki Habuka, research professor at Kyoto University’s Graduate School of Law.
“Without clearer guidance on what actions companies should take when using generative AI, practices may become fragmented,” the professor said.
United Launch Alliance Atlas V rocket carrying the first two demonstration satellites for Amazon’s Project Kuiper broadband internet constellation stands ready for launch on pad 41 at Cape Canaveral Space Force Station on October 5, 2023 in Cape Canaveral, Florida, United States.
Paul Hennessey | Anadolu Agency | Getty Images
Amazon delayed the launch of its Kuiper internet satellites due to poor weather conditions on Wednesday night.
A United Launch Alliance rocket carrying 27 Kuiper satellites was set to lift off from a launchpad in Cape Canaveral, Florida, but ULA said it couldn’t continue countdown operations as “stubborn cumulus clouds” and heavy winds pushed the launch outside its planned window, according to a livestream.
“Weather is observed and forecast NO GO for liftoff within the remaining launch window at Cape Canaveral this evening,” ULA said. The company said it will provide a new launch date at a later point.
Six years ago Amazon unveiled its plans to build a constellation of internet satellites in low Earth orbit, a region of space that’s within 1,200 miles of Earth’s surface. The company aims to sell high-speed, low-latency internet to consumers, corporations and governments, offering connections through square-shaped terminals. Commercial service is expected to come online later this year.
Amazon is racing to compete with SpaceX’s Starlink, the dominant player in the market, with 8,000 satellites already up in the air. SpaceX CEO Elon Musk now has a central role in the White House as one of President Donald Trump’s top advisors, overseeing the Department of Government Efficiency, or DOGE. Since Musk took on the role, Starlink’s footprint has increased within the federal government.
The clock is ticking for Amazon to meet a deadline set by the Federal Communications Commission, which requires the company to have half of its total constellation, or 1,618 satellites, up in the air by July 2026.
Once it completes its first launch, Amazon expects to ramp up its production, processing and deployment rates. It’s begun prepping satellites for its next mission, which will also hitch a ride on one of ULA’s Atlas V rockets.
Alphabet CEO Sundar Pichai meets with Polish Prime Minister Donald Tusk in Warsaw, Poland, on February 13, 2025.
Klaudia Radecka | Nurphoto | Getty Images
Google has reversed a policy forbidding employees from discussing its antitrust woes following a settlement with workers.
The company sent a notice to U.S. employees last week saying it rescinded “the rule requesting that workers refrain from commenting internally or externally about the on-going antitrust lawsuit filed against Google by the U.S. Department of Justice,” according to correspondence viewed by CNBC.
Google settled with the Alphabet Workers Union, which represents company employees and contractors, according to the U.S. National Labor Relations Board, or NLRB. The settlement and policy reversal mark a major victory for Google staffers, who have seen increased censorship on subjects such as politics, litigation and defense contracts by the search giant since 2019.
The U.S. Department of Justice filed an antitrust lawsuit against Google in 2020, alleging that the company has kept its share of the general search market by creating strong barriers to entry and a feedback loop that sustained its dominance.
Google said it “will not announce or maintain overbroad rules or policies that restrict your right to comment, internally or externally, about whether and/or how the on-going antitrust lawsuit filed against Google by the U.S. Department of Justice may impact your terms and conditions of employment,” according to last week’s notice.
The policy change was first reported by The New York Times.
The reversal comes as Google and the DOJ prepare to return to the courtroom for their scheduled remedies trial on April 21. The DOJ has said it is considering structural remedies, including breaking up Google’s Chrome web browser, which it argues gives Google an unfair advantage in the search market.
A U.S. District Court judge ruled in August that Google illegally held a monopoly in the search market. Google said it would appeal the decision. The DOJ doubled down on its calls for a breakup in a March filing.
Following the August ruling, Kent Walker, Google’s president of global affairs, sent a companywide email directing employees to “refrain from commenting on this case, both internally and externally.”
Shortly after, the Alphabet Workers Union filed an unfair labor practice charge against Google with the NLRB. The union alleged that Walker’s message was an “overly broad directive” and said that a breakup could impact workers’ roles. The NLRB in March ruled that Google must allow workers to speak on such topics.
Google’s settlement states that the National Labor Relations Act gives employees the right to form, join or assist a union. It notes that Google is not rescinding its prior clarification that states employees may not speak on behalf of Google on this matter without approval from the company. The settlement also adds that Google will not interfere with, restrain or coerce workers in the exercise of their rights.
Despite the settlement, spokesperson Courtenay Mencini said Google did not agree with the NLRB’s ruling.
“To avoid lengthy litigation, we agreed to remind employees that they have the right to talk about their employment, as they’ve always been free to and regularly do,” Mencini said in a statement to CNBC.
The settlement by Google comes at a “crucial moment” ahead of the remedies trial, the Alphabet Worker’s Union said Monday.
“We think the potential remedies from this trial could have impact on our wages, working conditions and terms of employment,” said Stephen McMurtry, communications chair of the Alphabet Workers Union-CWA, told CNBC.
Apple CEO Tim Cook inspects the new iPhone 16 during an Apple special event at Apple headquarters on September 09, 2024 in Cupertino, California.
Justin Sullivan | Getty Images
Apple shares skyrocketed 15% on Wednesday after President Donald Trump announced a 90-day pause on his administration’s “reciprocal tariffs,” which would have affected the company’s production locations in Vietnam, India, and Thailand.
The rally added over $400 billion to Apple’s market cap, which now stands just under $3 trillion. It was Apple’s best day since January 1998, when late founder Steve Jobs was the interim CEO and three years before the company unveiled the first iPod. At the time, Apple’s market cap was close to $3 billion.
Apple has been the most prominent name to get whacked by Trump’s tariffs. Before Wednesday, it was on its worst four-day trading stretch since 2000. Investors worried about Apple’s outlook because the company still makes the majority of its revenue from selling physical devices, which need to be imported into the U.S.
Most of Apple’s iPhones and other hardware products are still made in China, which was not exempted from tariffs on Wednesday. In fact, Trump increased tariffs on China to 125% on Wednesday, up from 54%.
China issued an 84% tariff on U.S. goods this week, raising the possibility that Apple could get caught up in a trade war and lose ground in China, its third-largest market by sales.
Apple has worked to diversify its supply chain to lessen reliance on China in recent years.
On Wednesday, tariffs on Vietnam were reduced from 46% to 10%, and tariffs on India were cut 26% to 10%, which raises the possibility that Apple will be able to serve a large percentage of its U.S. customers from factories outside of China with lower tariffs.
Stocks skyrocketed across the board on Wednesday after Trump announced the tariff pause. The Nasdaq Composite climbed over 12%, its second-best day ever.
Apple hasn’t commented publicly on Trump’s tariffs, but CEO Tim Cook will likely address the topic on an earnings call on May 1.
-
Sports2 years ago‘Storybook stuff’: Inside the night Bryce Harper sent the Phillies to the World Series
-
Sports1 year agoStory injured on diving stop, exits Red Sox game
-
Sports1 year agoGame 1 of WS least-watched in recorded history
-
Sports2 years agoMLB Rank 2023: Ranking baseball’s top 100 players
-
Sports4 years ago
Team Europe easily wins 4th straight Laver Cup
-
Environment2 years agoJapan and South Korea have a lot at stake in a free and open South China Sea
-
Environment2 years agoGame-changing Lectric XPedition launched as affordable electric cargo bike
-
Business3 years agoBank of England’s extraordinary response to government policy is almost unthinkable | Ed Conway