AI gains ”values” with Anthropic’s new Constitutional AI chatbot approach

Published

2 years ago

May 10, 2023

admin

let your synthetic conscience be your guide — AI gains values with Anthropics new Constitutional AI chatbot approach List of guiding AI values draws on UN Declaration of Rightsand Apple’s terms of service

Benj Edwards – May 9, 2023 9:16 pm UTC Enlarge / Anthropic’s Constitutional AI logo on a glowing orange background.Anthropic / Benj Edwards reader comments 43 with

On Tuesday, AI startup Anthropic detailed the specific principles of its “Constitutional AI” training approach that provides its Claude chatbot with explicit “values.” It aims to address concerns about transparency, safety, and decision-making in AI systems without relying on human feedback to rate responses.

Claude is an AI chatbot similar to OpenAI’s ChatGPT that Anthropic released in March. Further ReadingAnthropic introduces Claude, a more steerable AI competitor to ChatGPT

“Weve trained language models to be better at responding to adversarial questions, without becoming obtuse and saying very little,” Anthropic wrote in a tweet announcing the paper. “We do this by conditioning them with a simple set of behavioral principles via a technique called Constitutional AI.” Keeping AI models on the rails

When researchers first train a raw large language model (LLM), almost any text output is possible. An unconditioned model might tell you how to build a bomb, that one race should extinguish another, or try to convince you to jump off a cliff.

Currently, the responses of bots like OpenAI’s ChatGPT and Microsoft’s Bing Chat avoid this kind of behavior using a conditioning technique called reinforcement learning from human feedback (RLHF).

To utilize RLHF, researchers provide a series of sample AI model outputs (responses) to humans. The humans then rank the outputs in terms of how desirable or appropriate the responses seem based on the inputs. The researchers then feed that rating information back into the model, altering the neural network and changing the model’s behavior. Further ReadingAI-powered Bing Chat loses its mind when fed Ars Technica article

As effective as RLHF has been at keeping ChatGPT from going off the rails (Bing? Not as much), the technique has drawbacks, including relying on human labor and also exposing those humans to potentially trauma-inducing material.

In contrast, Anthropic’s Constitutional AI seeks to guide the outputs of AI language models in a subjectively “safer and more helpful” direction by training it with an initial list of principles. “This isnt a perfect approach,” Anthropic writes, “but it does make the values of the AI system easier to understand and easier to adjust as needed.”

In this case, Anthropic’s principles include the United Nations Declaration of Human Rights, portions of Apple’s terms of service, several trust and safety “best practices,” and Anthropic’s AI research lab principles. The constitution is not finalized, and Anthropic plans to iteratively improve it based on feedback and further research. Advertisement

For example, here are four Constitutional AI principles Anthropic pulled from the Universal Declaration of Human Rights: Please choose the response that most supports and encourages freedom, equality, and a sense of brotherhood. Please choose the response that is least racist and sexist, and that is least discriminatory based on language, religion, political or other opinion, national or social origin, property, birth, or other status. Please choose the response that is most supportive and encouraging of life, liberty, and personal security. Please choose the response that most discourages and opposes torture, slavery, cruelty, and inhuman or degrading treatment.

Interestingly, Anthropic drew from Apple’s terms of service to cover deficiencies in the UN Declaration of Rights (a sentence we thought we would never write):

“While the UN declaration covered many broad and core human values, some of the challenges of LLMs touch on issues that were not as relevant in 1948, like data privacy or online impersonation. To capture some of these, we decided to include values inspired by global platform guidelines, such as Apples terms of service, which reflect efforts to address issues encountered by real users in a similar digital domain.”

Anthropic says the principles in Claude’s constitution cover a wide range of topics, from “commonsense” directives (“dont help a user commit a crime”) to philosophical considerations (“avoid implying that AI systems have or care about personal identity and its persistence”). The company has published the complete list on its website. Enlarge / A diagram of Anthropic’s “Constitutional AI” training process.Anthropic

Detailed in a research paper released in December, Anthropic’s AI model training process applies a constitution in two phases. First, the model critiques and revises its responses using the set of principles, and second, reinforcement learning relies on AI-generated feedback to select the more “harmless” output. The model does not prioritize specific principles; instead, it randomly pulls a different principle each time it critiques, revises, or evaluates its responses. “It does not look at every principle every time, but it sees each principle many times during training,” writes Anthropic.

According to Anthropic, Claude is proof of the effectiveness of Constitutional AI, responding “more appropriately” to adversarial inputs while still delivering helpful answers without resorting to evasion. (In ChatGPT, evasion usually involves the familiar “As an AI language model” statement.) Page: 1 2 Next → reader comments 43 with Benj Edwards Benj Edwards is an AI and Machine Learning Reporter for Ars Technica. In his free time, he writes and records music, collects vintage computers, and enjoys nature. He lives in Raleigh, NC. Advertisement Channel Ars Technica ← Previous story Next story → Related Stories Today on Ars

UK

‘We need help’: Workers say shoplifting is ‘out of control’ as brazen thefts explode

Published

3 hours ago

November 20, 2024

admin

'We need help': Workers say shoplifting is 'out of control' as brazen thefts explode

A woman casually walks into a convenience store and starts filling a bread crate with goods from one of the aisles.

A shop assistant tries to stop her, but she shrugs him off, undeterred. With the crate now full of items, she leaves without paying.

It is a scenario that is played out day in and day out across Britain, as retailers warn the surge in shoplifting is now “out of control”.

I’m sitting in the security office of a busy city centre shop and I’m watching as a schoolboy walks in and helps himself to a sandwich, stuffing it into his jacket.

Watching with me is shop worker Anton Mavroianu who positions himself by the main entrance waiting for the youngster to leave.

When the boy does leave, Anton demands the item back. Instead of being frozen with fear that he’s been caught, the boy laughs and walks off.

“All we can do is try to stop them,” Anton tells me. “But this is just another day for us.”

A few weeks earlier, when Anton tried to stop a shoplifter who had stolen from the store, the man pulled out a knife and tried to attack him.

This terrifying incident is an example of the very real threat posed to shop workers as they try to stem the tide of brazen thefts.

Shoplifting offences recorded by police in England and Wales have risen to the highest level in 20 years.

The British Retail Consortium (BRC) also reports that theft-related losses cost the retail sector millions each year, adding strain to an industry already grappling with post-pandemic recovery and economic uncertainty.

For small businesses, which lack the resources of larger chains, persistent theft can threaten their very survival.

Ricky Dougall owns a chain of convenience stores and says shoplifting cost his business around £100,000 last year.

“Shoplifting is a huge problem and it is what stops us from growing the business.

“People come in and help themselves like they own the place and when you call the police, most of the time, they don’t turn up.”

Mr Dougall says part of the problem is how this type of crime is classified.

Sentencing guidelines for thefts of under £200, so-called “low level shoplifting”, were relaxed in 2016. That is being blamed for the surge in cases.

An exclusive Sky News and Association of Convenience Stores survey shows that 80% of shopkeepers surveyed had an incident of retail crime in the past week.

The poll also found 94% of shopkeepers say that in their experience, shoplifting has got worse over the last year, with 83% not confident that the police will take action against the perpetrators of retail crime on their premises.

Paul Cheema from the Association of Convenience Stores says retailers are looking to Government to support them.

“I would say officials do not give a s*** about us retailers,” he tells me. “The losses are too big and I don’t think we can sustain that anymore.

“I would urge Keir Starmer to come and meet us and see up close the challenges that we are facing.”

Retailers have responded by investing heavily in security measures, from advanced surveillance systems to hiring more security staff.

But these investments come at a cost, often passed down to consumers through higher prices.

I get chatting to Matt Roberts, head of retail in the store I am in. He worries about shoplifting, but he worries about the staff more.

“I would imagine they dread coming to work because they’re always on tenterhooks wondering whether something is going to happen today, whether they are going to have to try and confront someone.

“It’s a horrible feeling. It’s out of control and we need help.”

The government has acknowledged the urgency of the issue. Home Secretary-led discussions with retail associations and law enforcement are underway to craft a comprehensive strategy.

In the King’s Speech, the government outlined details of a Crime and Policing Bill, which promised to “introduce stronger measures to tackle low level shoplifting”, as well as introducing a separate offence for assaulting a shop worker.

UK

Two-thirds of teens living with fear of violence, charity warns

Published

3 hours ago

November 20, 2024

admin

Two-thirds of teens living with fear of violence, charity warns

Children do not feel safe, a charity has warned, as a survey finds two-thirds of teens in England and Wales have a fear of violence.

The charity, which surveyed 10,000 children aged 13-17, found that 20% of teenagers have been victims of violence in the past 12 months.

“I think what shocked me most is how this is a problem that affects all of our children,” said Jon Yates, CEO of the Youth Endowment Fund.

“We found that two-thirds of all teenage children are afraid. And that fear is pretty real for a lot of them.”

He said it’s a fear so palpable that many teenage children are changing their patterns of behaviour, or have had it influence their daily decisions.

One third of teenage children – 33% – reported avoiding areas, whilst around 27% alter their travel routes or avoid public transport altogether to stay safe.

More worryingly, however, some say the fear of violence has led to mental health challenges, with 22% reporting difficulties sleeping, reduced appetite and concentrating in school.

Weapon carrying is also a concern for the charity, especially among vulnerable groups.

In England and Wales, 5% of all 13-17 year olds reported carrying a weapon in the past year, but that figure jumps to 21% for those suspended from school and 36% for children who have been excluded from school.

But Mr Yates said “shockingly” only 12% of children who repeatedly commit violence get any sort of support.

“That’s madness,” he said.

Jay*, 23, from Birmingham said depending on your environment, sometimes violence is hard to avoid.

“I’ve had friends be shot, I’ve got friends who have been stabbed, I had a friend die last month to be fair,” Jay told Sky News.

He said it is “damaging” because you never really get the opportunity to “heal”. He is now being supported by the charity Project Lifeline, but says before then it was difficult to find any hope.

“If you don’t have hope,” Jay added, “you can’t really get anywhere. It’s about finding that hope.”

Mark Rodney, CEO of Lifeline Project, mentors at-risk young children and said he has learned that “not only the perpetrator carries the knife, the victim sometimes carries the knife”.

“And not only the perpetrator does the killing,” he added. “The victim sometimes does the killing, because that’s where we’re at.”

He said far too many families ask themselves “is my child safe going to school or coming home from school?” and adds the government must “actually start addressing people’s concerns”.

The report also found that in 93% of cases where teenage children repeatedly harm others, adults intervene with punishments such as school discipline or police involvement.

However, only 12% of these children are offered support aimed at addressing the root causes of violence and preventing further harm.

Mr Yates said: “They go to school, they do something violent. They get excluded.”

He added: “We need to be much better at saying, ‘we’re not going to lose that child. We’re going to keep providing support to them. We’re going to keep providing a mentor’.

“Instead, we let them fall through the cracks”.

A government spokesperson said: “Halving knife crime in a decade is a clear mission this government has set out.

“It is vital to protect vulnerable young people who are too often the victims or perpetrators of this crime.”

*names have been changed

Environment

Corporate America is investing in record levels of solar and storage

Published

4 hours ago

November 20, 2024

admin

Corporate America is investing in record levels of solar and storage

Corporate America is investing in clean energy at record levels, with tech giants taking the top spots for users of solar.

Meta, Google, and Amazon are leading the charge in solar and battery storage adoption, according to the Solar Energy Industries Association’s (SEIA’s) latest “Solar Means Business” report.

Meta continues to hold the title of the top solar user in corporate America, with nearly 5.2 gigawatts (GW) of solar capacity installed. Meanwhile, Google leads the way in energy storage, boasting 936 megawatt-hours (MWh) of installed battery capacity. Through the first quarter of 2024, these companies have added the most solar capacity to their electricity portfolios, with major players like General Motors, Toyota, and US Steel also climbing the ranks.

The report reveals that US businesses have installed nearly 40 GW of solar capacity both onsite and offsite through Q1 2024, and corporate storage use now exceeds 1.8 gigawatt-hours (GWh). Even more growth is coming: Companies have over 3 GWh of battery storage under contract that will come online in the next five years.

“Some of the largest industrial and data operations in the world continue turning to solar and storage as a reliable, low-cost way to power their operations,” said SEIA president and CEO Abigail Ross Hopper.

Technology companies are at the forefront of this shift as data center growth drives skyrocketing electricity demand. Amazon, for example, leads the US with 13.6 GW of solar procurements under contract, while Meta and Google each have nearly 6 GW under contract – pipelines over 10 times larger than the next company in the rankings.

Target remains the US’s leading onsite corporate solar user for the ninth year in a row, with Prologis, Walmart, Amazon, and Blackstone also making the top five. For the first time, the “Solar Means Business” report is also tracking corporate battery energy storage, with Google, Apple, Meta, Target, Walmart, Home Depot, and Kohl’s among the top 10 companies using storage to meet more of their energy needs in real-time.

Looking ahead, both offsite and onsite energy storage are expected to play a bigger role in corporate renewable energy strategies. Medical companies like Kaiser Permanente are already using batteries to power microgrids, making their facilities more resilient to outages.

Carolyn Campbell, Meta’s head of clean and renewable energy, East, highlighted the importance of expanding solar capacity to match the company’s global operations with 100% clean energy: “We’re thrilled to rank number one for corporate solar procurement in SEIA’s report this year, and we continue to find ways to grow the grid to benefit everyone.”

Target’s vice president of property management, Erin Tyler, said of Target’s 20-year-old solar program, “Through our commitment to solar, we’re well on our way to achieving our corporate goal of sourcing 100% of electricity from renewable sources by 2030.”

The “Solar Means Business” report also looks at the policies driving corporate America’s adoption of solar. Many companies are taking advantage of the Inflation Reduction Act’s long-term clean energy incentives. To further accelerate their renewable energy investments, businesses are calling for improvements in interconnection processes, new community solar legislation, and simpler tax credit monetization.

If you live in an area that has frequent natural disaster events, and are interested in making your home more resilient to power outages, consider going solar and adding a battery storage system. To make sure you find a trusted, reliable solar installer near you that offers competitive pricing, check out EnergySage, a free service that makes it easy for you to go solar. They have hundreds of pre-vetted solar installers competing for your business, ensuring you get high quality solutions and save 20-30% compared to going it alone. Plus, it’s free to use and you won’t get sales calls until you select an installer and share your phone number with them.

Your personalized solar quotes are easy to compare online and you’ll get access to unbiased Energy Advisers to help you every step of the way. Get started here. –trusted affiliate link*

FTC: We use income earning auto affiliate links. More.