Summary
Anthropic, known for its AI ethics focus, has partnered with Palantir and AWS to integrate its Claude models into U.S. intelligence and defense operations. This collaboration enables advanced data analysis and decision-making for national security but raises ethical concerns due to Palantir’s military ties. Critics question how Anthropic’s safety-first ethos aligns with such partnerships, highlighting the growing role of AI in defense and its ethical implications.
Anthropic x Palantir: A Crossover We Didn't Expect
On November 7, 2024, well known AI company Anthropic, specializing in AI security and ethics, and Palantir Technologies, known for data analytics in the security sector, announced a partnership with Amazon Web Services (AWS). The goal of the collaboration is to provide US intelligence and defense agencies with access to Anthropic's Claude 3 and 3.5 AI models through Palantir's AI Platform (AIP) on AWS.
This cooperation raises questions, especially given the different corporate philosophies: Anthropic emphasizes the importance of AI safety and ethical responsibility, while Palantir is known for its close ties to government security agencies. The goal of the partnership is to deploy the Claude models in safety-critical areas while meeting the stringent safety standards of the U.S. Department of Defense, specifically Impact Level 6 (IL6) accreditation.
The cooperation enables Anthropic to establish its AI models in new application areas and strengthen its market position in the public sector. At the same time, it raises the question of how the company can maintain its ethical standards in a partnership with a security-oriented company like Palantir.
This article is not about an ethical and moral evaluation of security and arms companies, or about the question of justice with or through wars. It is solely an analysis of the two companies and an attempt to show the implications of the cooperation: How does the partnership between Anthropic and Palantir influence Anthropic's ethical standards and what impact does this cooperation have on the application of AI in the safety-critical field?
What is Palantir?
“Palantir develops high-performance software platforms that serve as central operating systems for resilient, data-driven organizations of the 21st century.” (Palantir)
Palantir Technologies Inc. is a US software company founded in 2003 by Peter Thiel, Nathan Gettings, Joe Lonsdale, Stephen Cohen and Alex Karp. The name “Palantir” is derived from the magical “seeing stones” from J.R.R. Tolkien's “Lord of the Rings”, which enable their users to see distant places and communicate with each other.
From the outset, the company specialized in the analysis of large amounts of data (big data) and developed software solutions that can be used to integrate and analyse complex data from different sources. A key objective was to gain deeper insights into the data by combining human expertise with powerful algorithms.
A special feature of Palantir is its close cooperation with government institutions, particularly in the areas of intelligence and defense. Among its first customers were US federal agencies, including the CIA, which also supported the company financially. These collaborations enabled Palantir to deploy and further develop its technologies in security-critical areas.
Palantir offers several main products:
Palantir Gotham: this product is aimed at defense and intelligence agencies and supports them in threat analysis, counter-terrorism and intelligence gathering.
Palantir Foundry: A platform for commercial and civilian applications that helps companies integrate and analyze their data and make informed decisions.
Palantir Apollo: A continuous delivery system that enables the management and deployment of Gotham and Foundry and helps customers leverage multiple cloud platforms.
The importance of Palantir lies in its ability to process and utilize large and disparate amounts of data. This is particularly important in areas such as counter-terrorism, financial crime and public health. During the COVID-19 pandemic, for example, Palantir's technology was used to analyze health data and optimize the distribution of resources.
In the military sector, Palantir offers technologies that support decision-making and operational planning. One example is the TITAN program, a mobile ground system that uses artificial intelligence to enable precise attacks from a great distance. Although Palantir does not develop its own autonomous weapon systems, it does provide technologies that can be integrated into such systems. Palantir therefore plays an important role in the security industry, particularly by providing data analytics and AI solutions for military and security applications.
Despite its success, Palantir has also been criticized, particularly due to data protection concerns and cooperation with state surveillance authorities. Critics fear that the company's technologies could be used for mass surveillance. However, Palantir emphasizes that data protection principles are integrated into the architecture of its software from the outset.
In summary, Palantir Technologies has played a central role in the field of data analysis, particularly in security-related areas, since its foundation. By providing powerful data integration and analysis tools, the company helps both government and commercial customers make informed decisions and overcome complex challenges.
Anthropic and Its Focus on Safety and Ethics
“I think and talk a lot about the risks of powerful AI. The company I’m the CEO of, Anthropic, does a lot of research on how to reduce these risks. Because of this, people sometimes draw the conclusion that I’m a pessimist or “doomer” who thinks AI will be mostly bad or dangerous. I don’t think that at all. In fact, one of my main reasons for focusing on risks is that they’re the only thing standing between us and what I see as a fundamentally positive future. I think that most people are underestimating just how radical the upside of AI could be, just as I think most people are underestimating how bad the risks could be.”
Anthropic positions itself as a public benefit corporation, which means that, in addition to being profit-oriented, it also focuses on the common good. The company specializes in the development of general AI systems (AGI) and language models and is committed to the responsible use of AI. For products such as the chatbot Claude, the company strives to comply with generally recognized ethical rules through targeted training in accordance with the principles of the United Nations, among others.
A central concept of Anthropic is “constitutional AI”. This is an approach in which ethical principles are integrated directly into AI models in order to reduce unpredictable, unreliable and non-transparent elements. The aim is to develop a powerful but safe AI for the future of humanity.
The AI is trained to monitor itself and evaluate its efforts. For example, it checks whether an answer is potentially harmful and decides on this basis whether it should change the answer or reject the question. This is done by means of feedback loops in which the AI compares its answers with the ethical principles of its constitution. In this way, it learns from its own assessments instead of relying solely on external corrections.
An important feature of constitutional AI is the ability of the models to behave appropriately in problematic or ethically complex scenarios. For example, when asked a question that targets dangerous knowledge, constitutional AI recognizes the potential harm and refuses to answer. Instead, it could provide information that points out the risks or leads to a safer alternative.
Despite the strong focus on ethics and safety, Anthropic has faced various challenges since its inception. In August 2024, several authors filed a class action lawsuit against the company. They accused Anthropic of using copyrighted books without permission to train its AI models. The lawsuit emphasized that Anthropic had built up a billion-dollar business with this practice by using copyrighted works without the authors' consent.
In addition, Anthropic was accused of aggressive data scraping in September 2024. Website operators accused the company of automatically retrieving data from their sites without explicit permission, possibly in violation of the websites' terms of use. These allegations raise questions about the compatibility of Anthropic's ethical principles with its business practices.
Despite these controversies, Anthropic has received significant investment. In September 2023, Amazon announced an investment of up to USD 4 billion, followed by a commitment of USD 2 billion from Google the following month. These investments underline the confidence of major technology companies in Anthropic's approach and technologies.
In summary, since its inception, Anthropic has positioned itself as a company with a strong focus on ethical principles and safety in AI development. Despite significant progress and investment, the company has faced legal challenges and criticism of its business practices. These developments raise questions about the practical implementation of Anthropic's ethical principles and how the company will deal with such challenges in the future.
The Collaboration Between Anthropic and Palantir
“DENVER--(BUSINESS WIRE)-- Anthropic and Palantir Technologies Inc. (NYSE: PLTR) today announced a partnership with Amazon Web Services (AWS) to provide U.S. intelligence and defense agencies access to the Claude 3 and 3.5 family of models on AWS. This partnership allows for an integrated suite of technology to operationalize the use of Claude within Palantir’s AI Platform (AIP) while leveraging the security, agility, flexibility, and sustainability benefits provided by AWS.”
According to the official announcement, the cooperation between the two companies relates to the partnership in the area of military defense. As you can imagine, this primarily refers to intelligence work. AI is already ideally suited for evaluating masses of data and thus ensuring surveillance. I would like to emphasize once again that these statements are a neutral description of the facts and do not imply any kind of judgment.
“The partnership facilitates the responsible application of AI, enabling the use of Claude within Palantir’s products to support government operations such as processing vast amounts of complex data rapidly, elevating data driven insights, identifying patterns and trends more effectively, streamlining document review and preparation, and helping U.S. officials to make more informed decisions in time-sensitive situations while preserving their decision-making authorities. Claude became accessible within Palantir AIP on AWS earlier this month.”
The cooperation relates to critical data, i.e. sensitive and secret documents. “The partnership makes Claude available within Palantir's Impact Level 6 environment (IL6), a defense-accredited system that handles data critical to national security up to the "secret" classification level. This move follows a broader trend of AI companies seeking defense contracts, with Meta offering its Llama models to defense partners and OpenAI pursuing closer ties with the Defense Department.”
In concrete terms: „Performing operations on large volumes of complex data at high speeds, identifying patterns and trends within that data, and streamlining document review and preparation“ (Arstechnia.com).
The collaboration between Anthropic, Palantir and Amazon Web Services (AWS) aims to deploy Anthropic's Claude family of AI models in U.S. intelligence and defense agencies. Claude will be integrated into Palantir's IL6 environment, a Department of Defense-approved system for top-secret data, with AWS providing the infrastructure. The focus is on fast processing of large amounts of data, pattern recognition and optimization of document reviews. Despite the efficiency gains in operational processes, as demonstrated by Palantir in commercial applications, the companies say people retain decision-making power. Critics see the collaboration as part of a broader trend in which AI companies are increasingly seeking defense contracts.
However, the partnership also raises significant ethical questions. Anthropic, which publicly advocates for safe and ethical AI development, has been criticized for the apparent contradiction between its self-promotion and collaboration with military actors. The connection to Palantir, a controversial company with extensive military contracts, reinforces these concerns. There are also technical risks, as Claude, like other AI models, tends to provide false or fabricated information. The collaboration with defense agencies is seen by many as a step towards closer integration of the AI industry with the military and security sector, raising concerns among experts about the potential social and security implications.
Anthropic attaches great importance to the development of safe and ethical AI systems. As mentioned, the company has specially introduced the “Constitutional AI” method, in which AI models are trained using defined principles to ensure that they provide helpful, honest and harmless answers. These principles are based, among other things, on parts of the United Nations Universal Declaration of Human Rights.
In addition, Anthropic has implemented a “Responsible Scaling Policy” that includes technical and organizational protocols to manage the risks associated with the development of increasingly powerful AI systems.
Through these measures, Anthropic aims to develop AI technologies that are both powerful, safe and ethical.
Conclusion
The use of AI in the service of security authorities will increasingly expand. There is no doubt about that. China, in particular, has shown with DeepSeek how strong the political influence on AI already is today and determines what can be said.
Germany, on the other hand, is relying on AI in its arsenal (Taurus) in the Ukraine war.
“It's the software that makes the new drone stand out: Together with a Ukrainian manufacturer, the German AI company Helsing has developed a combat drone that can reportedly autonomously navigate its targets. Once programmed, a so-called kamikaze drone flies autonomously to its target and attacks it. On impact with its target, it detonates and is destroyed.
The government in Kyiv is now receiving 4000 of these combat drones - equipped with the AI developed in Germany. Both sides have kept the technical details and the exact location of production secret for security reasons. There are no photos of the drone yet.” [5]
The fact that AI is being used in the military sector should therefore come as no surprise. The surprise lies rather in the fact that Anthropic are pioneers here. Precisely because of their strong ethical approach, their often-circulated moral superiority, it is very irritating that they are the first to enter into a long-term partnership with Palantir and thus also make AI usable domestically. It is therefore not surprising that this contradiction between Anthropic's own ethical standards and the cooperation with Palantir collides.
“Anthropic has announced a partnership with Palantir and Amazon Web Services to bring its Claude AI models to unspecified US intelligence and defense agencies. Claude, a family of AI language models similar to those that power ChatGPT, will work within Palantir's platform using AWS hosting to process and analyze data. But some critics have called out the deal as contradictory to Anthropic's widely-publicized "AI safety" aims.” [6]
Although Anthropic emphasizes safety and ethical values with its constitutional AI, among other things, in practice they have no inhibitions about cooperating with surveillance companies. While they regularly refer to ethically high-quality outputs of their models, we have read little to nothing from Anthropic about ethical and moral principles in cooperation with military or military-related companies, which is very surprising.
It is also astonishing that Anthropic is the first to lean so far out of the window: although OpenAI has also recently adapted its principles to the effect that it is now also allowed to work with authorities, including for security purposes, Anthropic seems to go a few steps further.
Nevertheless, there should be no illusion that this was the last collaboration. Quite the opposite. AI applications are increasingly becoming a literally war-decisive technology. It can be assumed that the military and security authorities worldwide will integrate more and more AI models into their work. Because in future wars, the side that hesitates too long to integrate AI into its defense will lose. You could say that AI will be the difference between victory and defeat - in the economic sphere, but also on the battlefield.
—
Subscribe to FF Daily for more content from Kim Isenberg.
About the author
