Currencies29314
Market Cap$ 2.41T+2.02%
24h Spot Volume$ 35.85B+13.2%
DominanceBTC50.63%-0.70%ETH17.26%+1.43%
ETH Gas28 Gwei
Cryptorank
MainNewsClaude 3.5 s...

Claude 3.5 sets new AI benchmarks, beating GPT-4o in coding and reasoning


Claude 3.5 sets new AI benchmarks, beating GPT-4o in coding and reasoning
Jun, 20, 2024
2 min read
by CryptoSlate
Claude 3.5 sets new AI benchmarks, beating GPT-4o in coding and reasoning

Anthropic has launched Claude 3.5 Sonnet, the latest addition to its AI model lineup, claiming it surpasses previous models and competitors like OpenAI’s GPT-4 Omni. Available for free on Claude.ai and the Claude iOS app, the model is also accessible via the Anthropic API, Amazon Bedrock, and Google Cloud’s Vertex AI. Claude 3.5 Sonnet is priced at $3 per million input tokens and $15 per million output tokens, with a 200,000-token context window.

Claude 3.5 Sonnet benchmarks (Anthropic)
Claude 3.5 Sonnet benchmarks (Anthropic)

Claude 3.5 Sonnet sets new benchmarks in graduate-level reasoning (GPQA), undergraduate-level knowledge (MMLU), and coding proficiency (HumanEval). It demonstrates significant improvements in understanding nuance, humor, and complex instructions and excels at generating high-quality content with a natural tone. The model operates at twice the speed of Claude 3 Opus, making it suitable for complex tasks like context-sensitive customer support and multi-step workflows.

“In an internal agentic coding evaluation, Claude 3.5 Sonnet solved 64% of problems, outperforming Claude 3 Opus, which solved 38%.”

The model can independently write, edit, and execute code, making it effective for updating legacy applications and migrating codebases. It also excels in visual reasoning tasks, such as interpreting charts and graphs, and can accurately transcribe text from imperfect images, benefiting sectors like retail, logistics, and financial services.

Anthropic has also introduced Artifacts, a new feature on Claude.ai that allows users to generate and edit content like code snippets, text documents, or website designs in real time. This feature marks Claude’s evolution from a conversational AI to a collaborative work environment, with plans to support team collaboration and centralized knowledge management in the future.

Anthropic emphasizes its commitment to safety and privacy, stating that Claude 3.5 Sonnet has undergone rigorous testing to reduce misuse. The model has been evaluated by external experts, including the UK’s Artificial Intelligence Safety Institute (UK AISI), and has integrated feedback from child safety experts to update its classifiers and fine-tune its models. Anthropic assures that it does not train its generative models on user-submitted data without explicit permission.

Looking ahead, Anthropic plans to release Claude 3.5 Haiku and Claude 3.5 Opus later this year, along with new features like Memory, which will enable Claude to remember user preferences and interaction history.

The post Claude 3.5 sets new AI benchmarks, beating GPT-4o in coding and reasoning appeared first on CryptoSlate.

Read the article at CryptoSlate

Read More

Ora, Aiming to 'Unlock Design Space for AI Dapps,' Raises $20M

Ora, Aiming to 'Unlock Design Space for AI Dapps,' Raises $20M

The project, founded in 2022, says it aims to incorporate AI into decentralized appli...
Jun, 26, 2024
by CoinDesk
A study reveals that AI can fool university professors

A study reveals that AI can fool university professors

Researchers at the University of Reading have conducted interesting research by submi...
Jun, 27, 2024
3 min read
by CryptoPolitan
MainNewsClaude 3.5 s...

Claude 3.5 sets new AI benchmarks, beating GPT-4o in coding and reasoning


Claude 3.5 sets new AI benchmarks, beating GPT-4o in coding and reasoning
Jun, 20, 2024
2 min read
by CryptoSlate
Claude 3.5 sets new AI benchmarks, beating GPT-4o in coding and reasoning

Anthropic has launched Claude 3.5 Sonnet, the latest addition to its AI model lineup, claiming it surpasses previous models and competitors like OpenAI’s GPT-4 Omni. Available for free on Claude.ai and the Claude iOS app, the model is also accessible via the Anthropic API, Amazon Bedrock, and Google Cloud’s Vertex AI. Claude 3.5 Sonnet is priced at $3 per million input tokens and $15 per million output tokens, with a 200,000-token context window.

Claude 3.5 Sonnet benchmarks (Anthropic)
Claude 3.5 Sonnet benchmarks (Anthropic)

Claude 3.5 Sonnet sets new benchmarks in graduate-level reasoning (GPQA), undergraduate-level knowledge (MMLU), and coding proficiency (HumanEval). It demonstrates significant improvements in understanding nuance, humor, and complex instructions and excels at generating high-quality content with a natural tone. The model operates at twice the speed of Claude 3 Opus, making it suitable for complex tasks like context-sensitive customer support and multi-step workflows.

“In an internal agentic coding evaluation, Claude 3.5 Sonnet solved 64% of problems, outperforming Claude 3 Opus, which solved 38%.”

The model can independently write, edit, and execute code, making it effective for updating legacy applications and migrating codebases. It also excels in visual reasoning tasks, such as interpreting charts and graphs, and can accurately transcribe text from imperfect images, benefiting sectors like retail, logistics, and financial services.

Anthropic has also introduced Artifacts, a new feature on Claude.ai that allows users to generate and edit content like code snippets, text documents, or website designs in real time. This feature marks Claude’s evolution from a conversational AI to a collaborative work environment, with plans to support team collaboration and centralized knowledge management in the future.

Anthropic emphasizes its commitment to safety and privacy, stating that Claude 3.5 Sonnet has undergone rigorous testing to reduce misuse. The model has been evaluated by external experts, including the UK’s Artificial Intelligence Safety Institute (UK AISI), and has integrated feedback from child safety experts to update its classifiers and fine-tune its models. Anthropic assures that it does not train its generative models on user-submitted data without explicit permission.

Looking ahead, Anthropic plans to release Claude 3.5 Haiku and Claude 3.5 Opus later this year, along with new features like Memory, which will enable Claude to remember user preferences and interaction history.

The post Claude 3.5 sets new AI benchmarks, beating GPT-4o in coding and reasoning appeared first on CryptoSlate.

Read the article at CryptoSlate

Read More

Ora, Aiming to 'Unlock Design Space for AI Dapps,' Raises $20M

Ora, Aiming to 'Unlock Design Space for AI Dapps,' Raises $20M

The project, founded in 2022, says it aims to incorporate AI into decentralized appli...
Jun, 26, 2024
by CoinDesk
A study reveals that AI can fool university professors

A study reveals that AI can fool university professors

Researchers at the University of Reading have conducted interesting research by submi...
Jun, 27, 2024
3 min read
by CryptoPolitan