Multimodal neurons in artificial neural networks

OpenAI Blog2021-03-04 16:000 views

We’ve discovered neurons in CLIP that respond to the same concept whether presented literally, symbolically, or conceptually. This may explain CLIP’s accuracy in classifying surprising visual renditions of concepts, and is also an important step toward understanding the associations and biases that CLIP and similar models learn.

Source：https://openai.com/index/multimodal-neurons

My favorites

PreviousGPT-3 powers the next generation of apps NextUnderstanding the capabilities, limitations, and societal impact of large language models

South Korea-based DeepX tapes out DX-M2, an edge AI chip to run inference of 100B-parameter LLMs on robots and drones, targeting fall 2027 for mass production (Sally Ward-Foxton/EE Times)

Sally Ward-Foxton / EE Times : South Korea-based DeepX tapes out DX-M2, an edge AI chip to run inference of 100B-paramet

0Techmeme

Source: at a meeting in August 2026, Jensen Huang interrupted Colette Kress' presentation, calling her "a deer in the headlights" and just a "reporting CFO" (Wall Street Journal)

Wall Street Journal : Source: at a meeting in August 2026, Jensen Huang interrupted Colette Kress' presentation, calling

0Techmeme

Jensen Huang's departure exposes internal politics at Nvidia; source: Huang ran it as a "feudal system" with his daughter and son-in-law in powerful positions (Financial Times)

Financial Times : Jensen Huang's departure exposes internal politics at Nvidia; source: Huang ran it as a “feudal system

0Techmeme

How AI Is Helping Care Teams Get Patients the Right Care, Sooner

From pediatric research to smart hospitals, AI is helping care teams spend less time on routine tasks and more time with

0NVIDIA Blog

Select 'Apple Home Collection' Accessories Now Available to Order

The first three HomeView -compatible smart home accessories in the Apple Home Collection are available to order starting

0MacRumors

How Microsoft's Principal Software Engineering Manager Works and Uses AI

Article URL: https://newsletter.eng-leadership.com/p/how-microsofts-principal-software Comments URL: https://news.ycombi

0Hacker News New

Multimodal neurons in artificial neural networks

Related posts

South Korea-based DeepX tapes out DX-M2, an edge AI chip to run inference of 100B-parameter LLMs on robots and drones, targeting fall 2027 for mass production (Sally Ward-Foxton/EE Times)

Source: at a meeting in August 2026, Jensen Huang interrupted Colette Kress' presentation, calling her "a deer in the headlights" and just a "reporting CFO" (Wall Street Journal)

Jensen Huang's departure exposes internal politics at Nvidia; source: Huang ran it as a "feudal system" with his daughter and son-in-law in powerful positions (Financial Times)

How AI Is Helping Care Teams Get Patients the Right Care, Sooner

Select 'Apple Home Collection' Accessories Now Available to Order

How Microsoft's Principal Software Engineering Manager Works and Uses AI