OpenAI and Broadcom have unveiled Jalapeno, OpenAI's first custom AI chip, designed primarily to handle inference for ChatGPT and other services. It's a major step in OpenAI's plan to "build the full stack behind its models and products," says OpenAI. "By designing more of the stack ourselves, we can serve more intelligence with greater efficiency and keep pushing advanced AI toward broader access." CNBC reports: The chip with Broadcom is an ASIC, which industry experts say is less flexible than Nvidia's GPU, but is also less expensive and can be designed for specific AI tasks. OpenAI said that it designed the chip in nine months, and that it also crafted large parts of the computer system where it will be used.
The companies are calling the chip an "Intelligence Processor" and describe it as the first "AI accelerator" in a platform they're building "to make advanced AI faster, more reliable, and more accessible to more people." [...] A physical sample of the new chip will be delivered to OpenAI on Wednesday. The companies said they're aiming for initial deployment of the Jalapeno chips by the end of 2026, "expanding in the years ahead."
Read more of this story at Slashdot.
Connexion
