Running ChatGPT could cost OpenAI up to $700,000 a day due to expensive servers, says analyst

According to Dylan Patel, chief analyst at semiconductor research firm SemiAnalysis, running ChatGPT could cost OpenAI up to $700,000 a day due to the expensive servers required to power the AI's massive computing power. Operational expenses exceed training costs when deploying the model at any reasonable scale. OpenAI is reportedly secretly building an AI chip to reduce the cost.

While the training of ChatGPT's large language models likely costs tens of millions of dollars, inference costs far exceed training costs when deploying the model at any reasonable scale.