How much does it cost to run ChatGPT per day?

ChatGPT may be fun, but it certainly isn’t cheap to run. A new report has the numbers on how much it costs to operate the generative AI chatbot, and it’s a lot. SemiAnalysis’ Chief Analyst Dylan Patel released the report this week. According to his analysis, running ChatGPT costs approximately $700,000 a day. That breaks down to 36 cents for each question.

ChatGPT creator OpenAI currently uses Nvidia GPUs for computing power for the bot as well as its other partner brands. The report estimates that it will need 30,000 more GPUs just to maintain its current commercial trajectory in 2023. Fortunately, Microsoft, one of OpenAI’s primary investors and collaborators, may be developing proprietary AI chips to help reduce this high cost.