Berkeley Researchers Recreate DeepSeek AI’s Core for Just $30—Here’s What It Means

Agencies Ghacks
Jan 31, 2025
Misc
|
4

A team of researchers at the University of California, Berkeley, has successfully recreated the core technology behind DeepSeek AI for an astonishingly low cost of just $30. Led by Ph.D. candidate Jiayi Pan, the team managed to replicate DeepSeek R1-Zero’s reinforcement learning capabilities using a small language model with just 3 billion parameters.

Despite its modest size, the AI demonstrated self-verification and search abilities, allowing it to refine its responses iteratively. To test its problem-solving skills, the researchers used the Countdown game, a mathematical puzzle requiring players to reach a target number using arithmetic operations. Initially, the AI made random guesses, but through reinforcement learning, it improved its ability to revise and optimize its answers.

Pan’s team experimented with different model sizes, noting that a 500-million-parameter model struggled to refine responses, while a 1.5-billion-parameter model began incorporating revision techniques. Once scaled to 3 to 7 billion parameters, the AI displayed significant improvement in solving problems efficiently.

The affordability of this recreation raises questions about the costs of AI development. Currently, OpenAI charges $15 per million tokens via its API, while DeepSeek offers a far lower rate of $0.55 per million tokens. However, AI researcher Nathan Lambert has expressed skepticism about DeepSeek’s claimed affordability, arguing that its operational costs may reach $500 million to over $1 billion annually.

Additionally, concerns over data privacy and national security have led to DeepSeek being banned in parts of the U.S. Some reports suggest DeepSeek may have been trained using OpenAI’s ChatGPT, potentially explaining its lower expenses. While questions remain, Berkeley’s findings suggest that high-performance AI models could become far more accessible in the near future—potentially disrupting the dominance of AI giants like OpenAI, Google, and Microsoft.

Advertisement

Tutorials & Tips


Previous Post: «
Next Post: «

Comments

  1. ToonVD said on February 7, 2025 at 11:23 am
    Reply

    Most of these “Agencies Ghacks” articles remind me of SPAM: they spit out numerous articles, most of which you don’t wanna read. Real articles, like those of Martin Brinkmann, are being buried beneath them. :-(

  2. Hilarious North America said on February 3, 2025 at 1:28 am
    Reply

    I’d buy that for a dollar — Robocop.

    (Make America Cheap Again).

  3. Richard Steven Hack said on February 1, 2025 at 3:19 am
    Reply

    “its operational costs may reach $500 million to over $1 billion annually.”

    Or it may not since it’s just a side project of a major Chinese corporation…

    The amount of effort the US and the tame media are putting into trying to downplay DeepSeek is not surprising – given the geopolitical conflict going between the two countries – which almost inevitably will lead to a war which the US will lose – badly – hopefully without a nuclear exchange which will bring in Russia to finish the US off.

    1. Ulti P. Uszer said on February 2, 2025 at 7:43 pm
      Reply

      Bummmmmer!!!!!!!!

Leave a Reply

Check the box to consent to your data being stored in line with the guidelines set out in our privacy policy

We love comments and welcome thoughtful and civilized discussion. Rudeness and personal attacks will not be tolerated. Please stay on-topic.
Please note that your comment may not appear immediately after you post it.