OpenAI Unveil New AI Training Techniques To Overcome Data Scarcity Constraints | eWeek

OpenAI Unveil New AI Training Techniques To Overcome Data Scarcity Constraints

News graphic featuring the logo of OpenAI.

Image: eWeek

Dec 16, 2024
2 minute read
eWeek content and product recommendations are editorially independent. We may make money when you click on links to our partners. Learn More

Artificial intelligence (AI) is hitting a turning point as companies like OpenAI tackle significant challenges like skyrocketing energy use and spiraling costs by focusing on smarter, more efficient systems that think a bit more like humans. Among the issues they’re facing is a limitation of training data, with most of what’s online already having been used.

Take OpenAI’s “o1” model, for example—instead of throwing more computing power at the problem, it approaches tasks like humans might, breaking them into smaller steps and learning from expert feedback. A method called “test-time compute” lets it concentrate resources where they’re needed most, which bolsters performance without a massive price tag.

At a recent TED AI event, OpenAI researcher Noam Brown showed how a poker bot used this approach, reasoning for just 20 seconds to achieve the same results as a model trained for 100,000 times longer.

Addressing the Sustainability Challenge

This is a game-changer for AI development. Training today’s massive language models (LLMs) eats up enormous amounts of energy, straining power grids and raising environmental red flags. On top of that, the well of high-quality data is running dry. The o1 model is designed to handle these hurdles by relying on carefully chosen data and using resources more thoughtfully.

OpenAI isn’t alone. Other big players like Google DeepMind, Anthropic, and xAI are working on similar techniques. This competition is, of course, giving the whole race rocket boosters. The upside? These advances could lower costs and make cutting-edge AI tools more accessible to industries that haven’t been able to afford them.

This shift is also shaking up the hardware market. Companies like Nvidia, which dominates AI chip production, might need to rethink their game as these new, more efficient methods gain traction. With the door open to innovation, new competitors could start carving out a space in the market.

Looking Ahead

The big takeaway? AI’s focus has shifted. It’s less about building bigger models and more about building better ones—systems that reason, adapt, and learn smarter, not harder. As OpenAI co-founder Ilya Sutskever put it, “Scaling in the right direction is what matters most.”

We’re officially entering a new era for AI—one that promises smarter, more sustainable systems and a more competitive landscape. The possibilities are huge, and this is just the beginning.

Allison Francis

Allison Francis is a seasoned writer and marketing communications professional with a rich background spanning everything from business technology to consumer goods. Specializing in B2B technology, she has a background in hyperconverged infrastructure, managed IT services, BPO, cloud management, and customer experience technologies. Allison holds a bachelor's degree in public relations and marketing from Drake University. She resides in Denver, Colorado.

eWeek Logo

eWeek has the latest technology news and analysis, buying guides, and product reviews for IT professionals and technology buyers. The site's focus is on innovative solutions and covering in-depth technical content. eWeek stays on the cutting edge of technology news and IT trends through interviews and expert analysis. Gain insight from top innovators and thought leaders in the fields of IT, business, enterprise software, startups, and more.

Property of TechnologyAdvice. © 2026 TechnologyAdvice. All Rights Reserved

Advertiser Disclosure: Some of the products that appear on this site are from companies from which TechnologyAdvice receives compensation. This compensation may impact how and where products appear on this site including, for example, the order in which they appear. TechnologyAdvice does not include all companies or all types of products available in the marketplace.