• The AI Pulse
  • Posts
  • šŸ¤– OpenAIā€™s $100 Billion ā€œStargateā€ Project

šŸ¤– OpenAIā€™s $100 Billion ā€œStargateā€ Project

PLUS: Elon Muskā€™s xAI Announces Grok-1.5?!, AI21ā€™s SSM-Transformer Model

USC STUDENTS

āœŒļøThe AI Pulse x MAIA

Weā€™ve partnered with the Marshall Artificial Intelligence Association (MAIA): USCā€™s premiere club for students and entrepreneurs interested in AI and advanced data analytics.

In Collaboration With MAIA, Weā€™ll Share:
  • Monthly Q&As With Industry Experts

  • Beginner-Friendly BUAI Workshops

  • Annual Startup Pitch Competition

The AI Pulseā€™s daily content wonā€™t change. This partnership will bring additional learning resources to our subscribers.

Welcome back AI enthusiasts!

In todayā€™s AI Report:

  • šŸ“”OpenAIā€™s $100 Billion ā€œStargateā€ Project

  • šŸ’„Elon Muskā€™s xAI Announces Grok-1.5?!

  • šŸAI21ā€™s SSM-Transformer Model

  • šŸ› 5 Trending Tools

  • šŸ’°Venture Capital Updates

  • šŸ’¼Whoā€™s Hiring?

Read Time: 3 minutes

šŸ—žRECENT NEWS

OPENAI

šŸ“”OpenAIā€™s $100 Billion ā€œStargateā€ Project

Image Source: Dominik Gigler for DLD/Hubert Burda Media

Microsoft and OpenAI are reportedly planning a $100 billion data center project dubbed ā€œStargateā€ to provide millions of specialized server chips to power OpenAIā€™s research by 2028.

Key Details:
  • Microsoft will likely finance the project, which is expected to be 100X more costly than the largest existing data centers, including Equinix DC2, which required $1 billion to support over 450 enterprises.

  • The proposed U.S.-based data centers are part of a series of projects Microsoft and OpenAI plan to build over the next six years.

  • OpenAI CEO Sam Altman structured his supercomputer goals across five phases, with ā€œStargateā€ as the fifth.

  • According to The Information, Microsoft is developing a smaller, fourth-phase supercomputer for OpenAI to be launched around 2026.

  • Expenses for ā€œStargateā€ could surpass $115 billion, more than triple Microsoftā€™s expenditures last year on capital spending for servers, buildings, and technical equipment.

Why Itā€™s Important:
  • In March, Nvidia CEO Jensen Huang told CNBC that the latest ā€œBlackwell B200ā€ processors designed to power AI applications will cost between $30,000 and $40,000. AI chips are expensive, and the primary provider is Nvidia.

  • Microsoft and OpenAI are reducing reliance on Nvidia by streamlining access to computing power designed to work with chips from various suppliers like AMD, Intel, or Qualcomm.

  • The massive scale of ā€œStargateā€ prevents constraints or bottlenecks on processing power that halt AI advancements.

šŸ©ŗ PULSE CHECK

How will advancements in AI processing power, like ā€œStargate,ā€ impact society?

Vote Below to View Live Results

Login or Subscribe to participate in polls.

XAI

šŸ’„Elon Muskā€™s xAI Announces Grok-1.5?!

Image Source: Samferdselsdeperatment/Flickr

Elon Muskā€™s xAI announced Grok-1.5, the startupā€™s latest open-source AI model, showcasing enhanced reasoning capabilities on an impressive 128K context window.

Key Details:
  • Grok-1.5 has noticeable improvements in long-context understanding and advanced reasoning, especially with coding and math tasks.

  • The conversational chatbot achieved a 50.6% score on the MATH benchmark and a 90% score on the GSM8K benchmark, which covers a wide range of grade school to high school competition problems.

  • Grok-1.5 scored 74.1% on the Human Eval benchmark, which evaluates code generation and problem-solving abilities.

  • A new feature in Grok-1.5 is the capacity to process longer and more complex prompts up to 128K tokens (i.e., a fundamental unit of data processed by algorithms) within its context window (i.e., the amount of textual information AI models process for user queries).

  • Rumors are circulating that Grok-1.5 will include an ā€œAnalysisā€ button to summarize threads and replies on X.

Why Itā€™s Important:
  • Grok-1.5 displays significant improvements in reasoning and problem-solving, making the conversational chatbot helpful for programmers or educators.

  • By processing larger contexts, Grok-1.5 can analyze longer documents and follow complex instructions while maintaining accuracy, improving performance in research and analysis.

AI RESEARCH

šŸAI21ā€™s SSM-Transformer Model

AI21 Labs unveiled Jamba, an AI model that combines the Mamba Structured State Space (SSM) with elements of traditional transformer architecture to process long sequences efficiently.

SSM analyzes the userā€™s prompt to focus on relevant information and discard irrelevant data to process the prompt faster.

Transformer architecture is a deep learning system (i.e., teaches computers to process data like the human brain) with a self-attention mechanism that weights the importance of each part of the prompt differently.

Key Features:
  • Jamba boasts an impressive 256K context window, equivalent to 105,000 words or 210 pages.

  • The AI model delivers 3X faster processing on extended contexts than a transformer-based model.

  • Despite its large context window, Jamba only requires a single GPU with 80GB of memory.

  • Jambaā€™s weights are available on Hugging Face here.

šŸ› TRENDING TOOLS

šŸ½AirtableAI effortlessly integrates AI models into your apps and workflows.

šŸ§ŗWeavely builds and designs forms with incredible speed.

ā›Pickaxe creates AI-powered tools that earn money through paid subscriptions.

šŸƒā€ā™‚ļøMentor unlocks your potential with AI-powered goal management to achieve your goals like never before.

āœ‚ļøAutoCut revolutionizes video editing with animated captions, B-rolls, and audio enhancements.

šŸ”®Browse our always Up-To-Date AI Tools Database.

šŸ’°VENTURE CAPITAL UPDATES

  • Skyflow raises a $30M Series B to expand its data privacy business to support new AI technologies.

  • Google.org launches a $20M generative AI accelerator program.

  • ThinkSonoā€™s AI ultrasound guidance secures $2.7M to enhance DVT diagnosis.

šŸ’¼WHOā€™S HIRING?

  • Five9 (San Ramon, CA): PS Software Development Engineer Intern, Summer 2024

  • Astranis (San Francisco, CA): Electrical Integration Engineer Intern, Fall 2024

  • Second Order Effects (El Segundo, CA): Systems Integration/Test Engineering Intern, Fall 2024

  • Next Insurance (Palo Alto, CA): Pricing Actuarial Analyst

  • MobilityWare (Irvine, CA): Software Engineer I, Unity

šŸ¤–PROMPT OF THE DAY

EMPLOYEE ENGAGEMENT

šŸ§³Gauge Employee Sentiment

Create 15 survey questions to ask employees in an employee engagement survey how they feel about the companyā€™s [Strategic Decision (e.g., Cost Control)] through [List of Objectives (e.g., Layoffs, Budget Tightening, Cut Back on Travel)].

Strategic Decision = [Insert Here]

List of Objectives = [Insert Here]

šŸ“’FINAL NOTE

If you found this useful, follow us on Twitter or provide honest feedback below. It helps us improve our content.

How was todayā€™s newsletter?

ā¤ļøAI Pulse Review of The Day

ā€œGreat job on the AI Research section.ā€

-Isaiah (ā­ļøā­ļøā­ļøā­ļøā­ļøNailed it!)

šŸŽNOTION TEMPLATES

šŸšØSubscribe to our newsletter for free and receive these powerful Notion templates:

  • āš™ļø150 ChatGPT prompts for Copywriting

  • āš™ļø325 ChatGPT prompts for Email Marketing

  • šŸ“†Simple Project Management Board

  • ā±Time Tracker

Reply

or to participate.