- The AI Pulse
- Posts
- š¤ OpenAIās $100 Billion āStargateā Project
š¤ OpenAIās $100 Billion āStargateā Project
PLUS: Elon Muskās xAI Announces Grok-1.5?!, AI21ās SSM-Transformer Model
USC STUDENTS
āļøThe AI Pulse x MAIA
Weāve partnered with the Marshall Artificial Intelligence Association (MAIA): USCās premiere club for students and entrepreneurs interested in AI and advanced data analytics.
In Collaboration With MAIA, Weāll Share:
Monthly Q&As With Industry Experts
Beginner-Friendly BUAI Workshops
Annual Startup Pitch Competition
The AI Pulseās daily content wonāt change. This partnership will bring additional learning resources to our subscribers.
Welcome back AI enthusiasts!
In todayās AI Report:
š”OpenAIās $100 Billion āStargateā Project
š„Elon Muskās xAI Announces Grok-1.5?!
šAI21ās SSM-Transformer Model
š 5 Trending Tools
š°Venture Capital Updates
š¼Whoās Hiring?
Read Time: 3 minutes
šRECENT NEWS
OPENAI
š”OpenAIās $100 Billion āStargateā Project
Image Source: Dominik Gigler for DLD/Hubert Burda Media
Microsoft and OpenAI are reportedly planning a $100 billion data center project dubbed āStargateā to provide millions of specialized server chips to power OpenAIās research by 2028.
Key Details:
Microsoft will likely finance the project, which is expected to be 100X more costly than the largest existing data centers, including Equinix DC2, which required $1 billion to support over 450 enterprises.
The proposed U.S.-based data centers are part of a series of projects Microsoft and OpenAI plan to build over the next six years.
OpenAI CEO Sam Altman structured his supercomputer goals across five phases, with āStargateā as the fifth.
According to The Information, Microsoft is developing a smaller, fourth-phase supercomputer for OpenAI to be launched around 2026.
Expenses for āStargateā could surpass $115 billion, more than triple Microsoftās expenditures last year on capital spending for servers, buildings, and technical equipment.
Why Itās Important:
In March, Nvidia CEO Jensen Huang told CNBC that the latest āBlackwell B200ā processors designed to power AI applications will cost between $30,000 and $40,000. AI chips are expensive, and the primary provider is Nvidia.
Microsoft and OpenAI are reducing reliance on Nvidia by streamlining access to computing power designed to work with chips from various suppliers like AMD, Intel, or Qualcomm.
The massive scale of āStargateā prevents constraints or bottlenecks on processing power that halt AI advancements.
š©ŗ PULSE CHECK
How will advancements in AI processing power, like āStargate,ā impact society?Vote Below to View Live Results |
XAI
š„Elon Muskās xAI Announces Grok-1.5?!
Image Source: Samferdselsdeperatment/Flickr
Elon Muskās xAI announced Grok-1.5, the startupās latest open-source AI model, showcasing enhanced reasoning capabilities on an impressive 128K context window.
Key Details:
Grok-1.5 has noticeable improvements in long-context understanding and advanced reasoning, especially with coding and math tasks.
The conversational chatbot achieved a 50.6% score on the MATH benchmark and a 90% score on the GSM8K benchmark, which covers a wide range of grade school to high school competition problems.
Grok-1.5 scored 74.1% on the Human Eval benchmark, which evaluates code generation and problem-solving abilities.
A new feature in Grok-1.5 is the capacity to process longer and more complex prompts up to 128K tokens (i.e., a fundamental unit of data processed by algorithms) within its context window (i.e., the amount of textual information AI models process for user queries).
Rumors are circulating that Grok-1.5 will include an āAnalysisā button to summarize threads and replies on X.
Why Itās Important:
Grok-1.5 displays significant improvements in reasoning and problem-solving, making the conversational chatbot helpful for programmers or educators.
By processing larger contexts, Grok-1.5 can analyze longer documents and follow complex instructions while maintaining accuracy, improving performance in research and analysis.
AI RESEARCH
šAI21ās SSM-Transformer Model
AI21 Labs unveiled Jamba, an AI model that combines the Mamba Structured State Space (SSM) with elements of traditional transformer architecture to process long sequences efficiently.
SSM analyzes the userās prompt to focus on relevant information and discard irrelevant data to process the prompt faster.
Transformer architecture is a deep learning system (i.e., teaches computers to process data like the human brain) with a self-attention mechanism that weights the importance of each part of the prompt differently.
Key Features:
Jamba boasts an impressive 256K context window, equivalent to 105,000 words or 210 pages.
The AI model delivers 3X faster processing on extended contexts than a transformer-based model.
Despite its large context window, Jamba only requires a single GPU with 80GB of memory.
Jambaās weights are available on Hugging Face here.
š TRENDING TOOLS
š½AirtableAI effortlessly integrates AI models into your apps and workflows.
š§ŗWeavely builds and designs forms with incredible speed.
āPickaxe creates AI-powered tools that earn money through paid subscriptions.
šāāļøMentor unlocks your potential with AI-powered goal management to achieve your goals like never before.
āļøAutoCut revolutionizes video editing with animated captions, B-rolls, and audio enhancements.
š®Browse our always Up-To-Date AI Tools Database.
š°VENTURE CAPITAL UPDATES
Skyflow raises a $30M Series B to expand its data privacy business to support new AI technologies.
Google.org launches a $20M generative AI accelerator program.
ThinkSonoās AI ultrasound guidance secures $2.7M to enhance DVT diagnosis.
š¼WHOāS HIRING?
Five9 (San Ramon, CA): PS Software Development Engineer Intern, Summer 2024
Astranis (San Francisco, CA): Electrical Integration Engineer Intern, Fall 2024
Second Order Effects (El Segundo, CA): Systems Integration/Test Engineering Intern, Fall 2024
Next Insurance (Palo Alto, CA): Pricing Actuarial Analyst
MobilityWare (Irvine, CA): Software Engineer I, Unity
š¤PROMPT OF THE DAY
EMPLOYEE ENGAGEMENT
š§³Gauge Employee Sentiment
Create 15 survey questions to ask employees in an employee engagement survey how they feel about the companyās [Strategic Decision (e.g., Cost Control)] through [List of Objectives (e.g., Layoffs, Budget Tightening, Cut Back on Travel)].
Strategic Decision = [Insert Here]
List of Objectives = [Insert Here]
šFINAL NOTE
If you found this useful, follow us on Twitter or provide honest feedback below. It helps us improve our content.
How was todayās newsletter?
ā¤ļøAI Pulse Review of The Day
āGreat job on the AI Research section.ā
šNOTION TEMPLATES
šØSubscribe to our newsletter for free and receive these powerful Notion templates:
āļø150 ChatGPT prompts for Copywriting
āļø325 ChatGPT prompts for Email Marketing
šSimple Project Management Board
ā±Time Tracker
Reply