arrow-up icon
hero-booster

AI Acceleration Platform

Fixstars AI Booster

Maximize Hardware Efficiency, Minimize Operational Costs.

Get the Brochuredecoration Download Whitepaperdecoration

What is Fixstars AI Booster?

Fixstars AI Booster is an AI acceleration platform that maximizes hardware resource utilization and reduce operational costs.

Fixstars AI Booster optimizes hardware resource utilization and accelerates both training and inference processes, enabling cost-efficient AI development and operations. It supports a wide range of hardware environments and scales effortlessly from a single node to large-scale clusters.

decoration
Processing speed
0.0
Increase
decoration
Cloud usage costs
0
Reduction

What is AI Technology Gap?

AI Developers
  • It takes too long to set up servers and verify operation, preventing immediate development.
  • Even with high-performance GPUs, the expected performance isn't achieved.
  • Implementing new models slows down processing.
AI Infrastructure Managers
  • Too much burden on infrastructure staff due to frequent environment management and configuration changes.
  • Optimal hardware settings need to be re-evaluated with each model version update.
  • Lack of a unified management tool to visualize computing resource utilization.
decoration

Bridging the AI Technology Gap with

Fixstars AI Booster

  • Checkmark icon
    Solves Setup Challenges
    Enables immediate AI development without spending time on setup and operation verification. Supports a variety of hardware environments and scales from single nodes to large clusters.
    Read moredecoration
  • Checkmark icon
    Solves Performance Challenges
    Continuously cycles through monitoring and acceleration to maximize GPU performance, accelerating AI model learning and inference.
    Read moredecoration
  • Checkmark icon
    Solves Cost-Effectiveness Challenges
    Improved processing performance and reduced setup time decrease the days required for each learning cycle, significantly improving the cost per training run.
    Read moredecoration

Solution

01

Setup

General-purpose GPU cloud services only provide hardware, requiring companies to build their environment and verify operation before starting development.

Fixstars AI Booster includes middleware and an integrated development system for AI model development, significantly reducing setup effort and time.

Example of Setup during LLM Model Development  
  1. 1
    Server Startup
    ・Internal-only publishing method for web servers, etc.
    ・ZFS, Ceph for maximizing storage capacity and performance
  2. 2
    GPU Environment Installation
    ・Latest CUDA to maximize GPU performance
    ・NCCL to maximize interconnect utilization
  3. 3
    Framework Installation
    ・PyTorch to maximize the features of the current CUDA version
    ・Megatron DeepSpeed to maximize the current PyTorch
  4. 4
    Operation Verification
    ・Optuna to tune learning scripts according to the GPU server environment

  5. 5
    AI Development
    ・LLMOps pipeline to keep dedicated servers running without downtime
    ・MegatronLM adapted to the latest models such as Llama3
With Fixstars AI Booster
decoration decoration decoration

Significantly reduces setup effort and time

  1. 1
    AI Development
    ・Just log in via SSH and follow the steps
02

Performance

With very high-performance GPU-equipped servers, using them in a standard way may not fully utilize their performance.

Fixstars AI Booster, as an "AI Acceleration Platform," maximizes GPU performance and accelerates processing.

What is AI Acceleration Platform?
Example of Expected vs. Actual Processing Time
Conventional Server Processing Performance
triangle-down
ExpectationdecorationThis high-end GPU should cut processing time in half!
triangle-down
RealitydecorationIt's only about 20% faster...
Acceleration Example with Fixstars AI Booster
Processing Time for 7B Model Training
Processing Time for 70B Model Training
Processing Time for Single Batch Inference
Processing Time for Multi Batch Inference
03

Cost-Effectiveness

By increasing processing speed and cutting down training time, Fixstars AI Booster significantly reduces the cost per training run.

Cloud A Cloud B Cloud A
+Fixstars AI Booster
Cloud B
+Fixstars AI Booster
Node usage fee $71,773
(On-demand)
$20,000
(Monthly)
$71,773
(On-demand)
$20,000
(Monthly)
Processing performance 1(Standard) 1 x2.5 x2.5
Usage period 6 month 6 month 6 month 6 month
Setup Period 1 month 1 month - -
Number of training runs possible within the period 2.0 2.0 5.9 5.9
Days per training run 76 days 76 days 30 days 30 days
Cost per training run $435,867 $121,533 $145,267 $40,533
Based on: Tokens per training run: 0.1T, GPU performance: 1,000 TFLOP/s, GPU count: 16 (across 2 nodes)
The listed AI Booster performance is from a specific example using Megatron-LM for pre-training. Specific performance and time required for setup will vary depending on the customer's environment.

Where Fixstars AI Booster Helps

In fields demanding advanced computation and large-scale data processing, it fully harnesses GPU performance to significantly enhance development efficiency and productivity.

LLMs & NLP
Accelerate training and inference for large language models
Autonomous Driving & ADAS
Speed real-time sensor processing and enhance perception algorithms
Image & Video Processing
Boost performance in image classification, object detection, and video analysis
Healthcare
Accelerate processes such as bioinformatics and drug discovery simulations
Finance
Accelerate data processing in risk analysis, market forecasting, algorithmic trading
Big Data & Data Mining
Efficiently extract patterns and perform real-time analysis on massive datasets

Custom Engineering Service

We will accelerate your AI models and fine-tune Fixstars AI Booster to match your specific development environment and requirements.

  • decoration
    AI Model Optimization & Tuning
    Analyze your existing AI models and implement optimizations to boost performance.
  • decoration
    Custom Fixstars AI Booster Configuration
    Adjust Fixstars AI Booster settings to match your hardware environment and requirements.
  • decoration
    Distributed Training Environment Setup
    Build efficient multi-node distributed training environments.
  • decoration
    Custom Algorithm Development Support
    Develop specialized algorithms and models tailored to your specific needs.

Hardware Procurement & Setup

We offer GPU server recommendations and setup support tailored to your needs and development environment.

GPU Server

We can propose various cloud services or on-premises servers equipped with NVIDIA’s high-end GPUs.

Supports
  • Infrastructure Proposal
    • Choose the best cloud services tailored to your business requirements
  • Migration Support
    • Plan and execute migrations from on-premises infrastructure to the cloud
    • Assist with migrations between different cloud service providers
  • Customized Development Service
    • Develop bespoke scripts and automation tools to meet your specific needs
  • Training and Technical Support
    • Provide technical support and consulting services to your operations team

FAQ

Q. Should I change my existing training script for Fixstars AI Booster? plus interface icon

Modification is not needed. Built on standard open-source middleware used in generative AI/LLMs, it typically works with common code. For further performance improvement, adding arguments may be recommended.

Most likely. Our middleware integrated features realizing high efficiency based on the latest research papers. However, the speedup factor depends on your applications. Please consider our GPU workload analysis service for more details.

We optimized LLM middleware to the target servers. For instance, we tuned multi-GPU/multi-node communication and file storage for our cloud environment, resulting in 2.1x-3.7x performance boots.

Fixstars engineers acquired knowledge and skills to accelerate a large variety of computations including AI/ML from our engineering services. So we can apply acceleration techniques we have cultivated so far to this field.

Interested in Fixstars AI Booster?

Book a meeting with an expert
Contact us decoration
Learn more about Fixstars AI Booster
Get the Brochure decoration
Learn more about our acceleration case study
Download Whitepaper decoration