Red Hat, a leader in open-source solutions, has unveiled significant updates to its AI portfolio, enhancing efficiency and scalability for enterprises deploying artificial intelligence across hybrid cloud environments.
Empowering AI Adoption with Red Hat AI
As companies strive to integrate large language models (LLMs) into their operations, they face the challenge of balancing cost, accessibility, and proprietary data security. Red Hat AI addresses these issues by offering an enterprise-grade platform that streamlines model training and inference, ensuring seamless deployment across on-premises, cloud, and edge environments.
Red Hat OpenShift AI: A Comprehensive AI Lifecycle Platform
Red Hat OpenShift AI is a robust platform designed to manage predictive and generative AI lifecycles. Its latest release, OpenShift AI 2.18, introduces new features such as:
- Distributed Serving: Utilizing the vLLM inference server, this feature enables efficient model deployment across multiple GPUs, improving performance and resource utilization.
- End-to-End Model Tuning: With InstructLab and OpenShift AI data pipelines, fine-tuning LLMs is now more streamlined, scalable, and auditable.
- AI Guardrails: A technology preview of AI Guardrails enhances accuracy, performance, and security by monitoring interactions and filtering harmful content.
- Model Evaluation: The lm-eval component benchmarks LLM performance, ensuring optimized AI solutions for enterprise needs.
RHEL AI: A Foundation Model Platform for Enterprises
RHEL AI, a key component of Red Hat AI, provides enterprises with tools to develop and deploy LLMs consistently. The latest updates in RHEL AI 1.4 include:
- Granite 3.1 8B Model Support: This model offers multilingual capabilities and enhanced taxonomy customization.
- Graphical User Interface Enhancements: A developer preview introduces an intuitive interface for skill and knowledge contributions.
- Document Knowledge-Bench (DK-bench): Enables enterprises to compare fine-tuned AI models with base models for improved performance.
Red Hat AI InstructLab on IBM Cloud
To simplify AI adoption, Red Hat AI InstructLab will soon be available as a service on IBM Cloud, offering enterprises a cost-effective and secure model training and deployment solution.
AI Foundations Training: Empowering AI Talent
Recognizing the importance of AI literacy, Red Hat now provides free AI Foundations training courses. These courses cater to professionals at all levels, fostering a deeper understanding of AI’s role in business transformation.
Availability
Red Hat OpenShift AI 2.18 and RHEL AI 1.4 are now available for enterprises seeking advanced AI solutions tailored to their unique requirements.
Industry Impact
With AI becoming an integral part of modern enterprises, organizations are exploring innovative ways to enhance security and efficiency. Cloudflare’s AI Security Suite is another example of how businesses are fortifying their AI applications against emerging threats.
