Scale Up or Out with AMD-Powered Servers

Remember when big data was something only very big companies worried about? Or when artificial intelligence was science fiction rather than sound business strategy? Today, the majority of enterprises are using AI and big data to innovate and maintain their competitive advantage—and that means more pressure on IT teams to beef up their data center, cloud and edge processing capabilities.

Big data and real-time AI consume a lot of processing power, which typically means adding more servers (and finding more floorspace to store them), consuming more energy and spending more time managing hardware. The latest generation of Dell PowerEdge servers featuring AMD’s fourth-generation EPYC processor technology is designed to change all that. Small, energy-efficient, scalable and simple to manage, the new AMD-equipped PowerEdge servers are the right fit for enterprises that need to balance scalability with sustainability.

Better Scalability, Sustainability and Performance

You would expect higher performance from the latest generation of AMD-powered servers from Dell Technologies. But better performance is just the beginning. Dell and AMD have worked together to make their latest generation of PowerEdge servers more efficient through Smart Cooling technology, more secure through a silicon-based root of trust and simpler to manage through new infrastructure automation tools. Here are some of the new features you’ll find in the latest generation of AMD-equipped PowerEdge servers.

• 2X higher performance. The new AMD EPYC processors deliver up to 107% higher processing performance and up to 33% more storage capacity than their predecessor. That leads to faster business insights and improved application performance across the board.
• Denser and more efficient. The fourth-generation AMD EPYC processors deliver 50% more density in the core than previous generations, resulting in 47% higher performance per watt for better energy efficiency. In addition, Dell’s Smart Cooling technology reduces the server’s energy consumption through improved airflow and optimized cooling features.
• Easier to manage. Dell’s management tools, such as OpenManage Enterprise Power Manager and integrated Dell Remote Access Controller (iDRAC), make it easier than ever before to manage and automate bare metal servers, from correcting configuration drifts to optimizing energy usage.
• More secure. PowerEdge servers feature a silicon-based root of trust that protects against external attacks. AMD EPYC processors also feature Infinity Guard, which helps reduce the threat surface of the server during operation.

Flexible Configurations for a Broad Range of Applications

As more business applications move into the cloud and out toward the edge, scalability becomes critically important—both the ability to scale up and scale out. Dell PowerEdge servers with AMD technology are available in one- and two-socket configurations to handle a variety of different workloads. Our single-socket, 1U PowerEdge R6615 servers are ideal for applications that require maximum performance with a minimal footprint. For more compute-intensive applications such as artificial intelligence and real-time processing of large data sets, two-socket, 2U PowerEdge R7615 servers provide a high-performance platform that can easily scale to handle your most demanding applications.

PowerEdge servers with AMD EPYC processors are designed to handle big jobs, but what’s most impressive about them is what’s not big about them. You’ll have smaller energy bills because they consume less energy thanks to improved density in the design and innovative cooling solutions, as in the case of the PowerEdge C6615. With OpenManage Power Manager, you can also reduce the size of your carbon footprint by managing your power consumption for optimal efficiency. You can fit our AMD-powered servers into existing footprints without worrying about overheating.

Whether you’re upgrading your legacy servers or looking for a scalable foundation for new applications, PowerEdge servers featuring fourth-generation AMD EPYC processors deliver big performance in a more energy-efficient chassis. It’s the best of both worlds—scalability and sustainability.

Source: dell.com

Continue reading

Experience Choice in AI with Dell PowerEdge and Intel Gaudi3

The Dell PowerEdge XE9680 server has evolved to become a key player in the acceleration of AI and generative AI, machine learning, deep learning training and HPC modeling. The introduction of Intel® Gaudi® 3 AI Accelerator into this server lineup marks a significant advancement, offering an enhanced suite of technical capabilities designed to meet the needs of complex, data-intensive workloads. This evolution caters to a more diversified range of workloads, providing developers and enterprise professionals with options for pushing the limits of GenAI acceleration.

Harnessing Silicon Diversity for Customized Solutions

The Dell PowerEdge XE9680 distinguishes itself by being Dell’s pioneering platform integrating eight-way GPU acceleration with x86 server architecture, renowned for delivering unparalleled performance in AI-centric operations. The incorporation of the Intel Gaudi3 accelerator into this ecosystem further amplifies its capabilities, offering clients a choice to tailor their systems to specific computational needs, particularly associated with GenAI workloads. This strategic addition underscores a commitment to delivering no-compromise AI acceleration solutions that are both versatile and powerful.

Technical Specifications Driving Customer Success

With an architecture designed to thrive in up to 35°C environments, the XE9680 promotes reliability and scalability. The addition of Intel Gaudi3 accelerators enriches the server’s configuration possibilities. This includes up to 32 DDR5 memory DIMM slots for enhanced data throughput, 16 EDSFF3 storage drives for superior data storage solutions and eight PCIe Gen 5.0 slots for expanded connectivity and bandwidth. Coupled with dual 4th Generation Intel® Xeon® Scalable processors boasting up to 56 cores, the XE9680 is engineered to excel in executing demanding AI and ML workloads, providing a competitive edge in data processing and analysis.

Strategic Advancements for AI Insights

The PowerEdge XE9680, with the integration of additional accelerators, rises above conventional hardware capabilities, serving as a critical asset for businesses aiming to leverage AI for deep data insights. This combination of advanced processing power and efficient, air-cooled design sets a new benchmark in AI acceleration, delivering rapid, actionable insights to drive business outcomes.

Technological Openness Fostering Innovation

The Intel Gaudi3 AI accelerator brings to the table performance features vital for generative AI workloads, including 64 custom and programmable tensor processor cores (TPCs) and 128 GB of HBMe2 memory capacity, offering 3.7 TB of memory bandwidth, and 96 MB of on board static random-access memory (SRAM).  The Gaudi3’s open ecosystem is optimized through partnerships and supported by a robust framework of model libraries. Its development tools simplify the transition for existing codebases, reducing migration to a mere handful of code lines.

Unique Networking and Video Decoding Capabilities

The PowerEdge XE9680, augmented with the Gaudi3 accelerator, introduces novel networking capabilities directly integrated into the accelerators via six OSFP 800GbE ports. These links allow for direct connections to an external accelerator fabric without the need for external NICs to be placed in system. This not only simplifies the infrastructure but also aims to lower the total cost of ownership and complexity of an infrastructure. Furthermore, the Intel Gaudi3 specialized media decoders are designed for AI vision applications. These are capable of handling extensive pre-processing tasks, thus streamlining video-to-text conversions and enhancing performance for enterprise AI applications.

Dell PowerEdge XE9680 with the Gaudi3: A Visionary Step Forward in AI Development

The collaboration between Dell and Intel, crystallized in the Dell PowerEdge XE9680 with the Intel Gaudi3 AI accelerator, is a watershed moment in AI computing. It offers a forward-looking solution that meets the current demands of AI workloads and anticipates the future needs of the industry. This partnership promises to empower technology leaders with advanced tools for innovation, pushing the boundaries of AI development and setting new standards for computational excellence and efficiency.

Source: dell.com

Continue reading

Connected PCs: Expanding Dell’s Relationship with AT&T

In a world increasingly reliant on seamless connectivity, the need for reliable and secure network access has never been greater. Recognizing this, Dell is teaming up with AT&T to introduce a new promotion aimed at meeting the evolving needs of modern businesses.

Addressing Modern Connectivity Demands

As technology continues to advance, cellular connectivity has become indispensable, particularly in supporting the demands of GenAI use cases and the needs of remote and hybrid workers. According to research conducted by Dell on the GLG platform, there’s a growing expectation that cellular connectivity, especially with the promise of 5G, will play a more significant role in the future. If you require integrating data from distant locations, satellite and cellular connections might be the sole viable choices.

Moreover, connectivity isn’t just essential for individual users; it’s integral to the modern PC experience across various industries. From real estate to construction and professional services, connected PCs are seen as essential tools, enabling seamless communication and collaboration.

However, poor connectivity remains a significant frustration for many employees, ranking among the top three technology challenges in the workplace. With hybrid work becoming the new norm, the demand for reliable connectivity has only intensified. A significant number of companies have embraced a hybrid work model, with most employees favoring a blend of office and remote work arrangements.

Security Concerns in the Age of Hybrid Work

Despite the benefits of connectivity, security concerns loom large, especially in a hybrid work environment. Security breaches and cybercrimes pose significant threats, exacerbated by the increasing reliance on public Wi-Fi networks. Security professionals consistently overlook the fact that their own employees, contractors, and other internal users unknowingly facilitate (though not always intentionally perpetrate) numerous successful network breaches.

The integration of AI further heightens security risks, particularly with sensitive data and cloud-based applications. As AI applications become more pervasive across industries like healthcare, customer service and autonomous vehicles, ensuring data security becomes paramount.

Enhanced Security with Connected PCs

To address these challenges, Dell and AT&T are introducing a carrier promotion that not only enhances connectivity but also prioritizes security. By leveraging encrypted and secure cellular networks, connected PCs offer protection against unauthorized access and cyberattacks. Additionally, these PCs comply with the latest security standards and certifications, providing end-to-end security through Dell’s suite of security solutions.

Seamless Integration and Enhanced Performance

Connected PCs powered by AT&T’s network offer more than just security; they also deliver enhanced performance and a seamless user experience. With high-speed 4G and 5G networks, users can expect low-latency data transmission, supporting the data and computing demands of AI applications. This translates to better support for mobile and hybrid workers, enabling flexible work schedules and instant connectivity without the hassle of tethering or relying on public Wi-Fi networks. Giving priority to 5G as the main connection option in places where wireline alternatives are insufficient or unavailable should be of paramount importance.

The Carrier Referral Program: Simplifying Connectivity

Central to this promotion is the Carrier Referral Program, designed to accelerate the adoption of Connected PCs by simplifying the process of selecting, purchasing and activating carrier data plans. Targeting any commercial customer in the U.S. with a need for remote PC connectivity, the program offers up to a $100 bill credit and discounted monthly rates from AT&T for customers who activate service on eligible plans. Additionally, customers receive concierge support from AT&T to help select the right data plan and facilitate service activation at their convenience. Margaret Rooney-McMillen, AT&T Head of Strategic Partner Sales and Business Solutions VPGM, said, “AT&T is excited about this opportunity with Dell. Secure connectivity is critical to business workers, who are the heart and soul of AT&T business. The concierge service we’ve built to support Dell’s Carrier Referral Program is purpose driven, showcasing customer experience as our highest priority. We’re looking forward to seeing the success of this collaboration.”

Empowering Connectivity for the Future

Dell’s carrier promotion with AT&T represents a significant step forward in empowering connectivity for the future. By addressing the dual needs of reliable network access and robust security, this collaboration promises to redefine the way consumers and businesses experience connectivity. With seamless integration, enhanced performance and dedicated support, Dell and AT&T are committed to making connectivity simpler, safer and more accessible for all.

Source: dell.com

Continue reading

Plan Inferencing Locations to Accelerate Your GenAI Strategies

Businesses expect Generative AI (GenAI) to improve productivity, reduce costs and accelerate innovation. However, implementing GenAI solutions is no trivial task. It requires a lot of data, computational resources and expertise.

One of the most critical stages of GenAI model operation is inferencing, in which outputs are generated from a trained model based on user requests. Inferencing can have significant implications for the performance, scalability, longevity and cost-effectiveness of GenAI solutions. Therefore, it’s important for businesses to consider how they can optimize their inferencing strategy and choose the best deployment option for their needs.

Leveraging RAG to Optimize LLMs

Large language models (LLM), such as GPT-4, Llama 2 and Mistral, hold a lot of potential. They’re used for various applications, from chatbots to content creation and even to write code. However, LLMs depend on the data they’re trained on for accuracy.

Depending on the need for customization, some organizations may choose to implement pretrained LLMs, while others may build their own AI solutions from scratch. A third option is to pair an LLM with retrieval augmented generation (RAG), a technique for improving the accuracy of LLMs with facts from external data sources, such as corporate datasets.

Considerations for Where to Run Inferencing

To help determine where to place an inferencing solution, consider important qualifiers such as the number of requests that will be sent to the model, the number of hours a day the model will be active and how usage will scale over time. Additional considerations include the quality and speed of output and the amount of proprietary data that will be used.

Inferencing On-premises Can Save Costs and Accelerate Innovation

For GenAI solutions that pair LLMs with RAG, inferencing on-premises can be a better option than inferencing through the public cloud.

Inferencing LLMs and RAG in the public cloud can be expensive, as they can incur high data transfer, storage and compute fees. According to a recent study commissioned by Dell Technologies, Enterprise Strategy Group (ESG) found that inferencing on-premises can be more cost-effective. Inferencing LLMs and RAG on-premises with Dell solutions can be 38% to 75% more cost effective when compared to the public cloud.

ESG also found that Dell’s solutions were also up to 88% more cost effective compared to APIs. As the size of the model and the number of users increased, the cost effectiveness of inferencing on-premises with Dell grew.

LLMs paired with RAG can generate sensitive and confidential output that may contain personal or business information. Inferencing in the public cloud can be risky, as it can expose the data and outputs to other parties. Inferencing on-premises can be more secure, since data and outputs remain within a company’s network and firewall.

LLMs and RAG can benefit from continuous learning and improvement based on user feedback and domain knowledge. By running inferencing on-premises, innovation can flourish without being bound by a cloud provider’s update and deployment cycles.

Leverage a Broad Ecosystem to Accelerate Your GenAI Journey

At Dell, we empower you to bring AI to your data, no matter where it resides, including on-premises in edge environments and colocation facilities, as well as in private and public cloud environments. We simplify and accelerate your GenAI journey, creating better outcomes tailored to your needs, while safeguarding your proprietary data, with sustainability top of mind.

We offer a robust ecosystem of partners and Dell services to assist you, whether you’re just starting out or scaling up in your GenAI journey and provide comprehensive solutions that deliver ultimate flexibility now and into the future. In addition, with Dell APEX, organizations can subscribe to GenAI solutions and optimize them for multicloud use cases.

Source: dell.com

Continue reading

The Most Manageable Commercial PCs – From Dell

Organizations that manage fleets of commercial PCs know just how difficult a task this can be. Meeting the need to configure and manage devices on a timely basis, while juggling urgent update requests, ensuring compliance and meeting established SLAs can at times turn a “run the business” operation into a full-scale escalation.

The truth is that the PC and the applications used to manage these operations are intrinsically connected. You can’t have secure and reliably operating PCs without regular updates—and that requires having an OEM’s specific updates working smoothly and reliably with your PC management suite and tools.

Dell Technologies employs a holistic approach to its PC management processes to help IT admins better manage updates, monitor their fleets and balance both to minimize the impact to end user productivity. Our perspective is that you need to be able to easily manage Dell devices, lessening your administrative burden. We accomplish this by understanding the capabilities that will help you better manage Dell devices. And we then build these capabilities into our processes for both Dell tools and well-known commercial device management applications.

For instance, Dell provides capabilities thoughtfully designed to work together with applications like Microsoft Intune and Workspace One, while leveraging built-in remote “out of band” management features from Intel vPro. The result of these key integrations is that Dell PCs are the industry’s “most manageable commercial PCs,” benefitting organizations through tested, predictable updates, more easily maintaining device security posture and compliance and providing a built-in capability that allows a device to be tracked down and remotely managed.

For instance, the Dell Trusted Update Experience makes it simple to update endpoints with the latest BIOS, driver and firmware versions.

Dell is the only Top-5 PC vendor that:​

• Publishes a device drivers and downloads release schedule, so IT admins can deploy fleet-wide device-updates on a predictable timeline.
• Performs integrated validation of all driver and BIOS modules in an update. IT admins

Dell’s commercial PC systems management solution, Dell Client Command Suite, has industry-leading integrations with unified endpoint management solutions with Microsoft Intune and Workspace ONE. IT admins can tap into these integrations to further streamline the management of Dell commercial PCs.

With Dell Command | Endpoint Configure for Microsoft Intune, IT admins can:

• Securely configure BIOS settings, on a fleet of Dell commercial PCs, natively in Microsoft Intune.
• Configure unique per-device BIOS passwords, on a fleet of Dell commercial PCs, natively in Microsoft Intune.

With Dell Client Command Suite’s integration with Workspace ONE, IT admins can securely manage BIOS, firmware, OS and system updates—from the cloud.

And with Dell Command | Intel vPro Out of Band, IT admins can remotely manage systems, even when out-of-band—where the system is offline or has an inaccessible operating system.

By offering a unique, simplified and reliable BIOS, driver and firmware version update process, and with industry-leading third-party systems management solution integrations, Dell commercial PCs are designed to be the most manageable commercial PCs. Organizations benefit from PCs that are easier to manage, more secure and more predictable—with less risk of employee work interruption.

Source: dell.com

Continue reading

Dell Technologies Powering Creativity from Studio to Screen

When I mention to people that I’m gearing up to attend the National Association of Broadcasters event in Las Vegas with the Dell media and entertainment team, I always receive a lot of interest in how Dell Technologies supports this exciting industry. You may be surprised to learn that Dell Technologies has been helping major film studios, broadcasters and game developers create their media for years. Dell’s longstanding and proven reliability has positioned us being a highly regarded and trusted industry brand.

Over the years, Dell has been committed to driving innovation within their technology portfolio, from workstations to displays, as well as partnering with other industry leaders like NVIDIA and AMD to enable creatives to do their best work. An example of this is the incredible work produced by Orbital Studios using the Dell Precision Workstations. Check out the recent video Orbital produced discussing the role technology played in their recent efficiency gains.

As part of the storage team for Dell, we get to work on helping customers with processing and managing massive amounts of data. Storage has always been important for artist workflows like video edit, broadcast, visual effects and animation for films and episodic television, but newer workflows like AI, virtual production and game engine technology have emerged on the scene and are making storage, particularly all-flash storage, like Dell PowerScale, extremely valuable to accelerating workflows.

Generative AI (GenAI), fueled by machine learning algorithms, is shifting the paradigm across industries. But in the media and entertainment realm, this technology enhances creativity and amplifies human potential by allowing creators to fine-tune their vision, from generating realistic human faces to crafting entire landscapes. Filmmakers can now utilize GenAI to streamline pre-production processes such as concept art creation and storyboarding. Additionally, it opens up new avenues for procedural content generation in video games, enabling vast and dynamic virtual worlds. Still, other AI applications are worthy of more than an honorable mention because they’re creating dramatic efficiency gains, particularly in repetitive tasks, like rotoscoping.

Another interesting advancement for the industry is virtual production. Virtual production has revolutionized the filmmaking process, blurring the lines between physical sets and digital environments. By integrating real-time rendering technology with traditional filmmaking techniques, directors can visualize scenes in virtual environments, saving time and resources during production. From capturing complex visual effects to exploring alternative camera angles on the fly, virtual production empowers filmmakers to unleash their creativity like never before.

And then we have game engines, which have long been at the forefront of interactive entertainment, powering everything from AAA video games to immersive virtual reality experiences. However, their versatility extends beyond gaming, with applications in film, television, and advertising. By leveraging game engines like Unreal Engine and Unity, content creators can prototype, visualize and iterate on their ideas in real-time, facilitating collaboration and experimentation throughout the creative process.

These technology advancements are ultimately allowing media and entertainment companies to take audiences to new levels. Consider the latest Avatar or Mad Max movies as prime examples of how a studio can leverage these next-gen practices to break the ceiling on immersive storytelling. I’m filled with wonder considering the possibility of what broadcasting, movies and gaming will look like in the near and distant future. The possibilities stretch past the reaches of my mind.

That said, the computational demands of these innovative workflows are substantial. Processing enormous datasets and, in the instance of AI, training complex neural networks, requires powerful infrastructure. This is where PowerScale comes into play and why I’m so excited to join this incredible team. PowerScale offers a scalable architecture and the high-performance processing power needed to efficiently tackle large-scale media and entertainment workloads.

As you might imagine, I can become quite long-winded given the opportunity to talk about how Dell is helping to drive innovation in the entertainment space, but I know my enthusiasm is ultimately understood. Enabling creatives to push the boundaries of their imagination elevates our collective entertainment experiences to new and exciting levels. And who doesn’t want more of that?

Source: dell.com

Continue reading