Intelligent Enterprise Search Ever-More Critical with Employees Working from Home

By marketing@site-a.com

“What was the name of that client we worked with two years ago?” “Which folder has the files with last year’s marketing campaigns?” Such questions are typical in most businesses. Unfortunately, the constant hunt for information within organizations consumes enormous amounts of time. In fact, it is estimated that knowledge workers spend almost 20% of their time searching for and gathering information. That’s roughly 10 hours a week, or a quarter of their time in the office. 

For years, businesses have tried to make the information search process easier in one of two ways. They have either used rudimentary systems based on keyword search queries. Or, they have employed monolithic content management systems with better search capabilities, but typically exclude data stored outside of the system.

Unfortunately, these traditional enterprise search tools are not enough in today’s fast-paced, data-driven business environments. Exasperating the issue is COVID-19. It’s a good bet the time dedicated to search is even greater now with most people working from home during the pandemic. Workers have lost their in-office network where they can turn around and ask an office mate for help.

Such conditions have given rise to the need for intelligent enterprise search. Ideally, an intelligent enterprise search solution would extend search to data from all sources (applications, email, network shares, intranets, websites, databases, social media, and more). And would use artificial intelligence (AI) powered search techniques to deliver insightful information to every query.

Characteristics of Intelligent Search

What makes a search intelligent? Traditional enterprise search has always been based on entering keywords and getting a long list of results the user had to wade through. Intelligent search uses AI to help with content classification and to personalize search results based on a user’s previous searches. For instance, an AI-based intelligent search solution might analyze a person’s past queries, spot patterns, and suggest customized keywords or search terms.

Combining AI and search also allows for new and expanded search capabilities. For example, Natural Language Processing, as well as intelligence image and video analysis technology, can extend search to images, videos, audio, and multimedia content. Such functionality was never available with old-style keyword search.

Even higher-level capabilities are possible. For instance, solutions could leverage AI and machine learning techniques that enable a system to become self-learning. So, each time a user searches, results are refined and improved based on what the user considered valuable from previous searches. In this way, delivered information is personalized and optimized to meet a user’s needs.

Systems Requirements Grow

Intelligent enterprise search requires lots of processing power (supplied by high-performance CPUs and GPUS), massive amounts of storage, and superior data management capabilities. Systems also must be optimized for AI workloads.

This is an area where PSSC Labs can help. PSSC Labs has a more than 30 years history of delivering systems that meet the most demanding workloads across industries, government, and academia.

It offers a wide range of systems ideally suited for AI applications. To achieve the necessary performance, its AI deployments typically make use of GPU processing arrays. For workloads to run cost-effectively, the solutions support high data rates to keep the processors satiated. That, in turn, dictates the use of ultrafast interconnect technology and tightly coupled high-performance storage.  

The challenge for most companies is that they might have system expertise in HPC, but often not in AI. As such, there may be a skills gap that makes it hard to bring together the essential elements and fine-tune the system’s performance for critical enterprise intelligent search workloads.

To overcome such issues, many companies are looking for turnkey solutions that combine the needed processing, storage, memory, and interconnect technologies for AI into a tightly integrated system.

Delivering such a solution requires expertise and real-world best practices across both HPC and AI domains, plus deep industry knowledge about the specific data sources and search applications.

Beyond general systems for AI workloads, PSSC Labs also offers a solution specifically designed for intelligent search. The Daedalus Enterprise Search Appliance is a turnkey, high-performance computing platform powered by Elastic and certified compatible with Elastic Cloud Enterprise (ECE), which allows users to centrally manage and monitor their Elasticsearch deployments for use cases like search, observability, and security. The system includes all necessary hardware, networking, support, and software for a simple, one-step deployment.

Such solutions are increasingly important as the volumes of data companies use grows, and the need to find information quickly becomes critical to success. Get in touch with a Solutions Architect today to learn how the Daedalus Enterprise Search Appliance can simplify your business processes and streamline your work objectives. 

 

Mellanox BlueField-2: A Win-Win of Increased I/O Performance and Enhanced Security

By marketing@site-a.com

Improving the performance of compute workloads has always been a case of dealing with a changing landscape. The introduction of every new CPU, storage, or I/O technology boosted one aspect of performance but shifted the bottleneck to another.

Of late, most of the action has focused on increasing processing and storage performance. High-end systems now routinely use the latest generate CPUs, and many workloads are accelerated using GPUs. Storage solutions have benefited from lower-cost SSDs and innovative high-performance distributed file systems.

Now, there is a relatively new development for boosting I/O. Mellanox BlueField-2 is being integrated into high-performance computing (HPC) systems to eliminate common issues that degrade the overall performance of job execution.

The concept behind Mellanox BlueField-2 is that heavy compute and storage workloads consume valuable CPU cores for processing and steering network traffic. Such resources could be used for critical application processing. The way to reduce these demands is to handle these processing chores with an I/O Processing Unit (IPU), which brings programmable intelligence and accelerations to the network. 

Specifically, the Mellanox BlueField-2 IPU offloads critical network, security, and storage tasks from the CPU, making it ideal for addressing performance, networking efficiency, and cybersecurity concerns in a modern data- center.

Drilling Down into the Technology

Powered by industry-leading 50Gb/s PAM4 SerDes technology and PCIe Gen 4.0, BlueField-2 provides up to two ports of 25, 50, or 100Gb/s, or a single port of 200Gb/s Ethernet and InfiniBand connectivity. BlueField-2 combines the advanced capabilities of the ConnectX-6 Dx ASIC network adapter with an array of Arm processors and a high-speed memory controller, which enables enhanced and flexible software programmability.

BlueField-2 storage capabilities include NVMe-oF offload and NVMe emulation, which can be used for both the storage target and the storage client. The IPU is available as both a controller card that delivers the performance-boosting features in a PCIe standard form factor and as a software-programmable SmartNIC.

Beyond performance acceleration, one particularly useful benefit of using the SmartNic is that it can deliver isolation, hardware root-of-trust, and IPsec and TLS cryptography accelerations, allowing data center security at the end-point with best-in-class performance.

Mellanox SmartNICs and BlueField IPUs thus provide in-hardware security policy enforcement and connection tracking at full wire-speed with up to 100X performance gains compared to non-accelerated solutions – making them ideal to boost next-generation firewalls in bare-metal, virtualized, and containerized cloud environments.

Additionally, as an IPU, BlueField-2 provides in-hardware security capabilities, including agentless micro-segmentation, advanced malware detection, deep packet inspection, and application recognition, that far outperform software-only solutions.

These capabilities and features make the solution ideal for Department of Defense applications that require enhanced security extended to the edge and high performance.

Selecting the right technology solution

Integrating new technologies into HPC systems and optimizing those systems requires a great amount of time and special skill sets. Deploying such systems that deliver the requisite compute performance is a fine art. Employing such systems so that they also can support enhanced end-point security without impacting performance is even more challenging.  Many companies opt to team with a technology partner to benefit from real-world experience best practices and free their staff up for other jobs. PSSC Labs is a long-time partner with Mellanox, using its high-performance I/O solutions in the most demanding HPC applications.

PSSC Labs has a more than 30 years history of delivering systems that meet the most demanding workloads across industries, government, and academia. In particular, it has a long history working with federal agencies – from the Department of Defense and NASA to the National Oceanic and Atmospheric Administration and the National Institutes of Health. Through this experience, PSSC Labs understand the ever-increasing need for improving compute, storage, and security capabilities to meet the wide range of use cases across diverse agency missions. PSSC Labs HPC and Big Data products are available on a variety of government contract vehicles. These widely accepted contracting vehicles expedite the purchasing process while satisfying government purchasing regulations.

To learn more about I/O acceleration, visit www.site-a.com.

Must-have Technologies for Working Remotely

By marketing@site-a.com

Our nation and world is facing the battle of a lifetime. COVID-19 has forced the shutdown of schools and business, not just in the United States but worldwide. Many businesses have been asked to implement emergency work-from-home protocols to limit and if possible, avoid exposure in the workplace. Even some of the world’s largest organizations like Google, Facebook, and Amazon are limiting exposure for their employees by implementing work-from-home policies indefinitely. 

With so many employees being asked to work-from-home, the structure of businesses and how we do business with others is changing drastically. While these adjustments can be difficult, there are a few technologies you and your team can adopt to make the transition a bit easier. 

Video Conferencing

Chances are you already have access to some kind of video conference platform, like Google Hangouts or Zoom. Using video conferencing might feel awkward or uncomfortable at first, but it can add an extra layer of communication and understanding to your meetings. Video conferencing software will also typically include screen-sharing capabilities, which most companies will find to be useful when sharing or reviewing documents, purchase orders, presentations, etc. 

Chat

Communication can feel significantly different with a work-from-home culture, especially if you’re used to communicating in-person with your team members. Chat software like Slack can significantly speed up communication processes. Even better, Slack allows for communication between individual team members, entire departments, and the entire company — or any subset of employees. Each group can have their own channel that allows for constant communication and brainstorming without disrupting other team members that are not a part of that conversation or project. 

Project Management

Not everyone is great at time or project management, and keeping your employees on track and monitoring their progress can be even more difficult when done remotely. That’s where project management tools like Trello, Asana, and Basecamp come in. Tasks related to specific projects can be assigned to team members, making it easier to quickly view progress and identify what still needs to be done as deadlines approach. 

File Sharing Applications

Web-based applications like Box and Dropbox make file and document sharing easier than ever. In fact, this is actually how PSSC Labs shares their own files whether working remotely or in-house. By moving files over to Box or Dropbox, your team is given uninterrupted access to documents, spreadsheets, presentations, and more. It’s also easier to collaborate on these docs in real time without the risk of sending edited or incorrect versions back and forth. 

As we’re all adjusting to a new normal, it’s important to note that you and your team members will need to adjust to a new workflow that works for your company and that might not look exactly as you thought. Don’t be afraid to try new things or technologies for working remotely to find what works best for your business processes — and most importantly, stay healthy! 

AMD EPYC Rome Processor: An Emerging Alternative for HPC

By marketing@site-a.com

The AMD second generation of EPYC processors, code-named “Rome” and based on the Zen 2 microarchitecture, are emerging as an alternative processor for high-performance computing (HPC) server applications.

The processor, which was released last August, features up to 64 cores per socket with 128 PCIe 4.0 lanes and 8-channel memory. AMD touts it as offering a very high performance per dollar in the marketplace. For organizations familiar with AMD desktop technology, EPYC Rome is to the server what AMD Ryzen 3000 was to the desktop. Namely, the second-generation AMD EPYC Rome processor offers significantly improved instructions per cycle over the first-generation processor, as well as more cores and better thermal efficiency. Additionally, the processor features a higher base frequency and a higher boost frequency than the previous AMD top-of-the-line processor.

Workloads That Will Benefit from AMD EPYC

When launched, AMD noted that Rome offers far more CPU threads per socket than Intel’s Xeon Scalable CPUs do. The processor also supports a higher DDR4 clockrate (up to 3200 MHz). Most important for demanding data center applications, the 128 PCIe 4.0 lanes each have twice the bandwidth of a PCIe 3.0 lane. Such performance is critical in HPC and large data center applications because data ingestion by CPUs is often a bottleneck. The higher performance capacity means workloads will not be degraded, and jobs will run faster. Most Host Bus Adapters may not be able to immediately take advantage of this larger pipe, but we don’t expect that to be the case for very long. Over time, more and more network adapters, controllers, etc. will be able to fully take advantage of PCI Express® 4.0.  That’s not to say that right now there are no benefits. In fact, the immediate impact is significantly more lanes for PCI devices, such as NVMe devices.  This will dramatically improve IO performance and increase the number of devices connected to the server. 

Another very basic advantage for HPC use cases is that since AMD EPYC processors have more cores than their comparable competitive processors, they deliver more computing power. Processors with more cores are ideal for advanced modeling and simulation algorithms, such as a finite element simulation. For these workloads, a job needs to use a very large number of cores at a given time. And the workloads often require large amounts of shared memory. This changes the game for HPC environments (ie. Design & Engineering, Weather Modeling, Life Science, and Artificial Intelligence), where total core count directly relates to program success. AMD® is realizing their investment in the 7 nm technology is finally paying off.

AMD EPYC processors deliver other benefits for HPC workloads and environments. By virtue of having more cores, the processors can run more virtual machines (VMs). As a result, a company gets more efficient compute resource use out of a single system.  This is ideal for virtual desktop environments (VDI) as well as converged / hyper-converged applications.

Selecting the Right Technology Platform

AMD use for HPC server workloads has had a mixed track record over the years. However, the introduction of AMD EPYC processors seems to have caught the attention of the marketplace.

Noting this interest in the user community, PSSC Labs is rolling out solutions based on the processor this year. PSSC Labs has a more than 30 years history of delivering systems that meet the most demanding workloads across industries, government, and academia.

Its offerings include the PowerServe Uniti Servers line that leverages the latest components from Intel® and Nvidia®. These servers are ideal for a wide range of applications, including AI and deep learning, as well as for computational and data analysis.

PSSC Labs also offers CloudOOP Big Data Servers that deliver the highest level of performance one would expect in an enterprise server combined with the cost-effectiveness of direct attach storage for Big Data applications. The servers deliver 200+ MB/sec sustained IO speeds per hard drive (which is 30%+ faster than other OEMs.)

Due to the increase in the number of PCI Express lanes, PSSC Labs is upgrading their CloudSeek Database Servers as well. The products we plan to bring to market in the near future will be built to support up to 36 x NVMe devices

PSSC Labs plans to have an AMD EPYC version of all its platforms for HPC and Big Data by the second half of the year. User interest is sparking this move. The company has not sold an AMD-based server in more than ten years. The impression PSSC gets from the end-user community and its own evaluation of the new processors is that AMD is a viable choice for the most demanding HPC workloads.

Infrastructure Considerations for Containers and Kubernetes

By marketing@site-a.com

Containers and Kubernetes are at the heart of a broad industry shift where applications and services are based on a microservices architecture. Specifically, microservices are being rapidly adopted as a means of building and modernizing distributed applications allowing them to be more scalable, flexible, resilient, and easier to build.

Instead of building self-contained, monolithic applications, a microservices approach breaks applications into modular, independent components that can be dynamically integrated with one another using application programming interfaces (APIs).

Increasingly, companies are using containers to power their microservices application architectures. Containers encapsulate a lightweight runtime environment for an application. Specifically, containers enable finer-grained execution environments, permit application isolation, and are lightweight.

Furthermore, containers include everything needed to run, such as code, dependencies, libraries, binaries, and other elements. Today, Docker is the most popular choice for building and running containers.

Compared to Virtual Machines, containers share the OS kernel instead of having a full copy of it and take up less space. Because they do not require OS spin-up time associated with a VM, containers initialize faster. In general, containers start in seconds or even milliseconds, which is much faster than VMs. As such, containers deliver performance characteristics that match the needs of a microservices architecture. In particular, the quick instantiation maps better to the unpredictable workload characteristics associated with microservices. 

The growing embracement of containers was validated in a 2019 industry container usage survey that found the median number of containers per host doubled (to 30) between 2018 and 2019. And the maximum per-node density was 250 containers, which was a 38% increase from 2018.

Managing Your Containers

With such explosive growth in the use of containers, companies need a way to oversee and manage their efforts. That’s where Kubernetes comes in.

Kubernetes is an open-source container orchestrator system for automating deployment, scaling, and management of application containers across clusters of hosts. It was originally designed by Google and is now maintained by the Cloud Native Computing Foundation. Kubernetes works with a range of container tools, including Docker. It groups containers that make up an application into logical units for easy management and discovery.

Kubernetes provides a framework to run distributed systems resiliently. It takes care of scaling and failover for an application. For example, in a production environment, Kubernetes can start a new container if one goes down. Thus, helping to ensure there is no application downtime. Additionally, Kubernetes provides service discovery and load balancing, storage orchestration, automated rollout and rollbacks, self-healing features, configuration management, and more.

While there are a handful of container orchestrators available today, Kubernetes dominates the market. In addition to the widely used open-source variant, some commercial offerings such as Red Hat OpenShift are built on Kubernetes. (The commercial offers add enterprise features and support.)

Kubernetes can be deployed on a bare-metal cluster or on a cluster of virtual machines. Kubernetes, in turn, can orchestrate the containers it manages directly on bare metal or on virtual machines. Most instances of Kubernetes today are run on VMs running on-premises or in the cloud.

Bare-metal instances are not as common. However, there are use cases where they offer advantages. For example, a network edge application might be too latency-sensitive to tolerate the overhead created by a VM. Or an application (such as machine learning) might need to run on GPUs or other hardware accelerators, which do not lend themselves to VMs.

Optimized, Integrated Solutions

Running container workloads comes down to hardware. Businesses need physical machines, with CPUs, memory, and local persistent storage. In addition, they need some shared persistent storage and networking element to hook up all the machines.

A suitable system must be able to be dynamically provisioned by the users to handle different data workflows. Many companies are looking for turnkey solutions that combine the needed processing, storage, memory, and interconnect technologies to provide either the bare metal or VM foundation for their container and microservices efforts. Delivering such a solution requires expertise and real-world best practices across both HPC and container/Kubernetes domains, plus deep industry knowledge about the specific applications.

PSSC Labs has a more than 30 years history of delivering systems that meet the most demanding workloads across industries, government, and academia. Its offerings include the PowerServe Uniti Servers line that leverages the latest components from Intel® and Nvidia®. These servers are ideal for a wide range of applications, including AI and deep learning, as well as for computational and data analysis.

PSSC Labs also offers CloudOOP Big Data Servers that deliver the highest level of performance one would expect in an enterprise server combined with the cost-effectiveness of direct attach storage for Big Data applications. The servers deliver 200+ MB/sec sustained IO speeds per hard drive (which is 30%+ faster than other OEMs.)

As the number of containers per host grows and Kubernetes use grows, these solutions and other PSSC Labs systems are designed to meet the requirements of enterprises today. Such systems will increasingly become more important as companies explore new ways to make use of the containers, Kubernetes, and microservices to serve their users better and quickly react to new business opportunities.

Supercomputing for Design & Engineering SMBs

By marketing@site-a.com

Supercomputing is most commonly thought of as a tool only for the largest government agencies, top commercial companies, and most prestigious universities — not your everyday small and medium-sized businesses (SMBs). The focus of supercomputing is typically on the largest systems, which scale well beyond many thousands of processor cores. Many SMBs believe supercomputing capabilities to be well beyond their reach, but nothing could be further form the truth. SMBs need a competitive advantage to obtain government and commercial contracts, and that advantage is a powerful, scalable, high performance supercomputing platform.

Over the past 12 months, interest and deployment of high performance computing clusters at SMBs performing computational fluid dynamics (CFD), finite element analysis (FEA) and structural engineering work have trended significantly upward. Without HPC systems, the work these organizations are accomplishing would be nearly impossible. But with the right systems, it could be the lifeline to their organizational success. “Supercomputing is not just for the large and powerful organizations,” says Alex Lesser, Vice President of PSSC Labs. “Supercomputing is an accessible tool for everyone. Small and Medium Businesses need to leverage these tools to ensure their success, and it does not have to be costly or intimidating.”

PSSC Labs works closely with several trusted leaders in the design and engineering space. These organizations develop state-of-the-art physics-based models for test programs, modeling and simulation analysis solutions for highly dynamic events and reactivity of energetic materials, and much more. Many of our clients also design simulation software in multiple areas of physics, including computational fluid dynamics (CFD), aero and hydro acoustics, and more. The technology these best-of-breed design and engineering firms have developed are applicable to many areas of interests to scientists, engineers, technologists, and educators. We’re proud to support game-changing organizations with the necessary HPC hardware systems they need to build the best of the best, while giving them immediate, frontend access to a variety of CFD applications, including Ansys Fluent, Star CCM, CFD++, and OpenFOAM, as well as Finite Element Analysis (FAE) applications, like Abaqus FEA, COMSOL Multiphysics and SimScale.

POWERWULF ZXR1+ HPC CLUSTER

Starter configuration for under $100k

  • 200 Intel or AMD Processor Cores
  • 4 GB of Memory Per Processor Core
  • 100 Gbps High Speed Network
    (Intel Omnipath or Mellanox Infiniband)
  • 10 TB High Performance Flash Storage
  • 40 TB Long Term / Secondary Storage
  • CBeST Cluster Management Toolkit
    • Linux Cluster Operating System
    • Message Passing Libraries
    • Batch Scheduled
  • Complete 3 Year Service Level Agreement

engineering hpc cluster

While some SMBs might be hesitant to deploy an on-premise HPC platform due to the lack of an internal IT department or perceived level of complexity, these concerns are easily put to rest when partnering with the right partner. PSSC Labs’ goal is to deliver the most turn-key, highest performance, head-ache free HPC experience possible. Our PowerWulf ZXR1+ Clusters include all necessary hardware, software, and networking integrated by 20+ year HPC experts. “We are very proud of our 57 step testing and integration process, which is considered one of the industry’s most rigorous,” begins Larry Lesser, PSSC Labs Chief Technology Officer. “The results of this painstaking process are evident with a record of never delivering a DOA system and a consistently proven 99.99% system uptime.”  PSSC Labs stands firmly behind their product with a complete hardware and software service level agreement for up to five years. Because PSSC Labs is both the manufacturer of the hardware and developer of system software, SMBs have one phone number to call for immediate access to knowledgeable support.

Cloud providers and brokers will continue to try scaring SMBs into believing that they are incapable of supporting an on-premise HPC solution. They may argue the merits of using offerings from Amazon, Microsoft and Google will save companies significant cost, offer superior performance and greater scalability, but they’re wrong. SMBs in the Design & Engineering space are comprised of very intelligent and experienced engineers who can evaluate the numbers on their own and are not easily swayed. Companies who choose the cloud over on-premise models are accepting ever-expanding monthly bills, loss of control and governance, and lower security, while allowing their data to be completely at the mercy of a third party. With the threat of cyber attacks ever-looming, putting critical and confidential data on the cloud is possibly one of the most irresponsible things SMBs could do. A quick read of the “Cloud Hopper” investigation by the Wall Street Journal should serve as a stark warning.

More and more SMBs are deploying HPC systems than ever before. On-premise, high-performance supercomputers are well within the grasp of design & engineering organizations of all sizes. SMBs need to utilize these tools to develop new products, win more contracts and push their businesses forward.