Archive for the ‘Big Data’ Category

Getting started with machine-generated data

Brett Roberts

Brett Roberts

Data Analytics Systems Engineer at Dell EMC
Brett is the Technical Lead for Dell EMC’s Data Analytics Technology Alliances, focused on developing solutions that help customers solve their data challenges. You can find him on social media at @Broberts2261
Brett Roberts

Latest posts by Brett Roberts (see all)

By Brett Roberts with Debra Slapak

We are literally surrounded by data generated from devices and other machines—things like the phones in our pockets, vehicle sensors, the ATM at our favorite spot, cameras on the street, even the thermostats and appliances in our homes. As consumers, we benefit from insights generated when this data is analyzed and put to work for us. This, ideally, protects us or makes us more loyal to the companies that provide better experiences or outcomes for us.

Increasingly, business, government and non-profit organizations alike are generating, capturing, and analyzing massive amounts of machine-generated data to help them improve operational efficiency and customer experience. This process may look simple from the consumer side, but the reality is that transforming business and operating models using machine-generated data can be challenging. The data itself is typically a mix of structured, unstructured or semi-structured data from a wide variety of sources, and organizations often to struggle with how best to collect and analyze it.

To address these problems, Dell EMC and Splunk formed a strategic partnership to architect, test and validate solutions that combine Splunk on Dell EMC infrastructure. The work our teams do together simplifies decision-making and deployment of analytics solutions for machine-generated data, so our customers can focus on better experiences and outcomes for their customers.

Splunk is a platform for real-time operational intelligence using machine-generated data. It enables organizations to search, analyze and visualize those massive streams of machine data generated using highly-optimized IT systems and technology infrastructure—physical, virtual and in the cloud. Within just a few years, Splunk has emerged as one of the fastest-growing data-focused platforms, used by more than 75 of the Fortune 100 companies to extract value from machine-generated data. Some have called Splunk the “easy button” for analytics, because it quickly collects and analyzes all varieties of data whether it’s big data, fast data, the Internet of Things (IoT) sensor data, cyber-security streaming data, or sentiment analysis data from social media. Many attribute Splunk’s rapid success to its simplified end-to-end platform, which enables users to collect data from anywhere with its universal forwarding and indexing technology, as well as its ability to search and analyze data using “schema on the fly” technology, all resulting in the delivery of real-time insights and accelerated time to value.

To support the performance and evolving storage demands associated with creating actionable information using machine-generated data, Splunk requires powerful and flexible infrastructure that:

  • Provides processor and memory configurations based on Splunk recommendations (Splunk has a great document on this for different deployment needs.)
  • Enables a flexible, scale-out capacity consumption mode
  • Includes data services like data reduction (deduplication or compression) and encryption
  • Delivers cost-effective and optimized tiered storage for hot, warm, and cold data
  • Is optimized and validated by Splunk- to meet or exceed pre-determined reference hardware requirements

Let’s look at an example.

One of the world’s largest logistics companies recently embarked on a data journey to take control of fast, diverse and large amounts of machine-generated data. The company has planes, trucks, scanners, and warehouses, all creating enormous amounts of data, as much as multi-TBs per day. In this competitive industry where minutes matter, the risk of not harnessing data for a multitude of insights can mean the difference between success and failure. With so many machines generating data, capturing and leveraging that data can be massively complex.  Here is where the Splunk platform has delivered the power, flexibility, scalability and speed they need to tackle these challenges.

Splunk is an important half of the equation. The other half is ensuring that the infrastructure running Splunk will optimize Splunk operations in this environment. This means having a correctly sized configuration to support multi-TB-per day ingestion, with a scale-out architecture that grows as Splunk use cases expand and as data ingestion grows. Using Splunk on optimized, Splunk-validated infrastructure that provides powerful data services and cost effective tiering, our customer is now well on the journey to proactive insights that will drive their business farther and faster.

The figure below summarizes the key requirements for Splunk-optimized infrastructure.

 

Deploying Splunk on proven architectures that have the attributes shown in the above figure helps Splunk run efficiently and scale easily as Splunk usage evolves in an organization. This is where Dell EMC comes in. Dell EMC’s portfolio of technologies are a proven landing spot for Splunk workloads. To see many of the documented solutions that have been implemented over the past year, visit the Dell EMC partner page on Splunk.com. The strength of the partnership has led to the development of jointly validated solutions for Splunk. These solutions meet or exceed Splunk performance benchmarks, based on their documented reference hardware. The solutions (linked below) have been configured for all types of deployment needs and use cases. With these solutions, organizations reduce complexity and risk associated with do-it-yourself solutions and speed time to value and insights in Splunk deployments.

Deploying Splunk on Converged Infrastructure with Dell EMC Vblock540

Deploying Splunk on Dell EMC Scale-Out Hyper-converged Infrastructure

If you refer back to the checklist above, you’ll find that the Dell EMC | Splunk solutions cover the requirements listed: Proper processing and computer sizing, scale-out architecture and cost-effective tiering coupled with highly advanced data services.

Machine generated data is everywhere and has tremendous potential value. Don’t miss out on the chance to capitalize on it. Dell EMC solutions for Splunk are ideal for getting started and, as you scale, you’ll be confident knowing the solutions will scale with you.

 

 

Strata+Hadoop World 2017 – San Jose

Erin K. Banks

Portfolio Marketing Director at Dell EMC
Erin K. Banks has been in the IT industry for almost 20 years. She is the Portfolio Marketing Director for Big Data and Data Analytics at Dell EMC. Previously she worked at Juniper Networks in Technical Marketing for the Security Business Unit. She has also worked at VMware and EMC as an SE in the Federal Division, focused on Virtualization and Security. She holds both CISSP and CISA accreditations. Erin has a BS in Electrical Engineering and is an author, blogger, and avid runner. You can find her on social media at @banksek

Another Strata+Hadoop World San Jose is upon us and some of us are extra excited because this is the first time we are in San Jose as Dell EMC. I was literally on a call today going over the logistics and a couple of people could not stop talking about the event and how it will be great that we get to be a part of it as Dell EMC. We are incredibly proud of the way the merger has come together and all that we have accomplished along the way. This time we get the opportunity to show you that we are not just an infrastructure company but a company that is focused on your business outcomes. We have worked with the full range of customers and helped them be successful across multiple disciplines.

Strata+Hadoop World 2017What is our main message? Analytics that Drive Business

The only way that you can solve your business problems is through data analytics. Your current and future data has the potential to answer these problems, but recognizing the questions is not that easy. How do you find these questions and how do you get a return on information, is the true question. We want to guide you through the maze and challenges of data analytics through our services and simple and complete offerings that take the guess work out of the struggle. We want to allow your business to focus on what’s most important, driving your business forward.

We have two sessions occurring at Strata+Hadoop World

Tuesday @ 1:30 Pm in room 210 B/F with Bill Schmarzo ( @schmarzo )

Wednesday @ 11:00 am in room 210 B/F with yours truly, Erin Banks ( @banksek )

We will be in booth 1409, which is to the right of the main entrance, so please come on by and let us prove to you that we are more than just infrastructure. Also follow us on @DellEMCbigdata to see how the conference is going.

Some additional information can be found at our Dell EMC events site

Data Analytics Paves the Way to Better Healthcare

William Geller

William Geller

Data Analytics Product Marketing at Dell EMC
William Geller has been involved in new technology and data science for over 15 years, with experience launching and marketing new products for both startups and in enterprise, around the world. William is the Principal Product Marketing lead for Data Analytics in the Solutions Marketing division of CPSD. Prior to joining Dell EMC, he worked for numerous startups in Healthcare IT, Social Network Analytics, and cyber security. He holds a VMware VCP4.0 accreditation. Willam has an BS in Electrical Engineering from Drexel University and an MBA from Babson College. You can find him on Twitter at @williamgeller
William Geller
William Geller

The wide breadth of benefits from data analytics comes in many forms as companies embrace their data assets to affect their businesses and ultimately human lives. When it comes to healthcare, it’s easy to think there is no such thing as too much data. However, with limited time to address urgent medical issues, vast quantities of data aren’t always evaluated in time to uncover distinct patterns that could guide treatment.

Partners Healthcare, a hospital system in the Boston area, saw the same issue and sought to bring better clinical care outcomes with Dell EMC’s Analytic Insights Module. Brent Richter, Director of Enterprise Research at Partners Healthcare recently sat down for an interview with Dave Vellante at SiliconAngle. Richter discussed how Partner’s leveraging of incredible flows of patient data that are matched and reconciled between hospitals in the network, and blended with their own BioBank of sequenced genomes to support Precision Medicine. To illustrate the power of data analytics, Richter shares a staggering early success using Analytic Insights Module, where data analytics led physicians to forego the typical path of “try-and-fail” cancer treatments for a particular patient.  Instead their analysis revealed that they would achieve a better outcome for the patient if they focused on treatment using a drug called Crizotinib. Normally not used for the type of cancer this patient had, Analytic Insights Module has uncovered that the genetics of the tumor which had fully metastasized, matched a treatment used successfully elsewhere. To the delight of all, this course of treatment managed to greatly reduce the cancer in only 2 weeks. Partners Healthcare is harnessing all their patient data to reveal new insights for personalized medicine and customized treatments that just aren’t possible with traditional analytical methods – until now.

To view the SiliconAngle Cube session with Brent Richter, please follow this link.

Big Data Analytics and Its Impact on Holiday Shopping

Erin K. Banks

Portfolio Marketing Director at Dell EMC
Erin K. Banks has been in the IT industry for almost 20 years. She is the Portfolio Marketing Director for Big Data and Data Analytics at Dell EMC. Previously she worked at Juniper Networks in Technical Marketing for the Security Business Unit. She has also worked at VMware and EMC as an SE in the Federal Division, focused on Virtualization and Security. She holds both CISSP and CISA accreditations. Erin has a BS in Electrical Engineering and is an author, blogger, and avid runner. You can find her on social media at @banksek

It was my niece Kajsa’s birthday in October. It was so crazy at work that I almost completely forgot to get her a gift. Please don’t tell her!!! My biggest problem, outside of forgetting, is the struggle to find a gift for an 8-year-old when you live in two separate states and you want to get get her something unique and that you really hope she will like. holiday shopping

Shopping can be difficult and not many people like to do it, especially when you need to get something for someone else. What worried me more… there were two more months until holiday shopping occurred. Now I need to buy for her brother Tennison and Kajsa AGAIN. What is the appropriate age to start giving gift cards? Well until that age, I need a fall back plan which is of course online shopping. If I didn’t have time to remember her birthday, I certainly don’t have time to drive to the mall. We all have our favorite sites and personally my favorites include reviews and most importantly… recommendations.

So how does my problem help you and your business? If your business is not applying any data analytics to your inventory and your sales, you are not being competitive. There are different types of data analytics that you can using within your business but the most impactful are predictive and prescriptive analytics.

predictive analytics

Predictive analytics helps you understand what will happen. By looking into the past and how people reacted in certain conditions, can help you predict what will happen in the future. For instance, if I buy a home gaming system then more than likely other accessories will go with it and be recommended. Does your business have the ability to “upsell”? Does your business understand the correlation of the buyers to what they have bought over time? Buyers like me are looking for the recommendation, they are looking for ways to easily find out what else is out there. Your business more than likely has all of this past data. You might be using it your inventory tracking or just your quarterly sales. Now with predictive analytics, you have the ability to sell even more products or services.

Prescriptive analytics takes predictive analytics one step further and takes your business even closer into the big data analytics realm. Taking multiple points of information not only from purchases on your site but other sites as well as credit card purchases, and the attributes of the buyer, can help your business find the right options for your customers as well as drive newer products to them. Prescriptive analytics identifies the best course of action that an individual should take.  It is almost like you do the thinking for me because your business inputs all the points that is necessary to make the right decision. For example, maybe there is a trend going in that state and therefore I want to choose a gift that is something she truly will want.

Mother and son with pad during car travel at nightUnderstanding the data and applying it in such a way that it helps drives sales is not a new concept. Often times when we work with someone face to face they make recommendations on what others liked or paired with something. Now businesses have the opportunity to pull from many sources and therefore give you a richer insight. Not just the ability to know what we will more than likely buy but an understanding of what we should buy based on the information accumulated from people like me. Pulling information from other people buying an 8-year-old a gift will more than likely make sure that I buy the perfect gift. Isn’t that all what we want anyway… to be the perfect Aunt and Uncle that knows just what the kids want. Happy Holidays and happy online shopping this season. Just make sure you shop at a site that does data analytics.

 

Follow Dell EMC

Dell EMC Big Data Portfolio

See how the Dell EMC Big Data Portfolio can make a difference for your analytics journey

Subscribe to Blog via Email

Enter your email address to subscribe to this blog and receive notifications of new posts by email.

Dell EMC Community Network

Participate in the Everything Big Data technical community

Follow us on Twitter