The FINANCIAL — Dell on September 22 announced a new solution for Hadoop, co-designed with Cloudera and Syncsort and powered by Intel, that streamlines the planning, design, construction and deployment process of transforming data into a ready state for analysis, then loading it for business reporting or for querying; a process known as ETL (extract, transform and load).
Many customers want to adopt big data and analytics technologies to gain operational efficiency, yet Hadoop expertise may be difficult to find, creating an industry-wide skills gap. This inhibits businesses from performing these tasks without major disruption to their IT staff and environment, including paying costly consulting fees or dedicating extensive time and resources to training. To address this problem, the Dell | Cloudera | Syncsort Data Warehouse Optimization – ETL Offload Reference Architecture helps achieve faster insights in an intuitive way without needing to learn new skillsets, hire additional resources, or retool IT environments.
Traditional tools such as relational database management systems (RDBMS) and enterprise data warehouses (EDW), are not meeting the requirements of today’s business needs due to high costs, low performance and a lack of scalability. As customers’ needs continue to evolve, they are moving past general architectures in search of vendors who can provide use case driven, end-to-end solutions that fit their business needs now and into the future, according to Dell.
However, according to Gartner, through 2018, 70 percent of Hadoop deployments are predicted to fail to meet cost savings and revenue generation objectives due to skills and integration challenges. With that in mind, the Dell | Cloudera | Syncsort Data Warehouse Optimization – ETL Offload Reference Architecture is designed, tested and validated for customers looking for a cost-effective, faster, more efficient solution for ETL workloads. The reference architecture integrates Syncsort’s DMX-h technology to enable use of more intuitive tools to develop and deploy Hadoop ETL jobs without having to learn new code, which enables significantly faster time to value.
To put this to the test, Dell had an entry-level technician and an expert-level senior engineer run the same workload on four Dell PowerEdge R730xd servers and two Dell PowerEdge R730 servers, powered by Intel® Xeon® processor E5-2600 v3 product family, in a Hadoop cluster. The results were clear: an entry-level technician created ETL jobs with the Dell | Cloudera | Syncsort solution 60 percent faster than an expert level senior engineer running the same scenario with do-it-yourself, open-source ETL solutions. Additionally, the entry-level technician was able to streamline ETL design by 53 percent, giving businesses the equivalent of four days back..
The Dell| Cloudera | Syncsort Data Warehouse Optimization – ETL Offload Reference Architecture also offers:
Greater cost savings: Customers can save up to 76 percent on ETL administrative costs when compared to a do-it-yourself approach with open-source solutions. Additionally, by offloading the data transformation to Hadoop, customers can reduce transformation costs and reclaim data warehouse capability
Faster time-to-value: New Hadoop users can more quickly develop and deploy Hadoop ETL jobs, reducing the time it takes to design an ETL job for performing data validation by 55 percent
Quicker access to data insights: The Dell | Cloudera | Syncsort solution powered by Intel reduces the time spent on design by 53 percent, and enables 60 percent faster ETL jobs overall when compared to a do-it-yourself open-source solution
Customizable solutions: The reference architecture is easy and intuitive to integrate and deploy, allowing customers to spend more time on strategic forward-looking projects, and less on IT setup and management tasks
By teaming with Cloudera and Syncsort, Dell is continuing to invest in big data and analytics solution development as customers’ needs evolve. This solution marks the 15th reference architecture that has been certified and validated since 2011, demonstrating Dell’s commitment to delivering top of the line solutions for customers’ changing needs.
“Businesses are increasingly requiring quicker, cost effective and richer data insights to drive and accelerate their business results,” said Jim Ganthier, VP and GM of Engineered Solutions and Cloud, Dell. “Dell and Cloudera continue to jointly bring to market breakthrough big data and analytics solutions that deliver on those needs. Our new solution, which now incorporates Syncsort, will bring the power of big data insights to a whole new set of users who were once unable to justify the costs and complications of previously available commercial solutions.”
“End customer big data and analytic needs continue to evolve, they’re moving past general architectures in search of use case driven solutions that can solve real world problems, said Tim Stevens, vice president, Corporate and Business Development, Cloudera. “To address these needs, Cloudera has worked with Dell and Syncsort to design a solution that is faster, easier and more cost-effective to implement than ever before.”
“Many of our customers are leveraging Hadoop to offload expensive workloads from their enterprise data warehouses, resulting in faster time to insight, substantial cost savings and significant improvements in business agility,” said Josh Rogers, President, Syncsort. “This proven, turnkey solution from Dell, Cloudera and Syncsort integrates best-in-class hardware and software to help more organizations to capitalize on the benefits of ETL Offload.”