Bitwise, a data management consulting and services company, today announced the availability of the open source version of Hydrograph, an enterprise-class, GUI-based ETL development tool designed for Big Data and Cloud platforms.

The announcement ushers in a new era of Hadoop and Spark adoption for enterprises implementing an open source strategy by facilitating the migration of complex data integration jobs to more flexible, future-proof environments.

Hydrograph enables developers to easily build ETL (extract, transform and load) applications that integrate data from multiple sources within the open source Big Data ecosystem for reporting and analytics consumption.

Hydrograph Development

Bitwise created Hydrograph in partnership with Capital One to address pains of offloading ETL on Hadoop. Prior to releasing the open source version, Hydrograph development teams put the tool through its paces in production on Hadoop cluster deployments.

As Spark has become a more stabilized processing option, Bitwise modified Hydrograph to be able to utilize Spark’s powerful in-memory processing needed for developing ETL applications on large data sets. The metrics that have been achieved running Hydrograph on Spark clusters outperform other leading data integration platform results.

Open Source Adoption

Seeing an opportunity to foster innovation and allow other enterprises to benefit from Hydrograph, Bitwise and Capital One have open sourced the project after building internal adoption. Several other large Banking and Financial Services companies are lined up for adoption of the full-featured ETL tool, establishing a robust user community from the outset.

The open source version of Hydrograph is available on GitHub through Capital One, accessible here: https://github.com/capitalone/Hydrograph.

For Hydrograph reference architecture and demo video, visit: https://www.bitwiseglobal.com/en-us/data-tools/hydrograph/.

About Bitwise

Bitwise is a technology solutions provider that leverages data to enable business insights. Our breakthrough technology innovations help our global clients maximize their competitive advantage. We are the industry’s most experienced and dedicated team of data professionals, focusing on Data Warehousing, Data Integration, Analytics, Business Intelligence, Big Data and Digital Computation. We optimize value for our clients through our global delivery model and with our proprietary technology tools that reduce the time, complexity and cost of data initiatives. Together, our people and technology provide the insights clients need to continue to lead in their fields.

Founded in 1996, Bitwise is headquartered in Chicago, IL with development centers in Pune, India and Sydney, Australia. For more information, visit Bitwise at www.bitwiseglobal.com.

The post Bitwise Announces Open Source Availability of Hydrograph appeared first on Bitwise.

The post Capital One House at SXSW appeared first on Bitwise.

The post Open Source Hydrograph Brings Data Integration to Developers appeared first on Bitwise.

The post Hortonworks Future of Data Roadshow Atlanta appeared first on Bitwise.

The other week at Strata + Hadoop World NYC, Bitwise announced the introduction of Hydrograph, an ETL tool designed for the big data ecosystem.

The announcement was featured in Solutions Review and included in ZDNet’s listing of top Strata NYC announcements alongside MapR, Pentaho and Zoomdata.

If you have a need for ETL-like functionality for your Hadoop data lake, check out the announcement and see how Hydrograph simplifies data integration of big data workloads.

See Announcement

The post Strata + Hadoop World NYC Recap | October Newsletter appeared first on Bitwise.

The post Hadoop tool finds low-hanging fruit for migrating data warehouse jobs appeared first on Bitwise.

The post Hortonworks Future of Data Roadshow Minneapolis appeared first on Bitwise.

The post Strata NYC brings announcements from MapR, Pentaho, Zoomdata, and more appeared first on Bitwise.

Bitwise, a data management consulting and services company, today announced the introduction of a next-generation data integration tool called Hydrograph to address a need for ETL-like functionality on Hadoop in enterprises with big data workloads.

The announcement was made at Strata + Hadoop World, a deep-immersion event where data scientists, innovators, and executives get up to speed on emerging techniques and technologies. Built by practitioners that understand the pains of offloading ETL (Extract, Transform and Load) on Hadoop, Hydrograph is engineered to accelerate ETL development in the big data ecosystem.

ETL for the Hadoop Data Lake

“With its massively parallel processing, Hadoop once held promise for transforming the ETL process on large datasets – but moving ETLs to Hadoop still requires heavy MapReduce coding, which defeats the purpose,” notes Shahab Kamal, Executive Vice President – Client Management & Solution Engineering at Bitwise. “In order to take advantage of the processing power of Hadoop, Hydrograph uses Cascading to generate MapReduce jobs that are converted from XMLs developed using a desktop based GUI by connecting the components with links.”

Despite innovation in traditional ETL tools, gaps remain for organizations that are looking to cut costs and increase computation power by re-using ETL processes being used by their existing ETL applications on Hadoop, or to build new ETL processes on data in their Hadoop data lake.

“As the center of gravity of data moves toward Hadoop, tradition ETL vendors seek to adapt their tools to the new environment…but gaps remain” points out Nik Rouda, Senior Analyst – Big Data at Enterprise Strategy Group (ESG) after receiving a preview of the tool. “Traditional ETL vendors are expanding tool capabilities to Hadoop, but often carry over legacy issues to the new environment; Hydrograph is pure ETL on Hadoop built for today’s big data needs.”

Development of a Modern Data Integration Tool

Bitwise partnered with business users to design a tool that would help them pivot from a traditional ‘closed’ system for ETL development to a more modern open source environment. With the Bitwise team’s innovative developments, such as using Cascading as the foundation and building abstraction layers to simulate an ETL job, the effort proved that an ETL solution on Hadoop was possible.

“When we began development on Hydrograph over two years ago,” says Dhwanit Malani, Executive Vice President – Innovations at Bitwise, “Cascading provided the best compute option. With its swappable architecture, Hydrograph can work with the latest technologies, such as Spark and Flink, as they reach maturity.” With the addition of a User Interface that has a similar look and feel to leading data integration tools, Bitwise has developed an effective and powerful ETL tool for the big data ecosystem.

In order to foster innovation and allow other enterprises to benefit from Hydrograph, plans are underway to open source the project in the near future. Bitwise can help organizations quickly conduct a Hydrograph pilot and offers various support models to ensure optimal performance of the tool.

Bitwise is a Premier Exhibitor at Strata + Hadoop World this week in New York. Strata attendees are invited to visit Booth 215 where Bitwise will be demonstrating the Hydrograph tool, sharing customer case studies and answering questions.

For Hydrograph reference architecture and demo video, visit https://www.bitwiseglobal.com/en-us/data-tools/hydrograph/.

About Bitwise

Bitwise is a technology solutions provider that leverages data to enable business insights. Our breakthrough technology innovations help our global clients maximize their competitive advantage. We are the industry’s most experienced and dedicated team of data professionals, focusing on Data Warehousing, Data Integration, Analytics, Business Intelligence, Big Data and Digital Computation. We optimize value for our clients through our global delivery model and with our proprietary technology tools that reduce the time, complexity and cost of data initiatives. Together, our people and technology provide the insights clients need to continue to lead in their fields.

Founded in 1996, Bitwise is headquartered in Chicago, IL with development centers in Pune, India and Sydney, Australia. For more information, visit Bitwise at www.bitwiseglobal.com.

The post Bitwise Introduces ‘ETL on Hadoop’ Utility at Strata + Hadoop World appeared first on Bitwise.