Cascading 1.0 when released, represented a huge milestone. An enterprise friendly Java API, not a syntax, and fail fast planner allowed developers to build robust, maintainable, data-oriented applications that could execute reliably on Apache Hadoop for hours or days. Cascading 2.0 made a nod towards cluster platform independence with the addition of an in memory ‘local’ mode that proved applications could be built without direct API access to the underlying platform.

We are happy to announce that the latest Cascading 3.0 WIP now adds Apache Tez as a supported runtime platform. We are making this release available so interested parties can begin testing Tez deployments against existing Cascading applications. A downloadable version of Cascading 3.0 WIP and its documentation are available at: For more information about Cascading on Apache Tez: Cascading on Apache Tez Notes: https://github.com/cwensel/cascading/tree/wip-3.0/cascading-hadoop2-tez Sample Applications: https://github.com/Cascading/cascading.samples/tree/wip-3.0 Get notified when Cascading 3.

We have announced our new Fluid project and need your help in testing it out. Fluid is an API library exposing the Cascading library as a Fluent API. Fluid’s primary goal is not only to make hard things possible, but also to keep simple things simple. Fluid generates the builders for every current Cascading release (even those in WIP). The project is currently a work in progress and we are looking for feedback on the API before we make it 1.

We have published an initial IntelliJ plugin for Cascading designed to improve the experience of developing data-oriented applications in modern IDEs. The first version of the plugin allows developers to quickly visualize and debug their Cascading code with Driven when developing with IntelliJ. Project: https://github.com/Cascading/cascading-idea-plugin Also, we are planning on improving this plugin in future releases and are maintaining a to-do list on GitHub To-do List: https://github.com/Cascading/cascading-idea-plugin#to-do If interested in contributing, please open an issue on the project to discuss, fork, and submit a pull request.

We are happy to announce a new open source project that we have been working on: Cascading-Hive. Now, you can use Cascading and Apache Hive together. Key Features: Run Hive queries within a Cascade Read from Hive tables within a Cascading Flow Write/create Hive tables from a Cascading Flow Write/create partitioned Hive tables from a Cascading Flow Deconstruct a Hive view into Taps Cascading-Hive works with Cascading 2.5.4+ and Apache Hive 0.

We are happy to announce that Cascading SDK 2.5 is now publicly available. The Cascading SDK is a collection of tools, documentation, libraries, tutorials and example projects from the greater Cascading community. What’s New: Hadoop 2 support for all tools (Lingual 1.1, Multitool 2.5, Scalding, Cascalog) Driven Plugin Installer — The SDK now ships with an installer for the Driven plugin (Learn more at: http://cascading.io/driven/) EMR Bootstrap support – For EMR users, you now have the option to install the Driven plugin on your EMR cluster via the SDK’s EMR bootstrap action

We are happy to announce that Lingual 1.1 is now publicly available. The purpose of Lingual is to ease migration of SQL based workloads onto Hadoop, and to simplify integration with Hadoop through standards based APIs. Lingual provides an ANSI SQL interface on Cascading for Apache Hadoop. What’s New: Support for Hadoop 2 Key Features: ANSI SQL – A mature implementation of ANSI/ISO standard SQL-99 JDBC Driver – The standards compliant JDBC driver enables integration with many existing BI tools and application servers SQL Shell – An interactive SQL command interface for interacting with on Hadoop and executing SQL commands Catalog – Command line tool that allows users to curate a catalog of database tables mapping to Hadoop files and resources Data Provider API – Allows Lingual to query data simultaneously from multiple external systems with a single SQL statement For more details:

Due to popular demand, we’re happy to announce the availability of our Cascading Enterprise Developer Training course. For those of you that are just getting started with Cascading or those who want to take their Cascading chops to the next level, this course was designed for you. This comprehensive course covers topics ranging from basic to advanced Cascading concepts and best practices, all reinforced by hands-on labs. Learn more here at: http://www.

We are happy to announce that Cascading 2.5 is now publicly available for download. With Cascading 2.5, Cascading applications now have full support and compatibility for both Apache Hadoop 1 and Hadoop 2, including YARN. /downloads/ What’s New in Cascading 2.5: Support for Hadoop 2 and YARN Added PartitionTap, and deprecated TemplateTap, which allows for pluggable data partitioning and can be used as either a sink or source Updated Buffer to allow access to individual tuple streams for more complex join operations to be built out For more details on new features and resolved issues see:

We are happy to announce that Lingual 1.0 is now publicly available for download. Lingual provides an ANSI SQL interface on Cascading for Apache Hadoop. The purpose of Lingual is to ease migration of SQL based workloads onto Hadoop, and to simplify integration with Hadoop through standards based APIs. All the while benefiting from the robustness of Cascading. Key Features: ANSI SQL – A mature implementation of ANSI/ISO standard SQL-99 JDBC Driver – The standards compliant JDBC driver enables integration with many existing BI tools and application servers SQL Shell – An interactive SQL command interface for interacting with on Hadoop and executing SQL commands Catalog – Command line tool that allows users to curate a catalog of database tables mapping to Hadoop files and resources Data Provider API – Allows Lingual to query data simultaneously from multiple external systems with a single SQL statement For more details:

We are happy to announce that Cascading 2.2 is now publicly available for download. /downloads/ Cascading 2.2 includes a number of new features and updates: What’s New in Cascading 2.2 – First class support for field level type information used by the planner – Pluggable API for custom type coercion on custom types – Support for blocks of Java “scripts” in addition to expressions – AssemblyPlanner interface to allow for platform independent generative Flow planning

Checkout our screencast showing off how Lingual works along with some brand new features. We are ramping up to 1.0 in the near term, but as of today, Lingual has some very exciting features like support for Data Providers, the ability to dynamically add Tap/Scheme implementations to be used as tables in SQL queries from the JDBC drivers. Cascading Lingual – An Introduction from Concurrent Inc. on Vimeo.

Paco Nathan, the director of data science at Concurrent, Inc. speaks at the Hadoop Summit View YouTube presentation here – http://www.youtube.com/watch?v=RCTa2mlsFng&feature=youtu.be. Published on Jul 9, 2013

• Learn Everything You Need to Know about the Most Widely Used and Deployed Technology
  for Big Data Applications; Online Access Now Available
• Author Paco Nathan to Speak at OSCON 2013

SAN FRANCISCO – July 10, 2013 – Concurrent, Inc., the enterprise Big Data application platform company, today announced the book release of “Enterprise Data Workflows with Cascading” by Paco Nathan, director of data science at Concurrent. Published by O’Reilly Media, the hands-on book introduces readers to Cascading™, the most widely used and deployed technology for Big Data applications with more than 75,000+ user downloads a month. The Cascading framework enables users to quickly and easily build powerful data processing applications on Apache Hadoop that span ETL, data preparation and analytics with one unified development framework. The book offers developers, data scientists and system/IT administrators a quick overview on Cascading’s streamlined approach to data processing, data filtering and workflow optimization using sample applications based on Java, ANSI SQL, PMML, Scala and Clojure. Thousands of companies such as Etsy, Razorfish, TeleNav and Twitter already use Cascading for business-critical applications.

Announcing Pattern, a new library and framework that executes PMML workflows as Cascading applications on Apache Hadoop clusters. Read more about it on the Pattern project page, signup for announcements on the mail list, or read the press release.

Lingual is now available for download or build. See the Lingual page for details, or visit the Lingual project page.

Julian Hyde discusses how Optiq and Cascading work together to become Lingual.

Announcing Lingual, a new framework that executes ANSI SQL queries as Cascading applications on Apache Hadoop clusters. Read more about it on the Lingual project page, signup for announcements on the mail list, or read the press release.