Print this page
Friday, 16 October 2015 18:19

'Not implemented by the DistributedFileSystem FileSystem implementation' error in Talend Big Data

Written by
Rate this item
(0 votes)

'Not implemented by the DistributedFileSystem FileSystem implementation' error occassionally rears its head when debugging Talend Big Data jobs. This is a cryptic message that actually intends to convey that your job includes JARs from different versions of Hadoop in its classpath.

If you're using a standard version of Cloudera, MapR or Hortonworks Hadoop distributions in a Talend job, you will probably not encounter this error. However, if you have included additional JARs or are using a custom connector (a pack of JARs for a new or yet unsupported version of Hadoop), it is possible that you have included JARs that are of a different version than the Hadoop Cluster you're targeting, or JARs that are of a different versions.

To resolve the issue, check that the selected distribution and version of Hadoop on your Talend components match the set of JARs you're using. Also confirm that any JARs you're using match the target Hadoop distribution.

 

Read 6238 times Last modified on Tuesday, 01 December 2015 21:07
Published in Talend DI
Tagged under
Download attachments:
Will Munji

Will Munji is a seasoned data integration, data warehousing and business intelligence (BI) architect & developer who has been working in the DW/BI space for a while. He got his start in BI working on Brio SQR (later Hyperion SQR) and the Crystal Decisions stack (Reports, Analysis & Enterprise) and SAP BusinessObjects / Microsoft BI stacks. He currently focuses on Talend Data Management Suite, Hadoop, SAP BusinessObjects BI stack as well as Jaspersoft and Tableau. He has consulted for many organizations across a variety of industries including healthcare, manufacturing, retail, insurance and banking. At Kindle Consulting, Will delivers DW/BI/Data Integration solutions that range from front-end BI development (dashboards, reports, cube development, T-SQL/ PL/SQL ...) to data services (ETL/ DI development), data warehouse architecture and development, data integration to BI Architecture design and deployment.

Latest from Will Munji

Related items