org.apache.ignite.hadoop.fs

Class CachingHadoopFileSystemFactory

java.lang.Object

org.apache.ignite.hadoop.fs.BasicHadoopFileSystemFactory

org.apache.ignite.hadoop.fs.CachingHadoopFileSystemFactory

All Implemented Interfaces:

Externalizable, Serializable, HadoopFileSystemFactory

public class CachingHadoopFileSystemFactory
extends BasicHadoopFileSystemFactory

Caching Hadoop file system factory. Caches FileSystem instances on per-user basis. Doesn't rely on built-in Hadoop FileSystem caching mechanics. Separate FileSystem instance is created for each user instead.

This makes cache instance resistant to concurrent calls to FileSystem.close() in other parts of the user code. On the other hand, this might cause problems on some environments. E.g. if Kerberos is enabled, a call to FileSystem.get(URI, Configuration, String) will refresh Kerberos token. But this factory implementation calls this method only once per user what may lead to token expiration. In such cases it makes sense to either use BasicHadoopFileSystemFactory or implement your own factory.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
CachingHadoopFileSystemFactory() Constructor.

Method Summary

Methods inherited from class org.apache.ignite.hadoop.fs.BasicHadoopFileSystemFactory

get, getConfigPaths, getUri, getUserNameMapper, readExternal, setConfigPaths, setUri, setUserNameMapper, writeExternal

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

CachingHadoopFileSystemFactory

public CachingHadoopFileSystemFactory()

Constructor.