Cloudera Enterprise 5.15.x | Other versions

Configuring Storage Directories for DataNodes

Adding and Removing Storage Directories Using Cloudera Manager

Adding Storage Directories

Minimum Required Role: Configurator (also provided by Cluster Administrator, Full Administrator)

  1. Go to the HDFS service.
  2. Click the Configuration tab.
  3. Select Scope > DataNode.
  4. Add the new storage directory to the DataNode Data Directory property. To specify the storage type for HDFS heterogenous storage, add the storage type, surrounded by brackets, at the front of the path. For example: [SSD]/data/example_dir/

    To apply this configuration property to other role groups as needed, edit the value for the appropriate role group. See Modifying Configuration Properties Using Cloudera Manager.

  5. Click Save Changes to commit the changes.
  6. Restart the DataNode.
      Important: You must restart the DataNodes for heterogenous storage configuration changes to take effect.

Removing Storage Directories

Minimum Required Role: Cluster Administrator (also provided by Full Administrator)

  1. Stop the cluster.
  2. Go to the HDFS service.
  3. Click the Configuration tab.
  4. Select Scope > DataNode.
  5. Remove the current directories and add new ones to the DataNode Data Directory property.

    To apply this configuration property to other role groups as needed, edit the value for the appropriate role group. See Modifying Configuration Properties Using Cloudera Manager.

  6. Click Save Changes to commit the changes.
  7. Copy the contents under the old directory to the new directory.
  8. Start the cluster.
Page generated May 18, 2018.