tencent cloud

Elastic MapReduce

문서Elastic MapReduceEMR Development GuideAlluxio Development GuideMounting File System to Unified Alluxio File System

Mounting File System to Unified Alluxio File System

PDF
포커스 모드
폰트 크기
마지막 업데이트 시간: 2025-01-03 14:56:32

Background

Alluxio provides a unified namespace mechanism that allows other file systems to be mounted to the file system of Alluxio. In addition, it allows upper-layer applications to use the unified namespace to access data scattered across different systems.

Mounting COS

Sample: Mounting a COS bucket to an Alluxio directory
bin/alluxio fs mount --option fs.cos.access.key=<COS_SECRET_ID> \\
--option fs.cos.secret.key=<COS_SECRET_KEY> \\
--option fs.cos.region=<COS_REGION> \\
--option fs.cos.app.id=<COS_APP_ID> \\
/cos cos://<COS_BUCKET>/
Configure the COS information in each --option.
Configuration Item
Description
fs.cos.access.key
The COS secret ID
fs.cos.secret.key
The COS secret key
fs.cos.region
The COS region name, such as ap-beijing
fs.cos.app.id
Your AppID
COS_BUCKET
The COS bucket name without the AppID suffix
This command mounts the COS directory specified by cos://bucket/xxx to the /cos directory in Alluxio.

Mounting HDFS

Sample: Mounting an HDFS directory to an Alluxio directory
`bin/alluxio fs mount /hdfs hdfs://data`
This command mounts the /data directory of HDFS to the /hdfs subdirectory of Alluxio. After the mount is successful, the mounted content can be viewed by running the alluxio fs ls command.

Mounting CHDFS

Sample: Mounting CHDFS to Alluxio through mount
Note
This is supported only for EMR 2.5.0 or later + Alluxio 2.3.0 or later.
alluxio fs mount \\
--option alluxio.underfs.hdfs.configuration=/usr/local/service/hadoop/etc/hadoop/core-site.xml \\
/chdfs ofs://f4modr7kmvw-wMqw.chdfs.ap-chongqing.myqcloud.com

도움말 및 지원

문제 해결에 도움이 되었나요?

피드백