tencent cloud

Batch Compute

Product Introduction
What's Batch?
Scenarios
Strengths
Glossary
Quota & Limits
Data Security
Purchase Guide
Getting Started
Preparation
Using CLI - Submit a Job
Using CLI - Compute Environment
Configuring a Job
Using Console
Console User Guide
Task Template Management
Job Management
User Guide
How to create images usable by BatchCompute
Windows Custom Images
Environment Variables
Entering COS & CFS Paths
Event Notice & Callback
Cloud Access Management
Command Line Interface
Preparation
Quick Start
Running Remote Package
Mapping Remote Storage
Use Cases
Building Cluster Using Compute Environment
Example: 3ds Max 2018 Rendering
Example: Deep Learning
API Documentation
History
Introduction
API Category
Making API Requests
Compute Environment APIs
Configuration Viewing-related APIs
Task Template-related APIs
Job-related APIs
Data Types
Error Codes
SDK Documentation
Instructions
FAQs
Contact Us
Glossary
문서Batch ComputeUser GuideEntering COS & CFS Paths

Entering COS & CFS Paths

PDF
포커스 모드
폰트 크기
마지막 업데이트 시간: 2024-01-13 11:19:29

Overview

You need to enter COS and CFS paths for execution logs (StdOut and StdErr) and remote storage mappings in BatchCompute, which is slightly different from access to COS buckets or files in HTTP mode.

COS Path Description

Only endpoints in COS XML API format

For BatchCompute paths, only endpoints in the XML API format are supported as shown below:



Prefixed with cos://

The obtained COS endpoint is as shown below:

Prefix BatchCompute paths with cos:// and suffix them with /.
cos://batchdemo-125178xxxx.cos.ap-guangzhou.myqcloud.com/

Mounting subdirectory

Add subdirectories to a bucket path as common file directories. The following figure shows the subdirectories created in the bucket.

For directory mounting, the COS paths are as follows:
cos://batchdemo-125178xxxx.cos.ap-guangzhou.myqcloud.com/logs/
cos://batchdemo-125178xxxx.cos.ap-guangzhou.myqcloud.com/input/
cos://batchdemo-125178xxxx.cos.ap-guangzhou.myqcloud.com/output/

Supporting intra-region buckets

COS has regional attributes. Data transfer between the storage server and Cloud Virtual Machine (CVM) is efficient only when your BatchCompute job and COS bucket are in the same region.

CFS Path Description

In remote storage mappings, you can configure CFS/NAS paths to automatically mount to a local path as shown below:



Prefixed with cfs:// or nfs://

An example of an obtained CFS path is 10.66.xxx.xxx. Prefix a BatchCompute path with cfs:// or nfs://.
Note：
Suffix the path with / and ensure that your CFS/NAS and BatchCompute job are on the same network.
cfs://10.66.xxx.xxx/

이전 주제: Environment Variables다음 주제: Event Notice & Callback

도움말 및 지원

문제 해결에 도움이 되었나요?

피드백